IP Library Granted Patent US 10,061,697
Granted Patent B2
US 10,061,697 · App. 15/193,142 · Granted Aug 28, 2018

Garbage collection scope detection for distributed storage

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,061,697
App. No.
15/193,142
Granted
Aug 28, 2018
Kind
B2
Abstract

Systems and methods for determining garbage collection (GC) scope in a distribute storage system using chunk-based storage. The systems and methods are compatible with multi-version concurrency control (MVCC) semantics.

Claims (34)

1. A method for use with a distributed storage system comprising a plurality of storage devices, the method comprising:

initializing a garbage collection (GC) front value as the maximum sequence number associated with a storage chunk within a set of consecutively sealed storage chunks, the storage chunks corresponding to storage capacity allocated within the storage devices and having associated sequence numbers;

using the GC front value to determine GC scope, the GC scope including zero or more of the storage chunks;

retrieving metadata information about the GC scope storage chunks;

identifying unreferenced storage chunks from the GC scope storage chunks using the metadata information; and

reclaiming storage capacity corresponding to the unreferenced storage chunks.

2. The method of claim 1 further comprising:

sealing additional storage chunks; and

advancing the GC front value if the additional sealed storage chunk have sequence numbers consecutive to a previous GC front value.

3. The method of claim 2 wherein the storage chunks are used to store search tree elements, wherein advancing the GC front value comprises advancing the GC front value unless a search tree is being updated.

4. The method of claim 3 further comprising:

setting a first GC front block when a first search tree update commences; and

setting a second GC front block when a second search tree update commences,

wherein advancing the GC front value comprises advancing the GC front value after the first search tree update completes to the value of the second GC front block.

5. The method of claim 2 wherein sealing additional storage chunks comprises sealing additional storage chunks in response to a timeout expiring.

6. The method of claim 1 wherein retrieving metadata information about the GC candidate storage chunks comprises looking up metadata information in a metadata table using storage chunk sequence numbers.

7. A distributed storage system comprising:

a plurality of storage devices;

two or more storage nodes configured to:

initialize a garbage collection (GC) front value as the maximum sequence number associated with a storage chunk within a set of consecutively sealed storage chunks, the storage chunks corresponding to storage capacity allocated within the storage devices and having associated sequence numbers;

use the GC front value to determine GC scope, the GC scope including zero or more of the storage chunks;

retrieve metadata information about the GC scope storage chunks;

identify unreferenced storage chunks from the GC scope storage chunks using the metadata information; and

reclaim storage capacity corresponding to the unreferenced storage chunks.

8. The distributed storage system of claim 7 wherein the two or more storage nodes are further configured to:

seal additional storage chunks; and

advance the GC front value if the additional sealed storage chunk have sequence numbers consecutive to a previous GC front value.

9. The distributed storage system of claim 8 wherein the storage chunks are used to store search tree elements, wherein the two or more storage nodes are configured to advance the GC front value unless a search tree is being updated.

10. The distributed storage system of claim 9 wherein the two or more storage nodes are configured to:

set a first GC front block when a first search tree update commences;

set a second GC front block when a second search tree update commences; and

advance the GC front value after the first search tree update completes to the value of the second GC front block.

11. The distributed storage system of claim 8 wherein the two or more storage nodes are configured to seal additional storage chunks in response to a timeout expiring.

12. The distributed storage system of claim 7 wherein the two or more storage nodes are configured lookup metadata information in a metadata table using storage chunk sequence numbers.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (047648/0422) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060160/0862 →
RELEASE OF SECURITY INTEREST AT REEL 047648 FRAME 0346 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058298/0510 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 047648/0422 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Oct 12, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 047648/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2017
From: EMC CORPORATION
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 041872/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2016
From: DANILOV, MIKHAIL; SRIVASTAV, SHASHWAT; MALYGIN, MIKHAIL; WANG, CHEN; TCHOUB, IVAN
To: EMC CORPORATION
Reel/Frame 039301/0142 →