IP Library Granted Patent US 11,163,678
Granted Patent B2
US 11,163,678 · App. 16/819,722 · Granted Nov 2, 2021

Managing storage space for metadata consistency checking

Inventors: Vamsi K. Vankamamidi (Hopkinton, MA); Philippe Armangau (Acton, MA); Daniel E. Cummins (Hudson, NH)
Assignee: EMC IP Holding Company LLC
G06F12/0246G06F12/0253G06F12/0292G06F12/0811G06F12/0873G06F16/1827G06F2212/7207
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,163,678
App. No.
16/819,722
Granted
Nov 2, 2021
Kind
B2
Abstract

A method of managing storage space for a metadata consistency checking procedure (MCCP) is provided. The method includes (a) tracking an amount of metadata and an amount of user data organized by the metadata; (b) provisioning a quantity of storage dedicated to the MCCP based, at least in part, on a ratio of the amount of metadata to the amount of user data; and (c) upon initiation of the MCCP, building tracking structures within the provisioned storage dedicated to the MCCP. An apparatus, system, and computer program product for performing a similar method are also provided.

Claims (38)

1. A method of managing storage space for a metadata consistency checking procedure (MCCP), the method comprising:

tracking an amount of metadata and an amount of user data organized by the metadata;

provisioning a quantity of storage dedicated to the MCCP based, at least in part, on a ratio of the amount of metadata to the amount of user data; and

upon initiation of the MCCP, building tracking structures within the provisioned storage dedicated to the MCCP.

2. The method of claim 1 wherein provisioning the quantity of storage dedicated to the MCCP includes:

calculating the ratio of the amount of metadata to the amount of user data;

applying a mapping to the calculated ratio to yield a target percentage; and

determining the quantity of storage dedicated to the MCCP by applying the target percentage to a measure of storage used in connection with the user data.

3. The method of claim 2 wherein applying the mapping includes indexing into a table with the calculated ratio.

4. The method of claim 2 wherein applying the target percentage to the measure of storage used in connection with the user data includes multiplying a total amount of storage that has been allocated by the target percentage.

5. The method of claim 2 wherein provisioning the quantity of storage dedicated to the MCCP further includes adding storage dedicated to the MCCP in response to the calculated ratio increasing.

6. The method of claim 2 wherein provisioning the quantity of storage dedicated to the MCCP further includes removing storage dedicated to the MCCP in response to the calculated ratio decreasing.

7. The method of claim 6 wherein provisioning the quantity of storage dedicated to the MCCP further includes refraining from removing storage dedicated to the MCCP in response to the calculated ratio decreasing below a minimum threshold value.

8. The method of claim 1 ,

wherein the user data is stored within a user tier of storage (TOS) provided by a data storage system, the data storage system providing a plurality of different TOSs for a respective plurality of types of data;

wherein the plurality of different TOSs includes at least one metadata TOS and a consistency checking TOS; and

wherein provisioning the quantity of storage dedicated to the MCCP includes provisioning the quantity of storage to the consistency checking TOS.

9. The method of claim 8 wherein tracking the amount of metadata includes reading a cursor value of the at least one metadata TOS, the cursor value indicating a lowest address of the metadata TOS to which metadata has not yet been written.

10. The method of claim 9 wherein tracking the amount of metadata further includes subtracting empty space within the metadata TOS below the cursor value by reading pointers from a list of freed blocks of metadata.

11. The method of claim 9 ,

wherein the plurality of different TOSs further includes another metadata TOS for storing a special type of metadata different than stored in the metadata TOS; and

wherein tracking the amount of metadata further includes:

reading another cursor value of the other metadata TOS, the other cursor value indicating a lowest address of the other metadata TOS to which the special type of metadata has not yet been written and

summing the cursor value and the other cursor value.

12. The method of claim 8 wherein provisioning the quantity of storage to the consistency checking TOS includes:

initially failing to be able to provision an entirety of the quantity of storage to the consistency checking TOS due to a lack of a free chunk of storage; and

in response to failing, initiating garbage collection within the user TOS to free a chunk of storage.

13. The method of claim 12 wherein provisioning the quantity of storage to the consistency checking TOS further includes directly provisioning the chunk of storage freed by collection to the consistency checking TOS.

14. A computer program product comprising a non-transitory computer-readable storage medium storing a set of instructions, which, when performed by processing circuitry of a data storage apparatus (DSA), causes the DSA to manage storage space for a metadata consistency checking procedure (MCCP) by:

tracking an amount of metadata and an amount of user data organized by the metadata;

provisioning a quantity of storage dedicated to the MCCP based, at least in part, on a ratio of the amount of metadata to the amount of user data; and

upon initiation of the MCCP, building tracking structures within the provisioned storage dedicated to the MCCP.

15. A data storage apparatus (DSA) comprising:

a plurality of non-transitory persistent storage drives; and

processing circuitry coupled to memory configured to manage storage space for a metadata consistency checking procedure (MCCP) by:

tracking an amount of metadata and an amount of user data organized by the metadata;

provisioning a quantity of storage dedicated to the MCCP based, at least in part, on a ratio of the amount of metadata to the amount of user data; and

upon initiation of the MCCP, building tracking structures within the provisioned storage dedicated to the MCCP.

Assignments (13)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052852/0022) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0582 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0081) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0441 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0917) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0509 →
RELEASE OF SECURITY INTEREST AT REEL 052771 FRAME 0906 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0298 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2020
From: VANKAMAMIDI, VAMSI K.; ARMANGAU, PHILIPPE; CUMMINS, DANIEL E.
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 052905/0419 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0081 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0917 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052852/0022 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded May 28, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052771/0906 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →