Granted Patent B2

US 12,253,923 · App. 17/731,881 · Granted Mar 18, 2025

Inventors: Palak Sharma (Haryana, IN); Dibyasri Nandi (Kolkata, IN); Sindhushree K N (Karnataka, IN); Cheryl Marie Thompson (Sunnyvale, CA); Qinghua Zheng (San Jose, CA); Venkateswarlu Tella (Bangalore, IN); Debanjan Paul (West Bengal, IN); Dinakaran Narayanan (Chennai, IN)

Assignee: NetApp, Inc.

G06F11/2094G06F3/0604G06F3/0611G06F3/0619G06F3/064G06F3/0653G06F3/067G06F11/0712G06F11/0718G06F11/0727G06F11/1004G06F11/1453G06F11/1464G06F16/116G06F16/1744G06F2201/84

Abstract

Claims (72)

1. A method comprising:

determining that data hosted within a performance tier is to be tiered out to a capacity tier of an object store;

creating an object according to a unified object format, wherein the data is stored within slots of the object;

attaching slot header metadata to the object, wherein the slot header metadata comprises two sections of metadata including a first metadata portion comprising a compression group number of a slot within which a block of the data is stored and a compression group logical index in the compression group number at which the slot is located, and a second metadata portion comprising offset and length location information for the data residing in the object;

storing the object into the capacity tier of the object store;

caching the slot header metadata of the object within a persistent metafile stored within the performance tier, wherein an entry within the persistent metafile for the object maps the slot header metadata of the object to an object identifier of the object, wherein the entry is populated with the compression group number of the slot, the compression group logical index in the compression group, the offset and length location information, and a sequence number of the object;

utilizing the object identifier to identify the object in the object store for accessing a current sequence number specified by the slot header metadata within the object and to identify the entry, within the persistent metafile, for the object for accessing the sequence number specified by the entry;

comparing the sequence number in the entry of the persistent metafile stored within the performance tier with the current sequence number accessed from the object tiered out to the capacity tier of the object store; and

in response to the sequence number in the entry not matching the current sequence number accessed from the object, overwriting the persistent metafile with current slot header metadata read from the object.

2. The method of claim 1 , comprising:

caching the slot header metadata of the object as a 4 kb space optimized metadata entry in the persistent metafile stored within the performance tier.

3. The method of claim 1 , comprising:

receiving a request to read data from the object within the object store; and

utilizing the persistent metafile to process the request.

4. The method of claim 1 , comprising:

receiving a request to read data from the object within the object store; and

utilizing the offset and length location information in the slot header metadata cached within the persistent metafile stored in the performance tier to process the request.

5. The method of claim 1 , comprising:

receiving a request to read data from the object within the object store;

reading the offset and length location information in the slot header metadata from the persistent metafile stored within the performance tier to identify an offset and a length of the data within the object; and

performing an object store read operation using the offset and length to read the data from the object within the object store.

6. The method of claim 1 , comprising:

utilizing the slot header metadata of the object within the persistent metafile to construct and perform a single read operation transmitted to the object store to retrieve data from the object.

7. The method of claim 1 , comprising:

utilizing the slot header metadata of the object within the persistent metafile to construct and perform a single read operation transmitted to the object store to retrieve data from the object.

8. The method of claim 1 , comprising:

maintaining the persistent metafile within local storage attached to a node hosting the performance tier, wherein the node is remote to the object store.

9. A computing device comprising:

a memory comprising machine executable code; and

a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to:

determine that data hosted within a performance tier is to be tiered out to a capacity tier of an object store;

create an object according to a unified object format, wherein the data is stored within slots of the object;

attach slot header metadata to the object, wherein the slot header metadata comprises two sections of metadata including a first metadata portion comprising a compression group number of a slot within which a block of the data is stored and a compression group logical index in the compression group number at which the slot is located, and a second metadata portion comprising offset and length location information for the data residing in the object;

store the object into the capacity tier of the object store;

cache the slot header metadata of the object within a persistent metafile stored within the performance tier, wherein an entry within the persistent metafile for the object maps the slot header metadata of the object to an object identifier of the object, wherein the entry is populated with the compression group number of the slot, the compression group logical index in the compression group, the offset and length location information, and a sequence number of the object;

utilize the object identifier to identify the object in the object store for accessing a current sequence number specified by the slot header metadata within the object and to identify the entry, within the persistent metafile, for the object for accessing the sequence number specified by the entry;

compare the sequence number in the entry of the persistent metafile stored within the performance tier with the current sequence number accessed from the object tiered out to the capacity tier of the object store; and

in response to the sequence number in the entry not matching the current sequence number accessed from the object, overwrite the persistent metafile with current slot header metadata read from the object.

10. The computing device of claim 9 , wherein the machine executable code causes the processor to:

cache the slot header metadata of the object as a 4 kb metadata entry in the persistent metafile stored within the performance tier.

11. The computing device of claim 9 , wherein the machine executable code causes the processor to:

receive a request to read data from the object within the object store; and

utilize the persistent metafile to process the request.

12. The computing device of claim 9 , wherein the machine executable code causes the processor to:

receive a request to read data from the object within the object store; and

utilize the offset and length location information in the slot header metadata cached within the persistent metafile stored in the performance tier to process the request.

13. The computing device of claim 9 , wherein the machine executable code causes the processor to:

receive a request to read data from the object within the object store;

read the offset and length location information in the slot header metadata from the persistent metafile stored within the performance tier to identify an offset and a length of the data within the object; and

perform an object store read operation using the offset and length to read the data from the object within the object store.

14. The computing device of claim 9 , wherein the machine executable code causes the processor to:

utilize the slot header metadata of the object within the persistent metafile to construct and perform a single read operation transmitted to the object store to retrieve data from the object.

15. The computing device of claim 9 , wherein the machine executable code causes the processor to:

utilize the slot header metadata of the object within the persistent metafile to construct and perform a single read operation transmitted to the object store to retrieve data from the object.

16. The computing device of claim 9 , wherein the machine executable code causes the processor to:

maintain the persistent metafile within local storage attached to a node hosting the performance tier, wherein the node is remote to the object store.

17. A non-transitory machine readable medium comprising instructions for performing a method, which when executed by a machine, causes the machine to:

determine that data hosted within a performance tier is to be tiered out to a capacity tier of an object store;

create an object according to a unified object format, wherein the data is stored within slots of the object;

attach slot header metadata to the object, wherein the slot header metadata comprises two sections of metadata including a first metadata portion comprising a compression group number of a slot within which a block of the data is stored and a compression group logical index in the compression group number at which the slot is located, and a second metadata portion comprising offset and length location information for the data residing in the object;

store the object into the capacity tier of the object store;

cache the slot header metadata of the object within a persistent metafile stored within the performance tier, wherein an entry within the persistent metafile for the object maps the slot header metadata of the object to an object identifier of the object, wherein the entry is populated with the compression group number of the slot, the compression group logical index in the compression group, the offset and length location information, and a sequence number of the object;

utilize the object identifier to identify the object in the object store for accessing a current sequence number specified by the slot header metadata within the object and to identify the entry, within the persistent metafile, for the object for accessing the sequence number specified by the entry;

compare the sequence number in the entry of the persistent metafile stored within the performance tier with the current sequence number accessed from the object tiered out to the capacity tier of the object store; and

in response to the sequence number in the entry not matching the current sequence number accessed from the object, overwrite the persistent metafile with current slot header metadata read from the object.

18. The non-transitory machine readable medium of claim 17 , wherein the instructions cause the machine to:

cache the slot header metadata of the object as a 4 kb space optimized metadata entry in the persistent metafile stored within the performance tier.

19. The non-transitory machine readable medium of claim 17 , wherein the instructions cause the machine to:

receive a request to read data from the object within the object store; and

utilize the persistent metafile to process the request.

20. The non-transitory machine readable medium of claim 17 , wherein the instructions cause the machine to:

in response to determining that the persistent metafile is corrupt or missing, execute a repair process to repair the persistent metafile.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (30)