Granted Patent B2

US 11,042,299 · App. 15/340,691 · Granted Jun 22, 2021

Abstract

Claims (58)

1. A method for implementing an object store using removable storage media, the method comprising:

partitioning a removable storage medium into at least two partitions including a value store partition into which one or more data objects will be stored and a key store partition into which one or more keys identifying the data objects will be stored;

after partitioning the removable storage medium, identifying data for storage on the removable storage medium;

designating at least a portion of the data to a data object;

determining a location where to store the data object in the value store partition;

after determining the location, writing the data object, which includes at least the portion of the data, to the location; and

writing a key that identifies the data object and indicates the location to the key store partition.

2. The method of claim 1 , further comprising:

identifying second data for storage on the removable storage medium; and

before writing the data object, designating the second data to the data object, wherein the second data is included in the data object when writing the data object.

3. The method of claim 1 , wherein designating at least the portion of the data to the data object comprises designating a first portion of the data to the data object and the method further comprises:

designating a second portion of the data to a second data object.

4. The method of claim 3 , comprising:

determining a second location where to store the second data object in the value store partition;

writing the second data object to the second location; and

writing a second key that identifies the second data object and indicates the second location to the key store partition.

5. The method of claim 1 , further comprising:

caching the data in a non-removable storage medium at least until the data object is written to the location.

6. The method of claim 5 , further comprising:

releasing the data from the cache upon completion of writing the data object to the location.

7. The method of claim 5 , further comprising:

identifying the data to remain pinned in cache; and

maintaining the data in the cache as long as the data remains pinned.

8. The method of claim 5 , wherein the non-removable storage medium comprises a flash memory storage medium.

9. The method of claim 1 , further comprising:

performing erasure coding on the data, wherein the erasure coding results in creation of a plurality of data portions including the portion of the data.

10. The method of claim 1 , wherein the removable storage medium comprises a magnetic tape.

11. A data management system to implement an object store using removable storage media, the data management system comprising:

one or more computer-readable storage media;

a processing system operatively coupled with the one or more computer-readable storage media; and

program instructions stored on the one or more computer-readable storage media that, when read and executed by the processing system, direct the processing system to:

partition a removable storage medium into at least two partitions including a value store partition into which one or more data objects will be stored and a key store partition into which one or more keys identifying the data objects will be stored;

after the removable storage medium is partitioned, identify data for storage on the removable storage medium;

designate at least a portion of the data to a data object;

determine a location where to store the data object in the value store partition;

after determining the location, write the data object to the location; and

write a key that identifies the data object and indicates the location to a key store partition.

12. The data management system of claim 11 , wherein the program instructions further direct the processing system to:

identify second data for storage on the removable storage medium; and

before the data object is written, designate the second data to the data object, wherein the second data is included in the data object when writing the data object.

13. The data management system of claim 11 , wherein:

to designate at least the portion of the data to the data object the program instructions direct the processing system to at least designate a first portion of the data to the data object; and

the program instructions further direct the processing system to designate a second portion of the data to a second data object.

14. The data management system of claim 13 , wherein the program instructions further direct the processing system to:

determine a second location where to store the second data object in the value store partition;

write the second data object to the second location; and

write a second key that identifies the second data object and indicates the second location to the key store partition.

15. The data management system of claim 11 , wherein the program instructions further direct the processing system to:

cache the data in a non-removable storage medium at least until the data object is written to the location.

16. The data management system of claim 15 , wherein the program instructions further direct the processing system to:

release the data from the cache upon completion of writing the data object to the location.

17. The data management system of claim 15 , wherein the program instructions further direct the processing system to:

identify the data to remain pinned in cache; and

maintain the data in the cache as long as the data remains pinned.

18. The data management system of claim 15 , wherein the non-removable storage medium comprises a flash memory storage medium.

19. The data management system of claim 11 , wherein the program instructions further direct the processing system to:

receive the data over a communication network.

20. The data management system of claim 11 , wherein the removable storage medium comprises a magnetic tape.

Assignments (9)