Object tiering from local store to cloud store
An object tiering system transfers or tiers data objects from a data store to a cloud store. The system includes a processor and a memory having stored instructions that, when executed by the processor, cause the processor to ingest a first plurality of data objects in the data store, map a second plurality of data objects having a common tiering date to a region, and upon reaching the common tiering date, transfer the region to the cloud store. In some embodiments, the mapping is done a priori when each data object is ingested or at a first time before the common tiering date. In some embodiments, the common tiering date is a second time for transferring the second plurality of data objects from the data store to the cloud store. In some embodiments, the first plurality of objects includes the second plurality of objects.
1. An object tiering system for tiering objects including tiering from a data store to a cloud store, the system comprising:
a processor and a memory having stored instructions that, when executed by the processor, cause the processor to:
ingest a first plurality of data objects in the data store;
map a second plurality of data objects having a common tiering date to a region, wherein the mapping is done a priori when each data object is ingested or at a first time before the common tiering date, wherein the common tiering date is a second time for transferring the second plurality of data objects from the data store to the cloud store, wherein the first plurality of objects includes the second plurality of objects; and
upon reaching the common tiering date, transfer the region to the cloud store.
2. The system of claim 1 , wherein the data store is a local store.
3. The system of claim 1 , wherein the instructions, when executed by the processor, further cause the processor to:
map metadata associated with the second plurality of data objects to a metadata region based on a common metadata tiering date; and
transfer the metadata region to the cloud store upon reaching the common metadata tiering date.
4. The system of claim 1 , wherein the common tiering date is based on object access time.
5. The system of claim 1 , wherein the common tiering date is part of a lifecycle policy.
6. The system of claim 5 , wherein the instructions, when executed by the processor, further cause the processor to map the second plurality of data objects having the lifecycle policy to the region.
7. The system of claim 1 , wherein the region having the mapped data object is stored in a plurality of sequential locations in the data store, and wherein transferring the region to the cloud store comprises reading the region from the plurality of sequential locations.
8. A method comprising:
ingesting a first plurality of data objects in a data store;
mapping a second plurality of data objects having a common tiering date to a region, wherein the mapping is done a priori when each data object is ingested or at a first time before the common tiering date, wherein the common tiering date is a second time for transferring the second plurality of data objects from the data store to a cloud store, wherein the first plurality of objects includes the second plurality of objects; and
upon reaching the common tiering date, transferring the region to the cloud store.
9. The method of claim 8 , further comprising:
map metadata associated with the second plurality of data objects to a metadata region based on a common metadata tiering date; and
transfer the metadata region to the cloud store upon reaching the common metadata tiering date.
10. The method of claim 8 , wherein the common tiering date is based on object access time.
11. The method of claim 8 , wherein the common tiering date is part of a lifecycle policy.
12. The method of claim 11 , further comprising mapping the second plurality of data objects having the lifecycle policy to the region.
13. The method of claim 8 , wherein the region having the mapped data object is stored in a plurality of sequential locations in the data store, and wherein transferring the region to the cloud store comprises reading the region from the plurality of sequential locations.
14. A non-transitory computer-readable medium comprising computer-executable instructions embodied thereon that, when executed by a processor, cause the processor to perform a process comprising:
ingesting a first plurality of data objects in a data store;
mapping a second plurality of data objects having a common tiering date to a region, wherein the mapping is done a priori when each data object is ingested or at a first time before the common tiering date, wherein the common tiering date is a second time for transferring the second plurality of data objects from the data store to a cloud store, wherein the first plurality of objects includes the second plurality of object; and
upon reaching the common tiering date, transferring the region to the cloud store.
15. The medium of claim 14 , wherein the data store is a local store.
16. The medium of claim 14 , wherein the instructions, when executed by the processor, cause the processor to perform the process further comprising:
mapping metadata associated with the second plurality of data objects to a metadata region based on a common metadata tiering date; and
transferring the metadata region to the cloud store upon reaching the common metadata tiering date.
17. The medium of claim 14 , wherein the common tiering date is based on object access time.
18. The medium of claim 14 , wherein the common tiering date is part of a lifecycle policy.
19. The medium of claim 18 , wherein the instructions, when executed by the processor, cause the processor to perform the process further comprising mapping the second plurality of data objects having the lifecycle policy to the region.
20. The medium of claim 14 , wherein the region having the mapped data object is stored in a plurality of sequential locations in the data store, and wherein transferring the region to the cloud store comprises reading the region from the plurality of sequential locations.