Consolidation and migration of cloud data
A method of migrating or consolidating cloud data includes generating a container on a cloud platform and receiving, at the container, source metadata identifying a set of data to be migrated from a source cloud bucket associated with a source data domain to a destination cloud bucket associated with a destination data domain. The method further includes copying, by the container, set of data from the source cloud bucket to the destination cloud bucket based on the source metadata and generating, by the container, destination metadata for the set of data as stored at the destination cloud bucket.
1. A method of migrating or consolidating cloud data comprising:
generating a container on a cloud platform;
receiving, at the container, source metadata identifying a set of data to be migrated from a source cloud bucket associated with a source data domain to a destination cloud bucket associated with a destination data domain;
copying, by the container, the set of data from the source cloud bucket to the destination cloud bucket based on the source metadata; and
generating, by the container, destination metadata for the set of data as stored at the destination cloud bucket.
2. The method of claim 1 , further comprising:
storing the destination metadata for the set of data as stored at the destination cloud bucket at a local tier of on-premises storage of the destination data domain.
3. The method of claim 1 , wherein the source cloud bucket and the destination cloud bucket are located on a single cloud platform.
4. The method of claim 1 , wherein the source cloud bucket is located on a first cloud storage platform and the destination cloud bucket is located on a second cloud storage platform.
5. The method of claim 1 , wherein the set of data comprises a plurality of data regions of one or more data object containers at the source cloud bucket.
6. The method of claim 5 , wherein the source metadata identifying the set of data to be migrated comprises a plurality of tuples identifying each of the plurality data regions of the one or more data object containers at the source cloud bucket.
7. The method of claim 6 , wherein copying the set of data from the source cloud bucket to the destination cloud bucket comprises:
retrieving, by the container, the plurality of data regions from the one or more data object containers of the source cloud bucket;
generating, by the container a destination container for the plurality of data regions; and
copying, by the container, the plurality of data regions to the destination container.
8. A system comprising:
a memory; and
a processing device operatively coupled to the memory, the processing device to perform operations comprising:
generating a container on a cloud platform;
receiving, at the container, source metadata identifying a set of data to be migrated from a source cloud bucket associated with a source data domain to a destination cloud bucket associated with a destination data domain;
copying, by the container, the set of data from the source cloud bucket to the destination cloud bucket based on the source metadata; and
generating, by the container, destination metadata for the set of data as stored at the destination cloud bucket.
9. The system of claim 8 , further comprising:
storing the destination metadata for the set of data as stored at the destination cloud bucket at a local tier of on-premises storage of the destination data domain.
10. The system of claim 8 , wherein the source cloud bucket and the destination cloud bucket are located on a single cloud platform.
11. The system of claim 8 , wherein the source cloud bucket is located on a first cloud storage platform and the destination cloud bucket is located on a second cloud storage platform.
12. The system of claim 8 , wherein the set of data comprises a plurality of data regions of one or more data object containers at the source cloud bucket.
13. The system of claim 12 , wherein the source metadata identifying the set of data to be migrated comprises a plurality of tuples identifying each of the plurality data regions of the one or more data object containers at the source cloud bucket.
14. The system of claim 13 , wherein copying the set of data from the source cloud bucket to the destination cloud bucket comprises:
retrieving, by the container, the plurality of data regions from the one or more data object containers of the source cloud bucket;
generating, by the container a destination container for the plurality of data regions; and
copying, by the container, the plurality of data regions to the destination container.
15. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform one or more operations, the operations comprising:
generating a container on a cloud platform;
receiving, at the container, source metadata identifying a set of data to be migrated from a source cloud bucket associated with a source data domain to a destination cloud bucket associated with a destination data domain;
copying, by the container, the set of data from the source cloud bucket to the destination cloud bucket based on the source metadata; and
generating, by the container, destination metadata for the set of data as stored at the destination cloud bucket.
16. The non-transitory machine-readable medium of claim 15 , further comprising:
storing the destination metadata for the set of data as stored at the destination cloud bucket at a local tier of on-premises storage of the destination data domain.
17. The non-transitory machine-readable medium of claim 15 , wherein the source cloud bucket and the destination cloud bucket are located on a single cloud platform.
18. The non-transitory machine-readable medium of claim 15 , wherein the set of data comprises a plurality of data regions of one or more data object containers at the source cloud bucket.
19. The non-transitory machine-readable medium of claim 18 , wherein the source metadata identifying the set of data to be migrated comprises a plurality of tuples identifying each of the plurality data regions of the one or more data object containers at the source cloud bucket.
20. The non-transitory machine-readable medium of claim 19 , wherein copying the set of data from the source cloud bucket to the destination cloud bucket comprises:
retrieving, by the container, the plurality of data regions from the one or more data object containers of the source cloud bucket;
generating, by the container a destination container for the plurality of data regions; and
copying, by the container, the plurality of data regions to the destination container.