Cloud-based metadata management for on-premise storage systems
Enabling data portability between systems, including: submitting, to a cloud-based metadata store storing metadata describing data stored in a plurality of storage systems each coupled for data communications with a corresponding on-premises cloud infrastructure of a plurality of on-premises cloud infrastructures, a query; selecting a subset of the data responsive to the query and stored in at least one first storage system coupled to at least one first on-premises cloud infrastructure; and storing, from the at least one first storage system to a second storage system coupled to a second on-premises cloud infrastructure, the subset of the data responsive to the query.
1 . A method comprising:
querying, by a first storage system coupled to a first on-premises cloud infrastructure at a first physical location, a remote cloud-based metadata store storing metadata identifying data stored on respective ones of a plurality of on-premises cloud infrastructures, wherein the plurality of on-premises cloud infrastructures provide localized storage resources in different physical locations;
based on metadata received in response to the querying, replicating, from a second storage system, a subset of data absent from the first storage system and stored in the second storage system operatively coupled to a second on-premises cloud infrastructure in a second physical location; and
updating the remote cloud-based metadata store to indicate that the subset of data has been replicated to the first storage system.
2 . The method of claim 1 , wherein the subset of the data is synchronously replicated to the first storage system.
3 . The method of claim 1 , wherein replicating the subset of data comprises copying the subset of the data from the second storage system to the first storage system.
4 . The method of claim 1 , wherein each of the plurality of on-premises cloud infrastructures is configured to submit metadata to the remote cloud-based metadata store.
5 . The method of claim 1 , wherein replicating the subset of the data comprises selecting one or more portions of data not included in a response to a previously submitted query.
6 . The method of claim 1 , wherein updating the remote cloud-based metadata store is triggered by the replication of the subset of the data on the first storage system.
7 . The method of claim 1 , wherein the remote cloud-based metadata store is implemented in a cloud-computing environment remote from the plurality of on-premises cloud infrastructures.
8 . A system comprising:
a memory; and
a processing device, operatively coupled to the memory, the processing device configured to:
query a remote cloud-based metadata store storing metadata identifying data stored on respective ones of a plurality of on-premises cloud infrastructures, wherein the plurality of on-premises cloud infrastructures provide localized storage resources in different physical locations;
based on the metadata received in response to the querying, replicate, from a second storage system to a first storage system, a subset of the data absent from the first storage system and stored in a second storage system, wherein the first storage system is coupled to a first on-premises cloud infrastructure at a first physical location, and wherein the second storage system is operatively coupled to a second on-premises cloud infrastructure in a second physical location; and
update the remote cloud-based metadata store to indicate that the subset of data has been replicated to the first storage system.
9 . The storage system of claim 8 , wherein wherein the subset of the data is synchronously replicated to the first storage system.
10 . The storage system of claim 8 , wherein the subset of the data comprises copying the subset of the data from the second storage system to the first storage system.
11 . The storage system of claim 8 , wherein each of the plurality of on-premises cloud infrastructures is configured to submit metadata to the remote cloud-based metadata store.
12 . The storage system of claim 8 , wherein replicating the subset of the data comprises selecting one or more portions of data not included in a response to the querying.
13 . The storage system of claim 8 , wherein updating the remote cloud-based metadata store is triggered by the replication of the subset of the data on the first storage system.
14 . The storage system of claim 8 , wherein the remote cloud-based metadata store is implemented in a cloud-computing environment remote from the plurality of on-premises cloud infrastructures.
15 . A non-transitory computer readable storage medium storing instructions which, when executed, cause a processing device to:
query, a remote cloud-based metadata store storing metadata identifying data stored on respective ones of the plurality of on-premises cloud infrastructures;
based on the metadata received in response to the query, replicate, from a second storage system, a subset of the data absent from the first storage system and stored in a second storage system operatively coupled to a second on-premises cloud infrastructure in a second physical location; and
update the remote cloud-based metadata store to indicate that the subset of data has been replicated to the first storage system.
16 . The non-transitory computer readable storage medium of claim 15 , wherein the subset of the data is synchronously replicated to the first storage system.
17 . The non-transitory computer readable storage medium of claim 15 , wherein replicating the subset of the data comprises copying the subset of the data from the second storage system to the first storage system.
18 . The non-transitory computer readable storage medium of claim 15 , wherein each of the plurality of on-premises cloud infrastructures is configured to submit metadata to the remote cloud-based metadata store.
19 . The non-transitory computer readable storage medium of claim 15 , wherein replicating the subset of the data comprises selecting one or more portions of data not included in a response to the querying.
20 . The non-transitory computer readable storage medium of claim 15 , wherein updating the remote cloud-based metadata store is triggered by the replication of the subset of the data on the first storage system.