Migrating data among cloud-based storage networks via a data distribution service
Embodiments relate to systems and methods for migrating data between cloud networks via a data distribution service. In aspects, an administrator of a data payload may wish to migrate the data payload from a host cloud network to a target cloud provider to leverage cost, security, redundancy, consolidation, or other advantages. The data distribution service can identify target cloud providers with sets of resources that are capable of hosting the data payload. Further, the data distribution service can determine that the target cloud providers are connected to or capable of being connected to the data distribution service via a set of dedicated communication channels. According to aspects, the data distribution service can receive the data payload from the host cloud network, and transport the data payload to a selected target cloud provider via the set of dedicated communication channels.
1. A method, comprising:
identifying, for migration, a data payload in a host storage cloud of a host cloud provider;
receiving an instruction to migrate the data payload from the host storage cloud of the host cloud provider;
determining, by a processor associated with a data distribution service, a set of resources associated with a target cloud provider, wherein the determining is based on a set of transport parameters associated with the set of resources to host the data payload, the set of transport parameters comprising a schedule to migrate the data payload, and at least one of a data format capability, a security level, a secure connection capability, or an amount of data of the set of resources;
receiving, by the processor associated with the data distribution service, the data payload from the host storage cloud via a first set of dedicated transport connections;
storing the data payload in a staged data store associated with the data distribution service;
encrypting the data payload; and
initiating, based on the set of transportation parameters, transport of the encrypted data payload from the data distribution service to the set of resources via a second set of dedicated transport connections.
2. The method of claim 1 , wherein determining is based on:
a connectability of the set of resources to the data distribution service via the second set of dedicated transport connections.
3. The method of claim 2 , wherein the second set of dedicated transport connections exists between the set of resources and the data distribution service.
4. The method of claim 2 , wherein the second set of dedicated transport connections is to be established between the set of resources and the data distribution service.
5. The method of claim 1 , wherein the instruction is received from an administrator associated with the data payload.
6. The method of claim 1 , further comprising: maintaining a copy of the data payload in the host storage cloud.
7. The method of claim 1 , wherein determining the set of resources comprises determining multiple sets of resources associated with a plurality of target cloud providers.
8. The method of claim 1 , wherein the migration of the data payload is initiated in response to receiving a selection of the target cloud provider.
9. A system, comprising:
an interface to a data distribution service; and
a hardware processor, to communicate with the data distribution service via the interface, the processor to:
identify, for migration, a data payload in a host storage cloud of a host cloud provider;
receive an instruction to migrate the data payload from the host storage cloud of the host cloud provider;
determine a set of resources associated with a target cloud provider is based on a set of transport parameters associated with the set of resources to host the data payload, the set of transport parameters comprising a schedule to migrate the data payload, and at least one of a data format capability, a security level, a secure connection capability, or an amount of data of the set of resources;
receive, by the data distribution service, the data payload from the host storage cloud via a first set of dedicated transport connections;
store the data payload in a staged data store associated with the data distribution service;
encrypt the data payload; and
initiate, based on the set of transportation parameters, transport of the data payload from the data distribution service to the set of resources via a second set of dedicated transport connections.
10. The system of claim 9 , wherein determining is based on:
a connectability of the set of resources to the data distribution service via the second set of dedicated transport connections.
11. The system of claim 10 , wherein the second set of dedicated transport connections exists between the set of resources and the data distribution service.
12. The system of claim 10 , wherein the second set of dedicated transport connections is to be established between the set of resources and the data distribution service.
13. The system of claim 9 , wherein the instruction is received from an administrator associated with the data payload.
14. The system of claim 9 , wherein the processor is further to:
maintain a copy of the data payload in the host storage cloud.
15. The system of claim 9 , wherein determining the set of resources comprises determining multiple sets of resources associated with a plurality of target cloud providers.
16. The system of claim 9 , wherein the migration of the data payload is initiated in response to receiving a selection of the target cloud provider.