Data management in multi-cloud computing environment
A data transfer request is received from an application program hosted at a first location in a computing environment for transferring a given data set to a second location in the computing environment. The data transfer request comprises information identifying one or more data types of the given data set and one or more preferences associated with the transfer of the given data set. The second location is notified of the data transfer request. The method causes deployment of one or more data-aware services to optimize the given data set prior to transfer to the second location, wherein optimizing the given data set is performed based on the one or more data types of the given data set and the one or more preferences associated with the transfer of the given data set. For example, the data-aware services at the first location may comprise data deduplication and/or data compression.
1. A method, comprising:
receiving a data transfer request from an application program hosted at a first location in a computing environment for transferring a given data set to a second location in the computing environment, wherein the data transfer request comprises information identifying one or more data types of the given data set and one or more preferences associated with the transfer of the given data set;
notifying the second location of the data transfer request;
determining, based at least in part on the information identifying the one or more data types of the given data set and the one or more preferences associated with the transfer of the given data set, resource characteristic requirements for one or more data-aware services to be utilized for optimizing the given data set prior to transfer to the second location;
causing deployment of one or more data-aware services with the determined resource characteristic requirements to optimize the given data set prior to transfer to the second location, wherein optimizing the given data set is performed based on the one or more data types of the given data set and the one or more preferences associated with the transfer of the given data set, wherein the one or more data-aware services comprise one or more of a data deduplication service and a data compression service; and
validating, with the one or more data-aware services, the second location prior to transferring the given data set thereto;
wherein the steps are performed via one or more processing devices.
2. The method of claim 1 , wherein the step of causing deployment of the one or more data-aware services further comprises utilizing resources of the first location.
3. The method of claim 1 , wherein the step of causing deployment of the one or more data-aware services further comprises utilizing resources external to the first location.
4. The method of claim 1 , further comprising causing execution of the one or more data-aware services on the given data set.
5. The method of claim 4 , wherein the one or more data-aware services are executed on a portion of the given data set.
6. The method of claim 1 , further comprising transferring the given data set to the second location after execution of the one or more data-aware services on the given data set.
7. The method of claim 1 , wherein the one or more data types of the given data set are artificial intelligence/machine learning and analytics data types.
8. The method of claim 1 , wherein one or more of the first location and second location is a cloud computing platform.
9. The method of claim 1 , wherein one or more of the first location and second location is an edge computing network.
10. An article of manufacture comprising a processor-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by the one or more processing devices implement the steps of claim 1 .
11. A system, comprising:
at least one processor, coupled to a memory, and configured to:
receive a data transfer request from an application program hosted at a first location in a computing environment for transferring a given data set to a second location in the computing environment, wherein the data transfer request comprises information identifying one or more data types of the given data set and one or more preferences associated with the transfer of the given data set;
notify the second location of the data transfer request;
determine, based at least in part on the information identifying the one or more data types of the given data set and the one or more preferences associated with the transfer of the given data set, resource characteristic requirements for one or more data-aware services to be utilized for optimizing the given data set prior to transfer to the second location;
cause deployment of one or more data-aware services with the determined resource characteristic requirements to optimize the given data set prior to transfer to the second location, wherein optimizing the given data set is performed based on the one or more data types of the given data set and the one or more preferences associated with the transfer of the given data set, wherein the one or more data-aware services comprise one or more of a data deduplication service and a data compression service; and
validate, with the one or more data-aware services, the second location prior to transferring the given data set thereto.
12. The system of claim 11 , wherein the at least one processor is further configured to:
cause deployment of the one or more data-aware services further comprises utilizing resources of the first location.
13. The system of claim 11 , wherein the at least one processor is further configured to:
cause deployment of the one or more data-aware services further comprises utilizing resources external to the first location.
14. The system of claim 11 , wherein the at least one processor is further configured to:
cause execution of the one or more data-aware services on at least a portion of the given data set; and
transfer the given data set to the second location after execution of the one or more data-aware services on the given data set.
15. A method, comprising:
receiving a data transfer request from a first location in a computing environment for transferring a given data set to a second location in the computing environment, wherein the data transfer request comprises information identifying one or more data types of the given data set and one or more preferences associated with the transfer of the given data set;
determining, based at least in part on the information identifying the one or more data types of the given data set and the one or more preferences associated with the transfer of the given data set, resource characteristic requirements for one or more data-aware services to be utilized for optimizing the given data set prior to transfer to the second location;
causing deployment of one or more data-aware services with the determined resource characteristic requirements to process the given data set, wherein processing the given data set is performed based on the one or more data types of the given data set and the one or more preferences associated with the transfer of the given data set, wherein the one or more data-aware services comprises a data hydration service; and
validating, with the one or more data-aware services, the given data set;
wherein the steps are performed via one or more processing devices.
16. The method of claim 15 , wherein the processing of the given data set by the one or more data-aware services is performed at a time subsequent to receipt of the given data set at the second location.
17. The method of claim 15 , wherein the one or more data types of the given data set are artificial intelligence/machine learning and analytics data types.
18. The method of claim 15 , wherein one or more of the first location and second location is a cloud computing platform.
19. The method of claim 15 , wherein one or more of the first location and second location is an edge computing network.
20. An article of manufacture comprising a processor-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by the one or more processing devices implement the steps of claim 15 .