Multi-cloud data migration in platform as a service (PAAS) environment
According to one embodiment, a request is received for estimating migrating a first dataset from a first cloud system to a second cloud system. A migration cost estimation module determines a network bandwidth required to migrate the first dataset from the first cloud system to the second cloud system, determines a duplicated data time period during migration that the first dataset has to be maintained by both the first cloud system and the second cloud system for service continuity, and determines a total cost of migrating the first dataset from the first cloud system to the second cloud system based on the required network bandwidth and the duplicated data time period. It is then determined whether to migrate the first dataset from the first cloud system to the second cloud system based on the total cost.
1. A computer-implemented method for multi-cloud data migration of a platform-as-a-service (PaaS) environment, the method comprising:
receiving a request for estimating migrating a first dataset from a first cloud system to a second cloud system;
determining, by a migration cost estimation module executed by a processor, a network bandwidth required to migrate the first dataset from the first cloud system to the second cloud system;
determining by the migration cost estimation module a duplicated data time period during migration that the first dataset has to be maintained as duplicated data by both the first cloud system and the second cloud system for service continuity, wherein determining duplicated data time period comprises: determining a data transfer rate representing an amount of data can be transferred over the network within a predetermined time unit; determining a transfer unit cost for transferring data for each predetermined time unit; determining a size of the first dataset; and calculating the duplicated data time period based on the data transfer rate, the transfer unit cost, and the size of the first dataset;
determining by the migration cost estimation module a total cost of migrating the first dataset from the first cloud system to the second cloud system based on the required network bandwidth and the duplicated data time period;
determining whether to migrate the first dataset from the first cloud system to the second cloud system based on the total cost; and
migrating the first dataset from the first cloud system to the second cloud system in response to a positive determination to migrate.
2. The method of claim 1 , further comprising determining processing resources required to migrate the first dataset from the first cloud system to the second cloud system, wherein the total cost of the migration is determined further based on the determined processing resources.
3. The method of claim 2 , wherein determining processing resources required to migrate the first dataset comprises:
determining a cost of a central processing unit (CPU) cycle;
determining a size of the first dataset;
determining a number of CPU cycles required to transfer a predetermined data unit; and
calculating the required processing resources based on the cost of a CPU cycle, the size of the first dataset, and the number of CPU cycles required.
4. The method of claim 3 , wherein the required processing resources are calculated based on a multiplication of the cost of a CPU cycle, the size of the first dataset, and the number of CPU cycles required.
5. The method of claim 3 , wherein determining processing resources required to migrate the first dataset further comprises:
determining a cost of an input and output (IO) cycle;
determining a size of the first dataset;
determining an IO size representing an amount of data can be accessed per IO cycle; and
calculating the required processing resources based on the cost of an IO cycle, the size of the first dataset, and the IO size.
6. The method of claim 5 , wherein the required processing resources are calculated based on a multiplication of the cost of an IO cycle and the size of the first dataset, and divided by the IO size.
7. The method of claim 1 , wherein determining a network bandwidth required to migrate the first dataset comprises:
determining a cost of moving a predetermined data unit over a network;
determining a size of the first dataset; and
calculating the required network bandwidth based on the size of the first dataset and the cost of moving a predetermined data unit over a network.
8. The method of claim 7 , further comprising determining a data compression rate of the first dataset, wherein the required network bandwidth is calculated further based on the data compression rate of the first dataset.
9. The method of claim 8 , wherein the required network bandwidth is calculated based on a multiplication of the size of the first dataset and the cost of moving a predetermined data unit over a network in view of the data compression rate.
10. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations of estimating cost for data migration, the operations comprising:
receiving a request for estimating migrating a first dataset from a first cloud system to a second cloud system;
determining a network bandwidth required to migrate the first dataset from the first cloud system to the second cloud system;
determining a duplicated data time period during migration that the first dataset has to be maintained as duplicated data by both the first cloud system and the second cloud system for service continuity, wherein determining duplicated data time period comprises: determining a data transfer rate representing an amount of data can be transferred over the network within a predetermined time unit; determining a transfer unit cost for transferring data for each predetermined time unit; determining a size of the first dataset; and calculating the duplicated data time period based on the data transfer rate, the transfer unit cost, and the size of the first dataset;
determining a total cost of migrating the first dataset from the first cloud system to the second cloud system based on the required network bandwidth and the duplicated data time period;
determining whether to migrate the first dataset from the first cloud system to the second cloud system based on the total cost; and
migrating the first dataset from the first cloud system to the second clouds system in response to a positive determination to migrate.
11. The machine-readable medium of claim 10 , wherein the operations further comprise determining processing resources required to migrate the first dataset from the first cloud system to the second cloud system, wherein the total cost of the migration is determined further based on the determined processing resources.
12. The machine-readable medium of claim 11 , wherein determining processing resources required to migrate the first dataset comprises:
determining a cost of a central processing unit (CPU) cycle;
determining a size of the first dataset;
determining a number of CPU cycles required to transfer a predetermined data unit; and
calculating the required processing resources based on the cost of a CPU cycle, the size of the first dataset, and the number of CPU cycles required.
13. The machine-readable medium of claim 10 , wherein the required processing resources are calculated based on a multiplication of the cost of a CPU cycle, the size of the first dataset, and the number of CPU cycles required.
14. The machine-readable medium of claim 12 , wherein determining processing resources required to migrate the first dataset further comprises:
determining a cost of an input and output (IO) cycle;
determining a size of the first dataset;
determining an IO size representing an amount of data can be accessed per IO cycle; and
calculating the required processing resources based on the cost of an IO cycle, the size of the first dataset, and the IO size.
15. The machine-readable medium of claim 14 , wherein the required processing resources are calculated based on a multiplication of the cost of an IO cycle and the size of the first dataset, and divided by the IO size.
16. The machine-readable medium of claim 10 , wherein determining a network bandwidth required to migrate the first dataset comprises:
determining a cost of moving a predetermined data unit over a network;
determining a size of the first dataset; and
calculating the required network bandwidth based on the size of the first dataset and the cost of moving a predetermined data unit over a network.
17. The machine-readable medium of claim 16 , wherein the operations further comprise determining a data compression rate of the first dataset, wherein the required network bandwidth is calculated further based on the data compression rate of the first dataset.
18. The machine-readable medium of claim 17 , wherein the required network bandwidth is calculated based on a multiplication of the size of the first dataset and the cost of moving a predetermined data unit over a network in view of the data compression rate.
19. A data processing system, comprising:
a processor;
a memory coupled to the processor; and
a migration estimation module executed by the processor to perform operations, the operations including
receiving a request for estimating migrating a first dataset from a first cloud system to a second cloud system,
determining a network bandwidth required to migrate the first dataset from the first cloud system to the second cloud system,
determining a duplicated data time period during migration that the first dataset has to be maintained as duplicated data by both the first cloud system and the second cloud system for service continuity, wherein determining duplicated data time period comprises: determining a data transfer rate representing an amount of data can be transferred over the network within a predetermined time unit; determining a transfer unit cost for transferring data for each predetermined time unit; determining a size of the first dataset; and calculating the duplicated data time period based on the data transfer rate, the transfer unit cost, and the size of the first dataset,
determining a total cost of migrating the first dataset from the first cloud system to the second cloud system based on the required network bandwidth and the duplicated data time period,
determining whether to migrate the first dataset from the first cloud system to the second cloud system based on the total cost; and
migrating the first dataset from the first cloud system to the second cloud system in response to a positive determination to migrate.
20. The system of claim 19 , wherein the operations further comprise determining processing resources required to migrate the first dataset from the first cloud system to the second cloud system, wherein the total cost of the migration is determined further based on the determined processing resources.
21. The system of claim 20 , wherein determining processing resources required to migrate the first dataset comprises:
determining a cost of a central processing unit (CPU) cycle;
determining a size of the first dataset;
determining a number of CPU cycles required to transfer a predetermined data unit; and
calculating the required processing resources based on the cost of a CPU cycle, the size of the first dataset, and the number of CPU cycles required.
22. The system of claim 21 , wherein determining processing resources required to migrate the first dataset further comprises:
determining a cost of an input and output (IO) cycle;
determining a size of the first dataset;
determining an IO size representing an amount of data can be accessed per IO cycle; and
calculating the required processing resources based on the cost of an IO cycle, the size of the first dataset, and the IO size.
23. The system of claim 19 , wherein determining a network bandwidth required to migrate the first dataset comprises:
determining a cost of moving a predetermined data unit over a network;
determining a size of the first dataset; and
calculating the required network bandwidth based on the size of the first dataset and the cost of moving a predetermined data unit over a network.
24. The system of claim 23 , wherein the operations further comprise determining a data compression rate of the first dataset, wherein the required network bandwidth is calculated further based on the data compression rate of the first dataset.