Granted Patent B2

US 12,271,396 · App. 18/225,827 · Granted Apr 8, 2025

Inventors: Rohit Jaykumar Gattani (Pleasanton, CA); Rahul Gupta (Dublin, CA)

Assignee: Oracle International Corporation

G06F16/278G06F16/254

Abstract

Claims (63)

1. A method, comprising:

receiving, by a computing system, a plurality of data sets sampled from data stored in a source system, wherein partitioning information is not available or not provided at the source system;

extracting, by the computing system and for each data set, a respective partitioning column, each respective partitioning column comprising a plurality of discrete values;

extracting, by the computing system and for each data set, a respective set of discrete values from the plurality of discrete values of the respective partitioning column;

generating, by the computing system, a respective cumulative deviation score for each respective set of discrete values;

comparing, by the computing system, the generated cumulative deviation scores for the respective sets of discrete values;

extracting, by the computing system, a final set of discrete values as the partitioning information to be used for partitioning the data based at least in part on the compared cumulative deviation scores; and

partitioning, by the computing system, the data stored in the source system based at least in part on the partitioning information.

2. The method of claim 1 , wherein the extracting of the respective set of discrete values from the plurality of discrete values of the respective partitioning column comprises:

determining a frequency of each discrete value of the plurality of discrete values in the respective partitioning column;

comparing each frequency of each discrete value to a threshold frequency; and

determining the respective set of discrete values based at least in part on the comparison of each frequency of each discrete value to the threshold frequency.

3. The method of claim 1 , wherein the method further comprises:

determining a number of partitions to partition the data stored in the source system.

4. The method of claim 3 , wherein the method further comprises:

comparing the number of partitions to a number of discrete values of the respective set of discrete values;

determining that the number of partitions is different than the number of discrete values of the respective set of discrete values; and

grouping two or more discrete values of the respective set of discrete values such that the number of partitions corresponds to the number of discrete values.

5. The method of claim 3 , wherein the method further comprises:

determining the number of the discrete values of the set of discrete values being based at least in part on the number of partitions.

6. The method of claim 5 , wherein the determining of the number of the discrete values of the set of discrete values comprises determining a distribution of the discrete values.

7. The method of claim 3 , wherein the determining of the number of partitions comprises:

determining a capability of a downstream process to receive the partitioned data, wherein the number of partitions is based at least in part on the capability of the downstream process.

8. The method of claim 3 , wherein the method further comprises:

initializing a set of virtual machines based at least in part on the number partitions; and

transmitting, using the set of virtual machines, the partitioned data in parallel from the source system to a target system.

9. The method of claim 1 , wherein the generating of the respective cumulative deviation score for each respective set of discrete values comprises:

comparing each discrete value of each set of discrete values with each discrete value of each other respective set of discrete values to determine a deviation of discrete values, wherein the respective cumulative deviation score for each respective set of discrete values is based at least in a part on the deviation of discrete values.

10. A computing system, comprising:

one or more processors; and

a computer-readable medium including instructions that, when executed by the one or more processors, cause the one or more processors to:

receive a plurality of data sets sampled from data stored in a source system, wherein partitioning information is not available or not provided at the source system;

extract, for each data set, a respective partitioning column, each respective partitioning column comprising a plurality of discrete values;

extract, for each data set, a respective set of discrete values from the plurality of discrete values of the respective partitioning column;

generate a respective cumulative deviation score for each respective set of discrete values;

compare the generated cumulative deviation scores for each the respective sets of discrete values;

extract a final set of discrete values as the partitioning information to be used for partitioning the data based at least in part on the compared cumulative deviation scores; and

partition the data stored in the source system based at least in part on the partitioning information.

11. The computing system of claim 10 , wherein the extracting of the respective set of discrete values from the plurality of discrete values of the respective partitioning column comprises:

determining a frequency of each discrete value of the plurality of discrete values in the respective partitioning column;

comparing each frequency of each discrete value to a threshold frequency; and

determining the respective set of discrete values based at least in part on the comparison of each frequency of each discrete value to the threshold frequency.

12. The computing system of claim 10 , wherein the instructions that, when executed by the one or more processors, further cause the one or more processors to:

determine a number of partitions to partition the data stored in the source system.

13. The computing system of claim 10 , wherein

determining the generating of the respective cumulative deviation score for each respective set of discrete values comprises:

comparing each discrete value of each set of discrete values with each discrete value of each other respective set of discrete values to determine a deviation of discrete values, wherein the respective cumulative deviation score for each respective set of discrete values is based at least in a part on the deviation of discrete values.

14. A non-transitory computer-readable medium including stored thereon a sequence of instructions that, when executed by one or more processors, causes the one or more processors to:

receive a plurality of data sets sampled from data stored in a source system, wherein partitioning information is not available or not provided at the source system;

extract, for each data set, a respective partitioning column, each respective partitioning column comprising a plurality of discrete values;

extract, for each data set, a respective set of discrete values from the plurality of discrete values of the respective partitioning column;

generate a respective cumulative deviation score for each respective set of discrete values;

compare the generated cumulative deviation scores for the respective sets of discrete values;

extract a final set of discrete values as the partitioning information to be used for partitioning the data based at least in part on the compared cumulative deviation scores; and

partition the data stored in the source system based at least in part on the partitioning information.

15. The non-transitory computer-readable medium of claim 14 , wherein the instructions that, when executed by the one or more processors, further cause the one or more processors to:

determine a number of partitions to partition the data stored in the source system.

16. The non-transitory computer-readable medium of claim 15 , wherein the instructions that, when executed by the one or more processors, further cause the one or more processors to:

compare the number of partitions to a number of discrete values of the respective set of discrete values;

determine that the number of partitions is different than the number of discrete values of the respective set of discrete values; and

group two or more discrete values of the respective set of discrete values such that the number of partitions corresponds to the number of discrete values.

17. The non-transitory computer-readable medium of claim 14 , wherein the generating of the respective cumulative deviation score for each respective set of discrete values comprises:

comparing each discrete value of each set of discrete values with each discrete value of each other respective set of discrete values to determine a deviation of discrete values, wherein the respective cumulative deviation score for each respective set of discrete values is based at least in a part on the deviation of discrete values.

Assignments (2)

Continuity (1)

References Cited (19)