Efficient database management system and method for use therewith
A method for execution by a computer of a database management system includes obtaining a dataset that includes a set of data records, where the data set is associated with a set of data characteristics. The method further includes ranking analytical calculations of a list of analytical calculations that are able to be executed on the dataset based on the set of data characteristics and a set of analytical calculation characteristics associated with the list of analytical calculations to produce a ranked list of analytical calculations. The method further includes selecting an analytical calculation from the ranked list of analytical calculations based on the ranking. The method further includes executing the selected analytical calculation on the dataset to produce an analytical calculation result.
1. A method for execution by a computer of a database management system, the method comprising:
obtaining a dataset that includes a set of data records, wherein the data set is associated with a set of data characteristics;
selecting a ranked analytical calculation of a ranked list of analytical calculations that are able to be executed on the dataset, wherein a list of analytical calculations are ranked based on the set of data characteristics and a set of analytical calculation characteristics associated with the list of analytical calculations to produce the ranked list of analytical calculations, and wherein an analytical calculation characteristic of the set of analytical calculation characteristics indicates an estimated execution time to perform the analytical calculation; and
executing the selected ranked analytical calculation on the dataset to produce an analytical calculation result.
2. The method of claim 1 , wherein a data characteristic of the set of data characteristics further indicates a number of data records within the dataset.
3. The method of claim 1 , wherein a data characteristic of the set of data characteristics further indicates a data type of a column of each data record within the dataset.
4. The method of claim 1 , wherein the analytical calculation result indicates an abnormality of data records within the dataset.
5. The method of claim 4 , wherein the abnormality is one of:
an error;
data distortion; and
data noise.
6. The method of claim 1 further comprises:
determining to perform another analytical calculation on the dataset, wherein the other analytical calculation is not included in the ranked list of analytical calculations;
determining another analytical calculation characteristic for the other analytical calculation;
comparing the other analytical calculation characteristic to the set of analytical calculation characteristics; and
when the other analytical calculation characteristic matches a first analytical calculation characteristic of the set of analytical calculation characteristics:
determining the ranking of the analytical calculation associated with the first analytical calculation characteristic;
assigning the ranking of the analytical calculation to the other analytical calculation; and
executing the other analytical calculation on the dataset in accordance with the ranked list of analytical calculations.
7. The method of claim 1 further comprises:
executing each ranked analytical calculation within the ranked list of analytical calculations on the dataset to produce a list of result scores, wherein the list of result scores includes a result score for each ranked analytical calculation.
8. The method of claim 7 further comprises:
updating the ranking of the ranked list of analytical calculations based on the list of result scores.
9. The method of claim 1 , wherein the analytical calculation characteristic further includes:
a type of calculation to be performed by the ranked analytical calculation, wherein the type of calculation includes one or more of a linear operation and a square root operation.
10. The method of claim 1 , wherein the dataset includes a data confidence value.
11. The method of claim 1 , wherein the analytical calculation characteristic indicates an estimated execution time to perform the ranked analytical calculation.
12. A database management system that includes:
a memory; and
a computer that performs operations that include:
obtaining a dataset that includes a set of data records, wherein the data set is associated with a set of data characteristics;
selecting a ranked analytical calculation of a ranked list of analytical calculations that are able to be executed on the dataset, wherein a list of analytical calculations are ranked based on the set of data characteristics and a set of analytical calculation characteristics associated with the list of analytical calculations to produce the ranked list of analytical calculations, and wherein an analytical calculation characteristic of the set of analytical calculation characteristics indicates an estimated execution time to perform the analytical calculation; and
executing the selected ranked analytical calculation on the dataset to produce an analytical calculation result.
13. The database management system of claim 12 , wherein a data characteristic of the set of data characteristics further indicates a number of data records within the dataset.
14. The database management system of claim 12 , wherein a data characteristic of the set of data characteristics further indicates a data type of a column of each data record within the dataset.
15. The database management system of claim 12 , wherein the analytical calculation result indicates an abnormality of data records within the dataset.
16. The database management system of claim 15 , wherein the abnormality is one of:
an error;
data distortion; and
data noise.
17. The database management system of claim 12 , wherein the operations further include:
determining to perform another analytical calculation on the dataset, wherein the other analytical calculation is not included in the ranked list of analytical calculations;
determining another analytical calculation characteristic for the other analytical calculation;
comparing the other analytical calculation characteristic to the set of analytical calculation characteristics; and
when the other analytical calculation characteristic matches a first analytical calculation characteristic of the set of analytical calculation characteristics:
determining the ranking of the analytical calculation associated with the first analytical calculation characteristic;
assigning the ranking of the analytical calculation to the other analytical calculation; and
executing the other analytical calculation on the dataset in accordance with the ranked list of analytical calculations.
18. The database management system of claim 12 , wherein the operations further include:
executing each ranked analytical calculation within the ranked list of analytical calculations on the dataset to produce a list of result scores, wherein the list of result scores includes a result score for each ranked analytical calculation.
19. The database management system of claim 18 , wherein the operations further include:
updating the ranking of the ranked list of analytical calculations based on the list of result scores.
20. The database management system of claim 12 , wherein the analytical calculation characteristic further includes:
a type of calculation to be performed by the ranked analytical calculation, wherein the type of calculation includes one or more of a linear operation and a square root operation.