Efficient database management system and method for use therewith
A database management system operates by: obtaining a dataset from a memory of the database management system, wherein the dataset includes a set of data records; determining a set of data characteristics of the dataset; determining a list of analytical calculations that are able to be executed on the dataset; determining an analytical calculation characteristic for each analytical calculation of the list of analytical calculations to produce a set of analytical calculation characteristics, wherein the analytical calculation characteristic indicates an estimated execution time to perform the analytical calculation; ranking each analytical calculation of the list of analytical calculations based on the set of data characteristics and the set of analytical calculation characteristics to produce a ranked list of analytical calculations; selecting an analytical calculation from the ranked list of analytical calculations based on the ranking; and executing the selected analytical calculation on the dataset to produce an analytical calculation result.
1. A method for execution by a computer of a database management system, the method comprising:
obtaining a dataset from a memory of the database management system, wherein the dataset includes a set of data records;
determining a set of data characteristics of the dataset;
determining a list of analytical calculations that are able to be executed on the dataset;
determining an analytical calculation characteristic for each analytical calculation of the list of analytical calculations to produce a set of analytical calculation characteristics, wherein the analytical calculation characteristic indicates an estimated execution time to perform the analytical calculation;
ranking each analytical calculation of the list of analytical calculations based on the set of data characteristics and the set of analytical calculation characteristics to produce a ranked list of analytical calculations;
selecting an analytical calculation from the ranked list of analytical calculations based on the ranking; and
executing the selected analytical calculation on the dataset to produce an analytical calculation result.
2. The method of claim 1 , wherein a data characteristic of the set of data characteristics further indicates a number of data records within the dataset.
3. The method of claim 1 , wherein a data characteristic of the set of data characteristics further indicates a data type of a column of each data record within the dataset.
4. The method of claim 1 , wherein the analytical calculation result indicates an abnormality of data records within the dataset.
5. The method of claim 4 , wherein the abnormality is one of:
an error;
data distortion; or
data noise.
6. The method of claim 1 further comprises:
determining to perform another analytical calculation on the dataset, wherein the other analytical calculation is not included in the list of analytical calculations;
determining another analytical calculation characteristic for the other analytical calculation;
comparing the other analytical calculation characteristic to the set of analytical calculation characteristics;
when the other analytical calculation characteristic matches a first analytical calculation characteristic of the set of analytical calculation characteristics:
determining the ranking of the analytical calculation associated with the first analytical calculation characteristic;
assigning the ranking of the analytical calculation to the other analytical calculation; and
executing the other analytical calculation on the dataset in accordance with the ranked list of analytical calculations.
7. The method of claim 1 , further comprising:
executing each analytical calculation within the list of analytical calculations on the dataset to produce a list of result scores, wherein the list of result scores includes a result score for each analytical calculation.
8. The method of claim 7 , further comprising:
updating the ranking of the list of analytical calculations based on the list of result scores.
9. The method of claim 1 , wherein the analytical calculation characteristic further includes:
a type of calculation to be performed by the analytical calculation, wherein the type of calculation includes one or more of a linear operation and a square root operation.
10. The method of claim 1 , wherein the dataset includes a data confidence value.
11. A database management system that includes:
a memory;
a computer that performs operations that include:
obtaining a dataset from the memory of the database management system, wherein the dataset includes a set of data records;
determining a set of data characteristics of the dataset;
determining a list of analytical calculations that are able to be executed on the dataset;
determining an analytical calculation characteristic for each analytical calculation of the list of analytical calculations to produce a set of analytical calculation characteristics, wherein the analytical calculation characteristic indicates an estimated execution time to perform the analytical calculation;
ranking each analytical calculation of the list of analytical calculations based on the set of data characteristics and the set of analytical calculation characteristics to produce a ranked list of analytical calculations;
selecting an analytical calculation from the ranked list of analytical calculations based on the ranking; and
executing the selected analytical calculation on the dataset to produce an analytical calculation result.
12. The database management system of claim 11 , wherein a data characteristic of the set of data characteristics further indicates a number of data records within the dataset.
13. The database management system of claim 11 , wherein a data characteristic of the set of data characteristics further indicate a data type of a column of each data record within the dataset.
14. The database management system of claim 11 , wherein the analytical calculation result indicates an abnormality of data records within the dataset.
15. The database management system of claim 14 , wherein the abnormality is one of:
an error;
data distortion; or
data noise.
16. The database management system of claim 11 , wherein the operations further include:
determining to perform another analytical calculation on the dataset, wherein the other analytical calculation is not included in the list of analytical calculations;
determining another analytical calculation characteristic for the other analytical calculation;
comparing the other analytical calculation characteristic to the set of analytical calculation characteristics;
when the other analytical calculation characteristic matches a first analytical calculation characteristic of the set of analytical calculation characteristics:
determining the ranking of the analytical calculation associated with the first analytical calculation characteristic;
assigning the ranking of the analytical calculation to the other analytical calculation; and
executing the other analytical calculation on the dataset in accordance with the ranked list of analytical calculations.
17. The database management system of claim 11 , wherein the operations further include:
executing each analytical calculation within the list of analytical calculations on the dataset to produce a list of result scores, wherein the list of result scores includes a result score for each analytical calculation.
18. The database management system of claim 17 , wherein the operations further include:
updating the ranking of the list of analytical calculations based on the list of result scores.
19. The database management system of claim 11 , wherein the analytical calculation characteristic further includes:
a type of calculation to be performed by the analytical calculation, wherein the type includes one or more of a linear operation and a square root operation.
20. The database management system of claim 11 , wherein the dataset includes a data confidence value.