Database management systems for managing data with data confidence

1. A method for managing data storage and retrieval, the method operated within a database management system and the method comprising:

retrieving, by the database management system, a set of confidence data records from memory of the database management system, wherein a confidence data record of the set of confidence data records includes a set of data columns and one or more confidence columns populated with one or more data confidence values associated with data within one or more data columns of the set of data columns; and

analyzing, by the database management system, the set of confidence data records to produce a result, wherein the result includes a confidence level that is based on the one or more data confidence values associated with the data within the one or more data columns of the set of data columns.

2. The method of claim 1 , wherein a data confidence value of the one or more data confidence values comprises one or more of:

an estimate of an accuracy of the set of confidence data records;

an estimate of an accuracy of the confidence data record;

an estimate of an accuracy of a data point of the data within a data column of the one or more data columns; and

an estimate of a reliability level of the set of confidence data records.

3. The method of claim 1 further comprises:

determining whether a data confidence value associated with a first data record that is stored or is to be stored in the memory is less than a data confidence threshold; and

when the data confidence value is less than the data confidence threshold, generating a first confidence data record of the set of confidence data records based on the first data record and the data confidence value.

4. The method of claim 3 , wherein the first data record further comprises:

a first set of data columns.

5. The method of claim 4 , wherein the generating the first confidence data record comprises:

appending the data confidence value to the first set of data columns to produce the first confidence data record of the set of confidence data records.

6. The method of claim 4 , wherein the determining whether the data confidence value is less than the data confidence threshold comprises:

determining a data type associated with the first set of data columns; and

determining, based on the determined data type, the data confidence value of the first set of data columns is less than the data confidence threshold.

7. The method of claim 6 , wherein the data type includes one or more of:

digital sensor data;

network traffic data; and

genomic base pairs of a genome sequence.

8. The method of claim 1 further comprises:

interpreting one or more data points of the data within the set of data columns to produce the one or more data confidence values.

9. The method of claim 1 , wherein the analyzing the set of confidence data records to produce the result comprises:

performing one or more calculations on the set of confidence data records to produce the result; and

generating the confidence level associated with the result.

10. A database storage node of a database management system, the database storage node comprising:

memory;

an interface; and

a processing unit operably coupled to the memory and the interface, wherein the processing unit is operable to:

retrieve a set of confidence data records from memory of the database management system, wherein a confidence data record of the set of confidence data records includes a set of data columns and one or more confidence columns populated with one or more data confidence values associated with data within one or more data columns of the set of data columns; and

analyze the set of confidence data records to produce a result, wherein the result includes a confidence level that is based on the one or more data confidence values associated with the data within the one or more data columns of the set of data columns.

11. The database storage node of claim 10 , wherein the processing unit is operable to determine a data confidence value of the one or more data confidence values by one or more of:

determining an estimate of an accuracy of the set of confidence data records;

determining an estimate of an accuracy of the confidence data record;

determining an estimate of an accuracy of a data point of the data within a data column of the one or more data columns; and

determining an estimate of a reliability level of the set of confidence data records.

12. The database storage node of claim 10 , wherein the processing unit is further operable to:

determine whether a data confidence value associated with a first data record that is stored or is to be stored in the memory is less than a data confidence threshold; and

when the data confidence value is less than the data confidence threshold, generate a first confidence data record of the set of confidence data records based on the first data record and the data confidence value.

13. The database storage node of claim 12 , wherein the processing unit is further operable to determine the first data record comprises:

a first set of data columns.

14. The database storage node of claim 13 , wherein the processing unit is further operable to generate the first confidence data record by:

appending the data confidence value to the first set of data columns to produce the first confidence data record of the set of confidence data records.

15. The database storage node of claim 13 , wherein the processing unit is further operable to determine whether the data confidence value is less than the data confidence threshold by:

determining a data type associated with the first set of data columns; and

determining, based on the determined data type, the data confidence value of the first set of data columns is less than the data confidence threshold.

16. The database storage node of claim 15 , wherein the processing unit is further operable to determine the data type includes one or more of:

digital sensor data;

network traffic data; and

genomic base pairs of a genome sequence.

17. The database storage node of claim 10 , wherein the processing unit is further operable to:

interpret one or more data points of the data within the set of data columns to produce the one or more data confidence values.

18. The database storage node of claim 10 , wherein the analyzing the set of confidence data records to produce the result comprises:

performing one or more calculations on the set of confidence data records to produce the result; and

generating the confidence level associated with the result.