Increasing DCF confidence for analytic value
Aspects of annotating data are disclosed. As data is ingested to a data confidence fabric, analytic values, which includes tags or annotations, are attached to or associated with the data by an analytic insertion mechanism. The analytic values allow the data to be used by applications including machine learning algorithms immediately. Feedback from the applications allow the analytic insertion mechanism to improve and generate more valuable analytic values and to generate higher confidence scores for the analytic values.
1. A method for annotating data ingested into a data confidence fabric, the method comprising:
associating an analytic value with data, by an analystic insertion engine, as the data is ingested into the data confidence fabric, wherein the analytic value includes one or more tags and metadata, wherein inserting the analytic value includes annotating the data with the one or more tags and the metadata such that the data is immediately available for use by an application;
associating a confidence score to the data as the data is ingested into the data confidence fabric, wherein the confidence score indicates a trustworthiness of the data;
receiving feedback from the application, wherein the application is configured to associate the one or more tags and the metadata with attributes and is trained to generate the feedback based on the analytic value associated with the data; and
updating the analytic insertion engine with the feedback to improve the analytic insertion engine such that improved analytic values are generated by the analytic insertion engine and associated with data ingested into the data confidence fabric.
2. The method of claim 1 , further comprising receiving matching tags in the feedback between attributes of the application and the one or more tags included in the analytic value.
3. The method of claim 2 , further comprising increasing a confidence of the analytic value based on the matching tags.
4. The method of claim 3 , further comprising updating the analytic insertion engine based on the matching tags.
5. The method of claim 1 , further comprising receiving insights from the application as the feedback.
6. The method of claim 5 , wherein the insights relate to multiple tags included in the analytic value.
7. The method of claim 6 , further comprising increasing an analytic confidence score when the multiple tags associated with the insights are identified and included in the one or more tags associated with the analytic value.
8. The method of claim 7 , further comprising updating the analytic insertion engine based on the insights.
9. The method of claim 1 , further comprising receiving missing tags from the application as the feedback.
10. The method of claim 9 , further comprising updating the analytic insertion engine such that the analytic insertion engine is configured to add tags corresponding to the missing tags to the analytic value when found in the data.
11. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
associating an analytic value with data, by an analytic insertion engine, as the data is ingested into the data confidence fabric, wherein the analytic value includes one or more tags and metadata, wherein inserting the analytic value includes annotating the data with the one or more tags and the metadata such that the data is immediately available for use by an application;
associating a confidence score to the data as the data is ingested into the data confidence fabric, wherein the confidence score indicates a trustworthiness of the data;
receiving feedback from the application, wherein the application is configured to associate the one or more tags and the metadata with attributes and is trained to generate the feedback based on the analytic value associated with the data; and
updating the analytic insertion engine with the feedback to improve the analytic insertion engine such that improved analytic values are generated by the analytic insertion engine and associated with data ingested into the data confidence fabric.
12. The non-transitory storage medium of claim 11 , the operations further comprising receiving matching tags in the feedback between attributes of the application and the one or more tags included in the analytic value.
13. The non-transitory storage medium of claim 12 , the operations further comprising increasing a confidence of the analytic value based on the matching tags.
14. The non-transitory storage medium of claim 13 , the operations further comprising updating the analytic insertion engine based on the matching tags.
15. The non-transitory storage medium of claim 11 , the operations further comprising receiving insights from the application as the feedback.
16. The non-transitory storage medium of claim 15 , the operations wherein the insights relate to multiple tags included in the analytic value.
17. The non-transitory storage medium of claim 16 , the operations further increasing an analytic confidence score when the multiple tags associated with the insights are identified and included in the one or more tags associated with the analytic value.
18. The non-transitory storage medium of claim 17 , the operations further comprising updating the analytic insertion engine based on the insights.
19. The non-transitory storage medium of claim 11 , the operations further comprising receiving missing tags from the application as the feedback.
20. The non-transitory storage medium of claim 19 , the operations further comprising updating the analytic insertion engine such that the analytic insertion engine is configured to add tags corresponding to the missing tags to the analytic value when found in the data.