Self healing system for inaccurate metadata
View Patent ↗Based on a probability of summary metadata associated with an entity of a media hosting service being inaccurate, a determination is made as to whether to verify the accuracy of the summary metadata. In response to determining to verify the accuracy of the summary metadata, a determination is made as to whether the summary metadata is inaccurate with respect to master metadata associated with the entity of the media hosting service. The summary metadata is updated with a correct value determined from the master metadata, in response to determining the summary metadata is inaccurate.
1. A method, executed by a computer system, for correcting inaccurate data, the method comprising:
detecting occurrences of an event;
updating, in a first table, first data that describes occurrences of the event;
updating a summary count that describes a number of occurrences of the event;
periodically storing, in a second table, second data replicated from the first table, wherein the second data corresponds to first data in the first table at a prior time equal to a current time minus a lag time;
starting a live count of occurrences of the event, the live count updated responsive to detecting the event;
after an amount of time equal to the lag time, determining from the second table a delayed value of the summary count; and
determining an accurate value of the summary count based on the delayed value and the live count.
2. The method of claim 1 , further comprising:
responsive to determining a discrepancy between the accurate value and a current value of the summary count, updating the current value of the summary count based on the accurate value.
3. The method of claim 1 , further comprising:
determining whether to verify the summary count based on a calculated probability of the summary count being inaccurate.
4. The method of claim 3 , wherein the event involves an entity of a media hosting service and the probability is calculated based on an activity level of the entity in the media hosting service.
5. The method of claim 3 , further comprising:
responsive to determining to verify the accuracy of the summary metadata, generating a query for the second table; and
after the amount of time equal to the lag time, processing the query to determine the delayed value.
6. The method of claim 1 , wherein the event involves an entity of a media hosting service.
7. The method of claim 6 , wherein the entity is a user of the media hosting service.
8. The method of claim 6 , wherein the entity is a media content item of the media hosting service.
9. A non-transitory computer readable storage medium having computer program instructions for correcting inaccurate data, the computer program instructions to configure a processor to perform operations comprising:
detecting occurrences of an event;
updating, in a first table, first data that describes occurrences of the event;
updating a summary count that describes a number of occurrences of the event;
repeatedly storing, in a second table, second data replicated from the first table, wherein the second data corresponds to first data in the first table at a prior time equal to a current time minus a lag time;
starting a live count of occurrences of the event, the live count updated responsive to detecting the event;
after an amount of time equal to the lag time, determining from the second table a delayed value of the summary count; and
determining an accurate value of the summary count based on the delayed value and the live count.
10. The non-transitory computer readable storage medium of claim 9 , further comprising:
responsive to determining a discrepancy between the accurate value and a current value of the summary count, updating the current value of the summary count based on the accurate value.
11. The non-transitory computer readable storage medium of claim 9 , further comprising:
determining whether to verify the summary count based on a calculated probability of the summary count being inaccurate.
12. The non-transitory computer readable storage medium of claim 11 , wherein the event involves an entity of a media hosting service and the probability is calculated based on an activity level of the entity in the media hosting service.
13. The non-transitory computer readable storage medium of claim 11 , further comprising:
responsive to determining to verify the accuracy of the summary metadata, generating a query for the second table; and
after the amount of time equal to the lag time, processing the query to determine the delayed value.
14. A computer system for correcting inaccurate data, the system comprising:
a computer processor; and
a non-transitory computer readable storage medium having computer program instructions to configure the computer processor to perform operations comprising:
detecting occurrences of an event;
updating, in a first table, first data that describes occurrences of the event;
updating a summary count that describes a number of occurrences of the event;
periodically storing, in a second table, second data replicated from the first table, wherein the second data corresponds to first data in the first table at a prior time equal to a current time minus a lag time;
starting a live count of occurrences of the event, the live count updated responsive to detecting the event;
after an amount of time equal to the lag time, determining from the second table a delayed value of the summary count; and
determining an accurate value of the summary count based on the delayed value and the live count.
15. The system of claim 14 , wherein the instructions further configure the computer processor to perform operations comprising:
responsive to determining a discrepancy between the accurate value and a current value of the summary count, updating the current value of the summary count based on the accurate value.
16. The system of claim 14 , wherein the instructions further configure the computer processor to perform operations comprising:
determining whether to verify the summary count based on a calculated probability of the summary count being inaccurate.
17. The system of claim 16 , wherein the event involves an entity of a media hosting service and the probability is calculated based on an activity level of the entity in the media hosting service.
18. The system of claim 14 , wherein the instructions further configure the computer processor to perform operations comprising:
responsive to determining to verify the accuracy of the summary metadata, generating a query for the second table; and
after the amount of time equal to the lag time, processing the query to determine the delayed value.
19. The system of claim 14 , wherein the event involves an entity of a media hosting service.
20. The system of claim 19 , wherein the entity is a user of the media hosting service.