Self healing system for inaccurate metadata
Based on a probability of summary metadata associated with an entity of a media hosting service being inaccurate, a determination is made as to whether to verify the accuracy of the summary metadata. In response to determining to verify the accuracy of the summary metadata, a determination is made as to whether the summary metadata is inaccurate with respect to master metadata associated with the entity of the media hosting service. The summary metadata is updated with a correct value determined from the master metadata, in response to determining the summary metadata is inaccurate.
1. A computer implemented method for correcting inaccurate data, the method comprising:
storing, by a media hosting computer system, data describing occurrences of an event involving an entity and the media hosting computer system;
storing summary data that summarizes the data describing occurrences of the event involving the entity and the media hosting computer system;
calculating, by the media hosting computer system, a probability of a value of the stored summary data being inaccurate based on an activity level of the entity with the media hosting computer system;
determining whether to verify the accuracy of the summary data based at least in part on the calculated probability exceeding a threshold; and
verifying, by the media hosting computer system, whether the value of the stored summary data is inaccurate with respect to the data describing occurrences of the event involving the entity and the media hosting computer system based on the determination.
2. The method of claim 1 , wherein the entity is a user of the media hosting computer system.
3. The method of claim 1 , wherein the entity is a media content item accessible to users of the media hosting computer system.
4. The method of claim 1 , wherein the entity is a video accessible to users of the media hosting computer system.
5. The method of claim 1 , wherein the data is a count that describes a number of occurrences of the event.
6. The method of claim 4 , wherein the probability is calculated based on the count.
7. The method of claim 4 , wherein the probability is calculated based on the count and counts of other entities of the media hosting computer system of a same type as the count that describes the number of occurrences of the event.
8. The method of claim 1 , wherein the probability is calculated based on the activity level of the entity compared to activity levels of other entities.
9. The method of claim 1 , wherein the data summarizes master metadata generated from the occurrences of the event and verifying whether the value of the stored data is inaccurate comprises:
determining a correct value of the data based on the master metadata; and
responsive to the correct value being different than the value of the stored data, determining that the stored data is inaccurate.
10. A non-transitory computer readable storage medium having computer program instructions for correcting inaccurate data, the computer program instructions to configure a processor to perform operations comprising:
storing, by a media hosting computer system, data describing occurrences of an event involving an entity and the media hosting computer system;
storing summary data that summarizes the data describing occurrences of the event involving the entity and the media hosting computer system;
calculating, by the media hosting computer system, a probability of a value of the stored summary data being inaccurate based on an activity level of the entity with the media hosting computer system;
determining whether to verify the accuracy of the summary data based at least in part on the calculated probability exceeding a threshold; and
verifying, by the media hosting computer system, whether the value of the stored summary data is inaccurate with respect to the data describing occurrences of the event involving the entity and the media hosting computer system based on the determination.
11. The computer readable storage medium of claim 10 , wherein the entity is a video accessible to users of the media hosting computer system.
12. The computer readable storage medium of claim 10 , wherein the data is a count that describes a number of occurrences of the event.
13. The computer readable storage medium of claim 12 , wherein the probability is calculated based on the count.
14. The computer readable storage medium of claim 12 , wherein the probability is calculated based on the count and counts of other entities of the media hosting computer system of a same type as the count that describes the number of occurrences of the event.
15. The computer readable storage medium of claim 10 , wherein the data summarizes master metadata generated from the occurrences of the event and verifying whether the value of the stored data is inaccurate comprises:
determining a correct value of the data based on the master metadata; and
responsive to the correct value being different than the value of the stored data, determining that the stored data is inaccurate.
16. A media hosting computer system for correcting inaccurate data, the system comprising:
one or more computer processors; and
a non-transitory computer readable storage medium having computer program instructions to configure the one or more computer processors to perform operations comprising:
store data describing occurrences of an event involving an entity and the media hosting computer system;
store summary data that summarizes the data describing occurrences of the event involving the entity and the media hosting computer system;
calculate a probability of a value of the stored summary data being inaccurate based on an activity level of the entity with the media hosting computer system;
determine whether to verify the accuracy of the summary data based at least in part on the calculated probability exceeding a threshold; and
verify whether the value of the stored summary data is inaccurate with respect to the data describing occurrences of the event involving the entity and the media hosting computer system based on the determination.
17. The system of claim 16 , wherein the data is a count that describes a number of occurrences of the event.
18. The system of claim 17 , wherein the probability is calculated based on the count.
19. The system of claim 17 , wherein the probability is calculated based on the count and counts of other entities of the media hosting computer system of a same type as the count that describes the number of occurrences of the event.
20. The system of claim 16 , wherein the data summarizes master metadata generated from the occurrences of the event and verifying whether the value of the stored data is inaccurate comprises:
determining a correct value of the data based on the master metadata; and
responsive to the correct value being different than the value of the stored data, determining that the stored data is inaccurate.