Verification of social media data
View Patent ↗Information verification includes: presenting, to a plurality of independent verifiers, a verification task associated with a social media item obtained from a social media-based platform, the verification task being associated with an expected result; receiving, from the plurality of independent verifiers, a plurality of responses in response to the verification task; determining, using one or more computer processors, a verification result based at least in part on the plurality of responses; determining whether there is a disagreement between the verification result and the expected result; and in the event that there is a disagreement between the verification result and the expected result, performing an action in response to the disagreement.
1. An information verification system, comprising:
one or more processors to:
present, to a plurality of independent verifiers, a verification task associated with a social media item obtained from a social media-based platform, the verification task being associated with an expected result;
receive, from the plurality of independent verifiers, a plurality of responses in response to the verification task;
determine a verification result based at least in part on the plurality of responses;
determine whether there is a disagreement between the verification result and the expected result; and
in the event that there is a disagreement between the verification result and the expected result, perform an action in response to the disagreement; and
one or more memories coupled to the one or more processors, to provide the one or more is processors with instructions.
2. The system of claim 1 , wherein the independent verifiers are humans.
3. The system of claim 1 , wherein the verification result is determined based at least in part on a majority of the plurality of responses.
4. The system of claim 1 , wherein presenting the verification task includes presenting a link associated with the social media item.
5. The system of claim 1 , wherein the verification task pertains to whether the social media item is still present on the social media-based platform.
6. The system of claim 1 , wherein the verification task pertains to a number of related actions associated with the social media item.
7. The system of claim 1 , wherein the action includes storing information about the disagreement.
8. The system of claim 1 , wherein the action includes reloading the social media item from its source.
9. The system of claim 1 , wherein:
the verification task is one of a plurality of verification tasks associated with a plurality of social media items, the plurality of verification tasks being associated with a respective plurality of expected results;
the verification result is one of a plurality of verification results associated with the plurality of verification tasks; and
the one or more processors are further to determine whether there is a statistically significant rate of disagreements with respect to the plurality of verification results and the plurality of expected results.
10. The system of claim 9 , wherein the one or more processors are further to:
determine a statistical model based at least in part on the disagreements with respect to the plurality of verification results and the respective plurality of expected results; and
is use the statistical model to determine when to execute a crawler to update the plurality of social media items.
11. A method of information verification, comprising:
presenting, to a plurality of independent verifiers, a verification task associated with a social media item obtained from a social media-based platform, the verification task being associated with an expected result;
receiving, from the plurality of independent verifiers, a plurality of responses in response to the verification task;
determining, using one or more computer processors, a verification result based at least in part on the plurality of responses;
determining whether there is a disagreement between the verification result and the expected result; and
in the event that there is a disagreement between the verification result and the expected result, performing an action in response to the disagreement.
12. The method of claim 11 , wherein the independent verifiers are humans.
13. The method of claim 11 , wherein the verification result is determined based at least in part on a majority of the plurality of responses.
14. The method of claim 11 , wherein presenting the verification task includes presenting a link associated with the social media item.
15. The method of claim 11 , wherein the verification task pertains to whether the social media item is still present on the social media-based platform.
16. The method of claim 11 , wherein the verification task pertains to a number of related actions associated with the social media item.
17. The method of claim 11 , wherein the action includes storing information about the disagreement.
18. The method of claim 11 , wherein the action includes reloading the social media item from its source.
19. The method of claim 11 , wherein:
the verification task is one of a plurality of verification tasks associated with a plurality of is social media items, the plurality of verification tasks being associated with a respective plurality of expected results;
the verification result is one of a plurality of verification results associated with the plurality of verification tasks; and
the method further comprises determining whether there is a statistically significant rate of disagreements with respect to the plurality of verification results and the plurality of expected results.
20. The method of claim 19 , further comprising:
determining a statistical model based at least in part on the disagreements with respect to the plurality of verification results and the respective plurality of expected results; and
using the statistical model to determine when to execute a crawler to update the plurality of social media items.
21. A computer program product for information verification, the computer program product being embodied in a tangible computer readable storage medium and comprising computer instructions for:
presenting, to a plurality of independent verifiers, a verification task associated with a social media item obtained from a social media-based platform, the verification task being associated with an expected result;
receiving, from the plurality of independent verifiers, a plurality of responses in response to the verification task;
determining, using one or more computer processors, a verification result based at least in part on the plurality of responses;
determining whether there is a disagreement between the verification result and the expected result; and
in the event that there is a disagreement between the verification result and the expected result, performing an action in response to the disagreement.