Automated data authenticity validation
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for validating data authenticity. One of the methods includes retrieving data that includes (i) an archived version of a data source, (ii) a first hash value, and (iii) a set of provenance data for the archived version of the data source; hashing the archived version of the data source to generate a second hash value; determining that the second hash value and the first hash value satisfy a similarity criterion; detecting one or more differences between archived data in the archived version of the data source and current data in a current version of the data source; determining, using the set of provenance data, whether the archived version of the data source is likely authentic; and in response, restoring one or more portions of the data source corresponding to some of the one or more differences.
1 . A method comprising:
retrieving, from an archival database, data that includes (i) an archived version of a data source, (ii) a first hash value, and (iii) a set of provenance data for the archived version of the data source;
hashing the archived version of the data source to generate a second hash value;
determining that the second hash value and the first hash value satisfy a similarity criterion;
detecting one or more differences between archived data in the archived version of the data source and current data in a current version of the data source;
determining, using the set of provenance data for the archived version of the data source, whether the archived version of the data source is likely authentic; and
in response to determining that the second hash value and the first hash value satisfy the similarity criterion and that the archived version of the data source is likely authentic using the set of provenance data, restoring, from the archived version of the data source, one or more portions of the data source corresponding to some of the one or more differences.
2 . The method of claim 1 , wherein the provenance data represents one or more of (i) a source of the archived version of the data source, (ii) an operation performed on the archived version of the data source, (iii) a tool used to perform the operation on the archived version of the data source, or (iv) an indication of a result of the operation.
3 . The method of claim 2 , wherein determining, using the set of provenance data, whether the archived version of the data source is likely authentic comprises:
comparing an expected number of operations and results with a number of operations and results represented in the provenance data.
4 . The method of claim 2 , wherein determining, using the set of provenance data, whether the archived version of the data source is likely authentic comprises:
comparing an expected result of one or more operations with one or more results represented in the provenance data.
5 . The method of claim 4 , wherein the expected result of one or more operations is a result indicating operation success of the one or more operations, wherein the one or more operations are performed on the archived version of the data source.
6 . The method of claim 1 , wherein restoring the one or more portions of the data source comprises:
restoring one or more data objects used to detect the one or more differences between archived data in the archived version of the data source and current data in the current version of the data source.
7 . The method of claim 1 , comprising:
determining that a portion of the current version of the data source is likely corrupted or has been lost, wherein:
retrieving the archived version and detecting the one or more differences between the archived data in the archived version of the data source and the current data in the current version of the data source are responsive to determining that the portion of the current version of the data source is likely corrupted or has been lost.
8 . A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
retrieving, from an archival database, data that includes (i) an archived version of a data source, (ii) a first hash value, and (iii) a set of provenance data for the archived version of the data source;
hashing the archived version of the data source to generate a second hash value;
determining that the second hash value and the first hash value satisfy a similarity criterion;
detecting one or more differences between archived data in the archived version of the data source and current data in a current version of the data source;
determining, using the set of provenance data for the archived version of the data source, whether the archived version of the data source is likely authentic; and
in response to determining that the second hash value and the first hash value satisfy the similarity criterion and that the archived version of the data source is likely authentic using the set of provenance data, restoring, from the archived version of the data source, one or more portions of the data source corresponding to some of the one or more differences.
9 . The system of claim 8 , wherein the provenance data represents one or more of (i) a source of the archived version of the data source, (ii) an operation performed on the archived version of the data source, (iii) a tool used to perform the operation on the archived version of the data source, or (iv) an indication of a result of the operation.
10 . The system of claim 9 , wherein determining, using the set of provenance data, whether the archived version of the data source is likely authentic comprises:
comparing an expected number of operations and results with a number of operations and results represented in the provenance data.
11 . The system of claim 9 , wherein determining, using the set of provenance data, whether the archived version of the data source is likely authentic comprises:
comparing an expected result of one or more operations with one or more results represented in the provenance data.
12 . The system of claim 11 , wherein the expected result of one or more operations is a result indicating operation success of the one or more operations, wherein the one or more operations are performed on the archived version of the data source.
13 . The system of claim 8 , wherein restoring the one or more portions of the data source comprises:
restoring one or more data objects used to detect the one or more differences between archived data in the archived version of the data source and current data in the current version of the data source.
14 . The system of claim 8 , wherein the operations comprise:
determining that a portion of the current version of the data source is likely corrupted or has been lost, wherein:
retrieving the archived version and detecting the one or more differences between the archived data in the archived version of the data source and the current data in the current version of the data source are responsive to determining that the portion of the current version of the data source is likely corrupted or has been lost.
15 . One or more computer storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
retrieving, from an archival database, data that includes (i) an archived version of a data source, (ii) a first hash value, and (iii) a set of provenance data for the archived version of the data source;
hashing the archived version of the data source to generate a second hash value;
determining that the second hash value and the first hash value satisfy a similarity criterion;
detecting one or more differences between archived data in the archived version of the data source and current data in a current version of the data source;
determining, using the set of provenance data for the archived version of the data source, whether the archived version of the data source is likely authentic; and
in response to determining that the second hash value and the first hash value satisfy the similarity criterion and that the archived version of the data source is likely authentic using the set of provenance data, restoring, from the archived version of the data source, one or more portions of the data source corresponding to some of the one or more differences.
16 . The storage media of claim 15 , wherein the provenance data represents one or more of (i) a source of the archived version of the data source, (ii) an operation performed on the archived version of the data source, (iii) a tool used to perform the operation on the archived version of the data source, or (iv) an indication of a result of the operation.
17 . The storage media of claim 16 , wherein determining, using the set of provenance data, whether the archived version of the data source is likely authentic comprises:
comparing an expected number of operations and results with a number of operations and results represented in the provenance data.
18 . The storage media of claim 16 , wherein determining, using the set of provenance data, whether the archived version of the data source is likely authentic comprises:
comparing an expected result of one or more operations with one or more results represented in the provenance data.
19 . The storage media of claim 18 , wherein the expected result of one or more operations is a result indicating operation success of the one or more operations, wherein the one or more operations are performed on the archived version of the data source.
20 . The storage media of claim 15 , wherein restoring the one or more portions of the data source comprises:
restoring one or more data objects used to detect the one or more differences between archived data in the archived version of the data source and current data in the current version of the data source.