Data lineage based multi-data store recovery
Embodiments disclosed herein provide systems, methods, and computer readable media for data lineage based multi-data store recovery. In a particular embodiment, a method provides identifying first data in a first table of a plurality of tables stored in a plurality of data stores and restoring the first data to a first correct version of the first data in a prior version of the first table. The method further provides identifying a second table of the plurality of tables that descends from the first table and includes second descendent data that stems from the first data. The method also provides restoring the second descendent data to a second correct version of the second descendent data in a prior version of the second table.
1 . A method, comprising:
identifying that a first version of a first table of a plurality of tables comprises a corrupt version of first data;
identifying a prior version of the first table that comprises a correct version of the first data;
restoring the first data using the correct version of the first data from the prior version of the first table;
identifying a second table that descends from the first table, the second table including second data that is based at least in part on the corrupt version of the first data;
identifying, for the second table, a prior version of the second table that comprises a correct version of the second data that is based at least in part on the correct version of the first data; and
restoring the second data using the correct version of the second data from the identified prior version of the second table.
2 . The method of claim 1 , wherein restoring the first data using the correct version of the first data comprises:
replacing, within the first table, the corrupt version of the first data with the correct version of the first data while maintaining uncorrupted data included in the first table.
3 . The method of claim 1 , wherein identifying the second table that descends from the first table comprises:
analyzing data lineage for the plurality of tables that comprises the first table and the second table.
4 . The method of claim 1 , further comprising:
identifying a third table that descends from the first table, the third table including third data that is based at least in part on the corrupt version of the first data; and
identifying, for the third table, a prior version of the third table that comprises a correct version of the third data that is based at least in part on the correct version of the first data, wherein the identified prior version of the third table and the identified prior version of the second table are associated with different propagation times for the corrupt version of the first data.
5 . The method of claim 4 , wherein, in accordance with the identified prior version of the third table and the identified prior version of the second table being associated with different propagation times for the corrupt version of the first data, the identified prior version of the third table and the identified prior version of the second table are associated with different timestamps.
6 . The method of claim 1 , wherein:
identifying the prior version of the first table that comprises the correct version of the first data comprises identifying a most recent version of the first table that comprises the correct version of the first data; and
identifying the prior version of the second table that comprises the correct version of the second data comprises identifying a most recent version of the second table that comprises the correct version of the second data.
7 . The method of claim 1 , wherein identifying the second table is responsive to identifying that the first table of the plurality of tables comprises the corrupt version of the first data.
8 . The method of claim 1 , wherein identifying the prior version of the second table that comprises the correct version of the second data is based on an association between the identified prior version of the second table and the identified prior version of the first table that comprises the correct version of the first data.
9 . A system, comprising:
one or more non-transitory computer readable storage media storing processor-executable instructions; and
one or more processors coupled with the one or more non-transitory computer readable storage media, the one or more processors individually or collectively operable to execute the instructions to cause the system to:
identify that a first version of a first table of a plurality of tables comprises a corrupt version of first data;
identify a prior version of the first table that comprises a correct version of the first data;
restore the first data using the correct version of the first data from the prior version of the first table;
identify a second table that descends from the first table, the second table including second data that is based at least in part on the corrupt version of the first data;
identify, for the second table, a prior version of the second table that comprises a correct version of the second data that is based at least in part on the correct version of the first data; and
restore the second data using the correct version of the second data from the identified prior version of the second table.
10 . The system of claim 9 , wherein, to restore the first data using the correct version of the first data, the one or more processors are individually or collectively operable to execute the instructions to cause the system to:
replace, within the first table, the corrupt version of the first data with the correct version of the first data while maintaining uncorrupted data included in the first table.
11 . The system of claim 9 , wherein, to identify the second table that descends from the first table, the one or more processors are individually or collectively operable to execute the instructions to cause the system to:
analyze data lineage for the plurality of tables that comprises the first table and the second table.
12 . The system of claim 9 , wherein the one or more processors are individually or collectively further operable to execute the instructions to cause the system to:
identify a third table that descends from the first table, the third table including third data that is based at least in part on the corrupt version of the first data; and
identify, for the third table, a prior version of the third table that comprises a correct version of the third data that is based at least in part on the correct version of the first data, wherein the identified prior version of the third table and the identified prior version of the second table are associated with different propagation times for the corrupt version of the first data.
13 . The system of claim 12 , wherein, in accordance with the identified prior version of the third table and the identified prior version of the second table being associated with different propagation times for the corrupt version of the first data, the identified prior version of the third table and the identified prior version of the second table are associated with different timestamps.
14 . The system of claim 9 , wherein:
to identify the prior version of the first table that comprises the correct version of the first data, the one or more processors are individually or collectively operable to execute the instructions to cause the system to identify a most recent version of the first table that comprises the correct version of the first data; and
to identify the prior version of the second table that comprises the correct version of the second data, the one or more processors are individually or collectively operable to execute the instructions to cause the system to identify a most recent version of the second table that comprises the correct version of the second data.
15 . The system of claim 9 , wherein the one or more processors are individually or collectively operable to execute the instructions to cause the system to identify the second table responsive to identifying that the first table of the plurality of tables comprises the corrupt version of the first data.
16 . A non-transitory computer readable storage medium, comprising instructions executable by one or more hardware-implemented processors to cause a system to:
identify that a first version of a first table of a plurality of tables comprises a corrupt version of first data;
identify a prior version of the first table that comprises a correct version of the first data;
restore the first data using the correct version of the first data from the prior version of the first table;
identify a second table that descends from the first table, the second table including second data that is based at least in part on the corrupt version of the first data;
identify, for the second table, a prior version of the second table that comprises a correct version of the second data that is based at least in part on the correct version of the first data; and
restore the second data using the correct version of the second data from the identified prior version of the second table.
17 . The non-transitory computer readable storage medium of claim 16 , wherein, to restore the first data using the correct version of the first data, the instructions are executable by the one or more hardware-implemented processors to cause the system to:
replace, within the first table, the corrupt version of the first data with the correct version of the first data while maintaining uncorrupted data included in the first table.
18 . The non-transitory computer readable storage medium of claim 16 , wherein, to identify the second table that descends from the first table, the instructions are executable by the one or more hardware-implemented processors to cause the system to:
analyze data lineage for the plurality of tables that comprises the first table and the second table.
19 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions are further executable by the one or more hardware-implemented processors to cause the system to:
identify a third table that descends from the first table, the third table including third data that is based at least in part on the corrupt version of the first data; and
identify, for the third table, a prior version of the third table that comprises a correct version of the third data that is based at least in part on the correct version of the first data, wherein the identified prior version of the third table and the identified prior version of the second table are associated with different propagation times for the corrupt version of the first data.
20 . The non-transitory computer readable storage medium of claim 19 , wherein, based at least in part on the identified prior version of the third table and the identified prior version of the second table being associated with different propagation times for the corrupt version of the first data, the identified prior version of the third table and the identified prior version of the second table are associated with different timestamps.