Automatic verification of asynchronously replicated data
An apparatus in one embodiment comprises a storage system having a plurality of storage devices. The storage system is associated with a target site and configured to participate in a cycle-based asynchronous replication process with a storage system of a source site. The storage system of the target site is configured to receive from the storage system of the source site, in respective ones of a plurality of cycles of the cycle-based asynchronous replication process, corresponding sets of differential data representing respective deltas between pairs of source site snapshots for respective pairs of the cycles. The storage system of the target site utilizes the sets of differential data received in the respective ones of the cycles to update respective target site snapshots for those cycles. Over multiple cycles, the storage system of the target site verifies that respective different portions of designated target site and source site snapshots are equivalent.
1. An apparatus comprising:
a storage system comprising a plurality of storage devices;
the storage system being associated with a target site;
the storage system being configured to participate in a cycle-based asynchronous replication process with a storage system of a source site;
the storage system of the target site being further configured:
to receive from the storage system of the source site, in respective ones of a plurality of cycles of the cycle-based asynchronous replication process, corresponding sets of differential data representing respective deltas between pairs of source site snapshots for respective pairs of the cycles;
to utilize the sets of differential data received in the respective ones of the cycles to update respective target site snapshots for those cycles; and
over multiple ones of the cycles, to generate target site signatures for respective different portions of a designated one of the updated target site snapshots, to receive from the storage system of the source site corresponding source site signatures for respective different portions of a designated one of the source site snapshots, and to compare the target site and source site signatures in order to verify that the designated target site and source site snapshots are equivalent;
the verification of equivalence of the designated target site and source site snapshots thereby being spread over the multiple cycles with pairs of target site and source site signatures for the different portions of those snapshots being compared in respective ones of the multiple cycles;
wherein the different portions of the designated target site and source site snapshots have respective sizes determined as a function of a number of cycles of the cycle-based asynchronous replication process available for completion of the verification of equivalence of the designated target site and source site snapshots.
2. The apparatus of claim 1 wherein the target site and source site signatures comprise at least one of a checksum and a hash of corresponding portions of the designated target site and source site snapshots.
3. The apparatus of claim 1 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles comprise respective percentages of the designated target site and source site snapshots.
4. The apparatus of claim 3 wherein different percentages of the designated target site and source site snapshots are utilized in different ones of the multiple cycles.
5. The apparatus of claim 3 wherein a fixed percentage of the designated target site and source site snapshots is utilized in each of the multiple cycles.
6. The apparatus of claim 5 wherein the target site and source site signatures for different n percent portions of the designated target site and source site snapshots are verified in each of 100/n of the cycles.
7. The apparatus of claim 1 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles are determined at least in part based on a number n of the cycles of the cycle-based asynchronous replication process that are expected to be executed within a given time period.
8. The apparatus of claim 7 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles are determined by first determining n for the given time period and then computing 100/n to determine a percentage of the designated target site and source site snapshots to be verified in each of the n cycles.
9. The apparatus of claim 1 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles are dynamically adapted over time in order to control a lag time between initiation of transfer of a given one of the sets of differential data by the storage system of the source site and update of the corresponding target site snapshot by the storage system of the target site.
10. The apparatus of claim 1 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles are dynamically adapted over time by:
for a current one of the multiple cycles, calculating a verification rate as a function of a time elapsed for verification of a given one of the portions in a previous one of the multiple cycles;
calculating an amount of time remaining in a recover point objective period for the current cycle; and
multiplying the verification rate by the amount of time remaining in the recover point objective period for the current cycle to determine a particular portion of the designated target site and source site snapshots to be verified in the current cycle.
11. The apparatus of claim 10 wherein if the particular portion determined by multiplying the verification rate by the amount of time remaining in the recover point objective period for the current cycle is less than a specified minimum portion, the minimum portion is verified in the current cycle.
12. The apparatus of claim 1 wherein the storage systems of the target and source sites comprise respective content addressable storage systems having respective sets of non-volatile memory storage devices.
13. The apparatus of claim 1 wherein the storage systems of the target and source sites comprise respective clustered storage systems having respective sets of storage nodes each having a plurality of storage devices.
14. The apparatus of claim 1 wherein target site comprises a disaster recovery site data center and the source site comprises a production site data center.
15. A method comprising:
configuring a storage system of a target site to participate in a cycle-based asynchronous replication process with a storage system of a source site; and
in conjunction with performance of the cycle-based asynchronous replication process, the storage system of the target site:
receiving from the storage system of the source site, in respective ones of a plurality of cycles of the cycle-based asynchronous replication process, corresponding sets of differential data representing respective deltas between pairs of source site snapshots for respective pairs of the cycles;
utilizing the sets of differential data received in the respective ones of the cycles to update respective target site snapshots for those cycles; and
over multiple ones of the cycles, generating target site signatures for respective different portions of a designated one of the updated target site snapshots, receiving from the storage system of the source site corresponding source site signatures for respective different portions of a designated one of the source site snapshots, and comparing the target site and source site signatures in order to verify that the designated target site and source site snapshots are equivalent;
the verification of equivalence of the designated target site and source site snapshots thereby being spread over the multiple cycles with pairs of target site and source site signatures for the different portions of those snapshots being compared in respective ones of the multiple cycles;
wherein the different portions of the designated target site and source site snapshots have respective sizes determined as a function of a number of cycles of the cycle-based asynchronous replication process available for completion of the verification of equivalence of the designated target site and source site snapshots; and
wherein the method is implemented by at least one processing device comprising a processor coupled to a memory.
16. The method of claim 15 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles comprise respective percentages of the designated target site and source site snapshots.
17. The method of claim 15 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles are dynamically adapted over time in order to control a lag time between initiation of transfer of a given one of the sets of differential data by the storage system of the source site and update of the corresponding target site snapshot by the storage system of the target site.
18. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device of a storage system of a target site causes said storage system of the target site:
to participate in a cycle-based asynchronous replication process with a storage system of a source site; and
in conjunction with performance of the cycle-based asynchronous replication process:
to receive from the storage system of the source site, in respective ones of a plurality of cycles of the cycle-based asynchronous replication process, corresponding sets of differential data representing respective deltas between pairs of source site snapshots for respective pairs of the cycles;
to utilize the sets of differential data received in the respective ones of the cycles to update respective target site snapshots for those cycles; and
over multiple ones of the cycles, to generate target site signatures for respective different portions of a designated one of the updated target site snapshots, to receive from the storage system of the source site corresponding source site signatures for respective different portions of a designated one of the source site snapshots, and to compare the target site and source site signatures in order to verify that the designated target site and source site snapshots are equivalent;
the verification of equivalence of the designated target site and source site snapshots thereby being spread over the multiple cycles with pairs of target site and source site signatures for the different portions of those snapshots being compared in respective ones of the multiple cycles;
wherein the different portions of the designated target site and source site snapshots have respective sizes determined as a function of a number of cycles of the cycle-based asynchronous replication process available for completion of the verification of equivalence of the designated target site and source site snapshots.
19. The computer program product of claim 18 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles comprise respective percentages of the designated target site and source site snapshots.
20. The computer program product of claim 18 wherein the different portions of the designated target site and source site snapshots for which the verification of equivalence is spread over the multiple cycles are dynamically adapted over time in order to control a lag time between initiation of transfer of a given one of the sets of differential data by the storage system of the source site and update of the corresponding target site snapshot by the storage system of the target site.