Method and system for data consistency across failure and recovery of infrastructure
A method and system for data consistency across failure and recovery of infrastructure. In one embodiment of the method, copies of first data blocks stored in a source memory are sent to a target site via a data link. While sending one or more of the copies of the first data blocks to the target site, source hashes for second data blocks stored in the source memory are calculated, wherein the first data blocks are distinct from the second data blocks. While sending one or more of the copies of the first data blocks to the target site, target hashes of data blocks stored in a target memory of the target site are received. While sending one or more of the copies of the first data blocks to the target site, the source hashes are compared with the target hashes, respectively. After sending the first data blocks to the target site via the data link, copies of only those second data blocks are sent to the target site with source hashes that do not compare equally with respective target hashes.
1. A method comprising:
receive a merged map with entries corresponding to respective data blocks in a target memory, the merged map including updated block information for an active map and a synchronization map that track data block activity in the target memory, wherein a positive indicator in either map results in a modified indicator for that respective data block;
set a variable to Z, wherein Z is an integer greater than one, and wherein Z represents a number of data blocks in the target memory;
determine whether an entry in the merged map corresponding to the variable is set to indicate a respective data block in the target memory has been modified; and
if the entry in the merged map corresponding to the variable is set to indicate that the respective data block in the target memory has been modified according to either the active map or the synchronization map in the target memory:
calculate a hash value for a data block corresponding to the variable in a source memory;
send the calculated hash value and the variable to a target site, wherein the target site comprises the target memory; and;
decrement the variable, wherein if the entry in the merged map corresponding to the variable indicates that the respective data block in the target memory has not been modified, the variable is decremented without calculating the hash value for the data block corresponding to the variable in the source memory.
2. The method of claim 1 further comprising:
determining whether an entry in the merged map corresponding to the decremented variable is set to indicate a data block in the target memory corresponding to the decremented variable is modified;
if the entry in the merged map corresponding to the decremented variable is set to indicate the data block in the target memory corresponding to the decremented variable is modified:
calculate a hash value for a data block corresponding to the decremented variable in the source memory;
send the calculated hash value for the data block corresponding to the decremented variable in the source memory and the decremented variable to the target site; and
decrement the decremented variable; and
if the entry in the merged map corresponding to the decremented variable is set to indicate that the data block corresponding to the decremented variable in the target memory is not modified, decrement the decremented variable without calculating the hash value for the data block corresponding to the decremented variable in the source memory.
3. The method of claim 1 :
wherein entries in the merged map are set to logical one to indicate when respective data blocks in the target memory are modified, and;
wherein entries in the merged map are set to logical zero to indicate when respective data blocks in the target memory are not modified.
4. The method of claim 1 :
wherein one entry in the merged map is set to indicate that a respective data block in the target memory is modified;
wherein another entry in the merged map is set to indicate that a respective data block in the target memory is not modified.
5. The method of claim 1 :
wherein the data blocks in the target memory are contiguous with each other
wherein the data blocks in the source memory are contiguous with each other.
6. The method of claim 1 further comprising replacing n data blocks in the source memory with the copies of n blocks, respectively, from the target memory.
7. The method of claim 6 wherein at least one of the n data blocks corresponds to an entry in the merged map that is set to indicate that its corresponding data block in the target memory is modified.
8. A non-transitory computer readable medium (CRM) comprising instructions that are executable on one or more processors to implement a method, the method comprising:
receiving a merged map with entries corresponding to respective data blocks in a target memory, the merged map including updated block information for an active map and a synchronization map that track data block activity in the target memory, wherein a positive indicator in either map results in a modified indicator for that respective data block;
setting a variable to Z, wherein Z is an integer greater than one, and wherein Z represents a number of data blocks in the target memory;
determining whether an entry in the merged map corresponding to the variable is set to indicate that a respective data block in the target memory is modified according to either the active map or the synchronization map in the target memory;
if the entry in the map corresponding to the variable is set to indicate the respective data block in the target memory is modified:
calculating a hash value for a data block corresponding to the variable in a source memory;
sending the calculated hash value and the variable to a target site, wherein the target site comprises the target memory, and
decrementing the variable, wherein if the entry in the merged map corresponding to the variable is set to indicate the respective data block in the target memory is not modified, the variable is decremented without calculating the hash value for the data block corresponding to the variable in the source memory.
9. The non-transitory CRM of claim 8 wherein the method further comprises:
determining whether an entry in the merged map corresponding to the decremented variable is set to indicate a data block in the target memory corresponding to the decremented variable is modified;
if the entry in the merged map corresponding to the decremented variable is set to indicate the data block in the target memory corresponding to the decremented variable is modified:
calculate a hash value for a data block corresponding to the decremented variable in the source memory;
send the calculated hash value for the data block corresponding to the decremented variable in the source memory and the decremented variable to the target site, and;
decrement the decremented variable;
if the entry in the merged map corresponding to the decremented variable is set to indicate that the data block corresponding to the decremented variable in the target memory is not modified, decrement the decremented variable without calculating the hash value for the data block corresponding to the decremented variable in the source memory.
10. The non-transitory CRM of claim 8 :
wherein entries in the merged map are set to logical one to indicate when respective data blocks in the target memory are modified, and;
wherein entries in the merged map are set to logical zero to indicate when respective data blocks in the target memory are not modified.
11. The non-transitory CRM of claim 8 :
wherein one entry in the merged map is set to indicate that a respective data block in the target memory is modified;
wherein another entry in the merged map is set to indicate that a respective data block in the target memory is not modified.
12. The non-transitory CRM of claim 8 :
wherein the data blocks in the target memory are contiguous with each other
wherein the data blocks in the source memory are contiguous with each other.
13. The non-transitory CRM of claim 8 wherein the method further comprises replacing n data blocks in the source memory with the copies of n blocks, respectively, from the target memory.
14. The method of claim 13 wherein at least one of the n data blocks corresponds to an entry in the merged map that is set to indicate that its corresponding data block in the target memory is modified.
15. A computer system comprising:
one or more processors;
a computer-readable storage medium coupled to the one or more processors; and
a plurality of instructions, encoded in the computer-readable storage medium, wherein a method is implemented in response to executing the instructions, the method comprising:
receiving a merged map with entries corresponding to respective data blocks in a target memory, the merged map including updated block information for an active map and a synchronization map that track data block activity in the target memory, wherein a positive indicator in either map results in a modified indicator for that respective data block;
setting a variable to Z, wherein Z is an integer greater than one, and wherein Z represents a number of data blocks in the target memory;
determining whether an entry in the merged map corresponding to the variable is set to indicate a respective data block in the target memory is modified; and
if the entry in the merged map corresponding to the variable is set to indicate that the respective data block in the target memory is modified according to either the active map or the synchronization map in the target memory:
calculating a hash value for a data block corresponding to the variable in a source memory;
sending the calculated hash value and the variable to a target site, wherein the target site comprises the target memory; and
decrementing the variable, wherein if the entry in the merged map corresponding to the variable is set to indicate the respective data block in the target memory is not modified, the variable is decremented without calculating the hash value for the data block corresponding to the variable in the source memory.
16. The computer system of claim 15 wherein the method further comprises:
determining whether an entry in the merged map corresponding to the decremented variable is set to indicate a data block in the target memory corresponding to the decremented variable is modified;
if the entry in the merged map corresponding to the decremented variable is set to indicate the data block in the target memory corresponding to the decremented variable is modified:
calculate a hash value for a data block corresponding to the decremented variable in the source memory;
send the calculated hash value for the data block corresponding to the decremented variable in the source memory and the decremented variable to the target site, and;
decrement the decremented variable;
if the entry in the merged map corresponding to the decremented variable is set to indicate that the data block corresponding to the decremented variable in the target memory is not modified, decrement the decremented variable without calculating the hash value for the data block corresponding to the decremented variable in the source memory.
17. The computer system of claim 15 wherein:
wherein entries in the merged map are set to logical one to indicate when respective data blocks in the target memory are modified, and;
wherein entries in the merged map are set to logical zero to indicate when respective data blocks in the target memory are not modified.
18. The computer system of claim 15 wherein:
wherein the data blocks in the target memory are contiguous with each other
wherein the data blocks in the source memory are contiguous with each other.
19. The computer system of claim 15 wherein the method further comprises replacing n data blocks in the source memory with the copies of n blocks, respectively, from the target memory.
20. The computer system of claim 19 wherein at least one of the n data blocks corresponds to an entry in the merged map that is set to indicate that its corresponding data block in the target memory is modified.