Systems and methods for monitoring data synchronization progress in a multi-hop data recovery system
The disclosed computer-implemented method for monitoring data synchronization progress in a multi-hop data recovery system may include (i) calculating a number of data blocks to be synchronized, (ii) setting each element of a synchronization data structure to dirty, (iii) determining a dirty bytes counter, (iv) transmitting a portion of the data blocks to be synchronized, (v) receiving an acknowledgement corresponding to the transmitted portion of the data blocks, (vi) setting a set of elements within the synchronization data structure corresponding to the transmitted portion of the data blocks to clean, (vii) determining a pending dirty bytes counter that indicates a current number of elements within the synchronization data structure that are set to dirty, and (viii) transmitting the dirty bytes counter and the pending dirty bytes counter. Various other methods, systems, and computer-readable media are also disclosed.
1. A computer-implemented method for monitoring data synchronization progress in a multi-hop data recovery system, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:
calculating, by a computing device, a number of data blocks to be synchronized;
setting each element of a synchronization data structure to dirty;
determining a dirty bytes counter, wherein the dirty bytes counter indicates a number of elements of the synchronization data structure that are set to dirty;
transmitting a portion of the data blocks to be synchronized;
receiving an acknowledgement corresponding to the transmitted portion of the data blocks;
setting a set of bits of the synchronization data structure corresponding to the transmitted portion of the data blocks to clean;
determining a pending dirty bytes counter, wherein the pending dirty bytes counter indicates a current number of elements of the synchronization data structure that are set to dirty; and
transmitting the dirty bytes counter and the pending dirty bytes counter.
2. The computer-implemented method of claim 1 , further comprising:
receiving an indication to initiate a full synchronization of data.
3. The computer-implemented method of claim 1 , further comprising:
merging the synchronization data structure and an active data structure, wherein the active data structure corresponds to new data blocks from an application of the computing device.
4. The computer-implemented method of claim 1 , further comprising:
receiving, by a gateway, the dirty bytes counter, the pending dirty bytes counter, and a synchronization start time.
5. The computer-implemented method of claim 4 , further comprising:
calculating an estimated time of arrival (ETA) of the data blocks to be synchronized using the dirty bytes counter, the pending dirty bytes counter, and the synchronization start time.
6. The computer-implemented method of claim 4 , further comprising:
calculating a synchronization progress of the data blocks to be synchronized using the dirty bytes counter and the pending dirty bytes counter.
7. The computer-implemented method of claim 1 , further comprising:
transmitting another portion of the data blocks to be synchronized;
receiving another acknowledgement corresponding to the other portion of the data blocks;
setting another set of elements of the synchronization data structure corresponding to the other portion of the data blocks to clean;
updating the pending dirty bytes counter to an updated number of elements of the synchronization data structure set to dirty based on the other portion of the data blocks; and
transmitting the dirty bytes counter and the pending dirty bytes counter.
8. A system for monitoring data synchronization progress in a multi-hop data recovery system, the system comprising:
a computing device comprising at least one physical processor; and
physical memory comprising computer-executable instructions that, when executed by the at least one physical processor, cause the computing device to:
calculate a number of data blocks to be synchronized;
set each element of a synchronization data structure to dirty;
determine a dirty bytes counter, wherein the dirty bytes counter indicates a number of elements of the synchronization data structure that are set to dirty;
transmit a portion of the data blocks to be synchronized;
receive an acknowledgement corresponding to the transmitted portion of the data blocks;
set a set of elements of the synchronization data structure corresponding to the transmitted portion of the data blocks to clean;
determine a pending dirty bytes counter, wherein the pending dirty bytes counter indicates a current number of elements of the synchronization data structure that are set to dirty; and
transmit the dirty bytes counter and the pending dirty bytes counter.
9. The system of claim 8 , wherein the computer-executable instructions further cause the computing device to:
receive an indication to initiate a full synchronization of data.
10. The system of claim 8 , wherein the computer-executable instructions further cause the computing device to:
merge the synchronization data structure and an active data structure, wherein the active data structure corresponds to new data blocks from an application of the computing device.
11. The system of claim 8 , wherein the computer-executable instructions further cause the computing device to:
receive, by a gateway, the dirty bytes counter, the pending dirty bytes counter, and a synchronization start time.
12. The system of claim 11 , wherein the computer-executable instructions further cause the computing device to:
calculate an estimated time of arrival (ETA) of the data blocks to be synchronized using the dirty bytes counter, the pending dirty bytes counter, and the synchronization start time.
13. The system of claim 11 , wherein the computer-executable instructions further cause the computing device to:
calculate a synchronization progress of the data blocks to be synchronized using the dirty bytes counter and the pending dirty bytes counter.
14. The system of claim 8 , wherein the computer-executable instructions further cause the computing device to:
transmit another portion of the data blocks to be synchronized;
receive another acknowledgement corresponding to the other portion of the data blocks;
set another set of elements of the synchronization data structure corresponding to the other portion of the data blocks to clean;
update the pending dirty bytes counter to an updated number of elements of the synchronization data structure set to dirty based on the other portion of the data blocks; and
transmit the dirty bytes counter and the pending dirty bytes counter.
15. A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
calculate a number of data blocks to be synchronized;
set each element of a synchronization data structure to dirty;
determine a dirty bytes counter, wherein the dirty bytes counter indicates a number of elements within the synchronization data structure that are set to dirty;
transmit a portion of the data blocks to be synchronized;
receive an acknowledgement corresponding to the transmitted portion of the data blocks;
set a set of elements of the synchronization data structure corresponding to the transmitted portion of the data blocks to clean;
determine a pending dirty bytes counter, wherein the pending dirty bytes counter indicates a current number of elements within the synchronization data structure that are set to dirty; and
transmit the dirty bytes counter and the pending dirty bytes counter.
16. The non-transitory computer-readable medium of claim 15 , wherein the computer-executable instructions further cause the computing device to:
receive an indication to initiate a full synchronization of data.
17. The non-transitory computer-readable medium of claim 15 , wherein the computer-executable instructions further cause the computing device to:
merge the synchronization data structure and an active data structure, wherein the active data structure corresponds to new data blocks from an application of the computing device.
18. The non-transitory computer-readable medium of claim 15 , wherein the computer-executable instructions further cause the computing device to:
receive, by a gateway, the dirty bytes counter, the pending dirty bytes counter, and a synchronization start time.
19. The non-transitory computer-readable medium of claim 18 , wherein the computer-executable instructions further cause the computing device to:
calculate an estimated time of arrival (ETA) of the data blocks to be synchronized using the dirty bytes counter, the pending dirty bytes counter, and the synchronization start time.
20. The non-transitory computer-readable medium of claim 18 , wherein the computer-executable instructions further cause the computing device to:
calculate a synchronization progress of the data blocks to be synchronized using the dirty bytes counter and the pending dirty bytes counter.