Method and apparatus for determining data duplication progress in real-time
To monitor data duplication progress, embodiments of the present disclosure relate to a method and apparatus for determining data duplication progress in real-time. The method comprises initiating a duplication of data from a source system to a destination system. The method further comprises determining first duplication progress for an initial stage of the duplication, original data existing on the source system when the duplication is initiated being duplicated in the initial stage. Furthermore, the method further comprises determining, independently from the initial stage, second duplication progress for a delta stage of the duplication, delta data being duplicated in the delta stage and including at least data generated during the initial stage. The present disclosure develops a fine-grained monitoring mechanism of data duplication progress.
1. A method of determining data duplication progress in real-time, comprising:
initiating a duplication of data from a source system to a destination system;
determining first duplication progress for an initial stage of the duplication, original data existing on the source system when the duplication is initiated being duplicated in the initial stage; and
determining, independently from the initial stage, second duplication progress for a delta stage of the duplication, delta data being duplicated in the delta stage and including at least data generated during the initial stage.
2. The method according to claim 1 , wherein determining the first duplication progress comprises:
in response to the duplication being initiated, storing a first number of inodes of the source system to be duplicated;
at a time during the initial stage, obtaining a second number of inodes of the destination system that have been duplicated; and
determining the first duplication progress at the time based on the first and second numbers.
3. The method according to claim 1 , wherein determining the second duplication progress comprises:
at a time during the delta stage, obtaining a third number of changed inodes of the source system;
at the time, obtaining a fourth number of inodes in the destination system that are duplicated successfully in the delta stage; and
determining the second duplication progress at the time based on the third and fourth numbers.
4. The method according to claim 3 , further comprising:
for an inode in the destination system that fails in the delta stage, reduplicating a corresponding inode of the source system.
5. The method according to claim 1 , wherein the delta data include data generated by accessing the source system by a client during the initial stage.
6. The method according to claim 5 , wherein the delta data further include data generated in the source system by accessing the destination system by a client during the delta stage.
7. The method according to claim 1 , wherein the source system is a first file system of a plurality of file systems on a source machine, the method further comprising:
determining duplication progress of the first file system based on the first duplication progress and the second duplication progress; and
determining duplication progress of data of the source machine based on the duplication progress of the first file system and duplication progress of data of other file systems of the plurality of file systems.
8. A device for determining data duplication progress in real-time, comprising:
at least one processing unit; and
at least one memory coupled to the at least one processing unit and storing instructions executable by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to perform acts including:
initiating a duplication of data from a source system to a destination system;
determining first duplication progress for an initial stage of the duplication, original data existing on the source system when the duplication is initiated being duplicated in the initial stage; and
determining, independently from the initial stage, second duplication progress for a delta stage of the duplication, delta data being duplicated in the delta stage and including at least data generated during the initial stage.
9. The device according to claim 8 , wherein determining the first duplication progress comprises:
in response to the duplication being started, storing a first number of inodes of the source system to be duplicated;
at a time during the initial stage, obtaining a second number of inodes of the destination system that have been duplicated; and
determining the first duplication progress at the time based on the first and second numbers.
10. The device according to claim 8 , wherein determining the second duplication progress comprises:
at a time during the delta stage, obtaining a third number of changed inodes of the source system;
at the time, obtaining a fourth number of inodes in the destination system that are duplicated successfully in the delta stage; and
determining the second duplication progress at the time based on the third and fourth numbers.
11. The device according to claim 10 , wherein the acts further include:
for an inode in the destination system that fails in the delta stage, reduplicating a corresponding inode of the source system.
12. The device according to claim 8 , wherein the delta data include data generated by accessing the source system by a client during the initial stage.
13. The device according to claim 12 , wherein the delta data further include data generated in the source system by accessing the destination system by a client during the delta stage.
14. The device according to claim 8 , wherein the source system is a first file system of a plurality of file systems on a source machine, the acts further including:
determining duplication progress of the first file system based on the first duplication progress and the second duplication progress; and
determining duplication progress of data of the source machine based on the duplication progress of the first file system and duplication progress of data of other file systems of the plurality of file systems.
15. A computer program product for determining data duplication progress in real-time, the computer program product comprising:
a non-transitory computer readable medium encoded with computer-executable program code, the code configured to enable the execution of:
initiating a duplication of data from a source system to a destination system;
determining first duplication progress for an initial stage of the duplication, original data existing on the source system when the duplication is initiated being duplicated in the initial stage; and
determining, independently from the initial stage, second duplication progress for a delta stage of the duplication, delta data being duplicated in the delta stage and including at least data generated during the initial stage.
16. The computer program product of claim 15 , wherein determining the first duplication progress comprises:
in response to the duplication being initiated, storing a first number of inodes of the source system to be duplicated;
at a time during the initial stage, obtaining a second number of inodes of the destination system that have been duplicated; and
determining the first duplication progress at the time based on the first and second numbers.
17. The computer program product of claim 15 , wherein determining the second duplication progress comprises:
at a time during the delta stage, obtaining a third number of changed inodes of the source system;
at the time, obtaining a fourth number of inodes in the destination system that are duplicated successfully in the delta stage; and
determining the second duplication progress at the time based on the third and fourth numbers.
18. The computer program product of claim 17 , wherein the code is further configured to enable the execution of:
for an inode in the destination system that fails in the delta stage, reduplicating a corresponding inode of the source system.
19. The computer program product of claim 15 , wherein the delta data include data generated by accessing the source system by a client during the initial stage.
20. The computer program product of claim 15 , wherein the delta data further include data generated in the source system by accessing the destination system by a client during the delta stage.