Techniques for maintaining snapshot data consistency during file system cross-region replication
Techniques are described for efficient replication and maintaining snapshot data consistency during file storage replication between file systems in different cloud infrastructure regions. In certain embodiments, snapshot creation and deletion requests that occur during cross-region replications may be temporarily withheld until appropriate times to execute such requests safely, depending on the timing relationship between such requests and cross-region replication cycles.
1. A method, comprising:
generating, by a computing system, a snapshot of a source file system in a source region;
performing, by the computing system, a first cross-region replication and a second cross-region replication between the source file system in the source region and a target file system in a target region, the source region and the target region being in different regions;
receiving, by the computing system, a snapshot deletion request in the source file system to delete the snapshot;
determining, by the computing system, a timing of the snapshot deletion request in the source file system;
performing, by the computing system, a first operation in accordance with the timing of the snapshot deletion request being determined to be during the first cross-region replication; and
performing, by the computing system, a second operation in accordance with the timing of the snapshot deletion request being determined to be between the first and the second cross-region replications.
2. The method of claim 1 , wherein the first operation comprises withholding the snapshot deletion request by the source file system until an end of the first cross-region replication.
3. The method of claim 2 , wherein withholding the snapshot deletion request comprises storing metadata information of the snapshot by the source file system in a database for communicating to the target file system.
4. The method of claim 2 , wherein withholding the snapshot deletion request comprises:
transferring the snapshot by the source file system to the target file system to complete the first cross-region replication; and
deleting the snapshot by the target file system at the end of the second cross-region replication.
5. The method of claim 1 , wherein the second operation comprises deleting the snapshot by the source file system without transferring the snapshot to the target file system.
6. The method of claim 1 , further comprising determining a second timing of generating the snapshot of the source file system.
7. The method of claim 6 , further comprising transferring the generated snapshot to the target file system during the second cross-region replication in accordance with the second timing of the snapshot generation being determined to be during the first cross-region replication and in accordance with the timing of the snapshot deletion request being determined to be after the second cross-region replication.
8. A non-transitory computer-readable medium storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
generating, by a computing system, a snapshot of a source file system in a source region;
performing, by the computing system, a first cross-region replication and a second cross-region replication between the source file system in the source region and a target file system in a target region, the source region and the target region being in different regions;
receiving, by the computing system, a snapshot deletion request in the source file system to delete the snapshot;
determining, by the computing system, a timing of the snapshot deletion request in the source file system;
performing, by the computing system, a first operation in accordance with the timing of the snapshot deletion request being determined to be during the first cross-region replication; and
performing, by the computing system, a second operation in accordance with the timing of the snapshot deletion request being determined to be between the first and the second cross-region replications.
9. The non-transitory computer-readable medium of claim 8 , wherein the first operation comprises withholding the snapshot deletion request by the source file system until an end of the first cross-region replication.
10. The non-transitory computer-readable medium of claim 9 , wherein withholding the snapshot deletion request comprises storing metadata information of the snapshot by the source file system in a database for communicating to the target file system.
11. The non-transitory computer-readable medium of claim 9 , wherein withholding the snapshot deletion request comprises:
transferring the snapshot by the source file system to the target file system to complete the first cross-region replication; and
deleting the snapshot by the target file system at the end of the second cross-region replication.
12. The non-transitory computer-readable medium of claim 8 , wherein the second operation comprises deleting the snapshot by the source file system without transferring the snapshot to the target file system.
13. The non-transitory computer-readable medium of claim 8 , the operations further comprising determining a second timing of generating the snapshot of the source file system.
14. The non-transitory computer-readable medium of claim 13 , the operations further comprising transferring the generated snapshot to the target file system during the second cross-region replication in accordance with the second timing of the snapshot generation being determined to be during the first cross-region replication and in accordance with the timing of the snapshot deletion request being determined to be after the second cross-region replication.
15. A system, comprising:
one or more processors; and
one or more computer readable media storing computer-executable instructions that, when executed by the one or more processors, cause the system to:
create a snapshot of a source file system in a source region;
perform a first cross-region replication and a second cross-region replication between the source file system in the source region and a target file system in a target region, the source region and the target region being in different regions;
receive a snapshot deletion request in the source file system to delete the snapshot;
determine a timing of the snapshot deletion request in the source file system;
perform a first operation in accordance with the timing of the snapshot deletion request being determined to be during the first cross-region replication; and
perform a second operation in accordance with the timing of the snapshot deletion request being determined to be between the first and the second cross-region replications.
16. The system of claim 15 , wherein the first operation comprises withholding the snapshot deletion request by the source file system until an end of the first cross-region replication.
17. The system of claim 16 , wherein withholding the snapshot deletion request comprises:
transferring the snapshot by the source file system to the target file system to complete the first cross-region replication; and
deleting the snapshot by the target file system at the end of the second cross-region replication.
18. The system of claim 15 , wherein the second operation comprises deleting the snapshot by the source file system without transferring the snapshot to the target file system.
19. The system of claim 15 , wherein the system is further caused to determine a second timing of generating the snapshot of the source file system.
20. The system of claim 19 , wherein the system is further caused to transfer the generated snapshot to the target file system during the second cross-region replication in accordance with the second timing of the snapshot generation being determined to be during the first cross-region replication and in accordance with the timing of the snapshot deletion request being determined to be after the second cross-region replication.