Methods and systems to reduce latency of input/output (I/O) operations based on file system optimizations during creation of common snapshots for synchronous replicated datasets of a primary copy of data at a primary storage system to a mirror copy of the data at a cross-site secondary storage system
Multi-site distributed storage systems and computer-implemented methods are described for improving a resumption time of input/output (I/O) operations during a common snapshot process for storage objects. A computer-implemented method comprises performing a baseline transfer from at least one storage object of a first storage node to at least one replicated storage object of a second storage node, starting the common snapshot process including stop processing of I/O operations, performing a snapshot create operation on the primary storage site for the at least one storage object of the first storage node, resuming processing of I/O operations, and assigning a new universal unique identifier (UUID) to the at least one storage object of the second storage node after resuming processing of I/O operations with the new UUID to identify when file system contents are different than the baseline transfer.
1. A computer-implemented method performed by one or more processing resources of a multi-site distributed storage system with a primary storage site having a first storage node and a secondary storage site having a second storage node, the computer-implemented method comprising:
performing a baseline transfer from the at least one storage object of the first storage node to at least one storage object of the second storage node;
starting a common snapshot process including initiating hold state for the primary storage site to stop processing of input/output (I/O) operations during a time window; and
assigning a new identifier to the at least one storage object of the second storage node after resuming processing of I/O operations to reduce a resumption time of processing of input/output (I/O) operations during the common snapshot process with the new identifier to identify when active file system (AFS) contents are different than the baseline transfer for synchronous replication between the primary storage site and the secondary storage site.
2. The computer-implemented method of claim 1 , wherein assigning the new identifier occurs during a delete workflow to remove the synchronous replication relationship for the at least one storage object of the first storage node and the at least one storage object of the second storage node and guarantees that any subsequent update for an asynchronous replication relationship or resync transfer will detect a file system inconsistency between the baseline transfer between the primary storage site and the secondary storage site and the AFS contents.
3. The computer-implemented method of claim 2 , further comprising:
converting from the synchronous replication relationship to an asynchronous relationship from the at least one storage object of the first storage node to the at least one storage object of the second storage node; and
initiating an asynchronous resynchronous workflow from the at least one storage object of the first storage node to the at least one storage object of the second storage node.
4. The computer-implemented method of claim 3 , further comprising:
detecting AFS divergence post the common snapshot process when AFS contents are different than the baseline transfer;
performing a restore operation to remove file system inconsistencies due to the AFS divergence; and
performing asynchronous transfers from the at least one storage object of the first storage node to the at least one storage object of the second storage node.
5. The computer-implemented method of claim 1 , wherein the new identifier can be a multibit value to uniquely identify the storage object.
6. The computer-implemented method of claim 1 , further comprising:
establishing a synchronous replication relationship between the at least one storage object of the first storage node of the primary storage site and the at least one storage object of the second storage node of the secondary storage site;
performing a snapshot create operation on the primary storage site for the at least one storage object of the first storage node and sending the snapshot create operation to the secondary storage site to be performed on the at least one storage object of the second storage node of the secondary storage site; and
resuming processing of I/O operations and ending the hold state for the primary storage site.
7. A distributed storage system having a primary storage site with a first storage node and a secondary storage site with a second storage node comprising:
one or more processing resources; and
a non-transitory computer-readable medium coupled to the one or more processing resources, having stored therein instructions, which when executed by the one or more processing resources cause the one or more processing resources to:
perform a baseline data transfer from a first storage object of the first storage node to a second storage object of the second storage node including a baseline transfer that creates a snapshot copy of the first storage object and transfers the snapshot copy to the second storage object; and
add a transient tag to a snapshot tag meta file for the first storage object of the first storage node to grow the snapshot tag meta file during a synchronous replication process before fencing input/output (I/O) operations for the first storage object and the second storage object during a snapshot create request.
8. The distributed storage system of claim 7 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
initiate the synchronous replication process for a file system including starting a synchronous data replication for replicating data from the first storage object of the first storage node of the first storage site to the second storage object of the second storage node of the second storage site;
perform, the snapshot create request with aggregate affinity and thus fully utilize multithreading of the one or more processing resources in the file system.
9. The distributed storage system of claim 7 , wherein adding the transient tag to a snapshot tag meta file for the first storage object of the first storage node and optionally also for the second storage object of the second storage node during the synchronous replication process before fencing I/O operations moves serial operations in the file system out of a client I/O hold window.
10. The distributed storage system of claim 7 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
set a sync replication bit for the first storage object of the first storage node and also for the second storage object.
11. The distributed storage system of claim 7 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
remove the transient tag from the snapshot tag meta file if a common snapshot for the snapshot create request occurs during a configurable time period such that the common snapshot is available for a subsequent resync operation.
12. The distributed storage system of claim 7 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
store the transient tag in the snapshot tag meta file if a common snapshot for the snapshot create request did not occur during a configurable time period.
13. The distributed storage system of claim 7 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
establish an insync state to indicate a synchronous replication for a data replication relationship between the first storage object and the second storage object.
14. A non-transitory computer-readable storage medium embodying a set of instructions, which when executed by one or more processing resources cause the one or more processing resources to:
perform a baseline data transfer from a first storage object of a first storage node of a first storage site to a second storage object of a second storage node of a second storage site including a baseline transfer that creates a snapshot copy of the first storage object and transfers the snapshot copy to the second storage object; and
add a transient tag to a snapshot tag meta file for the first storage object of the first storage node to grow the snapshot tag meta file during a synchronous replication process before fencing input/output (I/O) operations for the first storage object and the second storage object during a snapshot create request.
15. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
initiate the synchronous replication process for a file system including starting a synchronous data replication for replicating data from the first storage object of the first storage node of the first storage site to the second storage object of the second storage node of the second storage site; and
perform, the snapshot create request with aggregate affinity and thus fully utilize multithreading of the one or more processing resources in the file system.
16. The non-transitory computer-readable storage medium of claim 14 , wherein adding the transient tag to a snapshot tag meta file for the first storage object of the first storage node and optionally also for the second storage object of the second storage node during the synchronous replication process before fencing I/O operations moves serial operations in the file system out of a client I/O hold window.
17. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
set a sync replication bit for the first storage object of the first storage node and also for the second storage object.
18. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
remove the transient tag from the snapshot tag meta file if a common snapshot for the snapshot create request occurs during a configurable time period such that the common snapshot is available for a subsequent resync operation.
19. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
store the transient tag in the snapshot tag meta file if a common snapshot for the snapshot create request did not occur during a configurable time period.
20. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions when executed by the one or more processing resources cause the one or more processing resources to:
establish an insync state to indicate a synchronous replication for a data replication relationship between the first storage object and the second storage object.