System and method for efficient block level granular replication
A system and method for efficiently restoring one or more data containers is provided. A common persistent consistency point image (PCPI) is identified between a source and a destination storage systems prior to the destination storage system performing a rollback operation to the commonly identified PCPI. Differential data is then transmitted from the source storage system in a line efficient manner to the destination storage system.
1 . A method comprising:
detecting that a subset of containers of a first file system of a first device comprise inconsistent data;
suspending operations directed to the subset of containers;
modifying the first file system so that content of the subset of containers matches content of a common image, wherein the modifying rolls back a state of a container within the first file system to a point in time of the container captured by the common image;
overwriting the content of the subset of containers with a content difference transferred from an active file system of a second device and corresponding to a difference between content of the common image and content of the active file system, wherein only changed blocks or references to the changed blocks of a container of the subset of containers are transferred if the container exists within the common image, wherein the content difference is identified as changes to the active file system by clients not captured by the common image, and wherein the overwriting comprises:
in response to determining that the content difference comprises multiple instances of a block of data referenced by multiple files, transferring a single instance of the block of data from the second device to the first device for overwriting the content of the subset of containers, wherein a reference for the block is transmitted instead of the single instance of the block based upon the block being shared with the common image; and
unsuspending and processing the operations directed to the subset of containers.
2 . The method of claim 1 , comprising:
enabling restart of a transfer of the content difference, from the second device to the first device, from a point corresponding to a last completed portion of the content difference being transferred.
3 . The method of claim 1 , comprising:
preserving a set of logical unit number identifiers prior to creating a rollback image on the first device before.
4 . The method of claim 3 , comprising:
restoring the set of logical unit identifiers after the content difference has been received from the second device.
5 . The method of claim 1 , wherein a suspended read operation is unsuspended and processed.
6 . The method of claim 1 , wherein the common image was created prior to the subset of containers becoming corrupted and corresponds to a common time of instantiation of the first file system and the active file system.
7 . The method of claim 1 , comprising:
processing a write operation directed to a first container within the first file system based upon the first container not being within the subset of containers.
8 . The method of claim 1 , wherein compression of the content difference, received from the second device, is retained.
9 . The method of claim 1 , wherein data deduplication of the content difference, received from the second device, is maintained.
10 . A computing device comprising:
a memory comprising machine executable code; and
a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to:
detect that a subset of containers of a first file system of a first device comprise inconsistent data;
suspend operations directed to the subset of containers;
modify the first file system so that content of the subset of containers matches content of a common image, wherein the modifying rolls back a state of a container within the first file system to a point in time of the container captured by the common image;
overwrite the content of the subset of containers with a content difference transferred from an active file system of a second device and corresponding to a difference between content of the common image and content of the active file system, wherein only changed blocks or references to the changed blocks of a container of the subset of containers are transferred if the container exists within the common image, wherein the content difference is identified as changes to the active file system by clients not captured by the common image, and wherein the overwriting comprises:
in response to determining that the content difference comprises multiple instances of a block of data referenced by multiple files, transfer a single instance of the block of data from the second device to the first device for overwriting the content of the subset of containers, wherein a reference for the block is transmitted instead of the single instance of the block based upon the block being shared with the common image; and
unsuspended and process the operations directed to the subset of containers.
11 . The computing device of claim 10 , wherein the subset of containers comprises a first file, and wherein the machine executable code causes the processor to deny access to the first file and allow access to other files and luns within the first file system.
12 . The computing device of claim 10 , wherein the machine executable code causes the processor to process requests directed to data of the first file system other than the subset of containers.
13 . The computing device of claim 10 , wherein the content difference comprises changes between a second subset of containers of the active file system and the common image.
14 . The computing device of claim 13 , wherein the content difference comprises an identifier of a first block of data existing in the common image.
15 . The computing device of claim 13 , wherein the content difference comprises an identifier of a first block of data previously transmitted from the second device to the first device.
16 . The computing device of claim 10 , wherein the machine executable code causes the processor to store a set of lun identifiers prior to creating a rollback image on the first device.
17 . The computing device of claim 16 , wherein the machine executable code causes the processor to restore the set of lun identifiers after the content difference has been received.
18 . The computing device of claim 10 , wherein compression of the content difference, received from the second device, is retained.
19 . The computing device of claim 10 , wherein data deduplication of the content difference, received from the second device, is maintained.
20 . A non-transitory computer readable medium comprising program instructions, which when executed by a processor, causes the processor to:
detect that a subset of containers of a first file system of a first device comprise inconsistent data;
suspend operations directed to the subset of containers;
modify the first file system so that content of the subset of containers matches content of a common image, wherein the modifying rolls back a state of a container within the first file system to a point in time of the container captured by the common image;
overwrite the content of the subset of containers with a content difference transferred from an active file system of a second device and corresponding to a difference between content of the common image and content of the active file system, wherein the content difference is identified as changes to the active file system by clients not captured by the common image, wherein only changed blocks or references to the changed blocks of a container of the subset of containers are transferred if the container exists within the common image, and wherein the overwriting comprises:
in response to determining that the content difference comprises multiple instances of a block of data referenced by multiple files, transfer a single instance of the block of data from the second device to the first device for overwriting the content of the subset of containers, wherein a reference for the block is transmitted instead of the single instance of the block based upon the block being shared with the common image; and
unsuspended and process the operations directed to the subset of containers.