Cascading snapshot creation in a native replication 3-site configuration
In one aspect a data replication process in a storage system includes creating, at a first target site, an empty container in a storage system. The empty container matches a container at a source site in response to initiation of an asynchronous data replication process. An aspect also includes transmitting a command to a second target site to create a container at the second target site. The first target site performs the asynchronous data replication process, which includes scanning the data upon receipt from the source site for a first target replication cycle and transmitting the scanned data to the container at the second target site for a second target replication cycle.
1. A method, comprising:
creating, at a first target site, an empty container in a storage system, the empty container matching a container at a source site in response to initiation of a cascading asynchronous data replication process;
transmitting, by the first target site in response to creating the empty container, a command to a second target site to create a container at the second target site; and
performing, by the first target site, the cascading asynchronous data replication process, comprising steps of:
scanning the data upon receipt from the source site for a first target replication cycle;
transmitting the scanned data to the container at the second target site for a second target replication cycle, the transmitting performed as the data is scanned at the first target site and before the first target replication cycle has completed;
upon receipt of all the data from the source site, marking, by the first target site, the first target replication cycle as complete; and
upon transmission of all the data to the second target site, marking, by the first target site, the second target replication cycle as complete;
wherein the performing is implemented until all data for the first target replication cycle has been received at the first target site, and all data for the second target replication cycle has been transmitted to the second target site.
2. The method of claim 1 , further comprising:
upon marking the first target replication cycle as complete for the data received from the source site and marking the second target replication cycle as complete for the data transmitted to the second target site, transmitting an acknowledgement to the second target site.
3. The method of claim 2 , wherein the second target site marks the container as a new consistent point in time for the cascading asynchronous data replication process.
4. The method of claim 1 , further comprising:
tracking operations of the cascading asynchronous data replication process, the tracking comprising:
incrementing a cycle counter as the data is received at the first target site from the source site; and
decrementing the cycle counter as the data is transmitted from the first target site to the second target site.
5. The method of claim 1 , wherein the data is received by the first target site from the source site over a short-range communication network, and the data is transmitted by the first target site to the second target site over a long-range communication network.
6. The method of claim 1 , wherein transmitting the scanned data to the container at the second target site for a second target replication cycle includes the first target site serving as a source for finding changes and transmitting the changes to the second target site.
7. The method of claim 1 , wherein the data received at the first target site is a difference between a current set of snapshots subject to the cascading asynchronous data replication process and a previous set of snapshots.
8. A system, comprising:
a memory comprising computer-executable instructions; and
a processor operable by a first target site, the processor executing the computer-executable instructions, the computer-executable instructions when executed by the processor cause the processor to perform operations comprising:
creating an empty container in a storage system, the empty container matching a container at a source site in response to initiation of a cascading asynchronous data replication process;
transmitting a command to a second target site to create a container at the second target site; and
performing the cascading asynchronous data replication process, comprising steps of:
scanning the data upon receipt from the source site for a first target replication cycle;
transmitting the scanned data to the container at the second target site for a second target replication cycle, the transmitting performed as the data is scanned at the first target site and before the first target replication cycle has completed:
upon receipt of all the data from the source site, marking, by the first target site, the first target replication cycle as complete; and
upon transmission of all the data to the second target site, marking, by the first target site, the second target replication cycle as complete;
wherein the performing is implemented until all data for the first target replication cycle has been received at the first target site, and all data for the second target replication cycle has been transmitted to the second target site.
9. The system of claim 8 , wherein the operations further include:
upon marking the first target replication cycle as complete for the data received from the source site and marking the second target replication cycle as complete for the data transmitted to the second target site, transmitting an acknowledgement to the second target site.
10. The system of claim 8 , wherein the operations further include:
tracking operations of the cascading asynchronous data replication process, the tracking comprising:
incrementing a cycle counter as the data is received at the first target site from the source site; and
decrementing the cycle counter as the data is transmitted from the first target site to the second target site.
11. The system of claim 8 , wherein the data is received by the first target site from the source site over a short-range communication network, and the data is transmitted by the first target site to the second target site over a long-range communication network.
12. The system of claim 8 , wherein the data received at the first target site is a difference between a current set of snapshots subject to the cascading asynchronous data replication process and a previous set of snapshots.
13. A computer program product embodied on a non-transitory computer readable medium, the computer program product including instructions that, when executed by a computer at a first target site, causes the computer to perform operations comprising:
creating an empty container in a storage system, the empty container matching a container at a source site in response to initiation of a cascading asynchronous data replication process;
transmitting a command to a second target site to create a container at the second target site; and
performing the cascading asynchronous data replication process, comprising steps of:
scanning the data upon receipt from the source site for a first target replication cycle;
transmitting the scanned data to the container at the second target site for a second target replication cycle, the transmitting performed as the data is scanned at the first target site and before the first target replication cycle has completed;
upon receipt of all the data from the source site, marking, by the first target site, the first target replication cycle as complete; and
upon transmission of all the data to the second target site, marking, by the first target site, the second target replication cycle as complete;
wherein the performing is implemented until all data for the first target replication cycle has been received at the first target site, and all data for the second target replication cycle has been transmitted to the second target site.
14. The computer program product of claim 13 , wherein the operations further include:
upon marking the first target replication cycle as complete for the data received from the source site and marking the second target replication cycle as complete for the data transmitted to the second target site, transmitting an acknowledgement to the second target site.
15. The computer program product of claim 13 , wherein the operations further include:
tracking operations of the asynchronous data replication process, the tracking comprising:
incrementing a cycle counter as the data is received at the first target site from the source site; and
decrementing the cycle counter as the data is transmitted from the first target site to the second target site.
16. The computer program product of claim 13 , wherein:
wherein further the data is received by the first target site from the source site over a short-range communication network, and the data is transmitted by the first target to the second target site over a long-range communication network.
17. The computer program product of claim 13 , wherein the data received at the first target site is a difference between a current set of snapshots subject to the cascading asynchronous data replication process and a previous set of snapshots.