Direct to remote replication
A computer implemented method, a computer program product, and a system for replicating data comprising: intercepting the IO data to a volume at the splitter; sending the IO data intercepted at the splitter to the volume; sending metadata of the IO data to a production RPA from the splitter, wherein an acknowledgement is sent to the splitter indicating that the metadata was received by the production RPA; and sending IO data, metadata, and timestamp of IO data to a remote site from the splitter, wherein IO data is sent to the remote site after splitter receives acknowledge of production RPA receiving the IO data.
1. A computer implemented method for replicating data, the method comprising:
intercepting, at a splitter of a storage system, input/output (IO) data sent from a host computer and directed to a production volume of the storage system, the splitter communicatively coupled to the host computer, the production volume, and a production Replication Protection Device (RPA), the production RPA tracking IOs received from the host computer in a delta marker stream through IO metadata obtained from the IO data;
forwarding, via the splitter, the intercepted IO data to the production volume;
sending, via the splitter, the IO metadata to the production RPA, the IO metadata including a volume ID, offset, and length;
receiving, at the splitter, an acknowledgement from the production RPA indicating that the IO metadata was received by the production RPA;
sending, via the splitter upon receiving the acknowledgement, the IO data, the IO metadata, and a timestamp of the IO data to a remote site; and
initializing a resynchronization mechanism, the resynchronization mechanism comprising reading data from dirty locations in the delta marker stream by the production RPA, attaching a timestamp to the data to synchronize the data, and sending the synchronized data to the remote site, wherein the dirty locations are locations marked in the delta marker stream.
2. The method of claim 1 , wherein sending the IO metadata of the IO data to the production RPA further comprises saving the metadata to the delta marker stream.
3. The method of claim 1 , wherein sending the IO metadata of the IO data to the production RPA further comprises responding with the timestamp of the IO data to the splitter.
4. The method of claim 1 , further comprising saving the IO data replicated to the remote site to a replica journal.
5. The method of claim 3 , wherein sending IO data, the IO metadata, and the timestamp of the IO data to the remote site further comprises a replica RPA in the remote site placing the IO data in order based on the timestamp of the IO data in a replica journal in the remote site.
6. The method of claim 5 , wherein IOs are flushed up to a timestamp only after all prior IOs have arrived at the remote site, and wherein IO metadata of IOs are erased once the IOs are flushed to the replica journal and the production volume.
7. The method of claim 1 , further comprising a resynchronization process of a location, wherein the resynchronization process of a location includes notifying the splitter of a location to be synchronized and a timestamp reading the data from production volume by the splitter and sending data and meta-data to a remote replication appliance (RPA) at the remote site.
8. A computer program product including a non-transitory computer readable storage medium having computer program code encoded thereon that when executed on a processor of a computer causes the computer to operate a computer system, the computer program product comprising program code enabling:
intercepting, at a splitter of a storage system, input/output (IO) data sent from a host system and directed to a volume of the storage system, the splitter communicatively coupled to the host system, the production volume, and a production Replication Protection Device (RPA), the production RPA tracking IOs received from the host system in a delta marker stream through IO metadata obtained from the IO data;
forwarding, via the splitter, the intercepted IO data to the production volume;
sending, via the splitter, the IO metadata to the production, the IO metadata including a volume ID, offset, and length;
receiving, at the splitter, an acknowledgement from the production RPA indicating that the IO metadata was received by the production RPA;
sending, via the splitter upon receiving the acknowledgement, the IO data, the IO metadata, and a timestamp of the IO data to a remote; and
initializing a resynchronization mechanism, the resynchronization mechanism comprising reading data from dirty locations in the delta marker stream by the production RPA, attaching a timestamp to the data to synchronize the data, and sending the synchronized data to the remote site, wherein the dirty locations are locations marked in the delta marker stream.
9. The computer program product of claim 8 , wherein sending the IO metadata of the IO data to the production RPA further comprises saving the metadata to the delta marker stream.
10. The computer program product of claim 8 , wherein sending the IO metadata of the IO data to the production RPA further comprises responding with the timestamp of the IO data to the splitter by the production RPA, and wherein sending the IO data, the IO metadata, and the timestamp of the IO data to the remote site further comprises a replica RPA in the remote site placing the IO data in order based on the timestamp of the IO data in a replica journal in the remote site.
11. The computer program product of claim 10 , wherein IOs are flushed up to a timestamp only after all prior IOs have arrived at the remote site, and wherein IO metadata of IOs are erased once the IOs are flushed to the replica journal and the production volume.
12. The computer program product of claim 8 , further comprising saving the IO data replicated to the remote site to a replica journal.
13. The computer program product of claim 8 , further comprising a resynchronization process of a location, wherein the resynchronization process of a location includes notifying the splitter of a location to be synchronized and a timestamp reading the data from production volume by the splitter and sending data and meta-data to a remote replication appliance (RPA) at the remote site.
14. A system for replicating data, the method comprising:
a storage system;
a host computer having a processor, the host computer communicatively coupled to the storage system; and
computer-executable program code operating in a memory communicatively coupled to the processor, wherein the computer-executable program code is configured to enable the host computer to execute the following:
intercepting, at a splitter of the storage system, input/output (IO) data sent from the host computer and directed to a production volume of the storage system, the splitter communicatively coupled to the host computer, the production volume, and a production Replication Protection Device (RPA), the production RPA tracking IOs received from the host computer in a delta marker stream through IP metadata obtained from the IO data;
forwarding, via the splitter, the intercepted IO data to the production volume;
sending, via the splitter, the IO metadata to the production RPA, the IO metadata including a volume ID, offset, and length;
receiving, at the splitter, an acknowledgement from the production RPA indicating that the metadata was received by the production RPA;
sending, via the splitter upon receiving the acknowledgement, the IO data, the IO metadata, and a timestamp of the IO data to a remote site; and
initializing a resynchronization mechanism, the resynchronization mechanism comprising reading data from dirty locations in the delta marker stream by the production RPA, attaching a timestamp to the data to synchronize the data, and sending the synchronized data to the remote site, wherein the dirty locations are locations marked in the delta marker stream.
15. The system of claim 14 , wherein sending the IO metadata of the IO data to the production RPA further comprises saving the metadata to the delta marker stream.
16. The system of claim 14 , wherein sending the IO metadata of the IO data to the production RPA further comprises responding with the timestamp of the IO data to the splitter by the production RPA, and wherein sending the IO data, the IO metadata, and the timestamp of the IO data to the remote site further comprises a replica RPA in the remote site placing the IO data in order based on the timestamp of the IO data in a replica journal in the remote site.
17. The system of claim 16 , wherein IOs are flushed up to a timestamp only after all prior IOs have arrived at the remote site, and wherein IO metadata of IOs are erased once the IOs are flushed to the replica journal and the production volume.
18. The system of claim 14 , further comprising saving the IO data replicated to the remote site to a replica journal.
19. The system of claim 14 , further comprising resynchronization process of a location, wherein the resynchronization process of a location includes notifying the splitter of a location to be synchronized and a timestamp reading the data from production volume by the splitter and sending data and meta-data to a remote replication appliance (RPA) at the remote site.