Systems and methods for performing data replication
View Patent ↗Preparing source data to be replicated in a continuous data replication environment. Certain systems and methods populate a file name database with entries having a unique file identifier descriptor (FID), short name and a FID of the parent directory of each directory or file on a source storage device. Such information is advantageously gathered during scanning of a live file system without requiring a snapshot of the source storage device. The database can be further used to generate absolute file names associated with data operations to be replayed on a destination storage device. Based on the obtained FIDs, certain embodiments can further combine write operations to be replayed on the destination storage device and/or avoid replicating temporary files to the destination system.
1. A method for performing data replication, the method comprising:
monitoring data operations associated with an application executing on a computing device, the data operations operative to write data to a first storage device;
populating a log file with a plurality of data entries indicative of the data operations;
identifying a first one of the plurality of data entries associated with writing data to a temporary file on the first storage device; and
replaying to a second storage device, based on a portion of the data entries, a portion of the data operations to replicate data to a first location on the second storage device, wherein the portion of the data entries does not include the first one of the plurality of data entries.
2. The method of claim 1 , wherein each of the plurality of data entries further comprises a file identifier descriptor (FID) of a file to be accessed on the first storage device by the corresponding data operation.
3. The method of claim 2 , wherein each of the plurality of data entries further comprises a location of a byte range within the file to be accessed on the first storage device.
4. The method of claim 3 , additionally comprising requesting the byte range of the file to be accessed.
5. The method of claim 4 , wherein said identifying comprises receiving a “no such file or directory” message in response to said requesting.
6. The method of claim 1 , additionally comprising identifying a second one of the plurality of data entries associated with deleting data from the temporary file on the first storage device.
7. The method of claim 6 , wherein the portion of the data entries does not include the second one of the plurality of data entries.
8. The method of claim 1 , wherein said monitoring is performed with a file system filter driver.
9. A system for performing data replication between two computing devices in a network, the system comprising:
at least one computer application executing on a first computing device and configured to generate a plurality of operations associated with storing data on a source storage device, the data comprising at least one temporary file and at least one non-transitory file;
a log file comprising a plurality of data entries indicative of the plurality of operations, wherein a first one of the plurality of data entries is associated with writing the at least one temporary file;
a processing module executing on and configured to identify a first one of the plurality of data entries associated with writing the temporary file, the processing module being further configured to copy a portion of the entries of the log file to a second computing device in network communication with the first computing device, wherein the portion of the data entries does not include the first one of the plurality of data entries.
10. The system of claim 9 , wherein each of the plurality of data entries further comprises a file identifier descriptor (FID) for each of the plurality of operations comprising a write operation.
11. The system of claim 10 , wherein each of the plurality of data entries does not comprise a copy of the data to be written to the source storage device.
12. The system of claim 10 , wherein the processing module comprises a filter driver.
13. The system of claim 12 , wherein processing module is configured to request, based on the FID of each of the plurality of data entries, a copy of the data written to the source storage device.
14. The system of claim 13 , wherein the processor is configured to make said request following a predetermined duration of time after the corresponding data entry is stored in the log file.
15. The system of claim 14 , wherein the predetermined duration of time comprises at least three seconds.