Systems and methods for storage block replication in a hybrid storage environment
The disclosed computer-implemented method for storage block replication in a hybrid storage environment may include receiving a request associated with a data source being replicated to modify a cloud object, storing an instruction for modifying the cloud object, determining that a replication operation for the source has completed, and modifying the cloud object and deleting the instruction for modifying the cloud object in response to determining that the replication operation has completed. In some examples, the request to modify the cloud object may include deleting the cloud object. Various other methods, systems, and computer-readable media are also disclosed.
1. A computer-implemented method for storage block replication in a hybrid storage environment, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:
receiving a request to modify a cloud object, wherein the request is associated with a data source being replicated;
storing an instruction associated with the request to modify the cloud object;
determining a replication lag time;
calculating a marker time based on a current time and the replication lag time;
determining, at least in part by comparing the marker time to a timestamp, that a replication operation associated with the request to modify the cloud object has completed; and
in response to determining that the replication operation has completed, modifying the cloud object and deleting the instruction for modifying the cloud object.
2. The computer implemented method of claim 1 , wherein modifying the cloud object comprises deleting the cloud object.
3. The computer implemented method of claim 1 , further comprising:
receiving another request to modify another cloud object, wherein the request is associated with the data source being replicated;
determining that the source being replicated is being replicated synchronously; and
in response to determining that the source is being replicated synchronously, immediately modifying the other cloud object.
4. The computer implemented method of claim 1 , further comprising:
storing the timestamp for the request to modify a cloud object.
5. The method of claim 4 , further comprising storing the request to modify the cloud object and the timestamp in a cloud modification database.
6. The method of claim 5 , further comprising sorting entries in the cloud modification database according to the timestamp.
7. The method of claim 1 , further comprising:
modifying a data source comprising metadata referencing locations of a plurality of cloud objects in a cloud storage; and
replicating the modified data source.
8. A system for storage block replication in a hybrid storage environment, the system comprising:
a volume manager module, stored in memory, the volume manager module operable to:
receive a request to modify a cloud object, wherein the request is associated with a source volume being replicated;
store an instruction for modifying the cloud object;
determine a replication lag time;
calculate a marker time based on a current time and the replication lag time;
determine, at least in part by comparing the marker time to a timestamp, that a replication operation for the source volume has completed; and
in response to a determination that the replication operation has completed, modify the cloud object and delete the instruction for modifying the cloud object; and
at least one physical processor that implement the volume manager module.
9. The system of claim 8 , further comprising:
a volume replicator module, stored in memory, the volume replicator module operable to replicate the source volume to a target volume, wherein the source volume comprises data mapping a cloud volume; and
wherein the at least one physical processor further implements the volume replicator module.
10. The system of claim 8 , wherein modifying the cloud object comprises deleting the cloud object.
11. The system of claim 8 , wherein the volume manager module is further operable to:
receive another request to modify another cloud object, wherein the request is associated with the source volume being replicated;
determine that the source being replicated is being replicated synchronously; and
in response to determining that the source is being replicated synchronously, immediately modifying the other cloud object.
12. The system of claim 8 , wherein the volume manager module is further operable to:
store the timestamp for the request to modify a cloud object.
13. The system of claim 12 , wherein the volume manager is further operable to store the request to modify the cloud object and the timestamp in a cloud modification database.
14. The system of claim 13 , wherein the volume manager is further operable to sort entries in the cloud modification database according to the timestamp.
15. The system of claim 9 , wherein the volume replicator module is further operable to:
store a data source comprising metadata referencing locations of a plurality of cloud objects in a cloud storage;
modify the data source; and
replicate the modified data source.
16. A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
receive a request to modify a cloud object, wherein the request is associated with a data source being replicated;
store an instruction for modifying the cloud object;
determine a replication lag time;
calculate a marker time based on a current time and the replication lag time;
determine, at least in part by comparing the marker time to a timestamp, that a replication operation for the source has completed; and
in response to a determination that the replication operation has completed, modify the cloud object and delete the instruction for modifying the cloud object.
17. The non-transitory computer-readable medium of claim 16 , wherein modifying the cloud object comprises deleting the cloud object.
18. The non-transitory computer-readable medium of claim 16 , wherein the computer executable instructions further cause the computing device to:
store the timestamp for the request to modify a cloud object.
19. The non-transitory computer-readable medium of claim 18 , wherein the computer executable instructions further cause the computing device to store the request to modify the cloud object and the timestamp in a cloud modification database.
20. The non-transitory computer-readable medium of claim 16 , wherein the computer executable instructions further cause the computing device to:
modify a data source comprising metadata referencing locations of a plurality of cloud objects in a cloud storage and
replicate the modified data source.