CONTINUOUS DATA PROTECTION IN CLOUD USING STREAMS
One example method includes performing a recovery operation. A recovery operation is performed using streams rather than volumes in the cloud and without using compute instances or servers for do data or undo data. Do data is written to a do stream. Occasionally, a compute instance power on reads data from the do stream. After reading the data, chunks are read from cloud storage and updated. Data overwritten in the chunks are saved to an undo stream. A snapshot of the updated chunks and the associated undo stream is stored in the cloud storage.
1 . A method, comprising:
receiving writes from a data protection system configured to provide data protection operations to a production site into a do stream in a cloud, the writes including data;
retrieving chunks from cloud object storage impacted by writes read from the do stream;
updating the retrieved chunks to form new chunks with the data read from the do stream;
storing data in the retrieved chunks that is updated with the data read from the do stream in an undo stream; and
writing the new chunks to the cloud object storage as a snapshot along with the undo stream.
2 . The method of claim 1 , further comprising uploading an image, using chunks, of a production storage to the cloud object storage.
3 . The method of claim 1 , further comprising occasionally starting a compute instance to read the data from the do stream.
4 . The method of claim 1 , further creating additional snapshots when reading data from the do stream and updating chunks, wherein each additional snapshot is stored with an accompanying undo stream.
5 . The method of claim 4 , wherein the undo stream associated with each snapshot of updated chunks allows any PiT recovery between the associated snapshot and a previous snapshot.
6 . The method of claim 5 , further comprising initiating a recovery operation, wherein the recovery operation includes unifying chunks and/or portions of an undo stream to obtain an image to restore.
7 . The method of claim 6 , further comprising identifying a PiT backup for recovery.
8 . The method of claim 7 , further comprising recovering the PiT using the snapshots and undo streams associated with he identified PiT.
9 . The method of claim 1 , wherein the do stream comprises a queue, further comprising managing a timing and location of data in the undo stream and the do stream such that any PiT can be recovered.
10 . The method of claim 1 , further comprising continuing to receive new data into the do stream while performing a recovery operation.
11 . A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
receiving writes from a data protection system configured to provide data protection operations to a production site into a do stream in a cloud, the writes including data;
retrieving chunks from cloud storage impacted by writes read from the do stream;
updating the retrieved chunks to form new chunks with the data read from the do stream;
storing data in the retrieved chunks that is updated with the data read from the do stream in an undo stream; and
writing the new chunks to the cloud storage as a snapshot along with the undo stream.
12 . The non-transitory storage medium of claim 11 , further comprising uploading an image, using chunks, of a production storage to the cloud storage.
13 . The non-transitory storage medium of claim 11 , further comprising occasionally starting a compute instance to read the data from the do stream.
14 . The non-transitory storage medium of claim 11 , further creating additional snapshots when reading data from the do stream and updating chunks, wherein each additional snapshot is stored with an accompanying undo stream.
15 . The non-transitory storage medium of claim 14 , further, wherein the undo stream associated with each snapshot of updated chunks allows any PiT recovery between the associated snapshot and a previous snapshot.
16 . The non-transitory storage medium of claim 15 , further comprising initiating a recovery operation, wherein the recovery operation includes unifying chunks and/or portions of an undo stream to obtain an image to restore.
17 . The non-transitory storage medium of claim 16 , further comprising identifying a Pit backup for recovery.
18 . The non-transitory storage medium of claim 17 , further comprising recovering the PiT using the snapshots and undo streams associated with he identified PiT.
19 . The non-transitory storage medium of claim 11 , wherein the do stream comprises a queue, further comprising managing a timing and location of data in the undo stream and the do stream such that any PiT can be recovered.
20 . The non-transitory storage medium of claim 11 , further comprising continuing to receive new data into the do stream while performing a recovery operation.