Using business continuity and disaster recovery for any point in time backup
Generating any point in time backups without native snapshot generation. Production data is split such that a journal stream is sent to a data protection system, which may be local or remote. The journal stream includes a data stream and a metadata stream. Backups are synthesized at the data protection system by rolling at least a portion of the journal. A backup for any point in time represented in the journal can be synthesized.
1. A method, comprising:
splitting an IO stream received from a source such that the IO stream is directed to production storage and to a data protection system;
aggregating the IO stream and generating a journal from the IO stream by the data protection system, wherein the journal includes a data stream and a metadata stream;
retrieving additional data to include in the journal from production data stored in the production storage when an IO in the IO stream is less than a block size;
storing the journal in a secondary storage; and
synthesizing backups from the journal.
2. The method of claim 1 , further comprising generating the backups according to a cadence, wherein the cadence is based on at least one of time, journal size, expected journal roll time, expected RPO.
3. The method of claim 1 , further comprising dividing the journal into journal files, wherein each journal file includes a portion of the data stream and a corresponding portion of the metadata stream.
4. The method of claim 3 , further comprising generating a new backup from a previous backup and one of the journal files.
5. The method of claim 1 , further comprising aligning the metadata stream and deduplicating the data.
6. The method of claim 1 , further comprising performing a fast copy to synthesize each of the backups.
7. The method of claim 1 , further comprising storing the backups as backups and journal files.
8. The method of claim 1 , further comprising setting a cadence for synthesizing the backups to balance an RPO with storage space.
9. The method of claim 1 , wherein the metadata stream includes one or more of IO volume, location length, timestamp, tagging, user information, descriptive data, wherein each entry in the metadata stream has a corresponding entry in the data stream.
10. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
splitting an IO stream received from a source such that the IO stream is directed to production storage and to a data protection system;
aggregating the IO stream and generating a journal from the IO stream by the data protection system, wherein the journal includes a data stream and a metadata stream;
retrieving additional data to include in the journal from production data stored in the production storage when an IO in the IO stream is less than a block size;
storing the journal in a secondary storage; and
synthesizing backups from the journal.
11. The non-transitory storage medium of claim 10 , the operations further comprising generating the backups according to a cadence, wherein the cadence is based on at least one of time, journal size, expected journal roll time, expected RPO.
12. The non-transitory storage medium of claim 10 , the operations further comprising dividing the journal into journal files, wherein each journal file includes a portion of the data stream and a corresponding portion of the metadata stream.
13. The non-transitory storage medium of claim 12 , the operations further comprising generating a new backup from a previous backup and one of the journal files.
14. The non-transitory storage medium of claim 10 , the operations further comprising aligning the metadata stream and deduplicating the data.
15. The non-transitory storage medium of claim 10 , the operations further comprising performing a fast copy to synthesize each of the backups.
16. The non-transitory storage medium of claim 10 , the operations further comprising storing the backups as backups and journal files.
17. The non-transitory storage medium of claim 10 , the operations further comprising setting a cadence for synthesizing the backups to balance an RPO with storage space.
18. The non-transitory storage medium of claim 10 , wherein the metadata stream includes one or more of IO volume, location length, timestamp, tagging, user information, descriptive data, wherein each entry in the metadata stream has a corresponding entry in the data stream.