Creating and maintaining clones in continuous data protection
In traditional storage arrays, the number of clones permitted inside the storage array may be limited by the amount of available storage. Further, clones stored on the array may require significant storage resources. Thus, the number of clone stored by the storage array may also be limited by the storage system memory and not just by the disk space. Accordingly, example embodiments of the present invention allow for creating and maintaining a plurality (e.g., an unlimited number) of thin asynchronous clones in storage, even if replica storage is capable of storing only a limited number of snapshots. Further, example embodiments of the present invention allow clones to be freely attached and detached from the replication environment for various purposes.
1. A method comprising:
maintaining a volume at a production site;
maintaining a copy of the volume at a copy site;
selectively storing a clone of the copy of the volume at the production site, the copy site or a remote storage;
receiving an input/output (I/O) sent to the volume at the production site;
replicating the I/O to the copy of the volume at the copy site;
applying the I/O to the copy of the volume at the copy site and the clone at the production site, the copy site, or the remote storage, and
determining a state of the clone of the copy of the volume with respect to the copy of the volume;
if the clone of the copy of the volume is in a sync state:
continuing to store I/Os; and
if the clone of the copy of the volume is in a syncing state:
updating dirty locations which differ between the clone of the copy of the volume and the copy of the volume by copying data from the copy of the volume to the clone and clearing a dirty bit in a differential bitmap; and
updating a new I/O arriving to the copy of the volume to the clone of the copy of the volume if the new I/O is to a synchronized area.
2. The method of claim 1 further comprising, if the clone of the copy of the volume is in an error state, tracking changes between the copy of the volume and the clone of the copy of the volume.
3. The method of claim 2 wherein tracking changes between the copy of the volume and the clone of the copy of the volume comprises tracking changes arriving to the copy of the volume in a delta marking stream or in a bitmap to enable reattaching the clone of the copy of the volume to the copy of the volume without a full sweep.
4. The method of claim 1 further comprising, if the clone of the copy of the volume is in a detached state:
tracking changes occurring to the copy of the volume; and
tracking changes occurring to the detached clone of the copy of the volume.
5. The method of claim 4 wherein tracking changes occurring to the detached clone of the copy of the volume comprises tracking changes in a facility provided by a storage array to track changes in a second volume to enable reattaching the clone of the copy of the volume to the copy of the volume without a full sweep.
6. The method of claim 4 wherein tracking changes occurring to the detached clone of the copy of the volume comprises:
attaching the clone to a splitter; and
tracking changes in the splitter and a protection appliance.
7. The method of claim 1 further comprising, if the clone of the copy of the volume is in a detached state, accepting I/Os from a host.
8. The method of claim 1 further comprising, if the clone of the copy of the volume is not in a detached state, accepting I/Os only from a data protection appliance maintaining the clone.
9. The method of claim 1 further comprising periodically attempting to recover the clone of the copy of the volume if the clone of the copy of the volume is in an error state.
10. The method of claim 1 further comprising:
placing the copy of the volume in an image access mode at a requested point in time; and
detaching the clone of the copy of the volume from the copy of the volume at the requested point in time.
11. The method of claim 10 further comprising repurposing the detached clone of the copy of the volume.
12. The method of claim 10 further comprising:
reattaching the clone of the copy of the volume to the copy of the volume;
merging differentials having occurred to the clone of the copy of the volume with differentials having occurred to the copy of the volume;
adding merged differentials to a bitmap indicating differentials between the clone of the copy of the volume and the copy of the volume; and
moving the clone to synching mode.
13. An apparatus comprising:
a processor; and
memory encoded with instructions that, when executed by the processor, cause the apparatus to perform the operations of:
maintaining a volume at a production site;
maintaining a copy of the volume at a copy site;
selectively storing a clone of the copy of the volume at the production site, the copy site, or a remote storage;
receiving an input/output (I/O) sent to the volume at the production site;
replicating the I/O to the copy of the volume at the copy site;
applying the I/O to the copy of the volume at the copy site and the clone at the production site, the copy site, or the remote storage, and
determining a state of the clone of the copy of the volume with respect to the copy of the volume;
if the clone of the copy of the volume is in a sync state:
continuing to store I/Os; and
if the clone of the copy of the volume is in a sync state:
updating dirty locations which differ between the clone of the copy of the volume and the copy of the volume by copying data from the copy of the volume to the clone and clearing a dirty hit in a differential bitmap; and
updating a new I/O arriving to the copy of the volume to the clone of the copy of the volume if the new I/O is to a synchronized area.
14. The apparatus of claim 13 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operation of, if the clone of the copy of the volume is in an error state, tracking changes between the copy of the volume and the clone of the copy of the volume.
15. The apparatus of claim 14 wherein tracking changes between the copy of the volume and the clone of the copy of the volume comprises tracking changes arriving to the copy of the volume in a delta marking stream or in a bitmap to enable reattaching the clone of the copy of the volume to the copy of the volume without a full sweep.
16. The apparatus of claim 13 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operations of, if the clone of the copy of the volume is in a detached state:
tracking changes occurring to the copy of the volume; and
tracking changes occurring to the detached clone of the copy of the volume.
17. The apparatus of claim 16 wherein tracking changes occurring to the detached clone of the copy of the volume comprises tracking changes in a facility provided by a storage array to track changes in a second volume to enable reattaching the clone of the copy of the volume to the copy of the volume without a full sweep.
18. The apparatus of claim 16 wherein tracking changes occurring to the detached clone of the copy of the volume comprises:
attaching the clone to a splitter; and
tracking changes in the splitter and a protection appliance.
19. The apparatus of claim 13 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operation of, if the clone of the copy of the volume is in a detached state, accepting I/Os from a host.
20. The apparatus of claim 13 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operation of, if the clone of the copy of the volume is not in a detached state, accepting I/Os only from a data protection appliance maintaining the clone.
21. The apparatus of claim 13 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operation of periodically attempting to recover the clone of the copy of the volume if the clone of the copy of the volume is in an error state.
22. The apparatus of claim 19 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operations of:
placing the copy of the volume in an image access mode at a requested point in time; and
detaching the clone of the copy of the volume from the copy of the volume at the requested point in time.
23. The apparatus of claim 22 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operation of repurposing the detached clone of the copy of the volume.
24. The apparatus of claim 22 wherein the memory is further encoded with instructions that, when executed by the processor, cause the apparatus to perform the operations of:
reattaching the clone of the copy of the volume to the copy of the volume;
merging differentials having occurred to the clone of the copy of the volume with differentials having occurred to the copy of the volume;
adding merged differentials to a bitmap indicating differentials between the clone of the copy of the volume and the copy of the volume; and
moving the clone to synching mode.
25. A computer program product having a non-transitory computer readable storage medium with instructions encoded thereon that, when executed by a processor of a computer, causes the computer to perform the operations of:
maintaining a volume at a production site;
maintaining a copy of the volume at a copy site;
selectively storing a clone of the copy of the volume at the production site, the copy site or a remote storage;
receiving an input/output (I/O) sent to the volume at the production site;
replicating the I/O to the copy of the volume at the copy site; and
applying the I/O to the copy of the volume at the copy site and the clone at the production site, the copy site, or the remote storage, and
determining a state of the clone of the copy of the volume with respect to the copy of the volume;
if the done of the copy of the volume is in a sync state:
continuing to store I/Os; and
if the clone of the copy of the volume is in a syncing state:
updating, dirty locations which differ between the done of the copy of the volume and the copy of the volume by copying data from the copy of the volume to the clone and clearing a dirty bit in a differential bitmap; and
updating a new I/O arriving to the copy of the volume to the clone of the copy of the volume if the new is to a synchronized area.