Ensure volume consistency for online system checkpoint
View Patent ↗Described embodiments provide systems and methods for operating a storage system wherein an online consistent system checkpoint is generated. The checkpoint contains a point in time image of a system and is used for providing recovery of the system to a known good state. In one embodiment the checkpoint includes volume configuration data, logical volume space, a plurality of layers of metadata, and physical data storage.
1. A method comprising:
generating at least one online checkpoint snapshot for at least one valid consistency group;
generating at least one online checkpoint snapshot for at least one external volume that is not part of a consistency group;
marking each checkpoint snapshot with a unique checkpoint owner identifier to distinguish between multiple checkpoints;
persisting in each checkpoint snapshot an object identifier;
suspending control module background volume merge and delete operations;
destaging online journals to persist hash backup metadata of snapshots and ancestors to disk;
generating a checkpoint copy of a volume configuration repository; and
performing system recovery using a selected checkpoint, comprising:
loading the checkpoint copy of the volume configuration repository;
matching snapshot volumes having a checkpoint owner identifier matching the selected checkpoint with original volumes;
assigning an external identifier of the original volume to one of the matching snapshot volume or to a snapshot of the matching snapshot volume; and
deleting the original volume having an external identifier assigned to a snapshot volume.
2. The method of claim 1 wherein said checkpoint snapshots are hidden and are read-only.
3. The method of claim 1 wherein said recovering the data module comprises recovering logical volume data and metadata.
4. The method of claim 3 wherein said recovering the control module comprises rebuilding in memory logical volume metadata after the data module recovery completes.
5. The method of claim 4 wherein said recovering the routing module comprises obtaining updated mapping between logical unit identifiers and logical volumes.
6. The method of claim 5 further comprising deleting all snapshot sets having a matching checkpoint identifier for the selected checkpoint used for performing the recovery.
7. A system comprising:
a processor; and
memory storing computer program code that when executed on the processor causes the processor to operate a storage system, the storage system operable to perform the operations of:
generating at least one online checkpoint snapshot for at least one valid consistency group;
generating at least one online checkpoint snapshot for at least one external volume that is not part of a consistency group;
marking each checkpoint snapshot with a unique checkpoint owner identifier to distinguish between multiple checkpoints;
persisting in each checkpoint snapshot an object identifier;
suspending control module background volume merge and delete operations;
destaging online journals to persist hash backup metadata of snapshots and ancestors to disk; and
generating a checkpoint copy of a volume configuration repository; and
performing system recovery using a selected checkpoint, comprising:
loading the checkpoint copy of the volume configuration repository;
matching snapshot volumes having a checkpoint owner identifier matching the selected checkpoint with original volumes;
assigning an external identifier of the original volume to one of the matching snapshot volume or to a snapshot of the matching snapshot volume; and
deleting the original volume having an external identifier assigned to a snapshot volume.
8. The system of claim 7 wherein said checkpoint snapshots are hidden and are read-only.
9. The system of claim 7 wherein said recovering the data module comprises recovering logical volume data and metadata.
10. The system of claim 9 wherein said recovering the control module comprises rebuilding in memory logical volume metadata after the data module recovery completes.
11. The system of claim 10 wherein said recovering the routing module comprises obtaining updated mapping between logical unit identifiers and logical volumes.
12. The system of claim 11 further comprising deleting all snapshot sets having a matching checkpoint identifier for the selected checkpoint used for performing the recovery.
13. A computer program product including a non-transitory computer readable storage medium having computer program code encoded thereon that when executed on a processor of a computer causes the computer to operate a storage system, the computer program product comprising:
computer program code for generating at least one online checkpoint snapshot for at least one valid consistency group;
computer program code for generating at least one online checkpoint snapshot for at least one external volume that is not part of a consistency group;
computer program code for marking each checkpoint snapshot with a unique checkpoint owner identifier to distinguish between multiple checkpoints;
computer program code for persisting in each checkpoint snapshot an object identifier;
computer program code for suspending control module background volume merge and delete operations;
computer program code for destaging online journals to persist hash backup metadata of snapshots and ancestors to disk; and
computer program code for generating a checkpoint copy of a volume configuration repository;
computer performing code for performing system recovery using a selected checkpoint, comprising:
loading the checkpoint copy of the volume configuration repository;
matching snapshot volumes having a checkpoint owner identifier matching the selected checkpoint with original volumes;
assigning an external identifier of the original volume to one of the matching snapshot volume or to a snapshot of the matching snapshot volume; and
deleting the original volume having an external identifier assigned to a snapshot volume.
14. The method of claim 1 , wherein the object identifier comprises one of a source consistency group external identifier or a production volume identifier and the object identifier is configured to reassign volume identity during system recovery.
15. The system of claim 7 , wherein the object identifier comprises one of a source consistency group external identifier or a production volume identifier and the object identifier is configured to reassign volume identity during system recovery.
16. The computer program product of claim 13 , wherein the object identifier comprises one of a source consistency group external identifier or a production volume identifier and the object identifier is configured to reassign volume identity during system recovery.