Online consistent system checkpoint
Described embodiments provide systems and methods for operating a storage system wherein an online consistent system checkpoint is generated. The checkpoint contains a point in time image of a system and is used for providing recovery of the system to a known good state. In one embodiment the checkpoint includes volume configuration data, logical volume space, a plurality of layers of metadata, and physical data storage.
1. A method of generating a checkpoint for a storage system, wherein said checkpoint contains a point in time image of a system, the generating a checkpoint comprising:
storing volume configuration data in a reserved area of storage;
storing logical volume space in the reserved area of storage;
storing a plurality of layers of metadata in the reserved area of storage; and
storing physical data accessed by a second level of indirection in the reserved area of storage;
destaging a control module journal;
persisting a control module hash tree and dirty tree metadata, the dirty tree data including an original metadata tree which has been subsequently modified; and
redirecting new data and metadata IOs to disk stripes reserved during a preparation of a separate area relating to the checkpoint and protecting checkpointed on-disk data and metadata, and
making a consistent checkpoint copy of a system management module repository in the reserved area of storage.
2. A method of generating a checkpoint for a storage system, wherein said checkpoint contains a point in time image of a system, the generating a checkpoint comprising:
storing volume configuration data in a reserved area of storage;
storing logical volume space in the reserved area of storage;
storing a plurality of layers of metadata in the reserved area of storage; and
storing physical data accessed by a second level of indirection in the reserved area of storage;
destaging a user data destage cache;
dumping hash metadata and physical layout metadata to a separate location;
allowing new metadata updates to a default location after the hash metadata and physical layout metadata are dumped to the separate location; and
redirecting new data and metadata IOs to disk stripes reserved during a preparation of a separate area relating to the checkpoint and protecting checkpointed on-disk data and metadata and
making a consistent checkpoint copy of a system management module repository in the reserved area of storage.
3. The method of claim 1 wherein, prior to said generating said checkpoint for a storage system, preparing the separate area for said checkpoint.
4. The method of claim 3 , wherein new I/Os and metadata are redirected to a different area to prevent overwriting data and metadata that are already part of said checkpoint.
5. The method of claim 3 wherein said preparing a separate area for said checkpoint includes running a defragmentation routine to free up disk space and to mark a certain amount of free disk space which is used for storing said checkpoint or non-checkpoint data.
6. The method of claim 1 further comprising performing a recovery of said system using said checkpoint.
7. A system comprising:
a processor; and
memory storing computer program code that when executed on the processor causes the processor to operate a storage system, the storage system operable to perform the operation of generating a checkpoint for a storage system, wherein said generating said checkpoint includes:
storing volume configuration data in a reserved area of storage;
storing logical volume space in the reserved area of storage;
storing a plurality of layers of metadata in the reserved area of storage; and
storing physical data accessed by a second level of indirection in the reserved area of storage;
destaging a control module journal;
persisting control module hash tree and dirty tree metadata, the dirty tree data including an original metadata tree which has been subsequently modified; and
redirecting new data and metadata IOs to disk stripes reserved during a preparation of a separate area relating to the checkpoint and protecting checkpointed on-disk data and metadata and
making a consistent checkpoint copy of a system management module repository in the reserved area of storage.
8. A system comprising:
a processor; and
memory storing computer program code that when executed on the processor causes the processor to operate a storage system, the storage system operable to perform the operation of generating a checkpoint for a storage system, wherein said generating said checkpoint includes:
storing volume configuration data in a reserved area of storage;
storing logical volume space in the reserved area of storage;
storing a plurality of layers of metadata in the reserved area of storage;
storing physical data accessed by a second level of indirection in the reserved area of storage;
destaging a user data destage cache;
dumping hash metadata and physical layout metadata to a separate location; and
allowing new metadata updates to a default location after the hash metadata and physical layout metadata are dumped to the separate location; and
redirecting new data and metadata IOs to disk stripes reserved during a preparation of a separate area relating to the checkpoint and protecting checkpointed on-disk data and metadata and
making a consistent checkpoint copy of a system management module repository in the reserved area of storage.
9. The system of claim 7 further comprising preparing a separate area for said checkpoint prior to generating said checkpoint.
10. The system of claim 7 further comprising performing a recovery using said checkpoint.
11. A computer program product including a non-transitory computer readable storage medium having computer program code encoded thereon that when executed on a processor of a computer causes the computer to operate a storage system to generate a checkpoint containing a point in time image of a storage system, the computer program product comprising:
computer program code for storing volume configuration data in a reserved area of storage;
computer program code for storing logical volume space in the reserved area of storage;
computer program code for storing a plurality of layers of metadata in the reserved area of storage; and
computer program code for storing physical data accessed by a second level of indirection in the reserved area of storage;
destaging a control module journal;
persisting control module hash tree and dirty tree metadata, the dirty tree data including an original metadata tree which has been subsequently modified; and
redirecting new data and metadata IOs to disk stripes reserved during a preparation of a separate area relating to the checkpoint and protecting checkpointed on-disk data and metadata and
making a consistent checkpoint copy of a system management module repository in the reserved area of storage.
12. The computer program product of claim 11 further comprising computer program code for performing a recovery using said checkpoint.