Metadata generation for incremental backup
Metadata generate for incremental backup is disclosed. A subset of blocks used to store file system metadata are identified in a set of blocks changed since a last backup. File system metadata stored in the subset of blocks is used to obtain file system metadata associated with file system objects that have been created and/or modified since the last backup. The file system metadata associated with file system objects that have been created and/or modified since the last backup is used to generate file system metadata files for the incremental backup.
1. A method of generating file system metadata for incremental backup, comprising:
reading a bitmap to determine a change block list comprising one or more blocks, wherein the change block list indicates blocks that have changed since a previous backup, wherein the one or more blocks were marked as having been changed since the previous backup;
determining which of the one or more blocks on the change block list stores file system metadata, wherein the one or more blocks on the change block list include at least one block storing file data and at least one block storing file system metadata;
determining that a first block of the one or more determined blocks on the change block list is configured to store file system metadata associated with a first file system object and file system metadata associated with a second file system object;
determining that the file system metadata associated with the first file system object stored in the first block has been modified since the previous backup and the file system metadata associated with the second file system object stored in the first block has not been modified at least in part by comparing a first file system object timestamp of the file system metadata associated with the first file system object and a second file system object timestamp associated with the second file system object with a timestamp associated with the previous backup; and
generating file system metadata for the incremental backup by using the modified file system metadata associated with the first file system object.
2. The method of claim 1 , wherein generating file system metadata for the incremental backup by using the modified file system metadata associated with the first file system object includes copying file system metadata associated with the previous backup.
3. The method of claim 2 , further comprising using the modified file system metadata associated with the first file system object to replace or update the file system metadata associated with the first file system object that was stored as part of the previous backup.
4. The method of claim 2 , wherein the file system metadata associated with the previous backup include one or more of an inode index file, a directory metadata file, and an inode metadata file.
5. The method of claim 1 , wherein file system metadata that is generated as part of a full backup or an incremental backup is stored with a timestamp.
6. The method of claim 5 , wherein the timestamp associated with the previous backup was generated as part of the previous backup.
7. The method of claim 1 , further comprising including in file system metadata that is generated as part of a full backup parent node identification data that identifies a parent node of a file system node that comprises a subdirectory, file, or other node that has a parent node in the file system hierarchy.
8. The method of claim 7 , further comprising using the parent node identification data stored at the full backup to update a parent node file system metadata in connection with an incremental backup in which file system metadata associated with a child node of the parent node has been changed.
9. A system to generate file system metadata for incremental backup, comprising:
a memory configured to store a bitmap usable to track which of a plurality of data blocks have been modified since a last backup; and
a processor coupled to the memory and configured to:
reading the bitmap to determine a change block list comprising one or more blocks, wherein the change block list indicates blocks that have changed since a previous backup, wherein the one or more blocks were marked as having been changed since the previous backup;
determine which of the one or more blocks on the change block list stores file system metadata, wherein the one or more blocks on the change block list include at least one block storing file data and at least one block storing file system metadata;
determining that a first block of the one or more determined blocks on the change block list is configured to store file system metadata associated with a first file system object and file system metadata associated with a second file system object;
determine that the file system metadata associated with the first file system object stored in the first block has been modified since the previous backup and the file system metadata associated with the second file system object stored in the first block has not been modified at least in part by comparing a first file system object timestamp of the file system metadata associated with the first file system object and a second file system object timestamp associated with the second file system object with a timestamp associated with the previous backup; and
generate file system metadata for the incremental backup by using the modified file system metadata associated with the first file system object.
10. The system of claim 9 , wherein the processor is configured to generate file system metadata for the incremental backup by using the modified file system metadata associated with the first file system object at least in part by copying file system metadata associated with the previous backup.
11. The system of claim 10 , wherein the processor is further configured to use the modified file system metadata associated with the first file system object to replace or update the file system metadata associated with the first file system object that was stored as part of the previous backup.
12. The system of claim 10 , wherein the file system metadata associated with the previous backup include one or more of an inode index file, a directory metadata file, and an inode metadata file.
13. The system of claim 9 , wherein file system metadata that is generated as part of a full backup or an incremental backup is stored with a timestamp.
14. The system of claim 13 , wherein the timestamp associated with the previous backup was generated as part of the previous backup.
15. The system of claim 9 , wherein the processor is further configured to include in file system metadata that is generated as part of a full backup parent node identification data that identifies a parent node of a file system node that comprises a subdirectory, file, or other node that has a parent node in the file system hierarchy.
16. The system of claim 15 , wherein the processor is further configured to use the parent node identification data stored at the full backup to update a parent node file system metadata in connection with an incremental backup in which file system metadata associated with a child node of the parent node has been changed.
17. A computer program product to generate file system metadata for incremental backup, the computer program product being embodied in a non-transitory tangible computer readable storage medium and comprising computer instructions for:
reading a bitmap to determine a change block list comprising one or more blocks, wherein the change block list indicates blocks that have changed since a previous backup, wherein the one or more blocks were marked as having been changed since the previous backup;
determining which of the one or more blocks on the change block list stores file system metadata, wherein the one or more blocks on the change block list include at least one block storing file data and at least one block storing file system metadata;
determining that a first block of the one or more determined blocks on the change block list is configured to store file system metadata associated with a first file system object and file system metadata associated with a second file system object;
determining that the file system metadata associated with the first file system object stored in the first block has been modified since the previous backup and the file system metadata associated with the second file system object stored in the first block has not been modified at least in part by comparing a first file system object timestamp of the file system metadata associated with the first file system object and a second file system object timestamp associated with the second file system object with a timestamp associated with the previous backup; and
generating file system metadata for the incremental backup by using the modified file system metadata associated with the first file system object.
18. The computer program product of claim 17 , generating file system metadata for the incremental backup by using the modified file system metadata associated with the first file system object includes copying file system metadata associated with the previous backup.
19. The computer program product of claim 18 , further comprising computer instructions for using the modified file system metadata associated with the first file system object to replace or update the file system metadata associated with the first file system object that was stored as part of the previous backup.
20. The computer program product of claim 19 , wherein the timestamp associated with the previous backup was generated as part of the previous backup.