Efficiently configuring multiple backup data policies with information specifying data to backup
A system and method for determining the data that should be backed up by a plurality of backup policies are described. A global file change log that lists which files have been changed may be maintained. The global file change log may be processed to distribute the file change information into policy-specific file change logs. A global block change bitmap may also be maintained. The global block change bitmap may indicate which data blocks of the files have been changed. Performing a respective backup operation for a respective backup policy may include backing up only the data blocks that have changed in the files listed in the respective policy-specific file change log since a previous backup operation for the respective backup policy was performed. The data blocks that have changed may be specified in a respective policy-specific block change bitmap for the respective backup policy.
1. A non-transitory, computer-accessible storage medium storing program instructions executable by one or more processors to:
for each respective backup policy of a plurality of backup policies, configure the respective backup policy with information specifying a respective subset of a plurality of files to be backed up;
in response to changes to the plurality of files, maintain a global file change log that lists which files of the plurality of files have been changed;
process the global file change log, wherein in processing the global file change log, the program instructions are executable to:
for each respective backup policy of the plurality of backup policies, determine which particular files of the respective subset of files corresponding to the respective backup policy are listed in the global file change log, and add the particular files to a respective policy-specific file change log for the respective backup policy; and
clear the global file change log;
wherein the program instructions are further executable by the one or more processors to perform a respective backup operation for each respective backup policy, wherein in performing the respective backup operation for each respective backup policy, the program instructions are executable by the one or more processors to backup the files listed in the respective policy-specific file change log for the respective backup policy;
wherein after performing the respective backup operation for each respective backup policy, the program instructions are further executable by the one or more processors to clear the respective policy-specific file change log for the respective backup policy.
2. The non-transitory, computer-accessible storage medium of claim 1 ,
wherein the program instructions are further executable by the one or more processors to periodically perform said processing the global file change log.
3. The non-transitory, computer-accessible storage medium of claim 1 , wherein the program instructions are further executable by the one or more processors to:
in response to changes to the plurality of files, maintain a global block change bitmap that indicates which data blocks of the plurality of files have been changed; and
for each respective backup policy of the plurality of backup policies, update a respective policy-specific block change bitmap using the global block change bitmap;
wherein in performing the respective backup operation for each respective backup policy, the program instructions are executable by the one or more processors to backup only the data blocks that have changed in the files listed in the respective policy-specific file change log since a previous backup operation for the respective backup policy was performed, wherein the data blocks that have changed are specified in the respective policy-specific block change bitmap for the respective backup policy.
4. The non-transitory, computer-accessible storage medium of claim 3 ,
wherein in updating the respective policy-specific block change bitmap for each respective backup policy, the program instructions are executable by the one or more processors to perform a bitwise OR operation on the respective policy-specific block change bitmap using the global block change bitmap.
5. The non-transitory, computer-accessible storage medium of claim 3 ,
wherein after performing the respective backup operation for each respective backup policy, the program instructions are further executable by the one or more processors to clear the respective policy-specific block change bitmap for the respective backup policy.
6. The non-transitory, computer-accessible storage medium of claim 3 ,
wherein the program instructions are executable by the one or more processors to update the policy-specific block change bitmaps for the backup policies in response to determining that a backup operation for one of the backup policies has been initiated.
7. The non-transitory, computer-accessible storage medium of claim 3 ,
wherein the program instructions are further executable by the one or more processors to clear the global block change bitmap after updating the policy-specific block change bitmaps for the backup policies.
8. A system comprising:
one or more processors; and
memory storing program instructions, wherein the program instructions are executable by the one or more processors to:
for each respective backup policy of a plurality of backup policies, configure the respective backup policy with information specifying a respective subset of a plurality of files to be backed up;
in response to changes to the plurality of files, maintain a global file change log that lists which files of the plurality of files have been changed;
process the global file change log, wherein in processing the global file change log, the program instructions are executable to:
for each respective backup policy of the plurality of backup policies, determine which particular files of the respective subset of files corresponding to the respective backup policy are listed in the global file change log, and add the particular files to a respective policy-specific file change log for the respective backup policy; and
clear the global file change log;
wherein the program instructions are further executable by the one or more processors to perform a respective backup operation for each respective backup policy, wherein in performing the respective backup operation for each respective backup policy, the program instructions are executable by the one or more processors to backup the files listed in the respective policy-specific file change log for the respective backup policy;
wherein after performing the respective backup operation for each respective backup policy, the program instructions are further executable by the one or more processors to clear the respective policy-specific file change log for the respective backup policy.
9. The system of claim 8 ,
wherein the program instructions are further executable by the one or more processors to periodically perform said processing the global file change log.
10. The system of claim 8 , wherein the program instructions are further executable by the one or more processors to:
in response to changes to the plurality of files, maintain a global block change bitmap that indicates which data blocks of the plurality of files have been changed; and
for each respective backup policy of the plurality of backup policies, update a respective policy-specific block change bitmap using the global block change bitmap;
wherein in performing the respective backup operation for each respective backup policy, the program instructions are executable by the one or more processors to backup only the data blocks that have changed in the files listed in the respective policy-specific file change log since a previous backup operation for the respective backup policy was performed, wherein the data blocks that have changed are specified in the respective policy-specific block change bitmap for the respective backup policy.
11. The system of claim 10 ,
wherein in updating the respective policy-specific block change bitmap for each respective backup policy, the program instructions are executable by the one or more processors to perform a bitwise OR operation on the respective policy-specific block change bitmap using the global block change bitmap.
12. The system of claim 10 ,
wherein after performing the respective backup operation for each respective backup policy, the program instructions are further executable by the one or more processors to clear the respective policy-specific block change bitmap for the respective backup policy.
13. The system of claim 10 ,
wherein the program instructions are executable by the one or more processors to update the policy-specific block change bitmaps for the backup policies in response to determining that a backup operation for one of the backup policies has been initiated.
14. The system of claim 10 ,
wherein the program instructions are further executable by the one or more processors to clear the global block change bitmap after updating the policy-specific block change bitmaps for the backup policies.
15. A method comprising:
for each respective backup policy of a plurality of backup policies, configuring the respective backup policy with information specifying a respective subset of a plurality of files to be backed up;
in response to changes to the plurality of files, maintaining a global file change log that lists which files of the plurality of files have been changed;
processing the global file change log, wherein processing the global file change log includes:
for each respective backup policy of the plurality of backup policies, determining which particular files of the respective subset of files corresponding to the respective backup policy are listed in the global file change log, and adding the particular files to a respective policy-specific file change log for the respective backup policy; and
clearing the global file change log;
wherein the method further comprises performing a respective backup operation for each respective backup policy, wherein performing the respective backup operation for each respective backup policy includes backing up the files listed in the respective policy-specific file change log for the respective backup policy; and
after performing the respective backup operation for each respective backup policy, clearing the respective policy-specific file change log for the respective backup policy.
16. The method of claim 15 , further comprising:
in response to changes to the plurality of files, maintaining a global block change bitmap that indicates which data blocks of the plurality of files have been changed; and
for each respective backup policy of the plurality of backup policies, updating a respective policy-specific block change bitmap using the global block change bitmap;
wherein performing the respective backup operation for each respective backup policy includes backing up only the data blocks that have changed in the files listed in the respective policy-specific file change log since a previous backup operation for the respective backup policy was performed, wherein the data blocks that have changed are specified in the respective policy-specific block change bitmap for the respective backup policy.