Dynamic triggering of block-level backups based on block change thresholds and corresponding file identities
A data storage management approach is disclosed that performs backup operations flexibly, based on a dynamic scheme of monitoring block changes occurring in production data. The illustrative system monitors block changes based on certain block-change thresholds and triggers block-level backups of the changed blocks when a threshold is passed. Block changes may be monitored in reference to particular files based on a reverse lookup mechanism. The illustrative system also collects and stores historical information on block changes, which may be used for reporting and predictive analysis.
1. A computer-implemented method comprising:
by a second computing device comprising one or more hardware processors:
executing an application,
tracking data block changes generated by the application,
tracking a file system comprising one or more data files accessible to the application including a first data file, and
transmitting, to a first computing device, point-in-time representations of changed data blocks in the one or more data files, and
further transmitting information indicating that first data blocks correspond to the first data file;
by the first computing device, which comprises one or more hardware processors:
maintaining a first mapping that identifies the first data file based on one or more of the first data blocks, and
based on identifying, within the point-in-time representations, a first set of changed data blocks that correspond to the first data file,
determining that the first data file passed a threshold measure of changed data blocks; and
by the second computing device, executing a block-level backup of the first set of changed data blocks,
wherein the block-level backup generates a secondary copy that is associated with the first data file and not with others of the one or more data files accessible to the application.
2. The method of claim 1 , wherein the determining that the first data file passed the threshold measure of changed data blocks is based at least in part on analyzing the first mapping maintained by the first computing device.
3. The method of claim 1 , wherein the first computing device maintains the first mapping based on the information indicating that the first data blocks correspond to the first data file.
4. The method of claim 1 , wherein the tracking of the data block changes generated by the application is performed by a first data agent and the tracking of the file system comprising one or more data files is performed by a second data agent.
5. The method of claim 1 , wherein the second computing device executes the block-level backup based on instructions received from a storage manager, which executes on a computing device comprising one or more hardware processors.
6. The method of claim 5 , wherein the instructions are received after the first computing device notifies the storage manager that the first data file passed the threshold measure of changed data blocks.
7. The method of claim 5 , wherein the threshold measure of changed data blocks is maintained at the storage manager and transmitted to the first computing device.
8. The method of claim 1 , wherein a media agent that executes on a computing device, which comprises one or more hardware processors, causes the secondary copy generated by the block-level backup to be stored at a data storage device.
9. The method of claim 1 , wherein the secondary copy is further associated with the application.
10. The method of claim 1 , wherein the threshold measure applies to the first data file.
11. The method of claim 1 , wherein the threshold measure applies to the first data file, and wherein a second, distinct, threshold measure applies to a second data file accessible to the application; and
wherein a second secondary copy results from a second block-level backup of a second set of changed data blocks, distinct from the first set of changed data blocks, based on the first computing device determining that the second data file passed the second, distinct, threshold measure.
12. The method of claim 1 further comprising:
by the first computing device:
receiving second information that associates the one or more data files with the application,
maintaining a second mapping that identifies the application based on the one or more data files, and
based on identifying, within the point-in-time representations, a second set of changed data blocks that correspond to the application,
determining that the second set of changed data blocks passed a threshold measure of changed data blocks; and
by the second computing device, executing a second block-level backup of the second set of changed data blocks, wherein the second block-level backup generates a second secondary copy that is associated with the application.
13. A computer-implemented method comprising:
by a second computing device comprising one or more hardware processors:
executing an application,
tracking data block changes generated by the application,
transmitting, to a first computing device, point-in-time representations of changed data blocks generated by the application,
scanning a file system comprising one or more first data files accessible to the application, and
transmitting, to the first computing device, information indicating that the one or more first data files are associated with the application;
by the first computing device, which comprises one or more hardware processors:
maintaining a first mapping that identifies the application based on the one or more first data files, and
based on identifying, within the point-in-time representations, a first set of changed data blocks, which correspond to the one or more first data files,
determining that the first set of changed data blocks passed a threshold measure of changed data blocks; and
by the second computing device, executing a block-level backup of the first set of changed data blocks,
wherein the block-level backup generates a secondary copy that is associated with the application.
14. The method of claim 13 , wherein the threshold measure applies to one of the one or more first data files associated with the application.
15. The method of claim 14 , wherein the block-level backup is triggered based on the one of the one or more first data files passing the threshold measure of changed data blocks.
16. The method of claim 13 , wherein the tracking of the data block changes generated by the application is performed by a first data agent and the scanning of the file system comprising the one or more first data files is performed by a second data agent.
17. The method of claim 13 , wherein the second computing device executes the block-level backup based on instructions received from a storage manager, which executes on a computing device comprising one or more hardware processors.
18. The method of claim 17 , wherein the threshold measure of changed data blocks is maintained at the storage manager and transmitted to the first computing device.
19. The method of claim 13 , wherein a media agent that executes on a computing device, which comprises one or more hardware processors, causes the secondary copy generated by the block-level backup to be stored at a data storage device.
20. The method of claim 13 , wherein the first computing device maintains the first mapping based on the information indicating that the one or more first data files are associated with the application.