Optimizing backup performance with heuristic configuration selection
Embodiments are described for a heuristic configuration selection process as part of or accessible by the backup management process. This processing component provides a method to automatically determine the configuration parameters needed to obtain optimal performance for a given backup/restore job. This process involves identifying key parameters that determine backup performance and suggest means to derive and incorporate those configurable parameters into the backup software automatically. Embodiments can be applied to stream based backups, or other types of backup software as well.
1. A computer-implemented method comprising:
creating a protection plan with an initial configuration for resources in a data storage system;
performing, by a backup program executed by a backup server processor, a backup operation in accordance with the initial configuration;
copying, by a backup program agent, data from a data source to protection storage;
sending, by the backup program agent, performance statistics to the backup software;
modifying the initial configuration to a modified configuration in response to the performance statistics;
completing the backup operation when the performance statistics meet defined minimum requirements;
defining an expected performance measurement based on a plurality of configuration parameters;
determining an actual performance measurement based on each of the plurality of configuration parameters;
comparing the actual performance measurement to the expected performance measurement to derive a difference measure; and
repeating, if the difference measure is above a defined threshold, the modifying step, or otherwise completing the backup operation.
2. The method of claim 1 , wherein the resources comprise at least one of: host data server resources, primary storage media, and protection storage media.
3. The method of claim 1 wherein the performance statistics are gathered for a first backup job, and wherein the modified configuration is applied to a second backup job to improve a performance of the second backup job.
4. The method of claim 3 wherein subsequent modified configurations are applied to subsequent backup jobs after the second backup job to improve a performance of each respective subsequent backup job.
5. The method of claim 1 wherein the initial configuration comprises a protection plan for the data source, the protection plan designating a backup type as one of an initial full backup, a subsequent full backup, and a subsequent incremental or differential backup.
6. The method of claim 5 wherein the initial configuration comprises a backup performance penalty representing a percentage of backup performance degradation that is acceptable to a backup administrator.
7. The method of claim 6 wherein the performance statistics specify a number of minimum channels needed to meet a desired backup performance as defined by the backup performance penalty.
8. The method of claim 1 wherein the performance measurement is defined by a backup administrator in terms of certain quality of service (QoS), recovery point objectives (RPO), recovery time objectives (RTO), data throughput, and data storage rate metrics.
9. The method of claim 1 wherein the backup system comprises a deduplication backup server running a Data Domain file system (DDFS).
10. The method of claim 9 wherein the backup system comprises an enterprise copy data management system.
11. A system having resources including host data server resources, primary storage media, and protection storage media, and comprising:
a database storing a protection plan created with initial configuration of the resources in the system;
a processor executing program code performing a backup operation executed by a backup server in accordance with the initial configuration; and
a backup program agent copying data from a data source to protection storage, sending performance statistics to the backup software, modifying the initial configuration to a modified configuration in response to the performance statistics, completing the backup operation when the performance statistics meet defined minimum requirements, defining an expected performance measurement based on a plurality of configuration parameters, determining an actual performance measurement based on each of the plurality of configuration parameters,
comparing the actual performance measurement to the expected performance measurement to derive a difference measure, and repeating, if the difference measure is above a defined threshold, the modifying step, or otherwise completing the backup operation.
12. The system of claim 11 wherein the backup server completes the backup operation when the performance statistics meet defined minimum requirements.
13. The system of claim 12 wherein the performance statistics are gathered for a first backup job, and wherein the modified configuration is applied to a second backup job to improve a performance of the second backup job, and wherein subsequent modified configurations are applied to subsequent backup jobs after the second backup job to improve a performance of each respective subsequent backup job.
14. The system of claim 13 wherein the initial configuration comprises a protection plan for the data source, the protection plan designating a backup type as one of an initial full backup, a subsequent full backup, and a subsequent incremental or differential backup.
15. The system of claim 14 wherein the initial configuration comprises a backup performance penalty representing a percentage of backup performance degradation that is acceptable to a backup administrator.
16. The system of claim 15 wherein the performance statistics specify a number of minimum channels needed to meet a desired backup performance as defined by the backup performance penalty.
17. The system of claim 11 wherein the performance measurement is defined by a backup administrator in terms of certain quality of service (QoS), recovery point objectives (RPO), recovery time objectives (RTO), data throughput, and data storage rate metrics.
18. The system of claim 12 wherein the system comprises a deduplication backup server running a Data Domain file system (DDFS).
19. A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to implement a method by:
creating a protection plan with an initial configuration for resources in a data storage system;
performing, by a backup program executed by a backup server processor, a backup operation in accordance with the initial configuration;
copying, by a backup program agent, data from a data source to protection storage;
sending, by the backup program agent, performance statistics to the backup software;
modifying the initial configuration to a modified configuration in response to the performance statistics; and
completing the backup operation when the performance statistics meet defined minimum requirements;
defining an expected performance measurement based on a plurality of configuration parameters;
determining an actual performance measurement based on each of the plurality of configuration parameters;
comparing the actual performance measurement to the expected performance measurement to derive a difference measure; and
repeating, if the difference measure is above a defined threshold, the modifying step, or otherwise completing the backup operation.
20. The computer program product of claim 19 wherein the initial configuration comprises a backup performance penalty representing a percentage of backup performance degradation that is acceptable to a backup administrator, and further wherein the performance statistics specify a number of minimum channels needed to meet a desired backup performance as defined by the backup performance penalty.