Systems and methods for performance monitoring
View Patent ↗Data storage systems monitor the performance of data storage operations on a granular level and compile the information for presenting to a user. The system measures the time of execution for individual granular stages of the storage operation and in response to the monitoring results, automatically adjust parameters to optimize performance. Further, the system performs a performance test by simulating the data storage operation, but may not actually write the data to the secondary storage medium.
1. A method to monitor performance of steps of a data storage operation in a data management system, the method comprising:
receiving, with at least one computing device comprising computer hardware, an instruction to simulate a data backup operation on a data set, the data backup operation comprising a plurality of steps including at least a scan step, a setup pipeline step, a send step, and a write step, wherein each of the scan step, the setup pipeline step, the send step, and the write step has at least one adjustable parameter;
for each of the scan step, the setup pipeline step, the send step, and the write step:
executing a plurality of iterative simulations with the computer hardware, adjusting the at least one adjustable parameter in each iterative simulation of the plurality of iterative simulations, and measuring the execution times of the plurality of iterative simulations;
wherein adjusting the at least one adjustable parameter is based at least in part on an execution time of a previous iterative simulation;
storing the execution times of the plurality of iterative simulations in a storage management database;
comparing, with the computer hardware, the execution times of the plurality of iterative simulations stored in the storage management database to determine a minimum execution time of the execution times; and
identifying, with the computer hardware, at least one adjusted parameter associated with the minimum execution time to provide identified parameters; and
saving, with the computer hardware, the identified parameters associated with each of the scan step, the setup pipeline step, the send step, and the write step as default parameters for the data backup operation.
2. The method of claim 1 wherein the default parameters minimize an overall execution time of the data backup operation.
3. The method of claim 1 wherein the default parameters are saved for later performance of a non-simulated data backup operation.
4. The method of claim 1 further comprising displaying, with the computer hardware, the execution times on a graphical user interface (GUI).
5. The method of claim 1 wherein the data backup operation comprises one or more of a full backup operation, a differential backup operation, an incremental backup operation, and a mirror backup operation.
6. The method of claim 1 wherein the data set comprises one or more of files, volumes, databases, and sub-clients.
7. The method of claim 1 wherein the setup pipeline step comprises setting up a pipeline and wherein the send step comprises sending the at least a portion of the data set through the pipeline to form the simulated backup data.
8. A system to monitor performance of steps of a data storage operation in a data management system, the system comprising:
a first computing device comprising computer hardware configured to receive an instruction to simulate a data backup operation on a data set, the data backup operation comprising a plurality of steps including at least a scan step, a setup pipeline step, a send step, and a write step, wherein each of the scan step, the setup pipeline step, the send step, and the write step has at least one adjustable parameter;
for each of the scan step, the setup pipeline step, the send step, and the write step:
the computer hardware configured to execute a plurality of iterative simulations,
the first computing device configured to adjust the at least one adjustable parameter in each iterative simulation of the plurality of iterative simulations, and measure execution times of plurality of iterative simulations;
the first computing device further configured to adjust the at least one adjustable parameter based at least in part on an execution time of a previous iterative simulation;
the first computing device further configured to store the execution times of the plurality of iterative simulations in the a storage management database;
the first computing device further configured to compare the execution times of the plurality of iterative simulations stored in the storage management database to determine a minimum execution time of the execution times; and
the first computing device further configured to identify at least one adjusted parameter associated with the minimum execution time to provide identified parameters; and
the first computing device further configured to save the identified parameters associated with each of the scan step, the setup pipeline step, the send step, and the write step as default parameters for the data backup operation.
9. The system of claim 8 wherein the default parameters minimize an overall execution time of the data backup operation.
10. The system of claim 8 wherein the default parameters are saved for later performance of a non-simulated data backup operation.
11. The system of claim 8 wherein the first computing device is further configured to display the execution times on a graphical user interface (GUI).
12. The system of claim 8 wherein the data backup operation comprises one or more of a full backup operation, a differential backup operation, an incremental backup operation, and a mirror backup operation.
13. The system of claim 8 wherein the data set comprises one or more of files, volumes, databases, and sub-clients.
14. The system of claim 8 wherein the setup pipeline step comprises setting up a pipeline and wherein the send step comprises sending the at least a portion of the data set through the pipeline to form the simulated backup data.