Dynamic parallelism
Techniques to optimize use of the available capacity of a backup target storage device are disclosed. In various embodiments, a current capacity of a target system to which backup data is to be streamed to handle additional streams is determined dynamically, at or near a time at which a backup operation is to be performed. One or more backup parameters of the backup operation is/are set dynamically, based at least in part on the dynamically determined current capacity of the target system.
1. A method of protecting data, comprising:
determining dynamically, at or near a time at which a backup operation is to be performed, a current capacity of a target system to which backup data is to be streamed to handle additional streams;
comparing the determined current capacity of the target system to one or more capabilities of a source system, wherein the one or more capabilities of the source system include a maximum number of concurrent backup write streams;
determining a number of concurrent backup streams for the backup operation based on the maximum number of concurrent backup write streams of the source system and a current number of additional backup write streams that the target system is capable of receiving;
dynamically setting one or more backup parameters of the backup operation, based at least in part on the determined number of concurrent backup streams for the backup operation; and
backing up to the target system the backup data based on the one or more backup parameters.
2. The method of claim 1 , further comprising:
receiving an indication to perform the backup operation; and
initiating at least in part in response to the indication said step of determining dynamically the current capacity of the target system.
3. The method of claim 1 , wherein the current capacity of the target system comprises the current number of additional backup write streams that the target system is capable of receiving.
4. The method of claim 1 , wherein dynamically setting one or more backup parameters of the backup operation includes allocating among two or more data sets said current capacity of the target system.
5. The method of claim 1 , wherein dynamically setting one or more backup parameters of the backup operation includes allocating among two or more data movers said current capacity of the target system.
6. The method of claim 1 , wherein the current capacity of the target system is determined by a calibrator module, appliance, or system with which the backup operation is associated.
7. The method of claim 1 , wherein the current capacity of the target system is determined at least in part by invoking an application programming interface (API) of the target system.
8. The method of claim 1 , wherein the one or more backup parameters of the backup operation are set based at least in part on a capability of the source system on which a source data to be backed up in the backup operation is stored.
9. The method of claim 1 , wherein the one or more backup parameters of the backup operation are set based at least in part on an attribute of a source data to be backed up in the backup operation is stored.
10. The method of claim 1 , further comprising monitoring the target system while the backup operation is being performed to detect a change in said current capacity of the target system.
11. The method of claim 10 , further comprising adjusting said one or more backup parameters during the course of the backup operation based at least in part on a determination that the current capacity of the target system has been detected to have changed.
12. A system to protect data, comprising:
a communication interface; and
a processor coupled to the communication interface and configured to:
determine dynamically, at or near a time at which a backup operation is to be performed, a current capacity of a target system to which backup data is to be streamed to handle additional streams;
compare the determined current capacity of the target system to one or more capabilities of a source system, wherein the one or more capabilities of the source system include a maximum number of concurrent backup write streams;
determine a number of concurrent backup streams for the backup operation based on the maximum number of concurrent backup write streams of the source system and a current number of additional backup write streams that the target system is capable of receiving;
dynamically set one or more backup parameters of the backup operation, based at least in part on the determined number of concurrent backup streams for the backup operation; and
back up to the target system the backup data based on the one or more backup parameters.
13. The system of claim 12 , wherein the processor is further configured to:
receive an indication to perform the backup operation; and
determine dynamically the current capacity of the target system at least in part in response to the indication.
14. The system of claim 12 , wherein the current capacity of the target system comprises the current number of additional backup write streams that the target system is capable of receiving.
15. The system of claim 12 , wherein to dynamically set one or more backup parameters of the backup operation, the processor is further configured to allocate among two or more data sets said current capacity of the target system.
16. The system of claim 12 , wherein to dynamically set one or more backup parameters of the backup operation, the processor is further configured to allocate among two or more data movers said current capacity of the target system.
17. The system of claim 12 , wherein the current capacity of the target system is determined at least in part by invoking an application programming interface (API) of the target system.
18. The system of claim 12 , wherein the one or more backup parameters of the backup operation are set based at least in part on a capability of the source system on which a source data to be backed up in the backup operation is stored.
19. A computer program product to protect data, the computer program product being embodied in a non-transitory computer readable medium and comprising computer instructions for:
determining dynamically, at or near a time at which a backup operation is to be performed, a current capacity of a target system to which backup data is to be streamed to handle additional streams;
comparing the determined current capacity of the target system to one or more capabilities of a source system, wherein the one or more capabilities of the source system include a maximum number of concurrent backup write streams;
determining a number of concurrent backup streams for the backup operation based on the maximum number of concurrent backup write streams of the source system and a current number of additional backup write streams that the target system is capable of receiving;
dynamically setting one or more backup parameters of the backup operation, based at least in part on the determined number of concurrent backup streams for the backup operation; and
backing up to the target system the backup data based on the one or more backup parameters.
20. The computer program product of claim 19 , wherein the current capacity of the target system comprises the current number of additional backup write streams that the target system is capable of receiving.