Intelligent backups with dynamic proxy in virtualized environment
Embodiments are described for dynamically spawning and/or decommissioning backup proxy nodes in a virtual infrastructure. A backup server can include a polling agent that polls the virtual infrastructure to determine a list of virtual machines whose data is to be backed up, and a list if virtual proxy nodes that facilitate backups of virtual machine data. A proxy map can be generated that describes the mapping of virtual machines to backup proxy nodes in the virtual infrastructure. Rules can be applied to the proxy map to determine whether a new proxy node should be spawned or an existing proxy node should be decommissioned. A new virtual proxy can be generated by accessing a database of preconfigured template virtual proxies to quickly generate the new virtual proxy. One or more virtual machines can be remapped to the newly created virtual proxy to ensure optimal throughput of backup data.
1. A computer-implemented method comprising:
setting a polling timer interval for initiating polling;
periodically polling a virtual machine host according to the polling timer interval to determine a plurality of virtual machines configured on the virtual machine host and attributes about each of the plurality of virtual machines, including at least one of a size of the virtual machine or a size of the data to be backed up for the virtual machine;
determining a number of backup proxies configured for backing up the data of each of the plurality of virtual machines on the virtual machine host and a mapping ratio of virtual machines to the number of backup proxies;
generating a new backup proxy based on the plurality of virtual machines and the number of backup proxies, in response to a rule in a set of one or more rules indicating that the mapping ratio of the plurality of virtual machines to backup proxies exceeds a threshold value, or only one backup proxy is configured for backing up the plurality of virtual machines;
automatically provisioning the new backup proxy based on a predetermined proxy template in response to the one or more rules indicating that the new backup proxy should be generated;
automatically, decommissioning one or more of the backup proxies in response to determining that a backup proxy is older than a threshold value of time, or a backup proxy uses an operating system that is outdated by a threshold number of revisions;
spawning a replacement backup proxy to replace each backup proxy decommissioned due to being old or outdated in response to determining that the replacement backup proxy is needed; and
in response to a change in the plurality of virtual machines, generation of one or more new backup proxies, or decommissioning of one or more old/outdated backup proxies, storing an updated list of the virtual machines and the backup proxies and an updated mapping of the virtual machines to the backup proxies in a configuration database; and
updating the polling timer interval by:
determining a configuration change occurred more than once during a last polling; and
decreasing the polling timer interval to a minimum time interval value between two configuration changes during the last polling, wherein the configuration change comprises the change in the plurality of virtual machines, generation of one or more backup proxies or decommissioning of one or more old/outdated backup proxies.
2. The method of claim 1 , wherein polling the virtual machine host comprises calling an application programming interface to a virtual machine manager on the virtual machine host to receive a list of virtual machines configured on the virtual machine host.
3. The method of claim 1 , further comprising:
analyzing the attributes of the plurality of virtual machines to be backed up, a mapping of the plurality of virtual machines to be backed up, and the backup proxies to determine at least one of: whether to add a new backup proxy or delete a backup proxy.
4. The method of claim 1 , further comprising automatically remapping one or more of the plurality of virtual machines from one of the backup proxies to the new backup proxy.
5. The method of claim 1 , wherein a rule indicates that the new backup proxy should be generated when there is insufficient parallelism in the backup system.
6. The method of claim 1 , wherein a rule indicates that the new backup proxy should be generated when a backup of a particular virtual machine is forecast to take longer than is allowed by a backup service level agreement.
7. A non-transitory computer-readable medium programmed with executable instructions that, when executed by a processing system having at least one hardware processor; perform operations comprising:
setting a polling timer interval for initiating polling;
periodically polling a virtual machine host according to the polling timer interval to determine a plurality of virtual machines configured on the virtual machine host and attributes about each of the plurality of virtual machines, including at least one of size of the virtual machine or a size of the data to be backed up for the virtual machine;
determining a number of backup proxies configured for backing up the data of each of the plurality of virtual machines on the virtual machine host;
generating a new backup proxy based on the plurality of virtual machines and the number of backup proxies, in response to a rule in a set of one or more rules indicating that the mapping ratio of the plurality of virtual machines to backup proxies exceeds a threshold value, or only one backup proxy is configured for backing up the plurality of virtual machines;
automatically provisioning the new backup proxy based on a predetermined proxy template in response to the one or more rules indicating that the new backup proxy should be generated;
automatically decommissioning one or more of the backup proxies in response to determining that a backup proxy is older than a threshold value of time, or a backup proxy uses an operating system that is outdated by a threshold number of revisions;
spawning a replacement backup proxy to replace each backup proxy decommissioned due to being old or outdated in response to determining that the replacement backup proxy is needed;
in response to a change in the plurality of virtual machines, generation of one or more new backup proxies, or decommissioning of one or more old/outdated backup proxies, storing an updated list of the virtual machines and the backup proxies and an updated mapping of the virtual machines to the backup proxies in a configuration database; and
updating the polling timer interval by:
determining a configuration change occurred more than once during a last polling; and
decreasing the polling tinier interval to a minimum time interval value between two configuration changes during the last polling, wherein the configuration change comprises the change in the plurality of virtual machines, generation of one or more backup proxies or decommissioning of one or more old/outdated backup proxies.
8. The medium of claim 7 , wherein polling the virtual machine host comprises calling an application programming interface to a virtual machine manager on the virtual machine host to receive a list of virtual machines configured on the virtual machine host.
9. The medium of claim 7 , further comprising:
analyzing the attributes of the plurality of virtual machines to be backed up, a mapping of the plurality of virtual machines to be backed up, and the backup proxies to determine at least one of: whether to add a new backup proxy or delete a backup proxy.
10. The medium of claim 7 , further comprising automatically remapping one or more of the plurality of virtual machines from one of the backup proxies to the new backup proxy.
11. The medium of claim 7 , wherein a rule indicates that the new backup proxy should be generated when there is insufficient parallelism in the backup system.
12. The medium of claim 7 , wherein a rule indicates that the new backup proxy should be generated when a backup of a particular virtual machine is forecast to take longer than is allowed by a backup service level agreement.
13. A system comprising:
a processing system having at least one hardware processor, the processing system coupled to a memory programmed with executable instructions that, when executed by the processing system, perform operations comprising:
setting a polling timer interval for initiating polling;
periodically polling a virtual machine host according to the polling timer interval to determine a plurality of virtual machines configured on the virtual machine host and attributes about each of the plurality of virtual machines, including at least one of a size of the virtual machine or a size of the data to be backed up for the virtual machine;
determining a number of backup proxies configured for backing up the data of each of the plurality of virtual machines on the virtual machine host and a mapping ratio of virtual machines to the number of backup proxies;
generating a new backup proxy based on the plurality of virtual machines and the number of backup proxies, in response to a rule in a set of one or more rules indicating that the mapping ratio of the plurality of virtual machines to backup proxies exceeds a threshold value, or only one backup proxy is configured for backing up the plurality of virtual machines;
automatically provisioning the new backup proxy based on a predetermined proxy template in response to the one or more rules indicating that the new backup proxy should be generated;
automatically decommissioning one or more of the backup proxies in response to determining that a backup proxy is older than a threshold value of time, or a backup proxy uses an operating system that is outdated by a threshold number of revisions;
spawning a replacement backup proxy to replace each backup proxy decommissioned due to being old or outdated in response to determining that the replacement backup proxy is needed; and
in response to a change in the plurality of virtual machines, generation of one or more new backup proxies, or decommissioning of one or more old; outdated backup proxies, storing an updated list of the virtual machines and the backup proxies and an updated mapping of the virtual machines to the backup proxies in a configuration database; and
updating the polling, timer interval by:
determining a configuration change occurred more than once during a last polling; and
decreasing the polling timer interval to a minimum time interval value between two configuration changes during the last polling, wherein the configuration change comprises the change in the plurality of virtual machines, generation of one or more backup proxies or decommissioning of one or more old/outdated backup proxies.
14. The system of claim 13 , wherein polling the virtual machine host comprises calling an application programming interface to a virtual machine manager on the virtual machine host to receive a list of virtual machines configured on the virtual machine host.
15. The system of claim 13 , further comprising:
analyzing the attributes of the plurality of virtual machines to be backed up, a mapping of the plurality of virtual machines to be backed up, and the backup proxies to determine at least one of: whether to add a new backup proxy or delete a backup proxy.
16. The system of claim 13 , further comprising automatically remapping one or more of the plurality of virtual machines from one of the backup proxies to the new backup proxy.
17. The system of claim 13 , wherein a rule indicates that the new backup proxy should be generated when there is insufficient parallelism in the backup system.
18. The system of claim 13 , wherein a rule indicates that the new backup proxy should be generated when a backup of a particular virtual machine is forecast to take longer than is allowed by a backup service level agreement.