Parallel proxy backup methodology
Embodiments describe concurrently backing up data associated with a relational database management system (RDBMS). In an embodiment, a request is received to back up data from multiple nodes to a target storage source. The multiple nodes are configured to provide storage services to data associated with the RDBMS and are communicatively coupled to a backup server configured to manage backup of one or more storage devices. In response to the request, one or more preference nodes are identified from multiple nodes based on a preference configuration. Using a backup algorithm, portions of the backup to be performed are assigned to one or more preference nodes selected from the identified preference nodes. The backup operations are initiated using the selected preference node(s). Each portion is a distinct subset of the data to be backed up and each of the selected preference node(s) is assigned a unique portion.
1. A computer-implemented method for backing up data, comprising:
receiving a request to back up data from a plurality of nodes to a target storage source, the plurality of nodes communicatively coupled to a backup server configured to manage backup of a plurality of storage devices, the plurality of nodes including a primary node and one or more secondary nodes, and each of the primary node and the one or more secondary nodes being configured to provide storage services to data associated with a relational database management system (RDBMS), wherein the plurality of nodes support a plurality of database availability groups, each database availability group comprising a set of databases that fail over together, wherein each of the plurality of nodes stores replicas of datasets from two or more of the plurality of database availability groups, and wherein the backup comprises datasets from two or more of the plurality of database availability groups;
in response to the request, identifying a plurality of preference nodes from the plurality of nodes based on a preference configuration;
assigning, using a backup algorithm, portions of the backup to be performed by one or more selected preference nodes from the plurality of identified preference nodes, wherein each portion of the backup is a distinct subset of the data to be backed up, wherein each of the one or more selected preference nodes is assigned a unique portion of the backup, and wherein backing up of at least one database availability group is distributed to two or more of the selected preference nodes, each of which stores a respective unique subset of databases of the at least one database availability group and performs backing up of its respective unique subset of databases of the at least one database availability group; and
initiating backup operations with the one or more selected preference nodes.
2. The method of claim 1 , wherein, when backup of a respective one of the portions is unsuccessful, a notification associated with the respective one of the portions indicates that the respective portion was unsuccessfully backed up and the method further comprises:
identifying one or more substitute preference nodes from the plurality of preference nodes; and
re-assigning, using the backup algorithm, the unsuccessfully stored portion of the backup to be performed by the one or more substitute preference nodes.
3. The method of claim 1 , wherein the backup algorithm is implemented by at least one of the backup server or the primary node and wherein the identification of the plurality of preference nodes from the plurality of nodes is performed by at least one of the backup server or the primary node.
4. The method of claim 1 , wherein the backup algorithm determines the portions of the backup to assign to the respective ones of the plurality of preference nodes based on at least one of:
a backup policy,
a size of the data to be backed up, or
a number of the databases or files that make up the data to be backed up.
5. The method of claim 1 , wherein each of the plurality of preference nodes creates its respective portion of the backup, sends its respective portion of the backup to the target storage system, and sends its notification to the backup server independently of operations performed by other ones of the plurality of preference nodes.
6. The method of claim 5 , wherein each notification is sent from a respective one of the plurality of preference nodes and received by the primary node, which forwards the notification to the backup server.
7. A non-transitory computer readable medium comprising instructions, which when executed by a processing system, cause the processing system to perform operations for backup, the operations comprising:
receiving a request to back up data from a plurality of nodes to a target storage source, the plurality of nodes communicatively coupled to a backup server configured to manage backup of a plurality of storage devices, the plurality of nodes including a primary node and one or more secondary nodes, and each of the primary node and the one or more secondary nodes being configured to provide storage services to data associated with a relational database management system (RDBMS), wherein the plurality of nodes support a plurality of database availability groups, each database availability group comprising a set of databases that fail over together, wherein each of the plurality of nodes stores replicas of datasets from two or more of the plurality of database availability groups, and wherein the backup comprises datasets from two or more of the plurality of database availability groups;
in response to the request, identifying a plurality of preference nodes from the plurality of nodes based on a preference configuration;
assigning, using a backup algorithm, portions of the backup to be performed by one or more selected preference nodes from the plurality of identified preference nodes, wherein each portion of the backup is a distinct subset of the data to be backed up, wherein each of the one or more selected preference nodes is assigned a unique portion of the backup, and wherein backing up of at least one database availability group is distributed to two or more of the selected preference nodes, each of which stores a respective unique subset of databases of the at least one database availability group and performs backing up of its respective unique subset of databases of the at least one database availability group; and
initiating backup operations with the one or more selected preference nodes.
8. The non-transitory computer readable medium of claim 7 , wherein, when backup of a respective one of the portions is unsuccessful, a notification associated with the respective one of the portions indicates that the respective portion was unsuccessfully backed up and the method further comprises:
identifying one or more substitute preference nodes from the plurality of preference nodes; and
re-assigning, using the backup algorithm, the unsuccessfully stored portion of the backup to be performed by the one or more substitute preference nodes.
9. The non-transitory computer readable medium of claim 7 , wherein the backup algorithm is implemented by at least one of the backup server or the primary node and wherein the identification of the plurality of preference nodes from the plurality of nodes is performed by at least one of the backup server or the primary node.
10. The non-transitory computer readable medium of claim 7 , wherein the backup algorithm determines the portions of the backup to assign to the respective ones of the plurality of preference nodes based on at least one of:
a backup policy,
a size of the data to be backed up, or
a number of the databases or files that make up the data to be backed up.
11. The non-transitory computer readable medium of claim 7 , wherein each of the plurality of preference nodes creates its respective portion of the backup, sends its respective portion of the backup to the target storage system, and sends its notification to the backup server independently of operations performed by other ones of the plurality of preference nodes.
12. The non-transitory computer readable medium of claim 11 , wherein each notification is sent from a respective one of the plurality of preference nodes and received by the primary node, which forwards the notification to the backup server.
13. A system for backing up data, the system comprising one or more processing devices, the one or more processing devices being configured to:
receive a request to back up data from a plurality of nodes to a target storage source, the plurality of nodes communicatively coupled to a backup server configured to manage backup of a plurality of storage devices, the plurality of nodes including a primary node and one or more secondary nodes, and each of the primary node and the one or more secondary nodes being configured to provide storage services to data associated with a relational database management system (RDBMS), wherein the plurality of nodes support a plurality of database availability groups, each database availability group comprising a set of databases that fail over together, wherein each of the plurality of nodes stores replicas of datasets from two or more of the plurality of database availability groups, and wherein the backup comprises datasets from two or more of the plurality of database availability groups;
in response to the request, identify a plurality of preference nodes from the plurality of nodes based on a preference configuration;
assign, using a backup algorithm, portions of the backup to be performed by one or more selected preference nodes from the plurality of identified preference nodes, wherein each portion of the backup is a distinct subset of the data to be backed up, wherein each of the one or more selected preference nodes is assigned a unique portion of the backup, and wherein backing up of at least one database availability group is distributed to two or more of the selected preference nodes, each of which stores a respective unique subset of databases of the at least one database availability group and performs backing up of its respective unique subset of databases of the at least one database availability group; and
initiate backup operations with the one or more selected preference nodes.
14. The system of claim 13 , wherein, when backup of a respective one of the portions is unsuccessful, a notification associated with the respective one of the portions indicates that the respective portion was unsuccessfully backed up and the method further comprises:
identify one or more substitute preference nodes from the plurality of preference nodes; and
re-assign, using the backup algorithm, the unsuccessfully stored portion of the backup to be performed by the one or more substitute preference nodes.
15. The system of claim 13 , wherein the backup algorithm is implemented by at least one of the backup server or the primary node and wherein the identification of the plurality of preference nodes from the plurality of nodes is performed by at least one of the backup server or the primary node.
16. The system of claim 13 , wherein the backup algorithm determines the portions of the backup to assign to the respective ones of the plurality of preference nodes based on at least one of:
a backup policy,
a size of the data to be backed up, or
a number of the databases or files that make up the data to be backed up.
17. The system of claim 13 , wherein each of the plurality of preference nodes creates its respective portion of the backup, sends its respective portion of the backup to the target storage system, and sends its notification to the backup server independently of operations performed by other ones of the plurality of preference nodes.
18. The system of claim 17 , wherein each notification is sent from a respective one of the plurality of preference nodes and received by the primary node, which forwards the notification to the backup server.