Application consistent network backup using three phase full quorum
A three-phase full quorum commit method enabling backing up of network devices that do not offer direct hooks in order to have application consistent protection. Devices are verified to be ready to perform a backup, and a condition of reaching and maintaining a full quorum of devices within a maximum time period is required before the system can be backed up. The three phase backup process reduces the chance of changes to network devices from corrupting consistency among the saved states of the different and disparate network devices. Multiple devices of different makes and models participate together as a unified backup as a network partition and all devices are verified as being in a ready state. The device configuration data is moved from device memory to local disk, and can then be tiered to secondary storage.
1. A computer-implemented method of providing application consistent backup of network equipment devices in a network, comprising:
determining a readiness of all the network equipment devices in the network to perform the backup in a prepare phase using a period of time accommodating a respective communication protocol of each network equipment device;
grouping two or more of the network equipment devices into a partition of a plurality of partitions;
configuring a data protection network device to backup and restore configuration changes of the partition using a three phase full quorum (3P-FQ) mechanism to provide all devices a same amount of time to invoke protection measures through individual prepare, snap, and save phases using device ternary content-addressable memory (TCAM), and to protect the network equipment devices of the partition based on a service level (SLA) policy apart from a fixed maintenance schedule, until all devices are ready;
performing, if all network equipment devices are determined to be ready, a snap and save phase saving configuration data including initial settings and the configuration changes of each of the network equipment devices to local storage to allow backup of a corresponding network equipment device to be completed out of sync with the plurality of network equipment devices through use of the local storage storing configuration items of the corresponding network device; and
performing, if all network equipment devices in the partition perform the snap and save phase, a backup and tier phase storing the configuration data of each of the network equipment devices to secondary storage from the local storage.
2. The method of claim 1 wherein the step of determining the readiness comprises:
defining a maximum time period of the period of time for readiness;
first determining if all devices are ready upon an initial readiness check; and
second determining, if not all the network equipment devices are ready upon the initial readiness check, whether all non-ready devices are ready within the maximum time period, and aborting the backup if not, otherwise acquiring and creating login sessions, and continuing to check that all the network equipment devices remain online and ready during the maximum time period.
3. The method of claim 2 wherein the step of continuing to check that all network equipment devices remain online and ready comprises continuously and periodically sending a status request signal to each device of all devices.
4. The method of claim 2 wherein readiness comprises a respective device being online and connected to the network and in control of all required authorization keys for network access, and is ready to accept a backup request.
5. The method of claim 1 wherein the snap and save phase comprises:
taking a snapshot backup of respective configuration data of each network equipment device;
saving the snapshot backup to the local storage; and
aborting the backup if any device of all network equipment devices fails taking the snapshot backup or saving the snapshot backup.
6. The method of claim 1 wherein the backup and tier phase comprises:
issuing a backup command to each network equipment device;
moving the snapshot backup from the local storage to the secondary storage; and
aborting the backup if any device of all network equipment devices fails executing the backup command or moving the snapshot backup.
7. The method of claim 1 wherein the network equipment devices comprise a plurality of interface devices using different logic circuits and programming code, and further comprise at least one of an out-of-band device coupled to other network equipment devices through a network implementing out-of-band protocols.
8. The method of claim 7 wherein the out-of-band device is an interface device comprising one of: a managed switch, a router, a firewall, and a buffer.
9. The method of claim 8 wherein the network comprises the out-of-band protocol network and a production software network coupling a plurality of computers together for the execution of one or more applications.
10. A computer-implemented method of providing application consistent backup of network equipment devices in a network, comprising:
grouping two or more of the network equipment devices into a partition of a plurality of partitions;
configuring a data protection network device to backup and restore configuration changes of the partition using a three phase full quorum (3P-FQ) mechanism to provide all devices a same amount of time to invoke protection measures through individual prepare, snap, and save phases using device ternary content-addressable memory (TCAM), and to protect the network equipment devices of the partition based on a service level (SLA) policy apart from a fixed maintenance schedule, until all devices are ready;
determining if a full quorum of network equipment devices are ready for the backup;
defining a maximum timeout period to allow the full quorum to reach readiness for the backup, the maximum timeout period defining a period of time accommodating a respective communication protocol of each network equipment device;
taking a snapshot backup of each network equipment device in the partition if the full quorum is ready;
storing the snapshot backup in local storage in a snap and save phase saving configuration data including initial settings and the configuration changes of each of the network equipment devices to local storage to allow backup of a corresponding network equipment device to be completed out of sync with the plurality of network equipment devices through use of the local storage storing configuration items of the corresponding network device;
backing up the snapshot backup from local storage to secondary storage; and
aborting the backup if at least one of: any network equipment device is not ready for the backup within the maximum timeout period, fails taking the snapshot backup, or fails backing up its configuration data to the secondary storage.
11. The method of claim 10 wherein each network equipment device is an interface device comprising one of: a managed switch, a router, a firewall, and a buffer.
12. The method of claim 11 wherein the snapshot backup comprises configuration information for a respective network equipment device and includes at least one of make, model, version, network address, and port configuration.
13. The method of claim 12 wherein the network equipment devices comprise a plurality of interface devices using different logic circuits and programming code, and further comprise at least one of an out-of-band device coupled to other network equipment devices through a network implementing out-of-band protocols.
14. The method of claim 10 wherein readiness comprises a respective device being online and connected to the network and in control of all required authorization keys for network access.
15. The method of claim 10 further comprising acquiring and creating login sessions, and continuing to check that all the network equipment devices remain online and ready during the maximum time period.
16. The method of claim 10 wherein the backup is performed by data protection software executed in a backup server of the network, and each network equipment device executes a data protection network device (DPND) process managed by a respective DPND device coupled to the backup server.
17. A system for providing application consistent backup of network equipment devices in a network, comprising:
a backup server providing backup software for backing up the network equipment devices according to one or more backup policies, wherein at least some of the network equipment devices are grouped into a partition of a plurality of partitions; and
a data protection network device (DPND) coordinator between the backup software and a respective DPND process deployed in each of the network equipment devices, wherein the DPND coordinator is configured to backup and restore configuration changes of the partition using a three phase full quorum (3P-FQ) mechanism to provide all devices a same amount of time to invoke protection measures through individual prepare, snap, and save phases using device ternary content-addressable memory (TCAM), and to protect the network equipment devices of the partition based on a service level (SLA) policy apart from a fixed maintenance schedule, until all devices are ready, and to:
determine a readiness of all the network equipment devices in the network to perform the backup in a prepare phase using a period of time accommodating a respective communication protocol of each network equipment device;
perform, if all network equipment devices are determined to be ready, a snap and save phase saving configuration data of each of the network equipment devices to local storage a snap and save phase saving configuration data including initial settings and the configuration changes of each of the network equipment devices to local storage to allow backup of a corresponding network equipment device to be completed out of sync with the plurality of network equipment devices through use of the local storage storing configuration items of the corresponding network device; and
perform, if all network equipment devices perform the snap and save phase, a backup and tier phase storing the configuration data including initial settings and the configuration changes of each of the network equipment devices in the partition to secondary storage from the local storage.
18. The system of claim 17 wherein each network equipment device is an interface device comprising one of: a managed switch, a router, a firewall, and a buffer.
19. The system of claim 18 wherein the network equipment devices comprise a plurality of interface devices using different logic circuits and programming code, and further comprise at least one of an out-of-band device coupled to other network equipment devices through a network implementing out-of-band protocols.
20. The system of claim 19 wherein the snapshot backup comprises configuration information for a respective network equipment device, and wherein readiness comprises a respective device being online and connected to the network and in control of all required authorization keys for network access.