Failover systems and methods for performing backup operations
In certain embodiments, a tiered storage system is disclosed that provides for failover protection during data backup operations. The system can provide for an index, or catalog, for identifying and enabling restoration of backup data located on a storage device. The system further maintains a set of transaction logs generated by media agent modules that identify metadata with respect to individual data chunks of a backup file on the storage device. A copy of the catalog and transaction logs can be stored at a location accessible by each of the media agent modules. In this manner, in case of a failure of one media agent module during backup, the transaction logs and existing catalog can be used by a second media agent module to resume the backup operation without requiring a restart of the backup process.
1. A method for performing a backup operation in a data storage system, the method comprising:
with a first computing device comprising one or more hardware processors and which is in networked communication with a storage manager and with a first client computing device of a plurality of client computing devices in a primary storage subsystem, and which is also in networked communication with at least one first storage device residing within a secondary storage subsystem and with at least one second storage device residing within the secondary storage subsystem that is separate from the at least one first storage device:
receiving, from the storage manager, an instruction to perform a backup operation relating at least to the first client computing device of the plurality of client computing devices;
receiving a plurality of data units from the first client computing device to store on the at least one first storage device as part of a backup operation;
storing at least one data unit of the plurality of data units on the at least one first storage device; and
prior to completion of the backup operation, uploading, in association with said storing of the at least one data unit and prior to, concurrently with, or subsequent to said storing of the at least one data unit, at least one transaction log to the at least one second storage device; and
with a second computing device comprising one or more hardware processors and which is in networked communication with the first client computing device, the at least one first storage device, and the at least one second storage device:
receiving, from the storage manager, an instruction to take over control of the backup operation;
obtaining the at least one transaction log associated with the backup operation from the at least one second storage device;
using at least the at least one transaction log, determining a point in the backup operation at which the first computing device ceased performance of the backup operation; and
using the determined point in the backup operation to resume performance of the backup operation at least partly by storing on the at least one first storage device at least one other data unit which has not yet been stored on the at least one first storage device, and without repeating the storage of the at least one data unit on the at least one first storage device.
2. The method of claim 1 , further comprising, with the second computing device and prior to resuming performance of the backup operation:
obtaining an index associated with the backup operation;
applying at least the at least one transaction log to the index to create an updated index; and
storing the updated index.
3. A data storage system for performing a backup operation, comprising:
a first computing device comprising one or more hardware processors and which is in networked communication with a storage manager and with a first client computing device of a plurality of client computing devices in a primary storage subsystem, and which is also in networked communication with at least one first storage device residing within a secondary storage subsystem and with at least one second storage device residing within the secondary storage subsystem that is separate from the at least one first storage device, wherein the first computing device is configured to:
receive, from the storage manager, an instruction to perform a backup operation relating at least to the first client computing device of the plurality of client computing devices;
receive a plurality of data units from the first client computing device to store on the at least one first storage device as part of a backup operation;
store at least one data unit of the plurality of data units on the at least one first storage device; and
prior to completion of the backup operation, upload, in association with said storing of the at least one data unit and prior to, concurrently with, or subsequent to said storing of the at least one data unit, at least one transaction log to the at least one second storage device; and
a second computing device comprising one or more hardware processors and which is in networked communication with the first client computing device, the at least one first storage device, and the at least one second storage device, wherein the second computing device is configured to:
receive, from the storage manager, an instruction to take over control of the backup operation;
obtain the at least one transaction log associated with the backup operation from the at least one second storage device;
using at least the at least one transaction log, determine a point in the backup operation at which the first computing device ceased performance of the backup operation; and
using the determined point in the backup operation to resume performance of the backup operation at least partly by storing on the at least one first storage device at least one other data unit which has not yet been stored on the at least one first storage device, and without repeating the storage of the at least one data unit on the at least one first storage device.
4. The data storage system of claim 3 , wherein the second computing device is further configured to, prior to resuming performance of the backup operation:
obtain an index associated with the backup operation;
apply at least the at least one transaction log to the index to create an updated index; and
store the updated index.