Providing status of data storage operations within an information management system
Systems and methods disclosed herein provide users with granular current information about backup operations that completed at their user devices, regardless of whether a backup job as a whole, which comprises a plurality of backup operations across multiple computing devices, is presently complete or incomplete. Accordingly, an illustrative information management system comprises feature enhancements that collect granular information about data storage operations occurring at a client device, so that up-to-date status thereof may be provided to querying users on demand. Thus, the illustrative system need not wait for the completion of the backup job to answer status queries about backup operations occurring before the full completion of the backup job. Moreover, data backed up in one of these backup operations may be restored on demand independently of whether the backup job as a whole is presently complete or incomplete.
1 . A system comprising:
a storage manager comprising one or more hardware processors, wherein the storage manager is configured to:
receive a query about a backup status of data of a client computing device;
determine that a backup job, which is not-yet completed, comprises a first backup operation that has been completed,
wherein the first backup operation previously backed up data of the client computing device, and
wherein the backup job comprises a plurality of backup operations associated with a plurality of client computing devices;
using a unique job identifier associated with the backup job, extract, from an indexing server, backup index information corresponding to the first backup operation, wherein the indexing server comprises one or more hardware processors and is distinct from the storage manager,
wherein the backup index information comprises metadata including timestamps, data sizes, locations, and file counts for completed backup operations;
process the backup index information to generate a status of the first backup operation;
provide the status of the first backup operation, which has been completed, to the client computing device, wherein the backup job is presently incomplete;
receive a request to restore data backed up by the first backup operation; and
in response to the request, initiate a restore operation of the data backed up by the first backup operation; and
a data agent executing on the client computing device, wherein the data agent is configured to:
generate a transaction log file comprising backup metadata associated with the first backup operation and further comprising an association with the backup job; and
transmit the transaction log file to the indexing server,
wherein the backup index information extracted from the indexing server is based on the transaction log file.
2 . The system of claim 1 wherein the storage manager is further configured to, in response to the query, provide a status of one or more backup operations among the plurality of backup operations of the backup job that were completed at the client computing device.
3 . The system of claim 1 wherein the client computing device comprises one or more hardware processors, and hosts one or more of: a core media agent and a data agent, and wherein one or more of the core media agent and the data agent is configured to:
receive, from the storage manager, a first instruction to execute the backup job, wherein the first instruction comprises job metadata for the backup job; and
use the job metadata received in the first instruction to perform a plurality of backup operations, including the first backup operation, without receiving an additional instruction from the storage manager, distinct from the first instruction to perform the backup job.
4 . The system of claim 1 wherein the data agent is further configured to:
perform the first backup operation using job metadata associated with the backup job, wherein the job metadata comprises information for executing the backup job.
5 . The system of claim 1 wherein the first backup operation is one of a first plurality of backup operations of the backup job that were completed at the client computing device, and wherein the storage manager is further configured to:
extract, from the indexing server, backup index information corresponding to all of the first plurality of backup operations of the backup job;
process the backup index information corresponding to all of the first plurality of backup operations of the backup job to determine status information thereof; and
provide the status information of all of the first plurality of backup operations of the backup job to the client computing device.
6 . The system of claim 1 wherein the storage manager is configured to:
upon receipt of the query about the backup status, utilize job metadata associated with the backup job to extract from the indexing server backup index information for completed backup operations of the backup job.
7 . The system of claim 1 wherein the storage manager is configured to:
store job metadata of a synthetic full backup job of data of the client computing device, wherein the synthetic full backup job is completed, and wherein the synthetic full backup job is distinct from the backup job that comprises the first backup operation;
upon receipt of the query about the backup status, retrieve the job metadata of the synthetic full backup job;
process the backup index information and the job metadata of the synthetic full backup job to generate a combined status of the first backup operation and the synthetic full backup job; and
provide the combined status to the client computing device.
8 . The system of claim 1 wherein the storage manager is configured to, in response to the query and after the backup job is complete, provide a status of the plurality of backup operations of the backup job that were completed at the client computing device.
9 . The system of claim 1 wherein the client computing device comprises one or more hardware processors, and hosts one or more of a core media agent and a data agent, wherein one or more of the core media agent and the data agent is configured to perform the restore operation.
10 . The system of claim 1 wherein the storage manager is configured to:
receive a request to restore data backed up by the first backup operation;
determine that a second backup operation is currently backing up data at the client computing device;
refrain from initiating a restore operation of the data backed up by the first backup operation, until the second backup operation is complete; and
after the second backup operation is complete, initiate a restore operation of the data backed up by the first backup operation.
11 . The system of claim 1 wherein the status of the first backup operation comprises a statistical performance metric of the first backup operation, which comprises one or more of: a timestamp of the first backup operation, one or more of a size of data backed up in the first backup operation, a size of data associated with an application backed up by the first backup operation, and a number of data files backed up in the first backup operation.
12 . The system of claim 1 wherein the backup index information identifies one or more of: the backup job, the first backup operation, the client computing device, a timestamp of the first backup operation, one or more backup copies generated by the first backup operation, and one or more storage locations of the one or more backup copies.
13 . The system of claim 1 wherein the status of the first backup operation is provided to the client computing device independently of whether a second backup operation of the backup job is currently backing up data at the client computing device.
14 . The system of claim 1 wherein the status of the first backup operation is provided to the client computing device independently of whether other backup operations of the backup job are complete or incomplete at other client computing devices.
15 . A computer-implemented method comprising:
receiving, by a storage manager, a query about a backup status of data of a client computing device, wherein the storage manager comprises one or more hardware processors;
determining that a backup job, which is not-yet completed, comprises a first backup operation that has been completed,
wherein the first backup operation previously backed up data of the client computing device, and
wherein the backup job comprises a plurality of backup operations associated with a plurality of client computing devices;
using a unique job identifier associated with the backup job, obtaining, from an indexing server, backup index information corresponding to the first backup operation, wherein the indexing server comprises one or more hardware processors and is distinct from the storage manager,
wherein the backup index information comprises metadata including timestamps, data sizes, locations, and file counts for completed backup operations;
processing the backup index information to generate a status of the first backup operation;
providing the status of the first backup operation, which has been completed, in response to the query, wherein the backup job is presently incomplete;
generating a transaction log file comprising backup metadata associated with the first backup operation and further comprising an association with the backup job;
transmitting the transaction log file to the indexing server,
wherein the backup index information extracted from the indexing server is based on the transaction log file;
receiving a request to restore data backed up by the first backup operation; and
in response to the request, initiating a restore operation of the data backed up by the first backup operation.
16 . The method of claim 15 wherein the client computing device comprises one or more hardware processors, and further comprising:
receiving, by the client computing device from the storage manager, a first instruction to execute the backup job, wherein the first instruction comprises job metadata for the backup job; and
using the job metadata received in the first instruction to perform a plurality of backup operations, including the first backup operation, without receiving an additional instruction from the storage manager, distinct from the first instruction to perform the backup job.
17 . The method of claim 15 wherein the client computing device comprises one or more hardware processors, and further comprising:
performing the first backup operation at the client computing device using job metadata associated with the backup job, wherein the job metadata comprises information for executing the backup job.
18 . The method of claim 15 further comprising: upon receipt of the query about the backup status, utilizing job metadata associated with the backup job to extract from the indexing server the backup index information for completed backup operations of the backup job.