Systems and methods for backing up to a virtual tape library
Presented herein are systems and methods for backing up and restoring data from a client computing system to a provider's virtual tape library using a proxy. The proxy emulates a physical tape library that interfaces with a client's system and allowing the use of client's native tape backup commands to initiate the backup data process. The backup data is transferred into files that represent tapes in the proxy and further processed into extents in the provider's object store. The processed backup data is stored in the local cache in the object store where it is retained for future access. The backup data may also be transferred to long-term storage via a media agent that facilitate movement of the data from the local cache to secondary storage. The present disclosure also provides for creating auxiliary copies of the backed-up data using a second VTL at a second site.
1. An information management system, configured to back up data to a virtual tape library, comprising:
one or more processors configured to:
send to a proxy a command to initiate a backup operation of data stored at a host computing device,
wherein the proxy comprises a virtual tape library (VTL) and a mount point to an object store,
wherein the object store comprises a local cache storage;
initiate a transfer of the data from the host computing device to the VTL associated with the proxy;
convert the data into backup files wherein each of the backup files represents a physical tape;
transmit the backup files to an object store mounted on the proxy;
convert at least one backup file into smaller size extents and store the smaller size extents to the local cache storage;
generate a backup index comprising information associated with the backup files transmitted to the object store; and
transmit a copy of the backup index to an index server hosted by provider system.
2. The information management system of claim 1 , wherein the backup files stored in the local cache storage is retained in the local cache storage according to an information management policy assigned to the data stored at the host computing device, wherein the information management policy comprises one or more setting indicating removal of the backup files from the local cache storage based on frequency the backup files are accessed from the local cache storage for restore jobs.
3. The information management system of claim 1 , wherein the one or more processors is further configured to: initiate, by a media agent, a transfer of the backup files from the local cache storage to secondary storage, wherein the media agent is in communication with the object store and the secondary storage.
4. The information management system of claim 3 , wherein the one or more processors is further configured to: process of the smaller size extents, by a media agent, wherein the processing comprises one of deduplication, encryption, and content indexing;
and store the processed smaller size extents to the secondary storage.
5. The information management system of claim 1 , wherein the generating of the backup index is initiated by a backup agent on the host computing device and wherein the generating of the backup index is based on parsing backup logs and extracting the backup information into a host backup report.
6. The information management system of claim 1 , wherein the object store comprises at least one server node, and wherein the at least one server node comprises the local cache storage, a database, and an object store agent.
7. The information management system of claim 1 , wherein the backup index comprises a mapping of a file to a tape bar code and offset associated with a virtual tape.
8. The information management system of claim 1 , wherein the one or more processors is further configured to notify the proxy that the backup operation associated with the host computing device is complete.
9. The information management system of claim 1 , wherein the one or more processors is further configured to: generate by a backup agent associated with the host computing device, a host backup report; and transmit the host backup report to the proxy.
10. The information management system of claim 1 , wherein the one or more processors is further configured to: obtain or receive tape configuration data from the host computing device.
11. A computer-implemented method for restoring data using a virtual tape library, the computer-implemented method comprising:
sending to a proxy a command to initiate a backup operation of data stored at a host computing device,
wherein the proxy comprises a virtual tape library (VTL) and a mount point to an object store,
wherein the object store comprises a local cache storage;
initiating a transfer of the data from the host computing device to the VTL associated with the proxy;
converting the data into backup files wherein each of the backup files represents a physical tape;
transmitting the backup files to an object store mounted on the proxy;
converting at least one backup file into smaller size extents and storing the smaller size extents to the local cache storage;
generating a backup index comprising information associated with the backup files transmitted to the object store; and
transmitting a copy of the backup index to an index server hosted by provider system.
12. The computer-implemented method of claim 11 , wherein the backup files stored in the local cache storage is retained in the local cache storage according to an information management policy assigned to the data stored at the host computing device, wherein the information management policy comprises one or more setting indicating removal of the backup files from the local cache storage based on frequency the backup files are accessed from the local cache storage for restore jobs.
13. The computer-implemented method of claim 11 , the computer-implemented method further comprising: initiating, by a media agent, a transfer of the backup files from the local cache storage to secondary storage, wherein the media agent is in communication with the object store and the secondary storage.
14. The computer-implemented method of claim 13 , the computer-implemented method further comprising: processing of the smaller size extents, by a media agent, wherein the processing comprises one of deduplication, encryption, and content indexing;
and storing the processed smaller size extents to the secondary storage.
15. The computer-implemented method of claim 11 , wherein the generating of the backup index is initiated by a backup agent on the host computing device and wherein the generating of the backup index is based on parsing backup logs and extracting the backup information into a host backup report.
16. The computer-implemented method of claim 11 , wherein the object store comprises at least one server node, and wherein the at least one server node comprises the local cache storage, a database, and an object store agent.
17. The computer-implemented method of claim 11 , wherein the backup index comprises a mapping of a file to a tape bar code and offset associated with a virtual tape.
18. The computer-implemented method of claim 11 , the computer-implemented method further comprising: notifying the proxy that the backup operation associated with the host computing device is complete.
19. The computer-implemented method of claim 11 , the computer-implemented method further comprising:
generating by a backup agent associated with the host computing device, a host backup report; and
transmitting the host backup report to the proxy.
20. The computer-implemented method of claim 11 , the computer-implemented method further comprising: obtaining or receiving tape configuration data from the host computing device.