System and method for scalable backup search

1. A remote agent for providing data protection services to virtual machines, comprising:

persistent storage for storing a backup data catalog; and

a backup manager programmed to:

instantiate a backup agent in a new virtual machine of the virtual machines;

obtain a backup data package associated with the new virtual machine using the backup agent, wherein the backup data package specifies assets of the new virtual machine;

generate a backup data processing schema for the new virtual machine based on the backup data package;

initiate a backup generation for the new virtual machine to store a backup for the new virtual machine in backup storage;

process, using the backup agent, metadata associated with the backup using backup data processing schema to obtain backup data processing schema compliant catalog data; and

provide search services for the backup using the backup data processing schema compliant catalog data and the backup data catalog.

2. The remote agent of claim 1 , wherein the metadata comprises:

first metadata generated by a first application hosted by the new virtual machine; and

second metadata generated by a second application hosted by the new virtual machine.

3. The remote agent of claim 2 , wherein the backup data processing schema specifies at least:

first actions for processing the first metadata; and

second actions for processing the second metadata,

wherein the first actions are different from the second actions.

4. The remote agent of claim 2 , wherein the backup comprises:

first backup data generated by the first application hosted by the new virtual machine; and

second backup data generated by a second application hosted by the new virtual machine.

5. The remote agent of claim 1 , wherein providing the search services for the backup using the backup data processing schema compliant catalog data and the backup data catalog comprises:

updating the backup data catalog using the backup data processing schema compliant catalog data to obtain an updated backup data catalog, wherein the backup data catalog is associated with a plurality of backups that comprises the backup, and wherein the plurality of backups is stored in backup storage;

obtaining a request for a portion of the backup;

searching the plurality of backups using the updated backup data catalog for the portion of the backup to obtain a search result; and

providing the search result in response to the request for the portion of the backup.

6. The remote agent of claim 5 , wherein the plurality of backups is stored in a format that is not natively searchable.

7. The remote agent of claim 1 , wherein the backup data processing schema compliant catalog data comprises indexing information for the backup.

8. A method for providing data protection services to virtual machines, comprising:

instantiating a backup agent in a new virtual machine of the virtual machines;

obtaining a backup data package associated with the new virtual machine using the backup agent, wherein the backup data package specifies assets of the new virtual machine;

generating a backup data processing schema for the new virtual machine based on the backup data package;

initiating a backup generation for the new virtual machine to store a backup for the new virtual machine in backup storage;

processing, using the backup agent, metadata associated with the backup using backup data processing schema to obtain backup data processing schema compliant catalog data; and

providing search services for the backup using the backup data processing schema compliant catalog data.

9. The method of claim 8 , wherein the metadata comprises:

first metadata generated by a first application hosted by the new virtual machine; and

second metadata generated by a second application hosted by the new virtual machine.

10. The method of claim 9 , wherein the backup data processing schema specifies at least:

first actions for processing the first metadata; and

second actions for processing the second metadata,

wherein the first actions are different from the second actions.

11. The method of claim 9 , wherein the backup comprises:

first backup data generated by the first application hosted by the new virtual machine; and

second backup data generated by a second application hosted by the new virtual machine.

12. The method of claim 8 , wherein providing the search services for the backup using the backup data processing schema compliant catalog data comprises:

updating a backup data catalog using the backup data processing schema compliant catalog data to obtain an updated backup data catalog, wherein the backup data catalog is associated with a plurality of backups that comprises the backup, and wherein the plurality of backups is stored in backup storage;

obtaining a request for a portion of the backup;

searching the plurality of backups using the updated backup data catalog for the portion of the backup to obtain a search result; and

providing the search result in response to the request for the portion of the backup.

13. The method of claim 12 , wherein the plurality of backups is stored in a format that is not natively searchable.

14. The method of claim 8 , wherein the backup data processing schema compliant catalog data comprises indexing information for the backup.

15. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for providing data protection services to virtual machines, the method comprising:

instantiating a backup agent in a new virtual machine of the virtual machines;

obtaining a backup data package associated with the new virtual machine using the backup agent, wherein the backup data package specifies assets of the new virtual machine;

generating a backup data processing schema for the new virtual machine based on the backup data package;

initiating a backup generation for the new virtual machine to store a backup for the new virtual machine in backup storage;

processing, using the backup agent, metadata associated with the backup using backup data processing schema to obtain backup data processing schema compliant catalog data; and

providing search services for the backup using the backup data processing schema compliant catalog data.

16. The non-transitory computer readable medium of claim 15 , wherein the metadata comprises:

first metadata generated by a first application hosted by the new virtual machine; and

second metadata generated by a second application hosted by the new virtual machine.

17. The non-transitory computer readable medium of claim 16 , wherein the backup data processing schema specifies at least:

first actions for processing the first metadata; and

second actions for processing the second metadata,

wherein the first actions are different from the second actions.

18. The non-transitory computer readable medium of claim 16 , wherein the backup comprises:

first backup data that was generated by the first application hosted by the new virtual machine; and

second backup data that was generated by a second application hosted by the new virtual machine.

19. The non-transitory computer readable medium of claim 15 , wherein providing the search services for the backup using the backup data processing schema compliant catalog data comprises:

updating a backup data catalog using the backup data processing schema compliant catalog data to obtain an updated backup data catalog, wherein the backup data catalog is associated with a plurality of backups that comprises the backup, and wherein the plurality of backups is stored in backup storage;

obtaining a request for a portion of the backup;

searching the plurality of backups using the backup data catalog for the portion of the backup to obtain a search result; and

providing the search result in response to the request for the portion of the backup.

20. The non-transitory computer readable medium of claim 19 , wherein the plurality of backups is stored in a format that is not natively searchable.