System and method for a dynamic data stream prioritization using content based classification
A method for performing backup operations includes obtaining, by a stream allocator operating in a backup storage system, a plurality of media management entries, wherein a media management entry of the plurality of media management entries specifies a data object, a relative priority, and a maximum number of streams, selecting the media management entry based on the relative priority, allocating a number of backup streams to the data object based on the maximum number of streams, and initiating a transfer of a backup of the data object from the production host to the backup storage system.
1. A method for performing backup operations, the method comprising:
obtaining, by a stream allocator operating in a backup storage system, a plurality of media management entries, wherein a media management entry of the plurality of media management entries specifies a data object, a relative priority, and a maximum number of streams;
selecting the media management entry based on the relative priority;
allocating a number of backup streams to the data object based on the maximum number of streams, wherein allocating the number of backup streams to the data object based on the maximum number of streams comprises:
making a determination that the maximum number of streams is higher than a total number of available backup streams of the backup storage system,
wherein the number of backup streams is equal to the total number of available backup streams; and
initiating a transfer of a backup of the data object from a production host to the backup storage system.
2. The method of claim 1 , wherein the relative priority is a highest priority relative to the priorities in the plurality of media management entries.
3. The method of claim 2 ,
wherein the relative priority is equal to a second relative priority of a second media management query, and
wherein selecting the media management entry is further based on a tie-breaking metric.
4. The method of claim 1 , wherein the media management entry is generated by a backup server operatively connected to the stream allocator.
5. The method of claim 4 , wherein the media management entry is generated based on a rules engine stored in the backup server.
6. A system, comprising:
a processor; and
memory comprising instructions which, when executed by the processor, perform a method, the method comprising:
obtaining, by a stream allocator operating in a backup storage system, a plurality of media management entries,
wherein a media management entry of the plurality of media management entries specifies a data object, a relative priority, and a maximum number of streams;
selecting the media management entry based on the relative priority;
allocating a number of backup streams to the data object based on the maximum number of streams, wherein allocating the number of backup streams to the data object based on the maximum number of streams comprises:
making a determination that the maximum number of streams is higher than a total number of available backup streams of the backup storage system,
wherein the number of backup streams is equal to the total number of available backup streams; and
initiating a transfer of a backup of the data object from a production host to the backup storage system.
7. The system of claim 6 , wherein the relative priority is a highest priority relative to the priorities in the plurality of media management entries.
8. The system of claim 7 , wherein the relative priority is equal to a second relative priority of a second media management query, and wherein selecting the media management entry is further based on a tie-breaking metric.
9. The system of claim 6 , wherein the media management entry is generated by a backup server operatively connected to the stream allocator.
10. The system of claim 9 , wherein the media management entry is generated based on a rules engine stored in the backup server.
11. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for performing a backup operation, the method comprising:
obtaining, by a stream allocator operating in a backup storage system, a plurality of media management entries,
wherein a media management entry of the plurality of media management entries specifies a data object, a relative priority, and a maximum number of streams;
selecting the media management entry based on the relative priority;
allocating a number of backup streams to the data object based on the maximum number of streams, wherein allocating the number of backup streams to the data object based on the maximum number of streams comprises:
making a determination that the maximum number of streams is higher than a total number of available backup streams of the backup storage system,
wherein the number of backup streams is equal to the total number of available backup streams; and
initiating a transfer of a backup of the data object from a production host to the backup storage system.
12. The non-transitory computer readable medium of claim 11 , wherein the relative priority is a highest priority relative to the priorities in the plurality of media management entries.
13. The non-transitory computer readable medium of claim 12 , wherein the relative priority is equal to a second relative priority of a second media management query, and wherein selecting the media management entry is further based on a tie-breaking metric.
14. The non-transitory computer readable medium of claim 11 , wherein the media management entry is generated by a backup server operatively connected to the stream allocator.