Systems and methods for granular resource management in a storage network
View Patent ↗In accordance with some aspects of the present invention, systems and methods are provided for dynamically and/or automatically selecting and/or modifying data path definitions that are used in performing storage operations on data. Alternate data paths may be specified or selected that use some or all resources that communicate with a particular destination to improve system reliability and performance. The system may also dynamically monitor and choose data path definitions to optimize system performance, conserve storage media and promote balanced load distribution.
1. A method for consolidating storage policies within a storage operation network, the method comprising:
accessing a first storage policy of a plurality of storage policies, the first storage policy comprising at least a first storage operation path that associates at least a first media agent with a first storage device in a first relationship;
accessing a second storage policy of the plurality of storage policies, the second storage policy comprising at least a second storage operation path that associates a second media agent with the first storage device in a second relationship, wherein the second media agent conducts data to the first storage device via the second storage operation path;
automatically evaluating with one or more computer hardware processors, the first and second storage policies and the first and second relationships to determine that both the first and second storage policies use both the first and second storage operation paths to conduct data to at least the first storage device;
consolidating the first and second storage policies into one comprehensive storage policy, wherein the comprehensive storage policy associates at least the first and second storage operation paths to the first storage device, wherein both the first and second storage paths of the comprehensive storage policy conduct data to at least the first storage device; and
automatically adding at least a third storage operation path to the comprehensive storage policy based on one or more network operating conditions that is predicted to occur, wherein the third storage operation path is an alternate data path that is different than the first and second storage operation paths.
2. The method of claim 1 wherein the one or more network operating conditions comprise at least one of the group consisting of: data transfer rate, load balancing, resource exhaustion, transmission congestion, or performance optimization.
3. The method of claim 1 wherein automatically evaluating the first and second storage policies is based at least in part whether the first and second storage policies share a common destination point.
4. The method of claim 1 wherein information about the first and second storage operation paths is obtained from an index cache.
5. The method of claim 1 wherein information about the first and second storage operation paths is obtained from a metabase.
6. The method of claim 1 wherein automatically evaluating the first and second storage policies is based at least in part on one of the group consisting of: origination point, destination point, transmission resources scheduled to be involved, and a process-based netlist.
7. The method of claim 1 wherein the one or more network operation conditions comprises forecasting network usage.
8. The method of claim 1 wherein automatically evaluating the first and second storage policies is based at least in part on which storage operation paths are likely to experience an adverse impact due to changing conditions.
9. The method of claim 1 wherein dynamically adding the third storage operation path is based at least in part on maintaining a substantially constant data load.
10. The method of claim 1 wherein dynamically adding the third storage operation path is based at least in part on preventing a failover condition.
11. A storage operation system comprising:
a plurality of storage devices;
a plurality of storage policies;
a first media agent executing in one or more computer hardware processors, the first media agent configured to manage the flow of data to at least a first storage device based on a first storage policy of the plurality of storage policies, wherein the first storage policy defines a first storage operation path that associates the first media agent and the first storage device in a first relationship;
a second media agent executing in one or more computer hardware processors, the second media agent configured to manage the flow of data to the first storage device based on a second storage policy of the plurality of storage policies, wherein the second storage policy defines a second storage operation path that associates the second media agent and the first storage device in a second relationship; and
a management component executing in one or more computer hardware processors, the management component configured to:
automatically evaluate the first and second storage policies and the first and second static relationships to determine that both the first and second storage policies use both the first and second storage paths to conduct data to at least the first storage device;
consolidate the first and second storage policies into one comprehensive storage policy, wherein the comprehensive storage policy associates at least the first and second storage paths to the first storage device, wherein both the first and second data paths of the comprehensive storage policy conduct data to at least the first storage device; and
automatically add at least a third storage operation path to the comprehensive storage policy based on one or more network operating conditions that is predicted to occur, wherein the third data path is an alternate data path this is different than the first and second storage operation paths.
12. The system of claim 11 wherein the one or more network operating conditions comprise at least one of the group consisting of: data transfer rate, load balancing, resource exhaustion, transmission congestion, or performance optimization.
13. The system of claim 11 wherein the management component is configured to automatically evaluate the first and second storage policies based at least in part whether the first and second storage policies share a common destination point.
14. The system of claim 11 wherein the management component is configured to obtain information about the first and second storage operation paths from an index cache.
15. The system of claim 11 wherein the management component is configured to obtain information about the first and second storage operation paths from a metabase.
16. The system of claim 11 wherein the management component is configured to automatically evaluate the first and second storage policies based at least in part one of the group consisting of: origination point, destination point, transmission resources scheduled to be involved, and a process-based netlist.
17. The system of claim 11 wherein the one or more network operation conditions comprises a forecast of network usage.
18. The system of claim 11 wherein the management component is configured to automatically evaluate the first and second storage policies based at least in part on which storage operation paths are likely to experience an adverse impact due to changing conditions.
19. The system of claim 11 wherein the management component is configured to dynamically add the third operation path based at least in part on maintaining a substantially constant data load.
20. The system of claim 11 wherein the management component is configured to dynamically add the third storage operation path based at least in part on preventing a failover condition.