Systems and methods for migrating components in a hierarchical storage network
View Patent ↗System and methods for selectively or automatically migrating resources between storage operation cells are provided. In accordance with one aspect of the invention, a management component within the storage operation system may monitor system operation and migrate components from storage operation cell to another to facilitate failover recovery, promote load balancing within the system and improve overall system performance as further described herein. Another aspect of the invention may involve performing certain predictive analyzes on system operation to reveal trends and tendencies within the system. Such information may be used as the basis for potentially migrating components from one storage operation cell to another to improve system performance and reduce or eliminate resource exhaustion or congestion conditions.
1. A storage system that automatically transfers a storage resource from a first storage operation cell to a second storage operation cell, the storage system comprising:
a first storage operation cell comprising computer hardware, the first storage operation cell monitors primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;
wherein the first storage operation cell directs the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;
a second storage operation cell comprising computer hardware, the second storage operation cell monitors the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;
wherein the second storage operation cell directs the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;
a third storage manager comprising computer hardware, the third storage manager automatically directs transfer of the first media agent to the second storage operation cell based on a prediction of future utilization of a first operational characteristic;
wherein the second storage operation cell reconstitutes the first media agent and a copy of the first index in association with the second storage operation cell;
wherein when the second storage operation cell determines that the copy of the first index is incomplete, the second storage operation cell performs a restore operation from at least a portion of the secondary data stored in the one or more secondary storage devices to restore the copy of the first index stored in association with the second storage operation cell; and
wherein after restoration of the copy of the first index stored in association with the second storage operation cell, the second storage operation cell directs the first media agent to copy a second portion of the primary data to the one or more secondary storage devices and update the copy of the first index.
2. The storage system of claim 1 wherein the first operational characteristic is representative of a distribution of storage operations within the first storage operation cell.
3. The storage system of claim 1 wherein the first operational characteristic is representative of storage media consumption.
4. The storage system of claim 3 wherein the transfer of the first media agent to the second storage operation cell reduces storage media consumption.
5. The storage system of claim 1 wherein the first operational characteristic is representative of overall system performance.
6. The storage system of claim 5 wherein the transfer of the first media agent to the second storage operation cell improves system efficiency.
7. A storage system that automatically transfers a storage resource from a first storage operation cell to a second storage operation cell, the storage system comprising:
a first storage operation cell comprising computer hardware, the first storage operation cell monitors primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;
wherein the first storage operation cell directs the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;
a second storage operation cell comprising computer hardware, the second storage operation cell monitors the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;
wherein the second storage operation cell directs the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;
a third storage manager comprising computer hardware, the third storage manager automatically directs transfer of management information associated with the first media agent to the second storage operation cell;
wherein the second storage operation cell reconstitutes the first media agent and a copy of the first index in association with the second storage operation cell based on the management information;
wherein when the second storage operation cell determines that the copy of the first index is incomplete, the second storage operation cell performs a restore operation from at least a portion of the secondary data stored in the one or more secondary storage devices to restore the copy of the first index stored in association with the second storage operation cell; and
wherein after restoration of the copy of the first index stored in association with the second storage operation cell, the second storage operation cell directs the first media agent to copy a second portion of the primary data to the one or more secondary storage devices and update the copy of the first index.
8. The storage system of claim 7 wherein the third storage manager directs transfer of management information associated with the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of a distribution of storage operations within the first storage operation cell.
9. The storage system of claim 7 wherein the third storage manager directs transfer of management information associated with the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of storage media consumption.
10. The storage system of claim 9 wherein the transfer of the first media agent to the second storage operation cell reduces storage media consumption.
11. The storage system of claim 7 wherein the third storage manager directs transfer of management information associated with the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of overall system performance.
12. The storage system of claim 11 wherein the transfer of the first media agent to the second storage operation cell improves system efficiency.
13. The storage system of claim 7 wherein the third storage manager directs transfer of management information associated with the first media agent to the second storage operation cell based at least in part on a first operational characteristic that consists of at least one of the group comprising network bandwidth utilization, resource capacity used, resource capacity available, time periods between storage operations, scheduling conflicts, and transmission path loads.
14. A method of automatically transferring a storage resource from a first storage operation cell to a second storage operation cell, the method comprising:
monitoring with a first storage operation cell comprising computer hardware, primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;
directing the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;
monitoring with a second storage operation cell comprising computer hardware, the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;
directing the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;
automatically directing transfer of management information associated with the first media agent to the second storage operation cell;
reconstituting the first media agent and the first index in the second storage operation cell based on the management information; and
determining that the copy of the first index is incomplete and performing a restore operation from at least a portion of the secondary data stored in the one or more secondary storage devices to restore the copy of the first index stored in association with the second storage operation cell;
after restoration of the copy of the first index stored in association with the second storage operation cell, directing the first media agent to copy a second portion of the primary data to the one or more secondary storage devices and update the copy of the first index.
15. The storage system of claim 14 wherein automatically directing transfer of management information associated with the first media agent to the second storage operation cell is based at least in part on a first operational characteristic that is representative of a distribution of storage operations within the first storage operation cell.
16. The storage system of claim 14 wherein automatically directing transfer of management information associated with the first media agent to the second storage operation cell is based at least in part on a first operational characteristic that is representative of storage media consumption.
17. The storage system of claim 16 wherein the transfer of the first media agent to the second storage operation cell reduces storage media consumption.
18. The storage system of claim 14 wherein automatically directing transfer of management information associated with the first media agent to the second storage operation cell is based at least in part on a first operational characteristic that is representative of overall system performance.
19. The storage system of claim 18 wherein the transfer of the first media agent to the second storage operation cell improves system efficiency.
20. The storage system of claim 14 wherein automatically directing transfer of management information associated with the first media agent to the second storage operation cell is based at least in part on a first operational characteristic that consists of at least one of the group comprising network bandwidth utilization, resource capacity used, resource capacity available, time periods between storage operations, scheduling conflicts, and transmission path loads.