Systems and methods for migrating components in a hierarchical storage network
System and methods for selectively or automatically migrating resources between storage operation cells are provided. In accordance with one aspect of the invention, a management component within the storage operation system may monitor system operation and migrate components from storage operation cell to another to facilitate failover recovery, promote load balancing within the system and improve overall system performance as further described herein. Another aspect of the invention may involve performing certain predictive analyzes on system operation to reveal trends and tendencies within the system. Such information may be used as the basis for potentially migrating components from one storage operation cell to another to improve system performance and reduce or eliminate resource exhaustion or congestion conditions.
1. A storage system that automatically transfers a storage resource from a first storage operation cell to a second storage operation cell, the storage system comprising:
a first storage operation cell comprising computer hardware, the first storage operation cell monitors primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;
wherein the first storage operation cell directs the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data; and
wherein the first storage manager monitors an operational characteristic associated with a first storage resource of the first storage operation cell,
a second storage operation cell comprising computer hardware, the second storage operation cell monitors the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;
wherein the second storage operation cell directs the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;
in the event the operational characteristic exceeds a threshold, initiating transfer of the first storage resource to the second storage operation cell, wherein the transfer of the first storage resource to the second storage operation cell creates a copy of management information associated with the first storage resource in the second storage operation cell;
wherein when the second storage operation cell determines that the copy of the management information is incomplete, the second storage operation cell performs a restore operation from the one or more secondary storage devices to restore the copy of the management information to the second storage operation cell.
2. The storage system of claim 1 wherein the copy of the management information is at least one of metadata associated with at least one of the group consisting of: media records, archive records, application records, job history, source and target network pathway information, and storage policy criteria.
3. The storage system of claim 1 wherein the second storage operation cell verifies the copy of the management information transferred from the first storage operation cell.
4. The storage system of claim 1 wherein the management information remains in the first storage operation cell after the copy of the management information is transferred to the second storage operation cell.
5. The storage system of claim 4 wherein the management information in both the first storage operation cell and the copy of the management information in the second storage information cell are updated when changes occur.
6. The storage system of claim 1 wherein the transfer of the first storage resource migrates the management information from the first storage operation cell to the second storage operation cell.
7. The storage system of claim 1 wherein the first storage manager directs transfer of the first storage resource to the second storage operation cell.
8. The storage system of claim 1 wherein the second storage manager directs transfer of the first storage resource to the second storage operation cell.
9. The storage system of claim 1 wherein the operational characteristic is based at least in part on a first operational characteristic that is representative of overall system performance.
10. The storage system of claim 1 wherein the operational characteristic is based at least in part on storage media consumption.
11. A method of automatically transferring a storage resource from a first storage operation cell to a second storage operation cell, the method comprising:
monitoring with a first storage operation cell comprising computer hardware, primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;
directing the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;
monitors an operational characteristic associated with a first storage resource of the first storage operation cell;
monitoring with a second storage operation cell comprising computer hardware, the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;
directing the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;
in the event the operational characteristic exceeds a threshold, initiating transfer of the first storage resource to the second storage operation cell, wherein the transfer of the first storage resource to the second storage operation cell creates a copy of management information associated with the first storage resource in the second storage operation cell; and
determining that the copy of the management information in the second storage operation cell is incomplete and performing a restore operation from the one or more secondary storage devices to restore the copy of the management information to the second storage operation cell.
12. The method of claim 11 wherein the copy of the management information is at least one of the group consisting of: media records, archive records, application records, job history, source and target network pathway information, and storage policy criteria.
13. The method of claim 11 further comprising verifying the copy of the management information transferred from the first storage operation cell.
14. The method claim 11 wherein the management information remains in the first storage operation cell after the copy of the management information is transferred to the second storage operation cell.
15. The method of claim 14 further comprising updating the management information in the first storage operation cell and the copy of the management information in the second storage information cell when changes occur.
16. The method of claim 11 wherein transferring the first storage resource migrates the management information from the first storage operation cell to the second storage operation cell.
17. The method of claim 11 wherein the first storage manager directs transfer of the first storage resource to the second storage operation cell.
18. The method of claim 11 wherein the second storage manager directs transfer of the first storage resource to the second storage operation cell.
19. The method of claim 11 wherein the operational characteristic is based at least in part on a first operational characteristic that is representative of overall system performance.
20. The method of claim 11 wherein the operational characteristic is based at least in part on storage media consumption.