System and method for intelligent, globally distributed network storage
View Patent ↗A data storage system comprising a plurality of storage nodes, each node existing at a physical location having one or more contexts. Interface mechanisms couple to each storage node to communicate storage access requests with the storage node. Data storage management processes select one or more of the storage nodes to serve a data storage request based at least in part upon the particular contexts of each of the storage nodes.
1. In an environment that includes globally distributed heterogeneous network devices for storing data, a method of transporting data from a source to a set of network devices, the method comprising:
receiving a storage access request from a source for data, wherein the data is associated with a set of criteria that define storage characteristics;
dynamically determining a geographic context, a political context, an economic context, and a topological context for each heterogeneous network device to determine which of the heterogeneous network devices are able to handle the data; and
automatically selecting a set of distributed network devices for storing the data, wherein the geographic context, political context, economic context, and topological context of the selected set of network devices matches the set of criteria and provides the storage characteristics for the data.
2. The method of claim 1 , further comprising transporting the data to the selected set of network devices such that the data is stored on the selected set of network devices.
3. The method of claim 1 , wherein the selected set of network devices are accessible over the Internet.
4. The method of claim 1 , wherein the storage characteristics includes one or more of cost of storage; availability of storage; amount of storage; type of data stored, and/or security for data.
5. The method of claim 1 , further comprising monitoring the geographic context, political context, economic context, and topological context of each of the set of selected devices.
6. The method of claim 5 , further comprising migrating at least some of the data to a different network device when at least one of the geographic context, political context, economic context, or topological context of at least one of the set of selected devices changes and does not satisfy the set of criteria for the data.
7. The method of claim 1 , wherein dynamically determining a geographic context, political context, economic context, and topological context for each network device further comprises a parallel process that is performed by multiple machines that communicate via a network.
8. The method of claim 1 , further comprising migrating the data when the set of criteria changes.
9. The method of claim 1 , wherein each geographic context, political context, economic context, and topological context of the set of selected devices collectively satisfy the set of criteria.
10. A method for globally storing data in geographically distributed storage devices, the method comprising:
determining a criteria for data that is to be stored in geographically distributed storage devices;
dynamically determining a geographic context, a political context, an economic context, and a topological context for the geographically distributed storage devices to determine which of the geographically distributed storage devices are able to satisfy the criteria;
dynamically determining a set of storage devices from the geographically distributed storage devices that collectively provide the geographic context, political context, economic context, and topological context for storing the data based on the criteria; and
storing the data at the set of storage devices.
11. The method of claim 10 , further comprising monitoring, with a plurality of interface devices, the geographic context, political context, economic context, and topological context for the geographically distributed storage devices.
12. The method of claim 10 , further comprising monitoring the geographic context, political context, economic context, and topological context of the set of storage devices.
13. The method of claim 12 , further comprising migrating at least a portion of the data to a different storage device when at least one of the geographic context, political context, economic context, or topological context of the set of network devices fails to satisfy the criteria.
14. The method of claim 12 , wherein some of the set of storage devices are located in different jurisdictions that are subject to different laws.
15. The method of claim 10 , wherein the data comprises one or more of archival data; redundant data; primary data; or backup data.
16. The method of claim 10 , further comprising dynamically complying with the criteria required for the data.
17. The method of claim 16 , further comprising dynamically complying with the criteria by sharing state information of the geographically distributed storage devices to enable migration of the data within the geographically distributed storage devices to maintain compliance with the criteria required for the data.