Hybrid data storage system with private storage cloud and public storage cloud
Systems and methods are disclosed for accessing data on a storage system. An apparatus, such as a data storage device or a computing device, may include a memory configured to store data. The apparatus is configured to receive a request for a file stored in a storage system. The storage system includes a private storage cloud and a set of public storage clouds. The apparatus is also configured to determine whether the file is retrievable from the set of public storage clouds. If the file is retrievable from the set of public storage clouds the apparatus may determine whether access to the set of public storage clouds is faster than access to the private storage cloud and may retrieve the file from one or more of the private storage cloud and the set of public storage clouds.
1. An apparatus, comprising:
a memory configured to store data; and
a processor coupled to the memory, the processor configured to:
receive a request for a file stored in a storage system comprising a private storage cloud and a set of public storage clouds;
determine whether the file is retrievable from the set of public storage clouds;
responsive to determining that the file is retrievable from the set of public storage clouds:
determine whether access to the set of public storage clouds is faster than access to the private storage cloud; and
retrieve the file from one or more of the private storage cloud and the set of public storage clouds; and
responsive to determining that the file is not retrievable from the set of public storage clouds:
retrieve the file from the private storage cloud;
determine an importance level for the file and a hotness level for the file; and
determine, based at least in part on the importance level and the hotness level, to keep the file on the private storage cloud and store a set of recovery data chunks for the file in the set of public storage clouds.
2. The apparatus of claim 1 , wherein the processor is configured to retrieve the file from one or more of the private storage cloud and the set of public storage clouds by:
retrieving the file from the private storage cloud responsive to determining that access to the set of public storage clouds is not faster than access to the private storage cloud.
3. The apparatus of claim 1 , wherein the processor is further configured to:
determine whether the private storage cloud and the set of public storage clouds can be accessed in parallel.
4. The apparatus of claim 3 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving a first set of portions of the file from the private storage cloud and a second set of portions of the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds can be accessed in parallel.
5. The apparatus of claim 3 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds cannot be accessed in parallel.
6. The apparatus of claim 1 , wherein the processor is further configured to:
determine whether a latest version of the file is retrievable from the set of public storage clouds; and
retrieve the file from the private storage cloud, responsive to determining that the latest version of the file is not retrievable from the set of public storage clouds.
7. The apparatus of claim 6 , wherein the processor is further configured to:
request that the latest version of the file be stored in the set of public storage clouds, responsive to determining that the latest version of the file is not retrievable from the set of public storage clouds.
8. The apparatus of claim 1 , wherein the processor is configured to retrieve the file from one or more of the private storage cloud and the set of public storage clouds by:
retrieving portions of the file from one or more of the private storage cloud or the set of public storage clouds.
9. The apparatus of claim 1 , wherein the processor is configured to retrieve the file from one or more of the private storage cloud and the set of public storage clouds by:
retrieving a set of recovery data chunks for the file from one or more of the private storage cloud or the set of public storage clouds; and
generating the file based on the set of recovery data chunks.
10. A method, comprising:
receiving a request for a file stored in a storage system comprising a private storage cloud and a set of public storage clouds;
determining whether the file is retrievable from the set of public storage clouds;
responsive to determining that the file is retrievable from the set of public storage clouds:
determining whether access to the set of public storage clouds is faster than access to the private storage cloud; and
retrieving the file from one or more of the private storage cloud and the set of public storage clouds; and
responsive to determining that the file is not retrievable from the set of public storage clouds:
retrieving the file from the private storage cloud;
determining an importance level for the file and a hotness level for the file; and
determining, based at least in part on the importance level and the hotness level, to keep the file on the private storage cloud and store a set of recovery data chunks for the file in the set of public storage clouds.
11. The method of claim 10 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving the file from the private storage cloud responsive to determining that access to the set of public storage clouds is not faster than access to the private storage cloud.
12. The method of claim 10 , further comprising:
determining whether the private storage cloud and the set of public storage clouds can be accessed in parallel.
13. The method of claim 12 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving a first set of portions of the file from the private storage cloud and a second set of portions of the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds can be accessed in parallel.
14. The method of claim 12 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds cannot be accessed in parallel.
15. The method of claim 10 , further comprising:
determining whether a latest version of the file is retrievable from the set of public storage clouds; and
retrieving the file from the private storage cloud, responsive to determining that the latest version of the file is not retrievable from the set of public storage clouds.
16. A system comprising:
a storage means configured to store data; and
a processing means coupled to the storage means, the processing means configured to:
receive a request for a file stored in a storage system comprising a private storage cloud and a set of public storage clouds;
determine whether the file is retrievable from the set of public storage clouds;
responsive to determining that the file is retrievable from the set of public storage clouds:
determine whether access to the set of public storage clouds is faster than access to the private storage cloud; and
retrieve the file from one or more of the private storage cloud and the set of public storage clouds; and
responsive to determining that the file is not retrievable from the set of public storage clouds:
retrieve the file from the private storage cloud;
determine an importance level for the file and a hotness level for the file; and
determine, based at least in part on the importance level and the hotness level, to keep the file on the private storage cloud and store a set of recovery data chunks for the file in the set of public storage clouds.