Elastic cloud storage on multiple locations
Described embodiments provide systems and methods of managing storage of data of a user across storage service providers. A storage service may receive a request to store data by a user. The storage service may communicate with storage service providers and may maintain storage vectors for each storage service provider. The storage service may identify a policy for the user. The policy may specify usage of the storage service providers based on a user profile. The storage service may determine, based on the policy, storage service providers to use to store the data of the user. The storage service may store a first portion of the data to a first storage vector of a first storage service provider. The storage service may store a second portion of the data to one of a second storage vector of a second storage service provider or a storage of the storage service.
1. A method for managing storage of data of a user across a plurality of third-party public storage service providers, the method comprising:
(a) receiving, by a storage service, a request to store data by a user, the storage service configured to communicate with a plurality of third-party public storage service providers, each of the plurality of third-party public storage service providers configured to maintain a plurality of storage vectors;
(b) identifying, by the storage service, a policy for the user, the policy specifying usage of one or more of the plurality of third-party public storage service providers based at least on a profile of the user;
(c) determining, by the storage service based at least on the policy, one or more third-party public storage service providers of the plurality of third-party public storage service providers to use to store the data of the user;
(d) selecting, by the storage service, a first storage vector from the plurality of storage vectors of a first third-party public storage service provider of the one or more third-party public storage service provider, responsive to determining that a location of the user is within a threshold distance of the first storage vector;
(e) storing, by the storage service, a first portion of the data to the first storage vector selected from the plurality of storage vectors of the first third-party public storage service provider of the one or more third-party public storage service providers; and
(f) storing, by the storage service, a second portion of the data to one of a second storage vector of a second third-party public storage service provider of the one or more third-party public storage service providers or a storage of the storage service.
2. The method of claim 1 , wherein a storage vector of the plurality of storage vectors identifies one of the location, address or a size of a corresponding unit of storage used to select the storage vector from the plurality of storage vectors of a respective third-party public storage service provider.
3. The method of claim 2 , wherein (b) further comprises identifying from the profile of the user one of the location of the user, storage size assigned to or requested by the user, or preferences of the user.
4. The method of claim 1 , wherein one of the first portion of the data or the second portion of the data comprises one of striped data or mirrored data in association with a respective redundant array of independent disk (RAID) level.
5. The method of claim 1 , further comprising obtaining, by the storage service, one of authentication credentials or an address for one of the first storage vector or the second storage vector.
6. The method of claim 1 , further comprising storing, by the storage service, the first portion of the data in encrypted form to the first storage vector and the second portion of the data in encrypted form to the second storage vector.
7. The method of claim 1 , further comprising storing, by the storage service, the data across different storage vectors across the one or more third-party public storage service providers.
8. The method of claim 1 , further comprising receiving, by the storage service, a second request to access the data and responsive to the second request identifying the storage vectors for the data.
9. The method of claim 8 , further comprising obtaining, by the storage service, different portions of the data across the storage vectors of the one or more third-party public storage service providers and combining the different portions of the data to provide as a response to the second request.
10. A system for managing storage of data of a user across a plurality of third-party public storage service providers, the system comprising:
a storage service executable on one or more processors, coupled memory and configured to communicate with a plurality of third-party public storage service providers, each of the plurality of third-party public storage service providers configured to maintain a plurality of storage vectors; and
wherein the storage service is configured to:
receive a request to store data by a user;
identify a policy for the user, the policy specifying usage of one of more of the plurality of third-party public storage service providers based at least on a profile of the user;
determine, based at least on the policy, one or more third-party public storage service providers of the plurality of third-party public storage service providers to use to store the data of the user;
select a first storage vector from the plurality of storage vectors of a first third-party public storage service provider of the one or more third-party public storage service provider, responsive to determining that a location of the user is within a threshold distance of the first storage vector;
store a first portion of the data to the first storage vector selected from the plurality of storage vectors of the first third-party public storage service provider of the one or more third-party public storage service providers; and
store a second portion of the data to one of a second storage vector of a second third-party public storage service provider of the one or more third-party public storage service providers or a storage of the storage service.
11. The system of claim 10 , wherein a storage vector of the plurality of storage vectors identifies one of the location, address or a size of a corresponding unit of storage used to select the storage vector from the plurality of storage vectors of a respective third-party public storage service provider.
12. The system of claim 11 , wherein the profile of the user identifies one of the location of the user, storage size assigned to or requested by the user, or preferences of the user.
13. The system of claim 10 , wherein one of the first portion of the data or the second portion of the data comprises one of striped data or mirrored data in association with a respective redundant array of independent disk (RAID) level.
14. The system of claim 10 , wherein the storage service is further configured to obtain one of authentication credentials or an address for one of the first storage vector or the second storage vector.
15. The system of claim 10 , wherein the storage service is further configured to store the first portion of the data in encrypted form to the first storage vector and the second portion of the data in encrypted form to the second storage vector.
16. The system of claim 10 , wherein the storage service is further configured to store the data across different storage vectors across the one or more third-party public storage service providers.
17. The system of claim 10 , wherein the storage service is further configured to receive a second request to access the data and responsive to the second request identifying the storage vectors for the data.
18. The system of claim 17 , wherein the storage service is further configured to obtain different portions of the data across the storage vectors of the one or more third-party public storage service providers and combining the different portions of the data to provide as a response to the second request.