Systems and methods for secure file management via an aggregation of cloud storage services
The present disclosure describes systems and methods for aggregation and management of cloud storage among a plurality of providers via file fragmenting to provide increased reliability and security. In one implementation, fragments or blocks may be distributed among a plurality of cloud storage providers, such that no provider retains a complete copy of a file. Accordingly, even if an individual service is compromised, a malicious actor cannot access the data. In another implementation, fragments may be duplicated and distributed to multiple providers, such that loss of communications to any one provider does not result in inability to access the data. This implementation may be combined with error correction techniques to allow recovery, even with loss of multiple providers. File synchronization may also be faster in these implementations by dividing reading and writing operations among multiple providers.
1. A method, comprising:
determining a plurality of fragments for a file, the file comprising a first bitstream and the plurality of fragments comprising a second bitstream; and
distributing the plurality of fragments of the file across a plurality of storage providers by: selecting a first storage provider of the plurality of storage providers;
determining a first fragment of the plurality of fragments for storing on the first storage provider of the plurality of storage providers;
initiating storage of the first fragment of the plurality of fragments to the first storage provider;
selecting a second storage provider of the plurality of storage providers;
determining a second fragment of the plurality of fragments for storing on the second storage provider of the plurality of storage providers;
initiating storage of the second fragment of the plurality of fragments to the second storage provider; and
generating an association between the first fragment and the first storage provider and a second association between the second fragment and the second storage provider.
2. The method of claim 1 , wherein the second bitstream is determined by applying a comb filter to the first bitstream.
3. The method of claim 1 , wherein the first bitstream comprises data configured to be read row by row and the second bitstream is determined by reading the data column by column.
4. The method of claim 1 , further comprising determining the file from an interaction at a user device where the file is stored.
5. The method of claim 4 , wherein the interaction is determined based on monitoring of an operating system or monitoring a storage location at the user device.
6. The method of claim 1 , wherein the selection of the first storage provider or the second storage provider is based on a type of the file, the selection of the first storage provider or the second storage provider is random, or the selection of the first storage provider of the second storage provider is based on a recency of access of the file by a user.
7. The method of claim 1 , wherein initiating storage of the first fragment of the plurality of fragments to the first storage provider comprises providing an instruction at a user device where the file is stored, the instruction adapted to cause the storage of the first fragment to the first storage provider.
8. A system for file management in an aggregation of storage providers, comprising:
a processor; and
a non-transitory computer readable medium comprising instructions for:
determining a plurality of fragments for a file, the file comprising a first bitstream and the plurality of fragments comprising a second bitstream; and
distributing the plurality of fragments of the file across a plurality of storage providers by:
selecting a first storage provider of the plurality of storage providers;
determining a first fragment of the plurality of fragments for storing on the first storage provider of the plurality of storage providers;
initiating storage of the first fragment of the plurality of fragments to the first storage provider;
selecting a second storage provider of the plurality of storage providers;
determining a second fragment of the plurality of fragments for storing on the second storage provider of the plurality of storage providers;
initiating storage of the second fragment of the plurality of fragments to the second storage provider; and
generating an association between the first fragment and the first storage provider and a second association between the second fragment and the second storage provider.
9. The system of claim 8 , wherein the second bitstream is determined by applying a comb filter to the first bitstream.
10. The system of claim 8 , wherein the first bitstream comprises data configured to be read row by row and the second bitstream is determined by reading the data column by column.
11. The system of claim 8 , wherein the instructions are further for: determining the file from an interaction at a user device where the file is stored.
12. The system of claim 11 , wherein the interaction is determined based on monitoring of an operating system or monitoring a storage location at the user device.
13. The system of claim 8 , wherein the selection of the first storage provider or the second storage provider is based on a type of the file, the selection of the first storage provider or the second storage provider is random, or the selection of the first storage provider of the second storage provider is based on a recency of access of the file by a user.
14. The system of claim 8 , wherein initiating storage of the first fragment of the plurality of fragments to the first storage provider comprises providing an instruction at a user device where the file is stored, the instruction adapted to cause the storage of the first fragment to the first storage provider.
15. A non-transitory computer readable medium, comprising instructions for:
determining a plurality of fragments for a file, the file comprising a first bitstream and the plurality of fragments comprising a second bitstream; and
distributing the plurality of fragments of the file across a plurality of storage providers by: selecting a first storage provider of the plurality of storage providers;
determining a first fragment of the plurality of fragments for storing on the first storage provider of the plurality of storage providers;
initiating storage of the first fragment of the plurality of fragments to the first storage provider;
selecting a second storage provider of the plurality of storage providers;
determining a second fragment of the plurality of fragments for storing on the second storage provider of the plurality of storage providers;
initiating storage of the second fragment of the plurality of fragments to the second storage provider; and
generating an association between the first fragment and the first storage provider and a second association between the second fragment and the second storage provider.
16. The non-transitory computer readable medium of claim 15 , wherein the second bitstream is determined by applying a comb filter to the first bitstream.
17. The non-transitory computer readable medium of claim 15 , wherein the first bitstream comprises data configured to be read row by row and the second bitstream is determined by reading the data column by column.
18. The non-transitory computer readable medium of claim 15 , wherein the instructions are further for: determining the file from an interaction at a user device where the file is stored.
19. The non-transitory computer readable medium of claim 18 , wherein the interaction is determined based on monitoring of an operating system or monitoring a storage location at the user device.
20. The non-transitory computer readable medium of claim 15 , wherein the selection of the first storage provider or the second storage provider is based on a type of the file, the selection of the first storage provider or the second storage provider is random, or the selection of the first storage provider of the second storage provider is based on a recency of access of the file by a user.
21. The non-transitory computer readable medium of claim 15 , wherein initiating storage of the first fragment of the plurality of fragments to the first storage provider comprises providing an instruction at a user device where the file is stored, the instruction adapted to cause the storage of the first fragment to the first storage provider.