Systems and methods for storing information within hybrid storage with local and cloud-based storage devices
The disclosed computer-implemented method for storing information within hybrid storage with local and cloud-based storage devices may include (1) dividing, if required, at the computing device, a file into multiple portions, (2) storing a first portion of the multiple portions as at least one first respective separate object on a local volume stored on the local storage device, (3) storing a second portion of the multiple portions as at least one second respective separate object on a cloud-based volume stored on a cloud-based storage device, and (4) naming each stored portion of the file with a respective object name comprising file metadata describing respective characteristics of the respective portion of the file. Various other methods, systems, and computer-readable media are also disclosed.
1. A computer-implemented method for storing information within hybrid storage with local and cloud-based storage devices, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:
dividing, at the computing device, a file into multiple portions;
storing a first portion of the multiple portions as at least one first respective separate object on a local volume stored on the local storage device without storing the at least one first respective separate object on a cloud-based storage device;
storing a second portion of the multiple portions as at least one second respective separate object on a cloud-based volume stored on the cloud-based storage device; and
naming each stored portion of the file with a respective object name comprising file metadata describing respective characteristics of the respective portion of the file, including at least one flag identifying a cloud storage class.
2. The computer-implemented method of claim 1 , further comprising creating at least one volume set, wherein the at least one volume set comprises:
the local volume stored on the local storage device; and
the cloud-based volume stored on the cloud-based storage device.
3. The computer-implemented method of claim 2 , further comprising creating a multi-volume file system comprising the at least one volume set.
4. The computer-implemented method of claim 1 , further comprising tagging the cloud-based volume as a data-only volume.
5. The computer-implemented method of claim 1 , further comprising representing the cloud-based volume as a proxy volume in a disk group.
6. The computer-implemented method of claim 1 , further comprising:
assigning a tier to the cloud-based volume and the local volume; and
dividing the file in response to a tiered-storage decision selecting the assigned tier.
7. The computer-implemented method of claim 1 , wherein the file metadata comprises:
a file path;
a file system unique identifier;
a file set identifier;
an inode number;
an inode generation count;
an offset within the file; and
a size of the respective portion.
8. The computer-implemented method of claim 1 , further comprising storing the file metadata on the local storage device.
9. The computer-implemented method of claim 1 , further comprising storing the respective object names on the local storage device.
10. The computer-implemented method of claim 1 , further comprising ensuring, following a system crash, digital information consistency of the file by:
identifying information movement in progress during the crash; and
reorganizing information identified as being moved during the crash.
11. The computer-implemented method of claim 1 , further comprising updating a stored portion of the file by writing the updated stored portion of the file in a new object having a new respective object name, wherein the new respective object name comprises file metadata describing respective characteristics of the updated stored portion of the file, including a unique number which is modified whenever the stored portion of the file is updated.
12. The computer-implemented method of claim 1 , further comprising reconstructing, when file system metadata relating to digital information stored on the cloud-based storage device is unusable, contents of the file including the file name by parsing object names stored on the cloud-based storage device.
13. The computer-implemented method of claim 1 , wherein the file metadata comprises a unique number.
14. The computer-implemented method of claim 1 , wherein the file metadata comprises a flag identifying the respective portion of the file is stored on the cloud-based volume.
15. The computer-implemented method of claim 1 , wherein the file metadata comprises a flag identifying the respective portion of the file is stored on the local volume.
16. The computer-implemented method of claim 1 , wherein the cloud storage class does not permit an update read on the at least one second respective separate object.
17. A system for storing information within hybrid storage with local and cloud-based storage devices, the system comprising:
a dividing module, stored in memory, that divides a file into multiple portions;
a first storing module, stored in the memory, that stores a first portion of the multiple portions as at least one first respective separate object on a local volume stored on the local storage device without storing the at least one first respective separate object on a cloud-based storage device;
a second storing module, stored in the memory, that stores a second portion of the multiple portions as at least one second respective separate object on the cloud-based volume stored on the cloud-based storage device;
a naming module, stored in the memory, that names each stored portion of the file with a respective object name comprising file metadata describing respective characteristics of the respective portion of the file, including at least one flag identifying a cloud storage class; and
at least one physical processor that executes the dividing module, the first storing module, the second storing module, and the naming module.
18. The system of claim 17 , further comprising a creating module, stored in the memory, that creates at least one volume set, wherein the at least one volume set comprises:
the local volume stored on the local storage device; and
the cloud-based volume stored on the cloud-based storage device.
19. The system of claim 17 , further comprising:
an assigning module, stored in the memory, that assigns a tier to the cloud-based volume and the local volume; and
a dividing module, stored in the memory, that divides the file in response to a tiered-storage decision selecting the assigned tier.
20. The system of claim 17 , wherein the file metadata comprises:
a file path;
a file system unique identifier;
a file set identifier;
an inode number;
an inode generation count;
an offset within the file;
a size of the portion;
a unique number;
a flag identifying the respective portion of the file is stored on the cloud-based volume or the local volume; and
at least one flag identifying a cloud storage class.
21. A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
divide, at the computing device, a file into multiple portions;
store a first portion of the multiple portions as at least one first respective separate object on a local volume stored on a local storage device without storing the at least one first respective separate object on a cloud-based storage device;
store a second portion of the multiple portions as at least one second respective separate object on a cloud-based volume stored on the cloud-based storage device; and
name each stored portion of the file with a respective object name comprising file metadata describing respective characteristics of the respective portion of the file, including at least one flag identifying a cloud storage class.
22. The non-transitory computer-readable medium of claim 21 , further comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to create at least one volume set, wherein the at least one volume set comprises:
the local volume stored on the local storage device; and
the cloud-based volume stored on the cloud-based storage device.
23. The non-transitory computer-readable medium of claim 21 , further comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
assign a tier to the cloud-based volume and the local volume; and
divide the file in response to a tiered-storage decision selecting the assigned tier.
24. The non-transitory computer-readable medium of claim 21 , wherein the file metadata comprises:
a file path;
a file system unique identifier;
a file set identifier;
an inode number;
an inode generation count;
an offset within the file;
a size of the respective portion;
a unique number;
a flag identifying the respective portion of the file is stored on the cloud-based volume or the local volume; and
at least one flag identifying a cloud storage class.