Staging data in a cloud-based storage system
Staging data in a cloud-based storage system, including: receiving, at the cloud-based storage system integrating a first tier of cloud storage and a second tier of cloud storage, a data storage operation from a computer device; storing data corresponding to the data storage operation within the first tier of cloud storage in accordance with a first storage format; and responsive to detecting a condition for transferring data between the first tier of cloud storage and the second tier of cloud storage, transferring the data in the first storage format from the first tier of cloud storage to a second data format within the second tier of cloud storage.
1. A method comprising:
receiving, at a cloud-based storage system integrating a first tier of cloud storage and a second tier of cloud storage, a data storage operation from a computer device;
storing data corresponding to the data storage operation within the first tier of cloud storage in accordance with a first storage format, wherein the data is stored in a plurality of cloud computing instances of the first tier of cloud storage; and
after detecting a condition for transferring the data between the first tier of cloud storage and the second tier of cloud storage, transferring the data in the first storage format from the first tier of cloud storage to a second data format within the second tier of cloud storage, wherein the data is transferred at a rate based on a data storage consumption rate of the first tier of cloud storage and upon a storage policy for the first tier of cloud storage to avoid provisioning additional cloud computing instances at the first tier of cloud storage.
2. The method of claim 1 , wherein the first tier of cloud storage of the cloud-based storage system includes the plurality of cloud computing instances that respectively store a portion of a dataset.
3. The method of claim 2 , wherein the cloud computing instances provide block-level data storage.
4. The method of claim 2 , wherein the second tier of cloud storage of the cloud-based storage system includes a cloud-based object storage that stores all portions of the dataset.
5. The method of claim 1 , wherein the first tier of cloud storage has one or more better performance characteristics than the second tier of cloud storage.
6. The method of claim 1 , further comprising:
modifying one or more portions of stored data within the first tier of cloud storage using a data storage optimization to generate modified data.
7. The method of claim 6 , further comprising:
storing, after modifying the one or more portions of stored data, the modified data within the first tier of cloud storage.
8. The method of claim 6 , further comprising:
storing, after modifying the one or more portions of stored data, the modified data within the second tier of cloud storage.
9. The method of claim 6 , wherein the data storage optimization is data compression.
10. The method of claim 1 , further comprising:
determining a data storage consumption rate for the first tier of cloud storage.
11. A cloud-based storage system including:
one or more cloud computing instances providing a first tier of cloud storage;
a second tier of cloud storage; and
one or more storage controller applications, each storage controller application executing in a cloud computing instance, wherein the one or more storage controller applications are configured to:
receive, within the first tier of cloud storage, a data storage operation from a computer device;
store data corresponding to the data storage operation within the first tier of cloud storage in accordance with a first storage format, wherein the data is stored in a plurality of cloud computing instances of the first tier of cloud storage; and
after detecting a condition for transferring the data between the first tier of cloud storage and the second tier of cloud storage, transfer the data in the first storage format from the first tier of cloud storage to a second data format within the second tier of cloud storage, wherein the data is transferred at a rate based on a data storage consumption rate of the first tier of cloud storage and upon a storage policy for the first tier of cloud storage to avoid provisioning additional cloud computing instances at the first tier of cloud storage.
12. The cloud-based storage system of claim 11 , wherein the first tier of cloud storage of the cloud-based storage system stores a portion of a dataset.
13. The cloud-based storage system of claim 11 , wherein the cloud computing instances provide block-level data storage.
14. The cloud-based storage system of claim 12 , wherein the second tier of cloud storage of the cloud-based storage system stores all portions of the dataset.
15. The cloud-based storage system of claim 11 , wherein the second tier of cloud storage of the cloud-based storage system includes a cloud object store.
16. The cloud-based storage system of claim 11 wherein the first tier of cloud storage has one or more better performance characteristics than the second tier of cloud storage.
17. The cloud-based storage system of claim 11 , wherein the one or more storage controller applications are further configured to:
modify one or more portions of stored data within the first tier of cloud storage using a data storage optimization to generate modified data.
18. The cloud-based storage system of claim 17 , wherein the one or more storage controller applications are further configured to:
store, after modifying the one or more portions of stored data, the modified data within the first tier of cloud storage.
19. The cloud-based storage system of claim 17 , wherein the one or more storage controller applications are further configured to:
store, after modifying the one or more portions of stored data, the modified data within the second tier of cloud storage.
20. The cloud-based storage system of claim 17 , wherein the data storage optimization is data deduplication.