Dynamic scaling of a virtual storage system
Dynamic scaling of a virtual storage system, including: detecting, within one or more virtual components of the virtual storage system, a change in performance; determining, in response to the detected change in performance, a scaling response based on the virtual storage system meeting one or more target performance metrics; and scaling, based on one or more available virtual components of the virtual storage system, up or down such that performance of the virtual storage system is in accordance within the one or more target performance metrics.
1. A method comprising:
detecting, within one or more virtual components of the virtual storage system, a change in performance;
determining, in response to the detected change in performance, a scaling response based on the virtual storage system meeting one or more target performance metrics, the scaling response including rebalancing a quantity of virtual drives serving staging memory by moving a quantity of virtual drives from a first subset of a set of virtual drive servers to a second subset of the set of virtual drive servers within the virtual storage system; and
scaling, based on one or more available virtual components of the virtual storage system, up or down such that performance of the virtual storage system is in accordance with the one or more target performance metrics.
2. The method of claim 1 , wherein scaling the virtual storage system is based at least in part on one or more of: costs of the virtual components, a priority level corresponding to a type of data being stored, or based on a priority level corresponding to an application or host storing data within the virtual storage system.
3. The method of claim 1 , wherein scaling is in response to a change in an application demand or application requirement.
4. The method of claim 1 , wherein detecting the change in performance is based on a monitoring process collecting performance metrics or storage utilization metrics.
5. The method of claim 1 , wherein scaling includes:
increasing or decreasing a quantity of the one or more virtual drive servers within the virtual storage system; and
after increasing or decreasing the quantity of the one or more virtual driver servers, rebalancing the quantity of virtual drives serving staging memory between the one or more virtual drive servers.
6. The method of claim 1 , wherein responsive to the change in performance, one or more virtual controllers of the virtual storage system rebalance data stored among one or more virtual drive servers of the virtual storage system.
7. The method of claim 1 , wherein the staging memory includes multiple virtual drive servers.
8. The method of claim 1 , wherein the virtual drive servers include respective local storage.
9. The method of claim 1 , wherein the virtual drive servers provide block-level data storage.
10. The method of claim 1 , wherein a request to write data to the virtual storage system is received by one or more virtual controllers running within a virtual machine, a container, or a bare metal server.
11. The method of claim 1 , wherein staging memory is provided by multiple virtual drive servers that respectively include a both virtual controller and local memory.
12. The method of claim 1 , wherein at least a portion of the data stored within the staging memory is deduplicated, encrypted, or compressed prior to migration from the staging memory to durable data storage.
13. The method of claim 1 wherein the staging memory of the virtual storage system is characterized by a low read latency relative to durable data storage provided by a cloud services provider.
14. A virtual storage system contained in a cloud computing environment, the virtual storage system including:
one or more virtual drives providing a staging memory for storage operations; and
one or more virtual controllers, each virtual controller executing in a cloud computing instance, wherein the one or more virtual controllers are configured to:
detecting, within one or more virtual components of the virtual storage system, a change in performance;
determining, in response to the detected change in performance, a scaling response based on the virtual storage system meeting one or more target performance metrics, the scaling response including rebalancing a quantity of virtual drives serving staging memory by moving a quantity of virtual drives between one or more virtual drive servers within the virtual storage system; and
scaling, based on one or more available virtual components of the virtual storage system, up or down such that performance of the virtual storage system is in accordance with the one or more target performance metrics.
15. The virtual storage system of claim 14 , wherein scaling the virtual storage system is based at least in part on one or more of: costs of the virtual components, a priority level corresponding to a type of data being stored, or based on a priority level corresponding to an application or host storing data within the virtual storage system.
16. The virtual storage system of claim 14 , wherein scaling is in response to a change in an application demand or application requirement.
17. The virtual storage system of claim 14 , wherein detecting the change in performance is based on a monitoring process collecting performance metrics or storage utilization metrics.
18. The virtual storage system of claim 14 , wherein scaling includes increasing or decreasing a quantity of virtual drive servers within the virtual storage system.