Performance-based scaling of a virtual storage system
Dynamic scaling of a virtual storage system, including: detecting, within one or more virtual components of the virtual storage system, a change in performance; determining, in response to the detected change in performance, a scaling response based on the virtual storage system meeting one or more target performance metrics; and scaling, based on one or more available virtual components of the virtual storage system, up or down such that performance of the virtual storage system is in accordance within the one or more target performance metrics.
1 . A method comprising:
based on a change in performance of a virtual storage system, determining a reallocation of virtual drives providing staging memory by moving a quantity of virtual drives from a first subset of virtual drive servers to a second subset of virtual drive servers among subsets of virtual drive servers within the virtual storage system; and
scaling, based on the determined reallocation, the virtual storage system to bring performance of the virtual storage system into accordance with one or more performance requirements.
2 . The method of claim 1 , wherein scaling the virtual storage system is based at least in part on one or more of: costs of one or more virtual components of the virtual storage system, a priority level corresponding to a type of data being stored, or based on a priority level corresponding to an application or host storing data within the virtual storage system.
3 . The method of claim 1 , wherein scaling is in response to a change in an application demand or application requirement.
4 . The method of claim 1 , wherein detecting the change in performance is based on a monitoring process collecting performance metrics or storage utilization metrics.
5 . The method of claim 1 , wherein scaling includes increasing or decreasing a quantity of virtual controllers within the virtual storage system.
6 . The method of claim 1 , wherein scaling includes increasing or decreasing a quantity of virtual drive servers within the virtual storage system.
7 . The method of claim 1 , wherein responsive to the change in performance of the virtual storage system, one or more virtual controllers of the virtual storage system rebalances data stored among one or more virtual drive servers of the virtual storage system.
8 . The method of claim 1 , wherein the staging memory of the virtual storage system includes multiple virtual drive servers.
9 . The method of claim 8 , wherein the multiple virtual drive servers of the virtual storage system include respective local storage.
10 . The method of claim 9 , wherein the multiple virtual drive servers provide block-level data storage.
11 . The method of claim 1 , wherein a request to write data to the virtual storage system is received by one or more virtual controllers running within a virtual machine, a container, or a bare metal server.
12 . The method of claim 1 , wherein the staging memory is provided by multiple virtual drive servers that respectively include a both virtual controller and local memory.
13 . The method of claim 1 , wherein at least a portion of data stored within the staging memory is deduplicated, encrypted, or compressed prior to migration from the staging memory to durable data storage provided by a cloud services provider.
14 . The method of claim 1 wherein the staging memory of the virtual storage system is characterized by a low read latency relative to durable data storage provided by a cloud services provider.
15 . A virtual storage system contained in a cloud computing environment, the virtual storage system including:
a plurality of virtual drives providing a staging memory for storage operations; and
one or more virtual controllers, each virtual controller executing in a cloud computing instance, wherein the one or more virtual controllers are configured to:
based on a change in performance of a virtual storage system, determine a reallocation of the plurality of virtual drives providing staging memory by moving a quantity of virtual drives from a first subset of virtual drive servers to a second subset of virtual drive servers among subsets of virtual drive servers within the virtual storage system; and
scale, based on the determined reallocation, the virtual storage system to bring performance of the virtual storage system into accordance with one or more performance requirements.
16 . The virtual storage system of claim 15 , wherein scaling the virtual storage system is based at least in part on one or more of: costs of one or more virtual components of the virtual storage system, a priority level corresponding to a type of data being stored, or based on a priority level corresponding to an application or host storing data within the virtual storage system.
17 . The virtual storage system of claim 15 , wherein scaling is in response to a change in an application demand or application requirement.
18 . The virtual storage system of claim 15 , wherein detecting the change in performance is based on a monitoring process collecting performance metrics or storage utilization metrics.
19 . The virtual storage system of claim 15 , wherein scaling includes increasing or decreasing a quantity of virtual controllers within the virtual storage system.
20 . The virtual storage system of claim 15 , wherein scaling includes increasing or decreasing a quantity of virtual drive servers within the virtual storage system.