METRICS DRIVEN EXPANSION OF CAPACITY IN SOLID STATE STORAGE SYSTEMS
The system, devices, and methods disclosed herein relate to using historic data storage system utilization metrics to automate data expansion capacity. In some embodiments, the data storage system is a RAID cloud having a plurality of storage devices divided into logical slices, also called splits. Methods disclosed herein allow user defined thresholds to be set wherein the thresholds control when data storage will be expanded. Data storage expansion capacity can be based upon historic usage criteria or customer-based criteria. Additional system customizations include user control over rebalancing data distribution as well as determining when system performance should be routinely evaluated offline.
1 . For a data storage system including a memory and a plurality of existing physical storage devices, each existing physical storage device logically divided, either explicitly or implicitly, into a plurality of split address spaces, a method comprising:
a. monitoring a total capacity value for the existing plurality of physical storage devices to determine if the total capacity value exceeds a utilization limit, wherein:
i. if the total capacity value exceeds the utilization limit, determining when the total capacity value will exceed a critical capacity limit; and
ii. if the total capacity value will exceed the critical capacity limit within a system performance evaluation period, adding at least one additional physical storage device to the data storage system;
b. storing a data growth rate in the memory; and
c. storing a plurality of data access rates in the memory, wherein the plurality of data access rates are correlated with a plurality of data blocks located in a plurality of splits in the plurality of existing physical storage device.
2 . The method of claim 1 further comprising using the data growth rate to determine when the total capacity value will exceed the critical capacity limit.
3 . The method of claim 1 further comprising partitioning the at least one additional physical storage drives into a plurality of additional split address spaces.
4 . The method of claim 3 further comprising moving a data block among the plurality of data blocks stored in the plurality of split address spaces into a split within the plurality of additional split address spaces.
5 . The method of claim 4 further comprising using the plurality of data access rates to determine when to copy the data block into the split within the plurality of additional split address spaces.
6 . The method of claim 4 further comprising using the plurality of data access rates to determine which of a plurality of data blocks stored in the plurality of split address spaces to copy into the split within the plurality of additional split address spaces.
7 . The method of claim 1 further comprising rebalancing the plurality of data blocks located in the existing physical storage devices by redistributing the plurality of data blocks among the existing physical storage devices and the additional physical storage device.
8 . A system comprising:
a. a plurality of existing physical storage devices, each existing physical storage device logically divided, either explicitly or implicitly, into a plurality of split address spaces;
b. one or more processors;
c. a memory comprising code stored thereon that, when executed, performs a method comprising:
i. monitoring a total capacity value for the existing plurality of physical storage devices to determine if the total capacity value exceeds a utilization limit, wherein:
1. if the total capacity value exceeds the utilization limit, determining when the total capacity value will exceed a critical capacity limit; and
2. if the total capacity value will exceed the critical capacity limit within a system performance evaluation period, adding at least one additional physical storage device to the data storage system;
ii. storing a data growth rate in the memory; and
d. storing a plurality of data access rates in the memory, wherein the plurality of data access rates are correlated with a plurality of data blocks located in a plurality of splits in the plurality of existing physical storage device.
9 . The system of claim 8 wherein the method further comprising using the data growth rate to determine when the total capacity value will exceed the critical capacity limit.
10 . The system of claim 8 wherein the method further comprises partitioning the at least one additional physical storage drives into a plurality of additional split address spaces.
11 . The system of claim 10 wherein the method further comprises moving a data block among the plurality of data blocks stored in the plurality of split address spaces into a split within the plurality of additional split address spaces.
12 . The system of claim 11 wherein the method further comprises using the plurality of data access rates to determine when to copy the data block into the split within the plurality of additional split address spaces.
13 . The system of claim 11 wherein the method further comprises using the plurality of data access rates to determine which of a plurality of data blocks stored in the plurality of split address spaces to copy into the split within the plurality of additional split address spaces.
14 . The system of claim 8 wherein the method further comprises rebalancing the plurality of data blocks located in the existing physical storage devices by redistributing the plurality of data blocks among the existing physical storage devices and the additional physical storage device.
15 . A non-transitory computer readable storage medium having software stored thereon for a data storage system including a plurality of first physical storage devices, each first physical storage device logically divided, either explicitly or implicitly, into a plurality of first split address spaces, the software comprising:
a. executable code that monitors a total capacity value for the existing plurality of physical storage devices to determine if the total capacity value exceeds a utilization limit, wherein:
i. if the total capacity value exceeds the utilization limit, determining when the total capacity value will exceed a critical capacity limit; and
ii. if the total capacity value will exceed the critical capacity limit within a system performance evaluation period, adding at least one additional physical storage device to the data storage system;
b. executable code that stores a data growth rate in the memory; and
c. executable code that stores a plurality of data access rates in the memory, wherein the plurality of data access rates are correlated with a plurality of data blocks located in a plurality of splits in the plurality of existing physical storage device.
16 . The non-transitory computer readable storage medium of claim 15 further comprising executable code that uses the data growth rate to determine when the total capacity value will exceed the critical capacity limit.
17 . The non-transitory computer readable storage medium of claim 15 further comprising executable code that partitions the at least one additional physical storage drives into a plurality of additional split address spaces.
18 . The non-transitory computer readable storage medium of claim 17 further comprising executable code that moves a data block among the plurality of data blocks stored in the plurality of split address spaces into a split within the plurality of additional split address spaces.
19 . The non-transitory computer readable storage medium of claim 17 further comprising executable code that uses the plurality of data access rates to determine when to copy the data block into the split within the plurality of additional split address spaces or which of a plurality of data blocks stored in the plurality of split address spaces to copy into the split within the plurality of additional split address spaces.
20 . The non-transitory computer readable storage medium of claim 15 further comprising executable code that rebalances the plurality of data blocks located in the existing physical storage devices by redistributing the plurality of data blocks among the existing physical storage devices and the additional physical storage device.