Effective utilization of different drive capacities
Techniques for providing effective utilization of different drive capacities in storage appliances. The techniques include providing a storage drive array that has a first set of storage drives and a second set of storage drives. Each storage drive in the first set has a first drive capacity and each storage drive in the second set has a second drive capacity. The first drive capacity is higher than the second drive capacity. The techniques include allocating, within the first drive capacity, at least a first sub-capacity and a second sub-capacity. The first sub-capacity is equal to the second drive capacity. The techniques include placing blocks of hot data in the first sub-capacities of the storage drives in the first set and/or the second drive capacities of the storage drives in the second set, and placing blocks of cold data in the second sub-capacities of the storage drives in the first set.
1. A method of providing effective utilization of different drive capacities in a storage appliance, comprising:
providing a storage appliance that includes a storage drive array, the storage drive array including a first set of storage drives and a second set of storage drives, each of the storage drives in the first set having a first total storage capacity, each of the storage drives in the second set having a second total storage capacity, the first total storage capacity of the storage drives in the first set being higher than the second total storage capacity of the storage drives in the second set, the first total storage capacity having a first storage sub-capacity and a second storage sub-capacity, the first storage sub-capacity being equal to the second total storage capacity, the first storage sub-capacity corresponding to a first predetermined threshold percentage of the first total storage capacity, and the second storage sub-capacity corresponding to a second predetermined threshold percentage of the first total storage capacity;
allocating the first storage sub-capacity of each storage drive in the first set for storing hot data;
allocating the second total storage capacity of each storage drive in the second set for storing hot data, the allocated first storage sub-capacity of the storage drives in the first set and the allocated second total storage capacity of the storage drives in the second set collectively corresponding to a hot storage tier;
allocating the second storage sub-capacity of each storage drive in the first set for storing cold data, the allocated second storage sub-capacity of the storage drives in the first set corresponding to a cold storage tier;
determining free space in the allocated first storage sub-capacity of each storage drive in the first set;
determining blocks of cold data stored in the allocated second storage sub-capacity transitioning to blocks of hot data; and
in response to the blocks of cold data stored in the allocated second storage sub-capacity transitioning to the blocks of hot data:
reallocating the first storage sub-capacity of each storage drive in the first set, wherein reallocating the first storage sub-capacity comprises placing the blocks of hot data in the reallocated first storage sub-capacity in accordance with a RAID configuration that spans all the storage drives in the first set and all the storage drives in the second set, the reallocated first storage sub-capacity maintaining the first predetermined threshold percentage of the first total storage capacity; and
reallocating the second storage sub-capacity of each storage drive in the first set, wherein reallocating the second storage sub-capacity comprises including the free space in a portion of the reallocated second storage sub-capacity, the reallocated second storage sub-capacity maintaining the second predetermined threshold percentage of the first total storage capacity.
2. The method of claim 1 further comprising:
placing the blocks of hot data in the reallocated first storage sub-capacity of each storage drive in the first set in accordance with a RAID configuration.
3. The method of claim 2 further comprising:
scaling a performance level of the hot storage tier by placing the blocks of hot data in accordance with the RAID configuration that spans all the storage drives in the first set and all the storage drives in the second set.
4. The method of claim 1 wherein the reallocating of one or more of the first storage sub-capacity and the second storage sub-capacity is performed within contiguous storage space of the first storage capacity of each storage drive in the first set.
5. The method of claim 1 wherein the reallocating of one or more of the first storage sub-capacity and the second storage sub-capacity is performed within noncontiguous storage space of the first storage capacity of each storage drive in the first set.
6. A system for providing effective utilization of different drive capacities in a storage appliance, comprising:
a storage drive array including a first set of storage drives and a second set of storage drives, each of the storage drives in the first set having a first total storage capacity, each of the storage drives in the second set having a second total storage capacity, the first total storage capacity of the storage drives in the first set being higher than the second total storage capacity of the storage drives in the second set, the first total storage capacity having a first storage sub-capacity and a second storage sub-capacity, the first storage sub-capacity being equal to the second total storage capacity, the first storage sub-capacity corresponding to a first predetermined threshold percentage of the first total storage capacity, and the second storage sub-capacity corresponding to a second predetermined threshold percentage of the first total storage capacity;
a memory; and
processing circuitry configured to execute program instructions out of the memory to:
allocate the first storage sub-capacity of each storage drive in the first set for storing hot data;
allocate the second total storage capacity of each storage drive in the second set for storing hot data, the allocated first storage sub-capacity of the storage drives in the first set and the allocated second total storage capacity of the storage drives in the second set collectively corresponding to a hot storage tier;
allocate the second storage sub-capacity of each storage drive in the first set for storing cold data, the allocated second storage sub-capacity of the storage drives in the first set corresponding to a cold storage tier;
determine free space in the allocated first storage sub-capacity of each storage drive in the first set;
determine blocks of cold data stored in the allocated second storage sub-capacity transitioning to blocks of hot data; and
in response to the blocks of cold data stored in the allocated second storage sub-capacity transitioning to the blocks of hot data:
reallocate the first storage sub-capacity of each storage drive in the first set, wherein reallocating the first storage sub-capacity comprises placing the blocks of hot data in the reallocated first storage sub-capacity in accordance with a RAID configuration that spans all the storage drives in the first set and all the storage drives in the second set, the reallocated first storage sub-capacity maintaining the first predetermined threshold percentage of the first total storage capacity; and
reallocate the second storage sub-capacity of each storage drive in the first set, wherein reallocating the second storage sub-capacity comprises including the free space in a portion of the reallocated second storage sub-capacity, the reallocated second storage sub-capacity maintaining the second predetermined threshold percentage of the first total storage capacity.
7. The system of claim 6 wherein the processing circuitry is further configured to execute the program instructions out of the memory to reallocate one or more of the first storage sub-capacity and the second storage sub-capacity within contiguous storage space of the first total storage capacity of each storage drive in the first set.
8. The system of claim 6 wherein the processing circuitry is further configured to execute the program instructions out of the memory to reallocate one or more of the first storage sub-capacity and the second storage sub-capacity within noncontiguous storage space of the first total storage capacity of each storage drive in the first set.
9. The system of claim 6 wherein each of the storage drives in the first set and each of the storage drives in the second set correspond to the same type of storage drive.
10. The system of claim 6 wherein the blocks of cold data stored in the allocated second storage sub-capacity of each storage drive in the first set conform to a given RAID configuration.
11. A computer program product including a set of non-transitory, computer-readable media having instructions that, when executed by processing circuitry, cause the processing circuitry to perform a method of providing effective utilization of different drive capacities in a storage appliance, the method comprising:
providing a storage appliance that includes a storage drive array, the storage drive array including a first set of storage drives and a second set of storage drives, each of the storage drives in the first set having a first total storage capacity, each of the storage drives in the second set having a second total storage capacity, the first total storage capacity of the storage drives in the first set being higher than the second total storage capacity of the storage drives in the second set, the first total storage capacity having a first storage sub-capacity and a second storage sub-capacity, the first storage sub-capacity being equal to the second total storage capacity, the first storage sub-capacity corresponding to a first predetermined threshold percentage of the first total storage capacity, and the second storage sub-capacity corresponding to a second predetermined threshold percentage of the first total storage capacity;
allocating the first storage sub-capacity of each storage drive in the first set for storing hot data;
allocating the second total storage capacity of each storage drive in the second set for storing hot data, the allocated first storage sub-capacity of the storage drives in the first set and the allocated second total storage capacity of the storage drives in the second set collectively corresponding to a hot storage tier;
allocating the second storage sub-capacity of each storage drive in the first set for storing cold data, the allocated second storage sub-capacity of the storage drives in the first set corresponding to a cold storage tier;
determining free space in the allocated first storage sub-capacity of each storage drive in the first set;
determining blocks of cold data stored in the allocated second storage sub-capacity transitioning to blocks of hot data; and
in response to the blocks of cold data stored in the allocated second storage sub-capacity transitioning to the blocks of hot data:
reallocating the first storage sub-capacity of each storage drive in the first set, wherein reallocating the first storage sub-capacity comprises placing the blocks of hot data in the reallocated first storage sub-capacity in accordance with a RAID configuration that spans all the storage drives in the first set and all the storage drives in the second set, the reallocated first storage sub-capacity maintaining the first predetermined threshold percentage of the first total storage capacity; and
reallocating the second storage sub-capacity of each storage drive in the first set, wherein reallocating the second storage sub-capacity comprises including the free space in a portion of the reallocated second storage sub-capacity, the reallocated second storage sub-capacity maintaining the second predetermined threshold percentage of the first total storage capacity.