Relative heat index based hot data determination for block based storage tiering
Disclosed is a process for determining a heat index for a block of data, such as an extent, for storage tiering. Weighted scores are used for read and write operations, since solid state devices operate better with read operations than write operations. The heat index associated with each extent is a function of a base score, rather than an absolute value. The base score is determined by adding the number of extents in a hot tier plus the access score, divided by the number of extents in the hot tier. In this fashion, the base score measures the weighted I/O activity relative to the size of the hot tier.
1. A method of determining a heat index for an extent of data stored in a tiered drive comprising:
determining a weighted access score by counting read operations from, and write operations to, said tiered drive, and weighting read operations with a higher score than write operations;
determining a number of extents stored in a hot tier of said tiered drive, said hot tier having a predetermined size;
calculating a base score that indicates weighted accesses relative to said predetermined size of said hot tier by adding said number of extents in said hot tier plus said weighted access score to generate a sum, said sum being divided by said number of extents;
generating a weighted hit score by counting a number of accesses for each extent with reads having a greater weight than writes;
generating a heat index score for each extent by multiplying said base score by said weighted hit score.
2. The method of claim 1 wherein said process of determining a weighted access score comprises:
weighting said read operations with twice the weight of write operations.
3. The method of claim 1 wherein said process of generating a weighted hit score comprises:
weighting said read operations with twice the weight of write operations.
4. The method of claim 1 further comprising:
storing said extents in buckets based upon said heat index.
5. A system for storing data in a tiered drive based upon a heat index comprising:
a tiered virtual drive comprising:
a solid state virtual drive comprising a plurality of solid state storage devices;
a SAS virtual drive comprising a plurality of SAS storage devices;
a SATA virtual drive comprising a plurality of SATA storage devices;
a plurality of controllers that control migration of data between said solid state storage devices, said SAS storage devices and said SATA storage devices by counting read and write operations of said tiered virtual drive to create a weighted access score, counting extents of data stored in said solid state storage devices to create a hot tier extent number, adding said hot tier extent number and said weighted access score to create a sum, dividing said sum by said hot tier extent number to create a base score, counting accesses in each of said extents stored in said solid state storage devices to create a weighted hit score for each of said extents, multiplying said base score by said hit score for each of said extents stored in said solid state storage devices to create a heat index for each of said extents stored in said solid state storage devices, using said heat index for each of said extents stored in said solid state storage devices to control said migration of data.
6. The system of claim 5 wherein said plurality of controllers controls migration of data by counting said read and write operations of said virtual drive with different weights.
7. The system of claim 5 wherein said plurality of controllers controls migration of data by counting said accesses of each of said extents stored in said solid state devices so that reads and writes have different weights.