System and method for storage tiering optimization
A method, computer program product, and computing system for receiving a plurality of input/output (IO) requests at a storage system. One or more IO properties may be extracted from the plurality of IO requests. The one or more IO properties may be processed, using one or more machine learning models, to define an access temperature value for one or more storage objects of the storage system. The one or more storage objects may be tiered between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system and one or more tiering policies.
1. A computer-implemented method, executed on a computing device, comprising:
receiving a plurality of input/output (IO) requests at a storage system;
extracting one or more IO properties from the plurality of IO requests;
processing, using one or more machine learning models, the one or more IO properties to define an access temperature value for one or more storage objects of the storage system, wherein the access temperature value indicates a likelihood that a storage object will be accessed within a particular future time frame; and
tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system and one or more tiering policies.
2. The computer-implemented method of claim 1 , further comprising:
generating one or more machine learning features from the one or more IO properties.
3. The computer-implemented method of claim 2 , wherein generating the one or more machine learning features from the one or more IO properties includes generating the one or more machine learning features from the one or more IO properties using one or more machine learning models.
4. The computer-implemented method of claim 2 , wherein the one or more machine learning features include:
a re-access block count; and
one or more of:
a re-access interval count for one or more blocks that have been re-accessed during a predefined interval; and
a re-access time gap between re-accessing for the one or more blocks that have been re-accessed.
5. The computer-implemented method of claim 1 , wherein tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system includes defining a plurality of tiering thresholds for the plurality of storage tiers based upon, at least in part, the access temperature values defined for the one or more storage objects.
6. The computer-implemented method of claim 5 , wherein tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system includes dynamically adjusting the plurality of tiering thresholds for the plurality of storage tiers based upon, at least in part, performance of the plurality of storage tiers.
7. The computer-implemented method of claim 1 , wherein the one or more machine learning models are configured for one or more of: offline training and continuous training.
8. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:
receiving a plurality of input/output (IO) requests at a storage system;
extracting one or more IO properties from the plurality of IO requests;
processing, using one or more machine learning models, the one or more IO properties to define an access temperature value for one or more storage objects of the storage system, wherein the access temperature value indicates a likelihood that a storage object will be accessed within a particular future time frame; and
tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system and one or more tiering policies.
9. The computer program product of claim 8 , wherein the operations further comprise:
generating one or more machine learning features from the one or more IO properties.
10. The computer program product of claim 9 , wherein generating the one or more machine learning features from the one or more IO properties includes generating the one or more machine learning features from the one or more IO properties using one or more machine learning models.
11. The computer program product of claim 9 , wherein the one or more machine learning features include:
a re-access block count; and
one or more of:
a re-access interval count for one or more blocks that have been re-accessed during a predefined interval; and
a re-access time gap between re-accessing for the one or more blocks that have been re-accessed.
12. The computer program product of claim 8 , wherein tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system includes defining a plurality of tiering thresholds for the plurality of storage tiers based upon, at least in part, the access temperature values defined for the one or more storage objects.
13. The computer program product of claim 11 , wherein tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system includes dynamically adjusting the plurality of tiering thresholds for the plurality of storage tiers based upon, at least in part, performance of the plurality of storage tiers.
14. The computer program product of claim 8 , wherein the one or more machine learning models are configured for one or more of: offline training and continuous training.
15. A computing system comprising:
a memory; and
a processor configured to receive a plurality of input/output (IO) requests at a storage system, wherein the processor is further configured to extract one or more IO properties from the plurality of IO requests, wherein the processor is further configured to generate one or more machine learning features from the one or more IO properties, wherein the one or more machine learning features include: a re-access block count, and one or more of: a re-access interval count for one or more blocks that have been re-accessed during a predefined interval, and a re-access time gap between re-accessing for the one or more blocks that have been re-accessed, wherein the processor is further configured to process, using one or more machine learning models, the one or more IO machine learning features to define an access temperature value for one or more storage objects of the storage system, and wherein the processor is further configured to tier the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system and one or more tiering policies.
16. The computing system of claim 15 , wherein generating the one or more machine learning features from the one or more IO properties includes generating the one or more machine learning features from the one or more IO properties using one or more machine learning models.
17. The computing system of claim 15 , wherein tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system includes defining a plurality of tiering thresholds for the plurality of storage tiers based upon, at least in part, the access temperature values defined for the one or more storage objects.
18. The computing system of claim 15 , wherein tiering the one or more storage objects between a plurality of storage tiers of the storage system, based upon, at least in part, the access temperature values defined for the one or more storage objects of the storage system includes dynamically adjusting the plurality of tiering thresholds for the plurality of storage tiers based upon, at least in part, performance of the plurality of storage tiers.