Congestion Mitigation in A Multi-Tiered Distributed Storage System
A distributed electronic storage system (DESS) comprises congestion management circuitry and data migration circuitry. The congestion management circuitry is operable to determine an amount of congestion in the DESS. The data migration circuitry is operable to control migration of data stored in a first tier of storage to a second tier of storage based on the amount of congestion in the DESS, characteristics of the data, and characteristics of the first tier of storage.
1 - 24 . (canceled)
25 . A method comprising:
in one or more processors:
determining a quality of service (QOS), provided by a storage system comprising a plurality of tiers, based on congestion;
migrating data, from a first tier to a second tier, according to the QoS; and
adapting the migration according to historical settings used in the storage system.
26 . The method of claim 25 , wherein the method comprises triggering the migration according to the data having a particular characteristic.
27 . The method of claim 26 , wherein the particular characteristic is one of:
amount of time since creation of the data being greater than a determined threshold;
amount of time since last modification of the data being greater than a determined threshold;
amount of time since last access of the data being greater than a determined threshold;
the data being of a particular size;
the data being of a particular type;
the data having been generated by a particular client process; and
the data having been generated by a particular node of the storage system.
28 . The method of claim 25 , wherein the determining of the QoS comprises:
determining a load on a local resource of the storage system; and
determining a load on a remote resource of the storage system.
29 . The method of claim 25 , wherein an amount of data migrated is based on an amount of unused space in the first tier.
30 . The method of claim 29 , wherein the method comprises triggering the migration when the amount of unused space in the first tier is below a threshold.
31 . The method of claim 25 , wherein the method comprises determining whether to move data, from the second tier to the first tier, according to the amount of congestion in the storage system.
32 . The method of claim 31 , wherein the method comprises moving the data, from the second tier to the first tier, only when the amount congestion in the storage system is below a determined threshold.
33 . The method of claim 25 , wherein:
code is stored on one or more non-transitory machine-readable storage devices, and the code is executed by the one or more processors to perform the method.
34 . A system comprising:
one or more processors operable to:
determine a quality of service (QOS) provided by a storage system comprising a plurality of tiers, wherein the QoS is based, at least in part, on an amount of congestion in the storage system;
migrate data, from a first tier to a second tier, according to the QoS provided by the storage system; and
adapt the migration according to historical settings used in the storage system.
35 . The system of claim 34 , wherein the migration is triggered by the data having a particular characteristic.
36 . The system of claim 35 , wherein the particular characteristic is one of:
amount of time since creation of the data being greater than a determined threshold;
amount of time since last modification of the data being greater than a determined threshold;
amount of time since last access of the data being greater than a determined threshold;
the data being of a particular size;
the data being of a particular type;
the data having been generated by a particular client process; and
the data having been generated by a particular node of the storage system.
37 . The system of claim 34 , wherein the determination of the QoS comprises:
a determination of a load on a local resource of the storage system; and
a determination of a load on a remote resource of the storage system.
38 . The system of claim 34 , wherein the migration is controlled according to an amount of unused space in the first tier.
39 . The system of claim 38 , wherein the migration is triggered when the amount of unused space in the first tier is below a threshold.
40 . The system of claim 34 , wherein the one or more processors are operable to determine whether to move data, from the second tier to the first tier, according to the amount of congestion in the storage system.
41 . The system of claim 40 , wherein the one or more processors are configured to move the data, from the second tier to the first tier, only when the amount congestion in the storage system is below a determined threshold.