Preventing extended latency in a storage system
Ensuring the fair utilization of system resources using workload based, time-independent scheduling, including: determining whether an amount of available system resources in the storage system has reached a predetermined reservation threshold; and responsive to determining that the amount of available system resources in the storage system has reached the predetermined reservation threshold: determining whether one or more entities in the storage system have utilized system resources in excess of their fair share by a predetermined threshold during one or more time-independent periods; and responsive to determining that one or more entities in the storage system have utilized system resources in excess of their fair share by the predetermined threshold during the time-independent period, limiting the one or more entities from issuing additional I/O requests to the storage system.
1. A method comprising:
determining whether an amount of available system resources in the storage system has reached a predetermined reservation threshold; and
responsive to determining that the amount of available system resources in the storage system has reached the predetermined reservation threshold:
determining whether one or more entities in the storage system have utilized system resources in excess of their share during one or more time-independent periods; and
responsive to determining that one or more entities in the storage system have utilized system resources in excess of their share during the time-independent period, limiting the one or more entities from issuing additional I/O requests to the storage system.
2. The method of claim 1 wherein limiting the one or more entities from issuing additional I/O requests to the storage system further comprises blocking the one or more entities from issuing additional I/O requests to the storage system.
3. The method of claim 1 further comprising:
determining an amount of I/O operations that may be processed by the storage system in parallel; and
establishing, in dependence upon the amount of I/O operations that may be processed by the storage system in parallel, the time-independent period.
4. The method of claim 3 wherein determining an amount of I/O operations that may be processed by the storage system in parallel further comprises determining the amount of I/O operations that may be processed by the storage system in parallel while adhering to a performance requirement.
5. The method of claim 1 wherein the time-independent period includes an amount of most recently processed I/O operations that is a function of the amount of I/O operations that may be processed by the storage system in parallel.
6. The method of claim 1 further comprising:
determining whether an additional time-independent period has expired since the one or more entities were limited from issuing additional I/O requests to the storage system; and
responsive to determining that the additional time-independent period has expired since the one or more entities were blocked from issuing additional I/O requests to the storage system, crediting the one or more entities with at least a portion of its fair share of system resources.
7. The method of claim 1 further comprising:
determining whether the amount of available system resources in the storage system has become larger than the predetermined reservation threshold; and
responsive to determining that the amount of available system resources in the storage system has become larger than the predetermined reservation threshold, enabling the one or more entities to issue additional I/O requests to the storage system.
8. The method of claim 1 further comprising determining, in dependence upon the amount of I/O operations that may be processed by the storage system in parallel, a fair share of system resources for each entity.
9. An apparatus including a computer memory and a computer processor, the computer memory including computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
determining whether an amount of available system resources in the storage system has reached a predetermined reservation threshold; and
responsive to determining that the amount of available system resources in the storage system has reached the predetermined reservation threshold:
determining whether one or more entities in the storage system have utilized system resources in excess of their share during one or more time-independent periods; and
responsive to determining that one or more entities in the storage system have utilized system resources in excess of their share during the time-independent period, limiting the one or more entities from issuing additional I/O requests to the storage system.
10. The apparatus of claim 9 wherein limiting the one or more entities from issuing additional I/O requests to the storage system further comprises blocking the one or more entities from issuing additional I/O requests to the storage system.
11. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
determining an amount of I/O operations that may be processed by the storage system in parallel; and
establishing, in dependence upon the amount of I/O operations that may be processed by the storage system in parallel, the time-independent period.
12. The apparatus of claim 11 wherein determining an amount of I/O operations that may be processed by the storage system in parallel further comprises determining the amount of I/O operations that may be processed by the storage system in parallel while adhering to a performance requirement.
13. The apparatus of claim 9 wherein the time-independent period includes an amount of most recently processed I/O operations that is a function of the amount of I/O operations that may be processed by the storage system in parallel.
14. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
determining whether an additional time-independent period has expired since the one or more entities were limited from issuing additional I/O requests to the storage system; and
responsive to determining that the additional time-independent period has expired since the one or more entities were blocked from issuing additional I/O requests to the storage system, crediting the one or more entities with at least a portion of its fair share of system resources.
15. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
determining whether the amount of available system resources in the storage system has become larger than the predetermined reservation threshold; and responsive to determining that the amount of available system resources in the storage system has become larger than the predetermined reservation threshold, enabling the one or more entities to issue additional I/O requests to the storage system.
16. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of determining, in dependence upon the amount of I/O operations that may be processed by the storage system in parallel, a fair share of system resources for each entity.
17. A storage system including a computer memory and a computer processor, the computer memory including computer program instructions that, when executed by the computer processor, cause the storage system to carry out the steps of:
determining whether an amount of available system resources in the storage system has reached a predetermined reservation threshold; and
responsive to determining that the amount of available system resources in the storage system has reached the predetermined reservation threshold:
determining whether one or more entities in the storage system have utilized system resources in excess of their share during one or more time-independent periods; and
responsive to determining that one or more entities in the storage system have utilized system resources in excess of their share during the time-independent period, limiting the one or more entities from issuing additional I/O requests to the storage system.
18. The storage system of claim 17 wherein limiting the one or more entities from issuing additional I/O requests to the storage system further comprises blocking the one or more entities from issuing additional I/O requests to the storage system.
19. The storage system of claim 17 wherein the time-independent period includes an amount of most recently processed I/O operations that is a function of the amount of I/O operations that may be processed by the storage system in parallel.
20. The storage system of claim 17 further comprising computer program instructions that, when executed by the computer processor, cause the storage system to carry out the steps of:
determining whether the amount of available system resources in the storage system has become larger than the predetermined reservation threshold; and
responsive to determining that the amount of available system resources in the storage system has become larger than the predetermined reservation threshold, enabling the one or more entities to issue additional I/O requests to the storage system.