Balancing the number of read operations and write operations that may be simultaneously serviced by a storage system
A computer system comprising: a data storage medium comprising a plurality of storage devices configured to store data; and a data storage controller coupled to the data storage medium; wherein the data storage controller is configured to: determine a target number of storage devices in a group of storage devices in a storage system that may exhibit variable I/O response times; detect one or more conditions associated with the group of storage devices; and after detecting the one or more conditions, change the target number of storage devices that may exhibit variable I/O response times.
1. A method comprising:
determining a threshold number of storage devices in a group of storage devices in a storage system that may concurrently exhibit variable I/O response times such that a reconstruct read can still be performed efficiently within the group of storage devices;
detecting one or more conditions related to write requests associated with the group of storage devices; and
in response to detecting the one or more conditions, adjusting the threshold number of storage devices such that a reconstruct read can still be performed while a performance of the group of storage devices is maintained compared to a time before the adjustment.
2. The method of claim 1 further comprising determining a number of storage devices that are concurrently exhibiting variable I/O response times.
3. The method of claim 2 further comprising:
determining whether the number of storage devices that are concurrently exhibiting variable I/O response times is greater than the threshold number;
if the number of storage devices that are concurrently exhibiting variable I/O response times is greater than the threshold number, scheduling requests to the group of storage devices to reduce the number of storage devices that are concurrently exhibiting variable I/O response times; and
if the number of storage devices that are concurrently exhibiting variable I/O response times is not greater than the threshold number, scheduling requests to improve performance of the group of storage devices.
4. The method of claim 1 , wherein detecting one or more conditions associated with the group of storage devices includes determining that a number of pending write requests for a given storage device in the group of storage devices exceeds a waiting threshold.
5. The method of claim 1 , wherein detecting one or more conditions associated with the group of storage devices includes detecting a given number of high-priority write requests targeting the group of storage devices.
6. The method of claim 1 , wherein exhibiting variable I/O response times includes executing high-latency operations.
7. A storage system, the storage system including a computer memory and a computer processor, the computer processor including computer program instructions that, when executed by the computer processor, cause the storage system to carry out the steps of:
determining a threshold number of storage devices in a group of storage devices in a storage system that may concurrently exhibit variable I/O response times such that a reconstruct read can still be performed efficiently within the group of storage devices;
detecting one or more conditions related to write requests associated with the group of storage devices; and
in response to detecting the one or more conditions, adjusting the threshold number of storage devices such that a reconstruct read can still be performed while a performance of the group of storage devices is maintained compared to a time before the adjustment.
8. The storage system of claim 7 further comprising computer program instructions that, when executed by the computer processor, cause the storage system to carry out the step of determining a number of storage devices that are concurrently exhibiting variable I/O response times.
9. The storage system of claim 8 further comprising computer program instructions that, when executed by the computer processor, cause the storage system to carry out the steps of:
determining whether the number of storage devices that are concurrently exhibiting variable I/O response times is greater than the threshold number;
if the number of storage devices that are concurrently exhibiting variable I/O response times is greater than the threshold number, scheduling requests to the group of storage devices to reduce the number of storage devices that are concurrently exhibiting variable I/O response times; and
if the number of storage devices that are concurrently exhibiting variable I/O response times is not greater than the threshold number, scheduling requests to improve performance of the group of storage devices.
10. The storage system of claim 7 , wherein detecting one or more conditions associated with the group of storage devices includes determining that a number of pending write requests for a given storage device in the group of storage devices exceeds a waiting threshold.
11. The storage system of claim 7 , wherein detecting one or more conditions associated with the group of storage devices includes detecting a given number of high-priority write requests targeting the group of storage devices.
12. The storage system of claim 7 , wherein exhibiting variable I/O response times includes executing high-latency operations.
13. An apparatus, the apparatus including a computer memory and a computer processor, the computer processor including computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
determining a threshold number of storage devices in a group of storage devices in a storage system that may concurrently exhibit variable I/O response times such that a reconstruct read can still be performed efficiently within the group of storage devices;
detecting one or more conditions related to write requests associated with the group of storage devices; and
in response to detecting the one or more conditions, adjusting the threshold number of storage devices such that a reconstruct read can still be performed while a performance of the group of storage devices is maintained compared to a time before the adjustment.
14. The apparatus of claim 13 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of determining a number of storage devices that are concurrently exhibiting variable I/O response times.
15. The apparatus of claim 14 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
determining whether the number of storage devices that are concurrently exhibiting variable I/O response times is greater than the threshold number;
if the number of storage devices that are concurrently exhibiting variable I/O response times is greater than the threshold number, scheduling requests to the group of storage devices to reduce the number of storage devices that are concurrently exhibiting variable I/O response times; and
if the number of storage devices that are concurrently exhibiting variable I/O response times is not greater than the threshold number, scheduling requests to improve performance of the group of storage devices.
16. The apparatus of claim 13 , wherein detecting one or more conditions associated with the group of storage devices includes determining that a number of pending write requests for a given storage device in the group of storage devices exceeds a waiting threshold.
17. The apparatus of claim 13 , wherein detecting one or more conditions associated with the group of storage devices includes detecting a given number of high-priority write requests targeting the group of storage devices.
18. The apparatus of claim 13 , wherein exhibiting variable I/O response times includes executing high-latency operations.