System and method for improving extent pool I/O performance by introducing disk level credits on mapped RAID
A method, computer program product, and computer system for receiving, by a computing device, an I/O request for data. A number of storage devices of a plurality of storage devices in a Mapped RAID group that will be used to process the I/O request may be determined. It may be determined whether each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has a respective threshold number of credits to process the I/O request. If each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has the respective threshold number of credits, the I/O request may be processed. If at least one storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request lacks the respective threshold number of credits, the I/O request may be queued.
1. A computer-implemented method comprising:
receiving, by a computing device, an I/O request for data;
determining a number of storage devices of a plurality of storage devices in a Mapped RAID group will be used to process the I/O request;
determining an initial storage device credit for each storage device determined to be used to process the I/O request, wherein the initial storage device credit for each storage device is based upon, at least in part, a type of storage device;
determining whether each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has a respective threshold number of credits to process the I/O request;
if each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has the respective threshold number of credits, processing the I/O request; and
if at least one storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request lacks the respective threshold number of credits, queueing the I/O request.
2. The computer-implemented method of claim 1 wherein an initial storage device credit for a first type of storage device of the plurality of storage devices is X.
3. The computer-implemented method of claim 2 wherein the first type of storage device of the plurality of storage devices is a hard disk drive.
4. The computer-implemented method of claim 1 wherein an initial storage device credit for a second type of storage device of the plurality of storage devices is Y.
5. The computer-implemented method of claim 4 wherein the second type of storage device of the plurality of storage devices is a flash drive.
6. The computer-implemented method of claim 1 wherein the threshold number of credits includes at least one of a number of user I/O credits in an extent pool and a number of background I/O credits in the extent pool.
7. The computer-implemented method of claim 1 further comprising returning one or more I/O credits used to process the I/O request based upon, at least in part, processing the I/O request.
8. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:
receiving an I/O request for data;
determining a number of storage devices of a plurality of storage devices in a Mapped RAID group will be used to process the I/O request;
determining an initial storage device credit for each storage device determined to be used to process the I/O request, wherein the initial storage device credit for each storage device is based upon, at least in part, a type of storage device;
determining whether each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has a respective threshold number of credits to process the I/O request;
if each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has the respective threshold number of credits, processing the I/O request; and
if at least one storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request lacks the respective threshold number of credits, queueing the I/O request.
9. The computer program product of claim 8 wherein an initial storage device credit for a first type of storage device of the plurality of storage devices is X.
10. The computer program product of claim 9 wherein the first type of storage device of the plurality of storage devices is a hard disk drive.
11. The computer program product of claim 8 wherein an initial storage device credit for a second type of storage device of the plurality of storage devices is Y.
12. The computer program product of claim 11 wherein the second type of storage device of the plurality of storage devices is a flash drive.
13. The computer program product of claim 8 wherein the threshold number of credits includes at least one of a number of user I/O credits in an extent pool and a number of background I/O credits in the extent pool.
14. The computer program product of claim 8 wherein the operations further comprise returning one or more I/O credits used to process the I/O request based upon, at least in part, processing the I/O request.
15. A computing system including one or more processors and one or more memories configured to perform operations comprising:
receiving an I/O request for data;
determining a number of storage devices of a plurality of storage devices in a Mapped RAID group will be used to process the I/O request;
determining an initial storage device credit for each storage device determined to be used to process the I/O request, wherein the initial storage device credit for each storage device is based upon, at least in part, a type of storage device;
determining whether each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has a respective threshold number of credits to process the I/O request;
if each storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request has the respective threshold number of credits, processing the I/O request; and
if at least one storage device of the number of storage devices in the Mapped RAID group that will be used to process the I/O request lacks the respective threshold number of credits, queueing the I/O request.
16. The computing system of claim 15 wherein an initial storage device credit for a first type of storage device of the plurality of storage devices is X.
17. The computing system of claim 16 wherein the first type of storage device of the plurality of storage devices is a hard disk drive.
18. The computing system of claim 15 wherein an initial storage device credit for a second type of storage device of the plurality of storage devices is Y.
19. The computing system of claim 15 wherein the threshold number of credits includes at least one of a number of user I/O credits in an extent pool and a number of background I/O credits in the extent pool.
20. The computing system of claim 15 wherein the operations further comprise returning one or more I/O credits used to process the I/O request based upon, at least in part, processing the I/O request.