Method and system for maximizing performance of a storage system using normalized tokens based on saturation points
In a method used for maximizing performance of a storage system, saturation points of the storage system for I/O requests of different types and sizes are identified. Normalized tokens are determined based on the saturation points. Unique numbers of normalized tokens are associated with the I/O requests of different types and sizes. A number of normalized tokens for a queue depth limit of a storage device is determined. From the queue depth limit, normalized tokens are allocated to each node in the storage device. I/O requests are processed according to the allocations of normalized tokens.
1. A method for maximizing performance of a storage system, the method comprising:
identifying saturation points of the storage system for I/O requests of different types and sizes;
determining, based on the saturation points, normalized tokens;
associating unique numbers of normalized tokens with the I/O requests of different types and sizes;
determining a number of normalized tokens for a queue depth limit of a storage device;
allocating, from the queue depth limit, normalized tokens to each node in the storage device; and
processing I/O requests according to the allocations of normalized tokens,
wherein determining normalized tokens comprises: comparing a saturation point of a read request of a smallest size against remaining saturation points.
2. The method of claim 1 , wherein identifying saturation points of the storage system for I/O requests of different types and sizes comprises:
identifying the saturation points for each type of storage device in the storage system.
3. The method of claim 1 , wherein allocating normalized tokens to each node in the storage device further comprises:
allocating normalized tokens to each group of storage processors in each node.
4. The method of claim 1 , further comprising:
determining a load of the storage system has exceeded a first threshold; and
processing I/O requests according to a system of prioritization.
5. The method of claim 4 , wherein processing I/O requests according to the system of prioritization comprises:
servicing high, medium, and low priority I/O requests according to a predetermined ratio.
6. The method of claim 5 , wherein servicing high, medium, and low priority I/O requests according to the predetermined ratio comprises:
servicing high, medium, and low priority I/O requests according to a predetermined ratio of requests or a predetermined ratio of available normalized tokens.
7. The method of claim 4 , further comprising:
determining a load of the storage system has exceeded a second threshold; and
processing solely I/O requests associated with a high priority.
8. The method of claim 7 , further comprising:
updating normalized tokens based on newly identified saturation points of the storage system for I/O requests of different types and sizes.
9. The method of claim 7 , wherein updating normalized tokens comprises:
updating normalized tokens in response to (a) a determination regarding latency of the storage system, or (b) a predetermined schedule for storage system re-evaluation.
10. A system for maximizing performance of a storage system, the system including a processor configured to:
identify saturation points of the storage system for I/O requests of different types and sizes;
determine, based on the saturation points, normalized tokens;
associate unique numbers of normalized tokens with the I/O requests of different types and sizes;
determine a number of normalized tokens for a queue depth limit of a storage device;
allocate, from the queue depth limit, normalized tokens to each node in the storage device; and
process I/O requests according to the allocations of normalized tokens;
wherein the processor is further configured to: compare a saturation point of a read request of a smallest size against remaining saturation points.
11. The system of claim 10 , wherein the processor is further configured to:
identify the saturation points for each type of storage device in the storage system.
12. The system of claim 10 , wherein the processor is further configured to:
allocate normalized tokens to each group of storage processors in each node.
13. The system of claim 10 , wherein the processor is further configured to:
determine a load of the storage system has exceeded a first threshold; and
process I/O requests according to a system of prioritization.
14. The system of claim 13 , wherein the processor is further configured to:
service high, medium, and low priority I/O requests according to a predetermined ratio.
15. The system of claim 14 , wherein the processor is further configured to:
service high, medium, and low priority I/O requests according to a predetermined ratio of requests or a predetermined ratio of available normalized tokens.
16. The system of claim 13 , wherein the processor is further configured to:
determine a load of the storage system has exceeded a second threshold; and
processing solely I/O requests associated with a high priority.
17. The system of claim 10 , wherein the processor is further configured to:
update normalized tokens based on newly identified saturation points of the storage system for I/O requests of different types and sizes.
18. The system of claim 10 , wherein the processor is further configured to:
update normalized tokens in response to (a) a determination regarding latency of the storage system, or (b) a predetermined schedule for storage system re-evaluation.