Managing Shared Resource Usage in Networked Storage Systems
Methods and systems for a networked storage system are provided. One method includes predicting an IOPS limit for a plurality of storage pools based on a maximum allowed latency of each storage pool, the maximum allowed latency determined from a relationship between the retrieved latency and a total number of IOPS from a resource data structure; identifying a storage pool whose utilization has reached a threshold value, the utilization based on a total number of IOPS directed towards the storage pool and a predicted IOPS limit; detecting a bully workload based on a numerical value determined from a total number of IOPS issued by the bully workload for the storage pool and a rising step function; and implementing a corrective action to reduce an impact of the bully workload on a victim workload.
1 . A method executed by one or more processors, comprising:
retrieving, from a data structure, input/output per second (IOPS) limits for storage volumes with quality of service (QoS) limits;
determining utilizations of the storage volumes based on the IOPS limits and a total IOPS directed towards each storage volume;
detecting a bully workload and a victim workload associated with a storage volume with utilization exceeding a threshold utilization value, wherein the bully workload is identified based on a first value determined from a total number of IOPS issued by the bully workload for the storage volumes from a starting moment when the utilization of the storage volume exceeds the threshold utilization value using a function, and wherein the victim workload is identified based on a second value determined from a total number of IOPS issued by the victim workload for the storage volumes from the starting moment when the utilization of the storage volume exceeds the threshold utilization value using the function, the first value being higher than the second value; and
implementing a corrective action to reduce an impact of the bully workload on the victim workload.
2 . The method of claim 1 , further comprising generating the data structure that includes a storage topology of a network storage system, the storage topology identifying each shared resource of the networked storage system including the storage volumes.
3 . The method of claim 2 , wherein the storage topology included in the data structure further identifies logical and physical paths to components that are used to process inputs and outputs.
4 . The method of claim 1 , wherein the function is a rising step function.
5 . The method of claim 1 , wherein detecting the bully workload and the victim workload is performed by a machine learning model generator.
6 . The method of claim 1 , wherein implementing the corrective action includes moving a workload from one resource to another or throttling input/output (I/O) request processing for the bully workload.
7 . The method of claim 1 , wherein the threshold utilization value is a percentage value with respect to a maximum IOPS value.
8 . A non-transitory, machine readable storage medium having stored thereon instructions comprising machine executable code, which when executed by a machine, causes the machine to:
retrieve, from a data structure, input/output per second (IOPS) limits for storage volumes with quality of service (QoS) limits;
determine utilizations of the storage volumes based on the IOPS limits and a total IOPS directed towards each storage volume;
detect a bully workload and a victim workload associated with a storage volume with utilization exceeding a threshold utilization value, wherein the bully workload is identified based on a first value determined from a total number of IOPS issued by the bully workload for the storage volumes from a starting moment when the utilization of the storage volume exceeds the threshold utilization value using a function, and wherein the victim workload is identified based on a second value determined from a total number of IOPS issued by the victim workload for the storage volumes from the starting moment when the utilization of the storage volume exceeds the threshold utilization value using the function, the first value being higher than the second value; and
implement a corrective action to reduce an impact of the bully workload on the victim workload.
9 . The non-transitory, machine readable storage medium of claim 8 , wherein the machine executable code further causes the machine to generate the data structure that includes a storage topology of a network storage system, the storage topology identifying each shared resource of the networked storage system including the storage volumes.
10 . The non-transitory, machine readable storage medium of claim 9 , wherein the storage topology included in the data structure further identifies logical and physical paths to components that are used to process inputs and outputs.
11 . The non-transitory, machine readable storage medium of claim 8 , wherein the function is a rising step function.
12 . The non-transitory, machine readable storage medium of claim 8 , wherein a machine learning model generator is used to detect the bully workload and the victim workload.
13 . The non-transitory, machine readable storage medium of claim 8 , wherein the machine executable code further causes the machine to move a workload from one resource to another or throttle input/output (I/O) request processing for the bully workload to implement the corrective action.
14 . The non-transitory, machine readable storage medium of claim 8 , wherein the threshold utilization value is a percentage value with respect to a maximum IOPS value.
15 . A system, comprising:
a memory containing machine readable medium comprising machine executable code having stored thereon instructions; and
a processor coupled to the memory to execute the machine executable code to:
retrieve, from a data structure, input/output per second (IOPS) limits for storage volumes with quality of service (QoS) limits;
determine utilizations of the storage volumes based on the IOPS limits and a total IOPS directed towards each storage volume;
detect a bully workload and a victim workload associated with a storage volume with utilization exceeding a threshold utilization value, wherein the bully workload is identified based on a first value determined from a total number of IOPS issued by the bully workload for the storage volumes from a starting moment when the utilization of the storage volume exceeds the threshold utilization value using a function, and wherein the victim workload is identified based on a second value determined from a total number of IOPS issued by the victim workload for the storage volumes from the starting moment when the utilization of the storage volume exceeds the threshold utilization value using the function, the first value being higher than the second value; and
implement a corrective action to reduce an impact of the bully workload on the victim workload.
16 . The system of claim 15 , wherein the machine executable code further causes the processor to generate the data structure that includes a storage topology of a network storage system, the storage topology identifying each shared resource of the networked storage system including the storage volumes.
17 . The system of claim 16 , wherein the storage topology included in the data structure further identifies logical and physical paths to components that are used to process inputs and outputs.
18 . The system of claim 15 , wherein the function is a rising step function.
19 . The system of claim 15 , wherein a machine learning model generator is used to detect the bully workload and the victim workload.
20 . The system of claim 15 , wherein the machine executable code further causes the processor to move a workload from one resource to another or throttle input/output (I/O) request processing for the bully workload to implement the corrective action.