Management of shared resources in a software-defined storage environment

1. A method, comprising:

receiving, by a storage control system, an input/output (I/O) request from a client application for accessing data storage resources controlled by the storage control system, wherein the data storage resources comprise storage devices which are logically divided by the storage control system into a plurality of storage device groups, wherein each storage device group of the plurality of storage device groups is dynamically allocated a corresponding amount of resource tokens by the storage control system based at least in part on relative workload demands of the storage device groups;

determining, by the storage control system, a resource token request value associated with the I/O request and (ii) a target storage device group of the plurality of storage device groups to which the I/O request is directed;

determining, by the storage control system, a number of allowed resource tokens to allocate to the client application, wherein the number of allowed resource tokens is determined as a function of (i) the resource token request value, (ii) a sum total of resource tokens requested by other client applications for accessing the target storage device group, and (iii) a total amount of resource tokens currently allocated to the target storage device group to which the I/O request is directed; and

sending to the client application, by the storage control system, the determined number of allowed resource tokens allocated to the client application to thereby enable the client application to limit a number of inflight I/O requests that the client application issues to the storage control system based on the number of allowed resource tokens allocated to the client application for accessing the target storage device group.

2. The method of claim 1 , wherein the number of allowed resource tokens allocated to the client application comprises a number of allowed I/O tokens, wherein the number of allowed I/O tokens is configured to limit an amount of I/O-related resources that are utilized to process I/O requests of the client application which are directed to the target storage device group.

3. The method of claim 1 , wherein the number of allowed resource tokens allocated to the client application comprises a number of allowed throughput tokens, wherein the number of allowed throughput tokens is configured to limit an amount of storage-related resources that are utilized to process I/O requests of the client application which are directed to the target storage device group.

4. The method of claim 3 , wherein one throughput token represents a predefined amount of data.

5. The method of claim 1 , wherein:

the resource token request value associated with the I/O request comprises an I/O token request value, wherein the I/O token request value represents a total amount of (i) current inflight I/O requests and (ii) accumulated I/O inflight requests of the client application which have not yet been sent; and

the number of allowed resource tokens allocated to the client application comprises a number of allowed I/O tokens, wherein the number of allowed I/O tokens represents a total number of inflight I/O requests the given client application can concurrently have in a next resource allocation cycle, wherein the total number of inflight requests comprises a total amount of (i) new inflight I/O requests that client application can send in the next resource allocation cycle and (ii) currently pending inflight I/O requests.

6. The method of claim 1 , wherein:

the resource token request value associated with the I/O request comprises a throughput token request value, wherein the throughput token request value represents a total amount of data associated with all inflight I/O requests of the client application; and

the number of allowed resource tokens allocated to the client application comprises a number of allowed throughput tokens, wherein the number of allowed throughput tokens represents a maximum amount of data that can be associated with all concurrent inflight I/O requests that are allocated to the given client application for a next resource allocation cycle.

7. The method of claim 1 , further comprising:

determining, by the storage control system, a current rank value of the client application;

adjusting, by the storage control system, the resource token request value associated with the I/O request of the client application based on the determined current rank value of the client application; and

determining, by the storage control system, the number of allowed resource tokens to allocate to the client application based on the adjusted resource token request value.

8. The method of claim 7 , wherein adjusting the resource token request value comprises reducing the resource token request value in proportion to a ratio of (i) the determined current rank value to (ii) a predefined maximum rank value.

9. The method of claim 1 , wherein the plurality of storage device groups comprises at least a first storage device group comprising storage devices of a first device type, and a second storage device group comprising storage devices of a second device type, which is different from the first device type; and wherein the method further comprises:

determining, by the storage control system, a respective maximum storage device group token value for each storage device group of the plurality of storage device groups, wherein the maximum storage device group token value for a given storage device group represents a maximum number of resource tokens that are allocated to the given storage device group, out of a total amount of available resource tokens of the data storage system, based on a maximum amount of concurrent I/O operations that the given storage device group can perform based on the type of storage devices of the given storage device group and a number of storage devices within the given storage device group.

10. An article of manufacture comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code is executable by one or more processors to implement a method comprising:

receiving, by a storage control system, an input/output (I/O) request from a client application for accessing data storage resources controlled by the storage control system, wherein the data storage resources comprise storage devices which are logically divided by the storage control system into a plurality of storage device groups, wherein each storage device group of the plurality of storage device groups is dynamically allocated a corresponding amount of resource tokens by the storage control system based at least in part on relative workload demands of the storage device groups;

determining, by the storage control system, a resource token request value associated with the I/O request and (ii) a target storage device group of the plurality of storage device groups to which the I/O request is directed;

determining, by the storage control system, a number of allowed resource tokens to allocate to the client application, wherein the number of allowed resource tokens is determined as a function of (i) the resource token request value, (ii) a sum total of resource tokens requested by other client applications for accessing the target storage device group, and (iii) a total amount of resource tokens currently allocated to the target storage device group to which the I/O request is directed; and

sending to the client application, by the storage control system, the determined number of allowed resource tokens allocated to the client application to thereby enable the client application to limit a number of inflight I/O requests that the client application issues to the storage control system based on the number of allowed resource tokens allocated to the client application for accessing the target storage device group.

11. The article of manufacture of claim 10 , wherein the number of allowed resource tokens allocated to the client application comprises a number of allowed I/O tokens, wherein the number of allowed I/O tokens is configured to limit an amount of I/O-related resources that are utilized to process I/O requests of the client application which are directed to the target storage device group.

12. The article of manufacture of claim 10 , wherein the number of allowed resource tokens allocated to the client application comprises a number of allowed throughput tokens, wherein the number of allowed throughput tokens is configured to limit an amount of storage-related resources that are utilized to process I/O requests of the client application which are directed to the target storage device group, wherein one throughput token represents a predefined amount of data.

13. The article of manufacture of claim 10 , wherein:

the resource token request value associated with the I/O request comprises an I/O token request value, wherein the I/O token request value represents a total amount of (i) current inflight I/O requests and (ii) accumulated I/O inflight requests of the client application which have not yet been sent; and

the number of allowed resource tokens allocated to the client application comprises a number of allowed I/O tokens, wherein the number of allowed I/O tokens represents a total number of inflight I/O requests the given client application can concurrently have in a next resource allocation cycle, wherein the total number of inflight requests comprises a total amount of (i) new inflight I/O requests that client application can send in the next resource allocation cycle and (ii) currently pending inflight I/O requests.

14. The article of manufacture of claim 10 , wherein:

the resource token request value associated with the I/O request comprises a throughput token request value, wherein the throughput token request value represents a total amount of data associated with all inflight I/O requests of the client application; and

the number of allowed resource tokens allocated to the client application comprises a number of allowed throughput tokens, wherein the number of allowed throughput tokens represents a maximum amount of data that can be associated with all concurrent inflight I/O requests that are allocated to the given client application for a next resource allocation cycle.

15. The article of manufacture of claim 10 , further comprising:

determining, by the storage control system, a current rank value of the client application;

adjusting, by the storage control system, the resource token request value associated with the I/O request of the client application based on the determined current rank value of the client application, wherein adjusting the resource token request value comprises reducing the resource token request value in proportion to a ratio of (i) the determined current rank value to (ii) a predefined maximum rank value; and

determining, by the storage control system, the number of allowed resource tokens to allocate to the client application based on the adjusted resource token request value.

16. The article of manufacture of claim 10 , wherein the plurality of storage device groups comprises at least a first storage device group comprising storage devices of a first device type, and a second storage device group comprising storage devices of a second device type, which is different from the first device type; and wherein the method further comprises:

determining, by the storage control system, a respective maximum storage device group token value for each storage device group of the plurality of storage device groups, wherein the maximum storage device group token value for a given storage device group represents a maximum number of resource tokens that are allocated to the given storage device group, out of a total amount of available resource tokens of the data storage system, based on a maximum amount of concurrent I/O operations that the given storage device group can perform based on the type of storage devices of the given storage device group and a number of storage devices within the given storage device group.

17. A server node, comprising:

at least one processor; and

system memory configured to store program code, wherein the program code is executable by the at least one processor to implement a storage control system which is configured to:

receive an input/output (I/O) request from a client application for accessing data storage resources controlled by the storage control system, wherein the data storage resources comprise storage devices which are logically divided by the storage control system into a plurality of storage device groups, wherein each storage device group of the plurality of storage device groups is dynamically allocated a corresponding amount of resource tokens by the storage control system based at least in part on relative workload demands of the storage device groups;

determine (i) a resource token request value associated with the I/O request and (ii) a target storage device group of the plurality of storage device groups to which the I/O request is directed;

determine a number of allowed resource tokens to allocate to the client application, wherein the number of allowed resource tokens is determined as a function of (i) the resource token request value, (ii) a sum total of resource tokens requested by other client applications for accessing the target storage device group, and (iii) a total amount of resource tokens currently allocated to the target storage device group to which the I/O request is directed; and

send to the client application, the determined number of allowed resource tokens allocated to the client application to thereby enable the client application to limit a number of inflight I/O requests that the client application issues to the storage control system based on the number of allowed resource tokens allocated to the client application for accessing the target storage device group.

18. The server node of claim 17 , wherein the number of allowed resource tokens allocated to the client application comprises a number of allowed I/O tokens, wherein the number of allowed I/O tokens is configured to limit an amount of I/O-related resources that are utilized to process I/O requests of the client application which are directed to the target storage device group.

19. The server node of claim 17 , wherein the number of allowed resource tokens allocated to the client application comprises a number of allowed throughput tokens, wherein the number of allowed throughput tokens is configured to limit an amount of storage-related resources that are utilized to process I/O requests of the client application which are directed to the target storage device group.

20. The server node of claim 17 , wherein the storage control system comprises a software-defined storage control system.