Dynamic adjustment of network resources based on logical storage volume working set
An apparatus comprises at least one processing device that includes a processor coupled to a memory. The processing device is configured to receive in a host device, for a plurality of targets of a storage system, information characterizing particular sets of one or more logical storage volumes accessible to the host device via respective ones of the targets, to compare the received information to a working set maintained by the host device, the working set identifying one or more logical storage volumes utilized by at least one application deployed on the host device, and to control a number of input-output (IO) queues configured in the storage system for each of one or more of the targets based at least in part on a result of the comparison of the received information to the working set. The targets illustratively comprise NVMe targets, and the logical storage volumes comprise respective NVMe namespaces.
1. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured:
to receive in a host device, for a plurality of targets of a storage system, information characterizing particular sets of one or more logical storage volumes accessible to the host device via respective ones of the targets;
to compare the received information to a working set maintained by the host device, the working set identifying one or more logical storage volumes utilized by at least one application deployed on the host device; and
to control a number of input-output (IO) queues configured in the storage system for each of one or more of the targets based at least in part on a result of the comparison of the received information to the working set.
2. The apparatus of claim 1 wherein each of the IO queues configured in the storage system for a given one of the targets is associated with a corresponding different Transmission Control Protocol (TCP) connection between the host device and the given target.
3. The apparatus of claim 1 wherein the storage system comprises a distributed storage system that includes a plurality of storage nodes, and wherein different ones of the targets are implemented on respective different ones of the storage nodes.
4. The apparatus of claim 3 wherein the distributed storage system comprises a software-defined storage system and the storage nodes comprise respective software-defined storage server nodes of the software-defined storage system.
5. The apparatus of claim 1 wherein a given one of the targets comprises at least one Non-Volatile Memory Express (NVMe) controller of the storage system.
6. The apparatus of claim 1 wherein the logical storage volumes comprise respective NVMe namespaces.
7. The apparatus of claim 1 wherein controlling a number of IO queues configured in the storage system for each of one or more of the targets based at least in part on a result of the comparison of the received information to the working set comprises:
setting the number of IO queues for a given one of the targets to a first number responsive to the received information indicating that the given target does not provide access to any of the logical storage volumes in the working set;
setting the number of IO queues for the given one of the targets to a second number, the second number being greater than the first number, responsive to the received information indicating that the given target provides access to at least one of the logical storage volumes in the working set.
8. The apparatus of claim 7 wherein the first number is zero and the second number is greater than or equal to one.
9. The apparatus of claim 7 wherein the number of IO queues for the given target is initially set to the first number and is subsequently increased to the second number responsive to an asynchronous event notification received in the host device from the given target, wherein the asynchronous event notification indicates a change in an active list of logical storage volumes accessible via the given target to include at least one of the logical storage volumes in the working set.
10. The apparatus of claim 7 wherein the number of IO queues for the given target is initially set to the second number and is subsequently decreased to the first number responsive to a change in the working set which results in the working set not including any logical storage volume for which access is provided via the given target.
11. The apparatus of claim 10 wherein for each of one or more of the IO queues previously configured for the given target, the host device sends a disconnect IO queue command and disconnects a corresponding TCP connection, in order to reduce the number of IO queues for the given target to the first number.
12. The apparatus of claim 1 wherein the received information comprises, for each of the targets, a corresponding active list of logical storage volumes accessible via that target.
13. The apparatus of claim 12 wherein the active list is reported by a given one of the targets to the host device in conjunction with a TCP association establishment phase in which a TCP association is established between the host device and the given target utilizing an administrative queue of the given target.
14. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device comprising a processor coupled to a memory, causes the at least one processing device:
to receive in a host device, for a plurality of targets of a storage system, information characterizing particular sets of one or more logical storage volumes accessible to the host device via respective ones of the targets;
to compare the received information to a working set maintained by the host device, the working set identifying one or more logical storage volumes utilized by at least one application deployed on the host device; and
to control a number of input-output (IO) queues configured in the storage system for each of one or more of the targets based at least in part on a result of the comparison of the received information to the working set.
15. The computer program product of claim 14 wherein each of the IO queues configured in the storage system for a given one of the targets is associated with a corresponding different Transmission Control Protocol (TCP) connection between the host device and the given target.
16. The computer program product of claim 14 wherein controlling a number of IO queues configured in the storage system for each of one or more of the targets based at least in part on a result of the comparison of the received information to the working set comprises:
setting the number of IO queues for a given one of the targets to a first number responsive to the received information indicating that the given target does not provide access to any of the logical storage volumes in the working set;
setting the number of IO queues for the given one of the targets to a second number, the second number being greater than the first number, responsive to the received information indicating that the given target provides access to at least one of the logical storage volumes in the working set.
17. A method comprising:
receiving in a host device, for a plurality of targets of a storage system, information characterizing particular sets of one or more logical storage volumes accessible to the host device via respective ones of the targets;
comparing the received information to a working set maintained by the host device, the working set identifying one or more logical storage volumes utilized by at least one application deployed on the host device; and
controlling a number of input-output (IO) queues configured in the storage system for each of one or more of the targets based at least in part on a result of the comparison of the received information to the working set;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.
18. The method of claim 17 wherein each of the IO queues configured in the storage system for a given one of the targets is associated with a corresponding different Transmission Control Protocol (TCP) connection between the host device and the given target.
19. The method of claim 17 wherein controlling a number of IO queues configured in the storage system for each of one or more of the targets based at least in part on a result of the comparison of the received information to the working set comprises:
setting the number of IO queues for a given one of the targets to a first number responsive to the received information indicating that the given target does not provide access to any of the logical storage volumes in the working set;
setting the number of IO queues for the given one of the targets to a second number, the second number being greater than the first number, responsive to the received information indicating that the given target provides access to at least one of the logical storage volumes in the working set.
20. The method of claim 19 wherein the number of IO queues for the given target is initially set to the first number and is subsequently increased to the second number responsive to an asynchronous event notification received in the host device from the given target, wherein the asynchronous event notification indicates a change in an active list of logical storage volumes accessible via the given target to include at least one of the logical storage volumes in the working set.