Application-level network queueing
There is disclosed in one example a network interface card (NIC), comprising: an ingress interface to receive incoming traffic; a plurality of queues to queue incoming traffic; an egress interface to direct incoming traffic to a plurality of server applications; and a queuing engine, including logic to: uniquely associate a queue with a selected server application; receive an incoming network packet; determine that the selected server application may process the incoming network packet; and assign the incoming network packet to the queue.
1. At least one non-transitory storage medium storing instructions to be executed by at least one server system, the instructions, when executed by the at least one server system, resulting in the at least one server system being configurable to perform operations comprising:
assigning, based upon respective application-specific quality of service-related data:
one or more queues to respective applications; and/or
respective portions of network traffic to the one or more queues;
wherein:
the respective application-specific quality of service-related data is associated with the respective applications;
the one or more queues are for use in application-level steering of the respective portions of the network traffic;
the respective application-specific quality of service-related data is configurable to be based upon respective application-associated identifier values;
the respective application-associated identifier values are configurable to be based upon respective port numbers associated with the respective applications;
the assigning is configurable to be associated with at least one tail latency;
the respective application-specific quality of service-related data is to be generated based upon policy-related data;
the policy-related data comprises quality of service policy data; and
the policy-related data is to be defined, at least in part, via a management user interface to be provided using an operating system.
2. The at least one non-transitory storage medium of claim 1 , wherein:
the policy-related data comprises user-definable security policy data; and
the user-definable security policy data is to be implemented in association with at least one operating system of the at least one server system.
3. The at least one non-transitory storage medium of claim 1 , wherein:
the respective applications are associated with tenant-associated virtual machines;
the respective applications comprise email and/or web applications; and
the at least one server system is configurable to implement receive-side scaling with respect to queue assignment associated with the respective applications.
4. The at least one non-transitory storage medium of claim 3 , wherein:
the at least one server system is configurable to implement network traffic load balancing in association with the respective applications; and
the at least one server system comprises a scalable distributed computer system.
5. The at least one non-transitory storage medium of claim 4 , wherein:
the one or more queues are configurable to be aligned with application threads.
6. The at least one non-transitory storage medium of claim 1 , wherein:
the respective port numbers comprise port 25 and/or port 80 ; and
the respective port numbers are to be used as respective queue assignment key values.
7. A method implemented using at least one server system, the method comprising:
assigning, based upon respective application-specific quality of service-related data:
one or more queues to respective applications; and/or
respective portions of network traffic to the one or more queues;
wherein:
the respective application-specific quality of service-related data is associated with the respective applications;
the one or more queues are for use in application-level steering of the respective portions of the network traffic;
the respective application-specific quality of service-related data is configurable to be based upon respective application-associated identifier values;
the respective application-associated identifier values are configurable to be based upon respective port numbers associated with the respective applications;
the assigning is configurable to be associated with at least one tail latency;
the respective application-specific quality of service-related data is to be generated based upon policy-related data;
the policy-related data comprises quality of service policy data; and
the policy-related data is to be defined, at least in part, via a management user interface to be provided using an operating system.
8. The method of claim 7 , wherein:
the policy-related data comprises user-definable security policy data; and
the user-definable security policy data is to be implemented in association with at least one operating system of the at least one server system.
9. The method of claim 7 , wherein:
the respective applications are associated with tenant-associated virtual machines;
the respective applications comprise email and/or web applications; and
the at least one server system is configurable to implement receive-side scaling with respect to queue assignment associated with the respective applications.
10. The method of claim 9 , wherein:
the at least one server system is configurable to implement network traffic load balancing in association with the respective applications; and
the at least one server system comprises a scalable distributed computer system.
11. The method of claim 10 , wherein:
the one or more queues are configurable to be aligned with application threads.
12. The method of claim 7 , wherein:
the respective port numbers comprise port 25 and/or port 80 ; and
the respective port numbers are to be used as respective queue assignment key values.
13. At least one server system comprising:
processor circuitry;
storage storing instructions to be executed by the processor circuitry, the instructions when executed by the processor circuitry resulting in the at least one server system being configurable to perform operations comprising:
assigning, based upon respective application-specific quality of service-related data:
one or more queues to respective applications; and/or
respective portions of network traffic to the one or more queues;
wherein:
the respective application-specific quality of service-related data is associated with the respective applications;
the one or more queues are for use in application-level steering of the respective portions of the network traffic;
the respective application-specific quality of service-related data is configurable to be based upon respective application-associated identifier values;
the respective application-associated identifier values are configurable to be based upon respective port numbers associated with the respective applications;
the assigning is configurable to be associated with at least one tail latency;
the respective application-specific quality of service-related data is to be generated based upon policy-related data;
the policy-related data comprises quality of service policy data; and
the policy-related data is to be defined, at least in part, via a management user interface to be provided using an operating system.
14. The at least one server system of claim 13 , wherein:
the policy-related data comprises user-definable security policy data; and
the user-definable security policy data is to be implemented in association with at least one operating system of the at least one server system.
15. The at least one server system of claim 13 , wherein:
the respective applications are associated with tenant-associated virtual machines;
the respective applications comprise email and/or web applications; and
the at least one server system is configurable to implement receive-side scaling with respect to queue assignment associated with the respective applications.
16. The at least one server system of claim 15 , wherein:
the at least one server system is configurable to implement network traffic load balancing in association with the respective applications; and
the at least one server system comprises a scalable distributed computer system.
17. The at least one server system of claim 16 , wherein:
the one or more queues are configurable to be aligned with application threads.
18. The at least one server system of claim 13 , wherein:
the respective port numbers comprise port 25 and/or port 80 ; and
the respective port numbers are to be used as respective queue assignment key values.