CACHE ALLOCATION SYSTEM
Examples described herein relate to a network interface device comprising: a host interface, a direct memory access (DMA) engine, and circuitry to allocate a region in a cache to store a context of a connection. In some examples, the circuitry is to allocate a region in a cache to store a context of a connection based on connection reliability and wherein connection reliability comprises use of a reliable transport protocol or non-use of a reliable transport protocol. In some examples, the circuitry is to allocate a region in a cache to store a context of a connection based on expected length of runtime of the connection and the expected length of runtime of the connection is based on a historic average amount of time the context for the connection was stored in the cache. In some examples, the circuitry is to allocate a region in a cache to store a context of a connection based on content transmitted and the content transmitted comprises congestion messaging payload or acknowledgement. In some examples, the circuitry is to allocate a region in a cache to store a context of a connection based on application-specified priority level and the application-specified priority level comprises an application-specified traffic class level or class of service level.
1 . An apparatus comprising:
a network interface device comprising:
a host interface,
a direct memory access (DMA) engine, and
circuitry to allocate a region in a cache to store a context of a connection.
2 . The apparatus of claim 1 , wherein the circuitry is to allocate a region in a cache to store a context of a connection based on connection reliability and wherein connection reliability comprises use of a reliable transport protocol or non-use of a reliable transport protocol.
3 . The apparatus of claim 1 , wherein the circuitry is to allocate a region in a cache to store a context of a connection based on expected length of runtime of the connection and wherein the expected length of runtime of the connection is based on a historic average amount of time the context for the connection was stored in the cache.
4 . The apparatus of claim 1 , wherein the circuitry is to allocate a region in a cache to store a context of a connection based on content transmitted and wherein the content transmitted comprises congestion messaging payload or acknowledgement.
5 . The apparatus of claim 1 , wherein the circuitry is to allocate a region in a cache to store a context of a connection based on application-specified priority level and wherein the application-specified priority level comprises an application-specified traffic class level or class of service level.
6 . The apparatus of claim 1 , wherein a size of the region is based on a priority level of the context and wherein the priority level of the context is based on a length of runtime of the connection, followed by content transmitted, followed by length of runtime of the connection, and followed by application-specified priority level.
7 . The apparatus of claim 1 , wherein the circuitry is to determine an eviction policy for the context based on one or more of: time the context is stored in the cache and/or number of times the context has been accessed from the cache.
8 . The apparatus of claim 1 , wherein the circuitry comprises resource director technology (RDT) and/or Platform Quality of Service (QoS).
9 . The apparatus of claim 1 , wherein the context is associated with a remote direct memory access (RDMA) queue pair.
10 . The apparatus of claim 1 , wherein the circuitry is to allocate zero cache to a context of a short-lived function.
11 . The apparatus of claim 1 , wherein the network interface device comprises one or more of:
remote direct memory access (RDMA)-enabled NIC, SmartNIC, network interface controller (NIC), SmartNlC, router, switch, forwarding element, infrastructure processing unit (IPU), or data processing unit (DPU).
12 . The apparatus of claim 1 , comprising a server communicatively coupled to the host interface, wherein the server is to configure the circuitry to allocate a region in a cache to store a context of a connection.
13 . A method comprising:
at a network interface device, allocating a region in a cache to store a context of a connection.
14 . The method of claim 13 , wherein the allocating a region in a cache to store a context of a connection is based on connection reliability and wherein the connection reliability comprises use of a reliable transport protocol or non-use of a reliable transport protocol.
15 . The method of claim 13 , wherein the allocating a region in a cache to store a context of a connection is based on expected length of runtime of the connection and wherein the expected length of runtime of the connection is based on a historic average amount of time the context for the connection was stored in the cache.
16 . The method of claim 13 , wherein the allocating a region in a cache to store a context of a connection is based on content transmitted and wherein the content transmitted comprises congestion messaging payload or acknowledgement.
17 . The method of claim 13 , wherein a size of the region is based on a priority level of the context and wherein the priority level of the context is based on length of runtime of the connection, followed by content transmitted, followed by length of runtime of the connection, and followed by application-specified priority level.
18 . A computer-readable medium comprising instructions stored thereon, that if executed by one or more processors, cause the one or more processors to:
execute a driver to configure a network interface device to allocate a region in a cache to store a context of a connection.
19 . The computer-readable medium of claim 18 , wherein the allocate a region in a cache to store a context of a connection is based on connection reliability and expected length of runtime of the connection and wherein:
the connection reliability comprises use of a reliable transport protocol or non-use of a reliable transport protocol and
the expected length of runtime of the connection is based on a historic average amount of time the context for the connection was stored in the cache.
20 . The computer-readable medium of claim 18 , wherein a size of the region is based on a priority level of the context and wherein the priority level of the context is based on length of runtime of the connection, followed by content transmitted, followed by length of runtime of the connection, and followed by application-specified priority level.