Server fabric adapter for I/O scaling of heterogeneous and accelerated compute systems
A server fabric adapter (SFA) communication system is disclosed. In some embodiments, the SFA communication system comprises an SFA communicatively coupled to a plurality of controlling hosts, a plurality of endpoints, and a plurality of network ports. The SFA is configured to receive a network packet from a network port of the plurality of network ports; separate the network packet into different portions, each portion including a header or a payload; map each portion of the network packet to: (i) a controlling host of the plurality controlling hosts, the controlling host being designated as a destination controlling host, or (ii) an endpoint of the plurality of endpoints, the endpoint being designated as a destination endpoint; and forward a respective portion of the network packet to the destination controlling host or the destination endpoint.
1. A method comprising:
providing an endpoint port that connects a fabric adapter to an endpoint, wherein the endpoint port has a queue for the endpoint to submit one or more scatter-gather lists (SGLs);
providing a host port that connects the fabric adapter to a controlling host, wherein the host port includes a header queue; and
combining, by the fabric adapter, data from the header queue with an SGL of the one or more SGLs to generate a network packet.
2. The method of claim 1 , wherein the network packet is used in peer-to-peer traffic.
3. The method of claim 1 , further comprising dividing, by the fabric adapter, the network packet into one or more headers and a payload.
4. The method of claim 3 , wherein the payload is transmitted to or received from an arbitrary memory geometry based on the SGL of memory locations.
5. The method of claim 1 , further comprising transmitting and receiving, by the fabric adapter, network packets between one or more endpoints and one or more networks, between two endpoints, or between two networks.
6. The method of claim 5 , wherein the networks are associated with a plurality of network ports that include one or more Ethernet ports.
7. The method of claim 1 , wherein the fabric adapter is a scalable and aggregated input/output (I/O) hub.
8. The method of claim 1 , wherein the endpoint is one of a storage element, a memory element, a graphics processing unit (GPU), an accelerator, or a field programmable gate array (FPGA).
9. The method of claim 1 , wherein the endpoint is one of a plurality of endpoints, the method further comprising:
receiving, by the fabric adapter, a trigger event;
retrieving, by the fabric adapter, payload data of a second network packet from a source endpoint of the plurality of endpoints; and
routing, based on associated descriptors and by the fabric adapter, the payload data to a destination endpoint of the plurality of endpoints.
10. The method of claim 9 , wherein the associated descriptors include at least one of a data descriptor or a header descriptor.
11. The method of claim 10 , wherein the trigger event is one of a host-initiated cache line operation or a SGL write initiated by the source endpoint to a memory address of the destination endpoint.
12. A system comprising:
a fabric adapter comprising a processor, memory, a plurality of endpoint ports, and a plurality of host ports and communicatively coupled to a plurality of controlling hosts, a plurality of endpoints, and a plurality of network ports, the fabric adapter configured to:
provide an endpoint port of the plurality of endpoint ports that connects the fabric adapter to an endpoint of the plurality of endpoints, wherein the endpoint port has a queue for the endpoint to submit one or more scatter-gather lists (SGLs);
provide a host port of the plurality of host ports that connects the fabric adapter to a controlling host of the plurality of controlling hosts, wherein the host port includes a header queue; and
combine data from the header queue with an SGL of the one or more SGLs to generate a network packet.
13. The system of claim 12 , wherein the network packet is used in peer-to-peer traffic.
14. The system of claim 12 , wherein the fabric adapter is further configured to transmit and receive network packets between one or more endpoints and one or more networks, between two endpoints, or between two networks.
15. The system of claim 12 , wherein the plurality of network ports comprise one or more Ethernet ports.
16. The system of claim 12 , wherein the fabric adapter is a scalable and aggregated input/output (I/O) hub.
17. The system of claim 12 , wherein the plurality of endpoints comprise storage elements, memory elements, graphics processing units (GPUs), accelerators, or a field programmable gate arrays (FPGAs).
18. The system of claim 12 , wherein the fabric adapter is further configured to:
receive a trigger event;
retrieve payload data of a second network packet from a source endpoint of the plurality of endpoints; and
route, based on associated descriptors, the payload data to a destination endpoint of the plurality of endpoints.
19. The system of claim 12 , wherein the associated descriptors include at least one of a data descriptor or a header descriptor.
20. The system of claim 12 , wherein the trigger event is one of a host-initiated cache line operation or a SGL write initiated by the source endpoint to a memory address of the destination endpoint.