Efficiently interconnecting computing nodes to enable use of high-radix network switches
A system for efficiently interconnecting computing nodes can include a plurality of computing nodes and a plurality of network switches coupled in parallel to the plurality of computing nodes. The system can also include a plurality of node interfaces. Each computing node among the plurality of computing nodes can include at least one node interface for each network switch among the plurality of network switches. The plurality of node interfaces corresponding to a computing node can be configured to send data to another computing node via the plurality of network switches. The system can also include a plurality of switch interfaces. Each network switch among the plurality of network switches can include at least one switch interface for each computing node among the plurality of computing nodes. A switch interface corresponding to the computing node can be coupled to a node interface corresponding to the computing node.
1. A method for efficiently processing a plurality of data streams while avoiding high-radix network devices, the method comprising:
sending, by a plurality of source node interfaces on a source node, a plurality of data streams, each data stream of the plurality of data streams being sent by a source node interface from the plurality of source node interfaces;
causing the plurality of data streams to be transmitted via a plurality of network switches coupled to the plurality of source node interfaces, each data stream being transmitted via a network switch from the plurality of network switches, and wherein each network switch from the plurality of network switches includes a first interface to receive data from the source node and a second interface to provide data to a destination node; and
receiving, at a plurality of destination node interfaces on the destination node, the plurality of data streams, each data stream of the plurality of data streams being received at a destination node interface from the plurality of destination node interfaces,
wherein the plurality of source node interfaces and the plurality of destination node interfaces send and receive the plurality of data streams without the source node performing serialization and without the destination node performing deserialization.
2. The method of claim 1 , wherein the plurality of network switches are coupled in parallel between the source node and the destination node.
3. The method of claim 1 , wherein each source node interface of the plurality of source node interfaces and each destination node interface of the plurality of destination node interfaces are configured to receive a serial data stream from a data source and send the serial data stream to another computing node via a network switch among the plurality of network switches.
4. The method of claim 1 , wherein:
the plurality of network switches are optically coupled to the source node and the destination node,
the plurality of source node interfaces and the plurality of destination node interfaces include a plurality of node optical transceivers, each source node interface and each destination node interface including at least one node optical transceiver, and
the first interface and the second interface on the plurality of network switches include a plurality of optical transceivers, each interface of the first interface and the second interface including at least one optical transceiver.
5. The method of claim 4 , wherein communications between the plurality of node optical transceivers and the plurality of optical transceivers occur via free-space optical communications.
6. The method of claim 1 , wherein the plurality of network switches are electrically coupled to the source node and the destination node.
7. The method of claim 1 , wherein the plurality of source node interfaces on the source node and the plurality of destination node interfaces on the destination node are optically coupled to the plurality of network switches via a plurality of optical cables.
8. A method for efficiently processing a plurality of data streams while avoiding high-radix network devices, the method comprising:
sending, by a first source node interface on a source node, a first data stream;
sending, by a second source node interface on the source node, a second data stream;
causing the first data stream to be transmitted via a first network switch coupled to the first source node interface, wherein the first network switch includes a first interface to receive data from the source node and a second interface to provide data to a destination node;
causing the second data stream to be transmitted via a second network switch coupled to the second source node interface, wherein the second network switch include a third interface to receive data from the source node and a fourth interface to provide data to the destination node;
receiving, at a first destination node interface on the destination node, the first data stream, wherein the first source node interface and the first destination node interface send and receive the first data stream without the source node performing serialization and without the destination node performing deserialization; and
receiving, at a second destination node interface on the destination node, the second data stream, wherein the second source node interface and the second destination node interface send and receive the second data stream without the source node performing serialization and without the destination node performing deserialization.
9. The method of claim 8 , wherein the first network switch and the second network switch are coupled in parallel between the source node and the destination node.
10. The method of claim 8 , wherein each node interface from the first source node interface, second source node interface, first destination node interface, and second destination node interface is configured to receive a serial data stream from a data source and send the serial data stream to another computing node via a network switch among the plurality of network switches.
11. The method of claim 8 , wherein:
the first network switch and the second network switch are optically coupled to the source node and the destination node,
the first source node interface, second source node interface, first destination node interface, and second destination node interface include a plurality of node optical transceivers, and
the first interface, second interface, third interface, and the fourth interface on the first network switch and the second network switch include a plurality of optical transceivers.
12. The method of claim 11 , wherein communications between the plurality of node optical transceivers and the plurality of optical transceivers occur via free-space optical communications.
13. The method of claim 8 , wherein the first network switch and the second network switch are electrically coupled to the source node and the destination node.
14. The method of claim 8 , wherein the first source node interface and the second source node interface on the source node and the first destination node interface and the second destination node interface on the destination node are optically coupled to the first network switch and the second network switch via a plurality of optical cables.
15. A system for efficiently processing a plurality of data streams while avoiding high-radix network devices, the system comprising:
a plurality of source node interfaces on a source node having a plurality of source node interfaces thereon, the plurality of source node interfaces being configured to send a plurality of data streams, each data stream of the plurality of data streams being sent by a source node interface from the plurality of source node interfaces;
a plurality of network switches coupled to the plurality of source node interfaces, each network switch from the plurality of network switches including a first interface to receive data from the source node and a second interface to provide data to a destination node, the plurality of network switches being configured to route the plurality of data streams from the source node to the destination node, wherein each data stream is transmitted via a network switch from the plurality of network switches; and
a plurality of destination node interfaces on the destination node, the plurality of destination node interfaces being configured to receive the plurality of data streams, each data stream from the plurality of data streams being received at a destination node interface from the plurality of destination node interfaces,
wherein the plurality of source node interfaces and the plurality of destination node interfaces send and receive the plurality of data streams without the source node performing serialization and without the destination node performing deserialization.
16. The system of claim 15 , wherein the plurality of network switches are coupled in parallel between the source node and the destination node.
17. The system of claim 15 , wherein each source node interface of the plurality of source node interfaces and each destination node interface of the plurality of destination node interfaces are configured to receive a serial data stream from a data source and send the serial data stream to another computing node via a network switch among the plurality of network switches.
18. The system of claim 15 , wherein:
the plurality of network switches are optically coupled to the source node and the destination node,
the plurality of source node interfaces and the plurality of destination node interfaces include a plurality of node optical transceivers, each source node interface and each destination node interface including at least one node optical transceiver, and
the first interface and the second interface on the plurality of network switches include a plurality of optical transceivers, each interface of the first interface and the second interface including at least one optical transceiver.
19. The system of claim 18 , wherein communications between the plurality of node optical transceivers and the plurality of optical transceivers occur via free-space optical communications.
20. The system of claim 18 , wherein the plurality of network switches are electrically coupled to the source node and the destination node.