Network collective offload message chunking management
The disclosed device can perform a collective operation on received datasets, and split the result into chunks in accordance with a chunking scheme. The device can also forward the chunks in accordance with a routing scheme that can direct chunks to appropriate nodes of a collective network. Various other methods, systems, and computer-readable media are also disclosed.
1 . A method comprising:
receiving a plurality of datasets;
performing a collective operation of a collective network on the plurality of datasets to produce a result dataset;
split the result dataset into a plurality of chunks using a chunking scheme that correlates index values of the plurality of datasets to a plurality of destinations in a round-robin style; and
send the plurality of chunks to the plurality of destinations based on the chunking scheme and a topology corresponding to the collective operation that defines paths for chunks traversing the collective network such that corresponding chunks reach a same destination.
2 . The method of claim 1 , wherein the topology defines connections between nodes of a collective network based on the collective operation such that the plurality of datasets are received from a prior level of the collective network and the plurality of chunks are sent to a subsequent level of the collective network.
3 . The method of claim 1 , wherein a number of the plurality of datasets corresponds to a number of input ports and a number of the plurality of chunks corresponds to a number of a plurality of output ports.
4 . The method of claim 1 , wherein the paths for chunks traversing the collective network ensures that chunks of matching vector indexes reach the same destination for the collective operation.
5 . A device comprising:
a plurality of output ports; and
a control circuit configured to:
perform a collective operation on a dataset to produce a result dataset;
split the result dataset into a plurality of chunks using a chunking scheme that correlates index values of the dataset to the plurality of output ports in a round-robin style; and
send the plurality of chunks through the plurality of output ports based on the chunking scheme.
6 . The device of claim 5 , wherein a number of the plurality of chunks matches a number of the plurality of output ports such that each of the plurality of chunks are sent through a respective one of the plurality of output ports.
7 . The device of claim 5 , wherein the device is part of collective network such that the plurality of output ports are connected to nodes of a subsequent level of the collective network.
8 . The device of claim 7 , wherein the plurality of output ports are connected to the nodes of the subsequent level based on a topology that defines paths for chunks traversing the collective network to send each of the plurality of chunks to destinations defined by the topology such that corresponding chunks reach a same destination.
9 . The device of claim 8 , wherein the topology is enforced using segment routing of the plurality of chunks.
10 . The device of claim 8 , wherein the topology defines connections between nodes based on the collective operation.
11 . The device of claim 5 , further comprising a plurality of input ports, wherein the control circuit is further configured to:
receive, through the plurality of input ports, a plurality of datasets; and
perform the collective operation on the plurality of datasets to produce the result dataset.
12 . The device of claim 11 , wherein a number of the plurality of datasets matches a number of the plurality of input ports such that each of the plurality of datasets are received from a respective one of the plurality of input ports.
13 . The device of claim 11 , wherein the device is part of collective network such that the plurality of input ports are connected to nodes of a prior level of the collective network.
14 . The device of claim 13 , wherein the plurality of datasets corresponds to chunks sent from the nodes of the prior level of the collective network.
15 . A device comprising:
a plurality of input ports;
a plurality of output ports; and
a control circuit configured to:
receive, through the plurality of input ports, a plurality of datasets;
perform a collective operation on the plurality of datasets to produce a result dataset;
split the result dataset into a plurality of chunks using a chunking scheme that correlates index values of the plurality of datasets to the plurality of output ports in a round-robin style; and
send the plurality of chunks through the plurality of output ports based on the chunking scheme.
16 . The device of claim 15 , wherein a number of the plurality of datasets matches a number of the plurality of input ports such that each of the plurality of datasets are received from a respective one of the plurality of input ports.
17 . The device of claim 15 , wherein a number of the plurality of chunks matches a number of the plurality of output ports such that each of the plurality of chunks are sent through a respective one of the plurality of output ports.
18 . The device of claim 15 , wherein the device is part of collective network such that the plurality of input ports are connected to nodes of a prior level of the collective network and the plurality of output ports are connected to nodes of a subsequent level of the collective network.
19 . The device of claim 18 , wherein the plurality of datasets corresponds to chunks sent from the nodes of the prior level of the collective network.
20 . The device of claim 18 , wherein the plurality of input ports are connected to the nodes of the prior level and the plurality of output ports are connected to the nodes of the subsequent level based on a topology that defines paths for chunks traversing the collective network and the plurality of chunks are sent through the plurality of output ports to destinations defined by the topology such that corresponding chunks reach a same destination.