Arithmetic processing offload system, client, server, and arithmetic processing offload method
An operation system of a client includes: an L3/L4 protocol and ACC function and argument data packetizing unit that serializes a function name and argument input from an application side according to a format of a predetermined protocol and packetizes the function name/argument as a payload; and an L3/L4 protocol and ACC function and return value data parsing unit that deserializes packet data input from a server side according to a format of a predetermined protocol and acquires a function name/execution result.
1 . An arithmetic processing offload system comprising a client device and a server connected to the client device via a network, the client device offloading specific processing of an application to an accelerator disposed in the server to perform arithmetic processing,
wherein the client device comprises one or more processors and is installed with a first operating system (OS), wherein the first OS causes the one or more processors of the client device to perform a first set of operations comprising:
serializing a first input that comprises (i) a function name of a function for performing the arithmetic processing on one or more input arguments and (ii) values of the one more input arguments from the application according to a format of a predetermined protocol and packetizing the serialized first input as a single payload of a first packet, wherein the single payload comprises data specifying (i) the function name and (ii) at least a portion of the values of the one or more input arguments;
transmitting the first packet comprising the single payload to the server;
receiving a second packet comprising data specifying arithmetic processing result of the function from the server; and
deserializing the second packet according to a format of a predetermined protocol to obtain the function name and the arithmetic processing result of the function; and
wherein the server comprises one or more processors and is installed with a second OS that causes the one or more processors of the server to perform a second set of operations comprising:
deserializing the single payload of the first packet received from the client device according to a format of a predetermined protocol to obtain (i) the function name of the function for performing the arithmetic processing on the one or more input arguments and (ii) the at least a portions of the values of the one more input arguments from the application;
performing, using the accelerator, the arithmetic processing of the function based on the values of the one more input arguments;
serializing a second input from the accelerator that comprises (i) the function name of the function and (ii) arithmetic processing result of the function according to a format of a predetermined protocol and packetizing the serialized second input as a single payload of the second packet, wherein the single payload of the second packet comprises data specifying (i) the function name and (ii) the arithmetic processing result; and
transmitting the second packet of the second packet comprising the single payload to the client device.
2 . The arithmetic processing offload system according to claim 1 ,
wherein the first set of operations further comprise:
exchanging data with an accelerator function/argument data packetizing unit, an accelerator function/return value data parsing unit, and a network interface card (NIC) driver unit without passing through a predetermined protocol stack, the NIC driver unit pruning data from an NIC.
3 . The arithmetic processing offload system according to claim 1 ,
wherein the second set of operations further comprise:
exchanging data with an accelerator function/argument data parsing unit, an accelerator function/return value data packetizing unit, and an NIC driver unit without passing through a predetermined protocol stack, the NIC driver unit pruning data from an NIC.
4 . A client device of an arithmetic processing offload system including the client device and a server connected to the client device via a network, the client offloading specific processing of an application to an accelerator disposed in the server to perform arithmetic processing,
wherein the client device comprises one or more processors and is installed with an operating system (OS) that causes the one or more processors of the client device to perform operations comprising:
serializing an input that comprises (i) a function name of a function for performing the arithmetic processing on one or more input arguments and (ii) values of the one more input arguments from the application according to a format of a predetermined protocol and packetizing the serialized input as a single payload of a first packet, wherein the single payload comprises data specifying (i) the function name and (ii) at least a portion of the values of the one or more input arguments;
transmitting the first packet comprising the single payload to the server;
receiving a second packet comprising data specifying arithmetic processing result of the function from the server; and
deserializing the second packet according to a format of a predetermined protocol to obtain the function name and the arithmetic processing result of the function.
5 . The client device of claim 4 , wherein the serializing comprises converting the function name and the values for the one or more arguments into a byte stream.
6 . The client device of claim 4 , wherein the predetermined protocol specifies a format for arranging the function name and values of the one or more arguments within the serialized input.
7 . The client device of claim 4 , wherein the predetermined protocol specifies one or more control bits for managing data size.
8 . The client device of claim 7 , wherein the control bits further indicate when an argument has been divided into multiple packets for transmission.
9 . The client device of claim 4 , wherein the packetizing further comprises:
including an identifier that uniquely identifies the accelerator in the first packet.
10 . The client device of claim 4 , wherein the serializing comprises representing the function name as a function identifier.
11 . A server of an arithmetic processing offload system including a client device and a server connected to the client device via a network, the client device offloading specific processing of an application to an accelerator disposed in the server to perform arithmetic processing,
wherein the server comprises one or more processors and is installed with an operating system (OS) that causes the one or more processors of the server to perform operations comprising:
deserializing a single payload of a first packet received from the client device according to a format of a predetermined protocol to obtain (i) a function name of a function for performing the arithmetic processing on one or more input arguments and (ii) values of the one more input arguments from the application;
performing, using the accelerator, the arithmetic processing of the function based on the values of the one more input arguments;
serializing an input from the accelerator that comprises (i) the function name of the function and (ii) arithmetic processing result of the function according to a format of a predetermined protocol and packetizing the serialized input as a single payload of a second packet, wherein the single payload of the second packet comprises data specifying (i) the function name and (ii) the arithmetic processing result; and
transmitting the second packet comprising the single payload of the second packet to the client device.