Secure and efficient distributed processing
In one embodiment, a secure distributed processing system includes nodes connected over a network, and configured to process tasks, each respective one of the nodes including a respective processor to process data of respective ones of the tasks, and a respective network interface controller to connect to other nodes over the network, store task master keys for use in computing communication keys for securing data transfer over the network for respective ones of the tasks, compute respective task and node-pair specific communication keys for securing communication with respective ones of the nodes over the network for respective ones of the tasks responsively to respective ones of the task master keys and node-specific data of respective node pairs, and securely communicate the processed data of the respective ones of the tasks with the respective ones of the nodes over the network responsively to the respective task and node-pair specific communication keys.
1. A secure distributed processing system, comprising a plurality of nodes connected over a network, and configured to process a plurality of tasks, each respective one of the nodes including:
a respective processor to process data of respective ones of the tasks; and
a respective network interface controller (NIC) to:
connect to other ones of the nodes over the network;
store task master keys for use in computing communication keys for securing data transfer over the network for respective ones of the tasks;
compute respective task and node-pair specific communication keys for securing communication with respective ones of the nodes over the network for respective ones of the tasks responsively to respective ones of the task master keys and node-specific data of respective pairs of the nodes; and
securely communicate the processed data of the respective ones of the tasks with the respective ones of the nodes over the network responsively to the respective task and node-pair specific communication keys.
2. The system according to claim 1 , wherein each respective one of the tasks is processed as a respective distributed process by more than one of the nodes.
3. The system according to claim 1 , wherein respective ones of the tasks are performed for tenants.
4. The system according to claim 3 , wherein the respective processor includes a graphics processing unit (GPU) configured to process data of respective ones of the tasks for respective ones of the tenants.
5. The system according to claim 4 , wherein each respective one of the tasks is processed as a respective distributed process by more than one of the nodes.
6. The system according to claim 1 , wherein one of the nodes in each of the respective pairs of the nodes is configured to generate a respective nonce, the node-specific data of each of the respective pairs of the nodes comprising the respective nonce.
7. The system according to claim 6 , wherein the node-specific data of the respective pairs of the nodes comprise address information of the respective pairs of the nodes.
8. The system according to claim 1 , wherein the node-specific data of the respective pairs of the nodes comprise address information of the respective pairs of the nodes.
9. The system according to claim 1 , wherein the respective NIC is configured to compute the task and node-pair specific communication keys responsively to setting up new connections with the respective ones of the nodes over the network so that for each new connection with a respective one of the nodes the respective NIC is configured to compute a corresponding new task and node-pair specific communication key.
10. The system according to claim 9 , wherein the respective NIC is configured to:
set up a first connection with a given one of the nodes;
compute a first task and node-pair specific communication key for the first connection responsively to a first nonce;
securely communicate with the given one of the nodes responsively to the first task and node-pair specific communication key;
dismantle the first connection;
set up a second connection with a given one of the nodes;
compute a second task and node-pair specific communication key for the second connection responsively to a second nonce, different to the first nonce; and
securely communicate with the given one of the nodes responsively to the second task and node-pair specific communication key.
11. The system according to claim 10 , wherein each respective one of the tasks is processed as a respective distributed process by more than one of the nodes.
12. The system according to claim 10 , wherein the respective NEC is configured to:
generate the first nonce responsively to a first connection request from the given one of the nodes; and
generate the second nonce responsively to a second connection request from the given one of the nodes.
13. The system according to claim 12 , wherein the respective NIC is configured to:
compute the first task and node-pair specific communication key for the first connection responsively to the first nonce and address information of the respective node of the respective NIC and the given one of the nodes; and
compute the second task and node-pair specific communication key for the second connection responsively to the second nonce and the address information of the respective node of the respective NIC and the given one of the nodes.
14. The system according to claim 1 , wherein the respective NIC is configured to:
reserve hardware resources responsively to a request from a given one of the nodes to establish a connection with the respective node of the respective NIC; and
cancel reservation of the hardware resources after a given timeout responsively to not successfully decrypting data received from the given one of the nodes.
15. A secure distributed processing method, comprising:
processing data of respective ones of a plurality of tasks;
connecting to other ones of a plurality of nodes connected over a network;
storing task master keys for use in computing communication keys for securing data transfer over the network for respective ones of the tasks;
computing respective task and node-pair specific communication keys for securing communication with respective ones of the nodes over the network for respective ones of the tasks responsively to respective ones of the task master keys and node-specific data of respective pairs of the nodes; and
securely communicating the processed data of the respective ones of the tasks with the respective ones of the nodes over the network responsively to the respective task and node-pair specific communication keys.
16. The method according to claim 15 , wherein each respective one of the tasks is processed as a respective distributed process by more than one of the nodes.
17. The method according to claim 15 , wherein respective ones of the tasks are performed for tenants by a graphics processing unit (GPU).
18. The method according to claim 15 , further comprising generating a respective nonce for each of the respective pairs of the nodes, the node-specific data of each of the respective pairs of the nodes comprising the respective nonce.
19. The method according to claim 18 , wherein the node-specific data of the respective pairs of the nodes comprise address information of the respective pairs of the nodes.
20. The method according to claim 15 , wherein the computing includes computing the task and node-pair specific communication keys responsively to setting up new connections with the respective ones of the nodes over the network so that for each new connection with a respective one of the nodes a corresponding new task and node-pair specific communication key is computed.
21. The method according to claim 20 , further comprising:
setting up a first connection with a given one of the nodes;
computing a first task and node-pair specific communication key for the first connection responsively to a first nonce;
securely communicating with the given one of the nodes responsively to the first task and node-pair specific communication key;
dismantling the first connection;
setting up a second connection with a given one of the nodes;
computing a second task and node-pair specific communication key for the second connection responsively to a second nonce, different to the first nonce; and
securely communicating with the given one of the nodes responsively to the second task and node-pair specific communication key.
22. The method according to claim 21 , further comprising:
generating the first nonce responsively to a first connection request from the given one of the nodes; and
generating the second nonce responsively to a second connection request from the given one of the nodes.
23. The method according to claim 22 , wherein:
the computing the first task and node-pair specific communication key includes computing the first task and node-pair specific communication key for the first connection responsively to the first nonce and address information of the respective node of the respective NIC and the given one of the nodes; and
the computing the second task and node-pair specific communication key includes computing the second task and node-pair specific communication key for the second connection responsively to the second nonce and the address information of the respective node of the respective NIC and the given one of the nodes.
24. The method according to claim 15 , further comprising:
reserving hardware resources responsively to a request from a given one of the nodes to establish a connection; and
cancelling reservation of the hardware resources after a given timeout responsively to not successfully decrypting data received from the given one of the nodes.