Reconfigurable computing cluster with assets closely coupled at the physical layer by means of an optical circuit switch

1. A reconfigurable computing cluster, comprising:

an optical circuit switch;

two or more bidirectional fiber optic communication paths; and

a first plurality of computing assets,

wherein each of the first plurality of computing assets comprises:

functional elements; and

a smart bridge coupled to the functional elements via a multi-lane PCIE (peripheral component interconnect express) bus, wherein the smart bridges within the first plurality of computing assets are configured to transparently extend the multi-lane PCIE bus between computing assets via the fiber optic communications paths and the optical circuit switch, and further wherein each of the first plurality of computing assets is connected to the optical circuit switch by the two or more bidirectional fiber optic communication paths to form a bidirectional ring network.

2. The reconfigurable computing cluster of claim 1 , wherein

the first plurality of computing assets comprises some or all of central processor unit assets, graphics processor unit assets, application accelerator assets, solid state drive assets, memory assets, storage assets, and network interface assets.

3. The reconfigurable computing cluster of claim 1 , further comprising:

a configuration manager computing device coupled to the optical circuit switch and the plurality of computing assets.

4. The reconfigurable computing cluster of claim 3 , wherein the configuration manager computing device is configured to:

receive a request for a compute node;

select, from the first plurality of computing assets, a second plurality of computing assets to implement the compute node;

define communications paths between the second plurality of computing assets in the compute node;

configure the second plurality of computing assets; and

configure the optical circuit switch to provide the defined communications paths.

5. The reconfigurable computing cluster of claim 3 , wherein the configuration manager computing device is configured to:

receive a request to execute an application;

define a compute node required to execute the application;

select, from the first plurality of computing assets, a second plurality of computing assets to implement the compute node;

define communications paths between the second plurality of computing assets in the compute node;

configure the second plurality of computing assets; and

configure the optical circuit switch to provide the defined communications paths.

6. The reconfigurable computing cluster of claim 1 , wherein a second plurality of computing assets, selected from the first plurality of computing assets, are connected via the optical circuit switch to form a bidirectional ring network.

7. The reconfigurable computing cluster of claim 1 , wherein the smart bridges within the first plurality of computing assets implement a native link protocol for communicating with other computing assets within the first plurality of computing assets via the fiber optic communications paths and the optical circuit switch.

8. A compute node within a reconfigurable computing cluster having a first plurality of computing assets, each of the first plurality of computing assets coupled to an optical circuit switch by two or more bidirectional fiber optic communications paths, the compute node comprising:

a second plurality of computing assets taken from the first plurality of computing assets, each of the second plurality of computing assets connected to at least two other computing assets from the second plurality of computing assets via the respective fiber optic communications paths and the optical circuit switch

wherein each of the second plurality of computing assets further comprises:

functional elements; and

a smart network interface card (smart bridge) coupled to the functional elements via a multi-lane PCIE bus, wherein the smart bridges within the second plurality of computing assets are configured to transparently extend the multi-lane PCIE bus between connected pairs of computing assets via the fiber optic communications paths and the optical circuit switch.

9. The compute node of claim 8 , wherein

the second plurality of computing assets are connected via the respective fiber communications paths and the optical circuit switch to form a bidirectional ring network.

10. The reconfigurable computing cluster of claim 8 , wherein the smart bridges within the second plurality of computing assets implement a native link protocol for communicating between connected pairs computing assets via the respective fiber optic communications paths and the optical circuit switch.

11. A method for managing a reconfigurable computing cluster comprising:

providing a reconfigurable computing cluster, comprising an optical circuit switch, two or more bidirectional fiber optic communication paths, and a first plurality of computing assets, wherein each of the first plurality of computing assets comprises functional elements, and a smart bridge coupled to the functional elements via a multi-lane PCIE (peripheral component interconnect express) bus, wherein the smart bridges within the first plurality of computing assets are configured to transparently extend the multi-lane PCIE bus between computing assets via the fiber optic communications paths and the optical circuit switch, and further wherein each of the first plurality of computing assets is connected to the optical circuit switch by the two or more bidirectional fiber optic communication paths to form a bidirectional ring network;

receiving a request for a compute node;

selecting, from the first plurality of computing assets, a second plurality of computing assets to implement the compute node;

defining communications paths between the second plurality of computing assets to implement the compute node; the communication paths connecting each of the second plurality of computing assets to at least two other computing assets from the second plurality of computing assets; and

configuring the optical circuit switch to provide the defined communications paths between the second plurality of computing assets.

12. The method of claim 11 , wherein defining communications paths between the second plurality of computing assets comprises:

defining communications paths to connect each of the second plurality of computing assets to at least two other computing assets from the second plurality of computing assets.

13. The method of claim 12 , wherein defining communications paths between the second plurality of computing assets comprises:

defining communications paths to connect the second plurality of computing assets as a bidirectional ring network.

14. The method of claim 11 , wherein receiving a request for a compute node comprises:

receiving a request to execute an application; and

defining a compute node required to execute the application.

15. A reconfigurable computing cluster comprising:

an optical circuit switch;

a first plurality of computing assets comprising functional elements, each of the first plurality of computing assets connected to the optical circuit switch by two or more bidirectional fiber optic communications paths; and

a smart bridge coupled to the functional elements via a multi-lane PCIE (peripheral component interconnect express) bus,

wherein the smart bridge within the first plurality of computing assets is configured to transparently extend the multi-lane PCIE bus between computing assets via the fiber optic communications paths and the optical circuit switch, and further wherein each of the first plurality of computing assets is connected to the optical circuit switch by the two or more bidirectional fiber optic communication paths to form a bidirectional ring network.

16. The reconfigurable computing cluster of claim 15 , wherein the smart bridge within the first plurality of computing assets implements a native link protocol for communicating with other computing assets within the first plurality of computing assets via the fiber optic communications paths and the optical circuit switch.