Remote storage for hardware microservices hosted on XPUs and SOC-XPU platforms
Methods, apparatus, and software for remote storage of hardware microservices hosted on other processing units (XPUs) and SOC-XPU Platforms. The apparatus may be a platform including a System on Chip (SOC) and an XPU, such as a Field Programmable Gate Array (FPGA). Software, via execution on the SOC, enables the platform to pre-provision storage space on a remote storage node and assign the storage space to the platform, wherein the pre-provisioned storage space includes one or more container images to be implemented as one or more hardware (HW) microservice front-ends. The XPU/FPGA is configured to implement one or more accelerator functions used to accelerate HW microservice backend operations that are offloaded from the one or more HW microservice front-ends. The platform is also configured to pre-provision a remote storage volume containing worker node components and access and persistently store worker node components.
1. A platform configured to be deployed in a network environment including a remote storage node coupled to a fabric, comprising:
a circuit board to which multiple components are operatively coupled, including,
a System On Chip (SOC), having a plurality of cores;
at least one fabric interface configured to be coupled to the fabric;
memory, in which software to be executed on one or more of the plurality of cores in the SOC is stored, the software including software code configured to pre-provision storage space on the remote storage node and assign the storage space to the platform, wherein the pre-provisioned storage space includes one or more container images to be implemented as one or more hardware (HW) microservice front-ends; and
an Other Processing Unit (XPU), communicatively coupled to the SOC via interconnect circuitry in the circuit board and configured to implement one or more accelerator functions used to accelerate HW microservice backend operations that are offloaded from the one or more HW microservice front-ends.
2. The platform of claim 1 , wherein the remote storage node includes a plurality of NVMe (Non-Volatile Memory Express) drives, and the platform is configured to employ an NVMe over fabric (NVMe-oF) protocol to pre-provision the storage space on the remote storage node.
3. The platform of claim 2 , wherein the storage space is pre-provisioned as one or more NVMe-oF volumes including a pre-provisioned NVMe-oF volume containing a plurality of HW microservice container images.
4. The platform of claim 2 , wherein the storage space is pre-provisioned as one or more NVMe-oF volumes including a pre-provisioned NVMe-oF volume containing worker node components.
5. The platform of claim 4 , wherein a portion of the memory comprises non-volatile memory implemented as persistent storage, and wherein execution of the software code further enables the platform to:
retrieve worker node components from the pre-provisioned NVMe-oF volume containing worker node components; and
persistently store the worker node components that are retrieved in the non-volatile memory.
6. The platform of claim 1 , wherein the XPU comprises a Field Programmable Gate Array (FPGA), and the one or more accelerated functions comprise FPGA kernels.
7. The platform of claim 6 , wherein execution of the software further enables to platform to:
retrieve an FPGA kernel bitstream from the remote storage node;
provision an accelerator function in the FPGA using the FPGA kernel bitstream to program the FPGA to accelerate HW microservice backend operations for at least one HW microservice.
8. The platform of claim 1 , wherein the platform comprises an infrastructure processing unit (IPU).
9. The platform of claim 8 , wherein the XPU comprises a Field Programmable Gate Array (FPGA), wherein the IPU comprises a Peripheral Component Interconnect Express (PCIe) card, and the FPGA is configured to implement one or more PCIe interfaces.
10. The platform of claim 1 , wherein the platform is configured to be installed in a server including a central processing unit (CPU) that is communicatively coupled to at least one of the SOC and XPU when the platform is installed in the server.
11. A method implemented on a platform configured to be deployed in a data center including a remote storage node coupled to a fabric, the platform including a System on Chip (SOC) having a plurality of cores and operatively coupled to a circuit board and communicatively coupled to an other processing unit (XPU) operatively coupled to the circuit board, the method comprising:
communicatively coupling the platform to the fabric; and
pre-provisioning storage space on the remote storage node and assigning the storage space to the platform, wherein the pre-provisioned storage space includes one or more container images to be implemented as one or more hardware (HW) microservice front-ends on the platform.
12. The method of claim 11 , wherein the remote storage node includes a plurality of NVMe (Non-Volatile Memory Express) drives, further comprising:
employing an NVMe over fabric (NVMe-oF) protocol to pre-provision the storage space on the remote storage node,
wherein the storage space is pre-provisioned as one or more NVMe-oF volumes including a pre-provisioned NVMe-oF volume containing a plurality of HW microservice front-end container images.
13. The method of claim 12 , further comprising:
pre-provisioning an NVMe-oF volume containing worker node components;
retrieving worker node components from the pre-provisioned NVMe-oF volume containing worker node components; and
persistently storing the worker node components that are retrieved in non-volatile storage on the platform.
14. The method of claim 12 , further comprising:
searching for a HW microservice front-end container image among the plurality of HW microservice front-end container images stored on the remote storage node;
receiving, via the remote storage nodes, a HW microservice front-end container image the is provided by the remote storage node;
testing the HW microservice front-end container image that is provided; and
determining whether the provided HW microservice front-end container image successfully works or fails.
15. The method of claim 11 , wherein the XPU comprises a Field Programmable Gate Array (FPGA), and the one or more accelerated functions comprise FPGA kernels, further comprising:
retrieving an FPGA kernel bitstream from the remote storage node;
provision an accelerator function in the FPGA using the FPGA kernel bitstream to program the FPGA to accelerate HW microservice backend operations for at least one HW microservice.
16. A system comprising:
a fabric or network;
a remote storage node, coupled to the fabric and including a plurality of storage devices;
a server, including,
one or more central processing units (CPUs); and
an infrastructure processing unit (IPU) comprising,
a circuit board to which multiple components are operatively coupled, including,
a System On Chip (SOC), having a plurality of cores;
at least one fabric interface coupled to the fabric or network;
memory, in which software to be executed on one or more of the plurality of cores in the SOC is stored, the software including software code configured to pre-provision storage space on the remote storage node and assign the storage space to the platform, wherein the pre-provisioned storage space includes one or more container images to be implemented as one or more hardware (HW) microservice front-ends; and
a Field Programmable Gate Array (FPGA), communicatively coupled to the SOC via interconnect circuitry in the circuit board and configured to implement one or more accelerator functions used to accelerate HW microservice backend operations that are offloaded from the one or more HW microservice front-ends.
17. The system of claim 16 , wherein the remote storage node includes a plurality of NVMe (Non-Volatile Memory Express) drives, and the platform is configured to employ an NVMe over fabric (NVMe-oF) protocol to pre-provision the storage space on the remote storage node.
18. The system of claim 17 , wherein the storage space is pre-provisioned as one or more NVMe-oF volumes including a pre-provisioned NVMe-oF volume containing a plurality of HW microservice container images and including a pre-provisioned NVMe-oF volume containing worker node components.
19. The system of claim 18 , wherein a portion of the memory in the IPU comprises non-volatile memory implemented as persistent storage, and wherein execution of the software code further enables the IPU to:
retrieve worker node components from the pre-provisioned NVMe-oF volume containing worker node components; and
persistently store the worker node components that are retrieved in the non-volatile memory.
20. The system of claim 16 , wherein the remote storage node is installed in a first rack in a datacenter, the server is installed in a second rack in the data center, and the first rack is connected to the second rack via the fabric or network.