Memory with cache-coherent interconnect
A system and method for managing memory resources. In some embodiments the system includes a first server, including a stored-program processing circuit, a first network interface circuit, and a first memory module. The first memory module may include a first memory die, and a controller. The controller may be connected to the first memory die through a memory interface, to the stored-program processing circuit through a cache-coherent interface, and to the first network interface circuit.
1 . A system, comprising:
a first server, comprising:
a stored-program processing circuit,
a first network interface circuit, and
a first memory module,
wherein:
the first memory module comprises:
a first memory die, and
a controller,
the controller being connected:
to the first memory die through a memory interface,
to the stored-program processing circuit through a cache-coherent interface, and
to the first network interface circuit,
the controller being external to the first network interface circuit, and being configured to convert a network packet from the cache-coherent interface to a data suitable for the memory interface, and
the first network interface circuit being compatible with the cache-coherent interface, and being external to a portion of the cache-coherent interface that connects the controller to the stored-program processing circuit.
2 . The system of claim 1 , wherein:
the first memory module further comprises a second memory die,
the first memory die comprises volatile memory, and
the second memory die comprises persistent memory.
3 . The system of claim 2 , wherein the persistent memory comprises NAND flash.
4 . The system of claim 3 , wherein the controller is configured to provide a flash translation layer for the persistent memory.
5 . The system of claim 1 , wherein the cache-coherent interface comprises a Compute Express Link (CXL) interface.
6 . The system of claim 1 , wherein the first server comprises an expansion socket adapter, connected to an expansion socket of the first server, the expansion socket adapter comprising:
the first memory module; and
the first network interface circuit.
7 . The system of claim 6 , wherein the controller of the first memory module is connected to the stored-program processing circuit through the expansion socket.
8 . The system of claim 6 , wherein the expansion socket comprises an M.2 socket.
9 . The system of claim 6 , wherein the controller of the first memory module is connected to the first network interface circuit by a peer to peer Peripheral Component Interconnect Express (PCIe) connection.
10 . The system of claim 1 , further comprising:
a second server, and
a network switch connected to the first server and to the second server.
11 . The system of claim 10 , wherein the network switch comprises a top of rack (ToR) Ethernet switch.
12 . The system of claim 10 , wherein the controller of the first memory module is configured to receive remote direct memory access (RDMA) requests, and to send RDMA responses.
13 . The system of claim 10 , wherein the controller of the first memory module is configured to receive remote direct memory access (RDMA) requests through the network switch and through the first network interface circuit, and to send RDMA responses through the network switch and through the first network interface circuit.
14 . The system of claim 13 , wherein the controller of the first memory module is configured to:
receive data, from the second server;
store the data in the first memory module; and
send, to the stored-program processing circuit, a command for invalidating a cache line.
15 . The system of claim 1 , wherein the controller of the first memory module comprises a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC).
16 . A method for performing remote direct memory access in a computing system, the computing system comprising:
a first server and a second server,
the first server comprising:
a stored-program processing circuit,
a first network interface circuit, and
a first memory module comprising a controller and a memory interface,
the controller being external to the first network interface circuit, being connected to the stored-program processing circuit through a cache-coherent interface, and being configured to convert a network packet from the cache-coherent interface to a data suitable for the memory interface, and
the first network interface circuit being compatible with the cache-coherent interface, and being external to a portion of the cache-coherent interface that connects the controller to the stored-program processing circuit,
the method comprising:
receiving, by the controller of the first memory module, a remote direct memory access (RDMA) request; and
sending, by the controller of the first memory module, a RDMA response.
17 . The method of claim 16 , wherein:
the computing system further comprises an Ethernet switch connected to the first server and to the second server, and
the receiving of the RDMA request comprises receiving the RDMA request through the Ethernet switch.
18 . The method of claim 16 , further comprising:
receiving, by the controller of the first memory module, a read command, from the stored-program processing circuit, for a first memory address,
translating, by the controller of the first memory module, the first memory address to a second memory address, and
retrieving, by the controller of the first memory module, data from the first memory module at the second memory address.
19 . The method of claim 16 , further comprising:
receiving data, by the controller of the first memory module,
storing, by the controller of the first memory module, the data in the first memory module, and
sending, by the controller of the first memory module, to the stored-program processing circuit, a command for invalidating a cache line.
20 . A system, comprising:
a first server, comprising:
a stored-program processing circuit,
a first network interface circuit, and
a first memory module,
wherein:
the first memory module comprises:
a first memory die, and
controller means,
the controller means being connected:
to the first memory die through a memory interface,
to the stored-program processing circuit through a cache-coherent interface, and
to the first network interface circuit,
the controller means being external to the first network interface circuit, and being configured to convert a network packet from the cache-coherent interface to a data suitable for the memory interface, and
the first network interface circuit being compatible with the cache-coherent interface, and being external to a portion of the cache-coherent interface that connects the controller means to the stored-program processing circuit.