Granted Patent B2

US 12,443,373 · App. 18/628,917 · Granted Oct 14, 2025

Inventors: Eldho Mathew Pathiyakkara Thombra (Bengaluru, IN); Prashant Vishwanath Mahendrakar (Bengaluru, IN); Jin In So (Hwaseong-si, KR); Jong-Geon Lee (Seoul, KR)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

G06F3/0659G06F3/0604G06F3/0679

Abstract

Claims (46)

1. A system for Dual In-line Memory Module (DIMM)-to-DIMM communication, the system comprising:

a plurality of Near Memory Processing (NMP) Dual In-line Memory Modules (DIMMs), each NMP DIMM comprising a processing node and one or more ports, each of the one or more ports configured to establish communication with a port among one or more ports of another NMP DIMM of the plurality of NMP DIMMs; and

a processor of a host platform configured to:

identify data dependencies to offload a NMP command to one NMP DIMM among the plurality of NMP DIMMs; and

initiate aggregation of data to the one NMP DIMM by queuing data read requests to the one NMP DIMM,

wherein the processing node of the one NMP DIMM is configured to:

receive data directly from one or more ports of one or more other NMP DIMMs among the plurality of NMP DIMMs through the one or more ports of the one NMP DIMM;

receive the NMP command from the processor of the host platform;

process the NMP command received from the processor of the host platform using the data received from at least one of the one or more other NMP DIMMs and data present in the one NMP DIMM; and

send a NMP command completion notification to the processor of the host platform.

2. The system as claimed in claim 1 , wherein the one NMP DIMM comprises one port, and

wherein the processing node of the one NMP DIMM is configured to:

communicatively connect the one NMP DIMM and a first NMP DIMM of the one or more other NMP DIMMs through the one port.

3. The system as claimed in claim 1 , wherein the one NMP DIMM comprises a first port and a second port, and

the processing node of the one NMP DIMM is further configured to:

communicatively connect the one NMP DIMM and a first NMP DIMM of the one or more other NMP DIMMs through the first port; and

communicatively connect the one NMP DIMM and a second NMP DIMM of the one or more other NMP DIMMs through the second port.

4. The system as claimed in claim 3 , wherein the one NMP DIMM comprises a switch, and

wherein the processing node of the one NMP DIMM is configured to:

select one of the first port and the second port using the switch.

5. The system as claimed in claim 1 , wherein one of the one or more ports of each of the plurality of NMP DIMMs is communicatively connected to at least one remote server through an external switch for accessing data.

6. The system as claimed in claim 1 , wherein the processing node of the one NMP DIMM is further configured to receive data from the one or more other NMP DIMMs based on the queued data read requests.

7. The system as claimed in claim 1 , wherein the processing node of the one NMP DIMM is further configured to establish direct communication with the one or more ports of the one or more other NMP DIMMs among the plurality of NMP DIMMs through the one or more ports of the one NMP DIMM.

8. A device comprising a first Near Memory Processing (NMP) Dual In-line Memory Module (DIMM) configured with a DIMM-to-DIMM communication with a plurality of NMP DIMMs including a second NMP DIMM, the first NMP DIMM comprising:

a first processing node; and

a first port,

wherein the first processing node of the first NMP DIMM is configured to:

receive a NMP command from a processor of a host platform configured to communicate with the first NMP DIMM and the second NMP DIMM;

establish direct communication with a second port of the second NMP DIMM through the first port of the first NMP DIMM based on a data dependency on the second NMP DIMM corresponding to the NMP command received from the host platform;

receive data directly from the second port of the second NMP DIMM through the first port of the first NMP DIMM;

process the NMP command based on the data received from the second NMP DIMM and data stored in the first NMP DIMM; and

send a notification to the host platform based on completing the NMP command.

9. The device as claimed in claim 8 , wherein the first processing node of the first NMP DIMM is further configured to:

parse the NMP command received from the processor of the host platform; and

identify the data dependency on the second NMP DIMM, based on the parsed NMP command.

10. The device as claimed in claim 8 , wherein:

the NMP command is received from the host platform to offload the NMP command to the first NMP DIMM based on identifying the data dependency on the second NMP DIMM by the host platform; and

data read requests are queued to the first NMP DIMM by the host platform to initiate aggregation of data to the first NMP DIMM.

11. The device as claimed in claim 10 , wherein the first processing node of the first NMP DIMM is further configured to receive data from the second NMP DIMM based on the queued data read requests.

12. The device as claimed in claim 8 , wherein the first processing node of the first NMP DIMM is further configured to communicatively connect the first NMP DIMM and the second NMP DIMM through the first port.

13. The device as claimed in claim 8 , wherein the first NMP DIMM further comprises a third port, and the plurality of NMP DIMMs further include a third NMP DIMM,

wherein the first processing node of the first NMP DIMM is further configured to:

communicatively connect the first NMP DIMM and the second NMP DIMM through the first port; and

communicatively connect the first NMP DIMM and the third NMP DIMM through the third port.

14. The device as claimed in claim 13 , wherein the first NMP DIMM further comprises a switch, and

wherein the first processing node of the first NMP DIMM is further configured to select one of the first port and the third port using the switch.

Priority Claims (1)

Continuity (2)

References Cited (31)