IP Library Granted Patent US 12,375,587
Granted Patent B2
US 12,375,587 · App. 17/714,793 · Granted Jul 29, 2025

Mesh network-on-a-chip (NOC) with heterogeneous routers

Inventors: Qingbo Wang (Irvine, CA); Mitchell Robert Fream (Germantown, MD); Adarsha Balaji (Philadelphia, PA); Martin Lueker-Boden (Fremont, CA); Dejan Vucinic (San Jose, CA)
Assignee: Western Digital Technologies, Inc.
H04L69/18G06F13/42G06F15/7825G06F2213/0026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,587
App. No.
17/714,793
Granted
Jul 29, 2025
Kind
B2
Abstract

A mesh network-on-a-chip (NOC) with heterogenous routers for use with homogenous processing elements. Some of the routers are configured differently from other routers to interface more efficiently with particular physical resources that the processing elements require, such as particular input/output or memory devices. For example, one router is configured for use with the Peripheral Component Interconnect Express (PCIe) protocol, whereas another router is configured for use with the InterLaken communication protocol. Still further, the overall system is configured so that the various physical resources are physically adjacent to the particular router that is designed to access the resource to help ensure fair access by each processing element of the NOC to the particular resources that are required. The NOC may be part of a large manycore system on field programmable gate array (FPGA). The methods and apparatus described herein are generally applicable to all system-on-a-chip (SOC) designs.

Claims (63)

1. A network-on-a-chip (NOC), comprising:

a network of routers, each router configured for use with a corresponding processing element of a plurality of processing elements;

wherein the routers are interconnected to couple the processing elements to one another;

wherein the routers comprise a first plurality of routers, each configured the same as the other routers of the first plurality of routers;

wherein the routers further comprise a second plurality of routers, each configured differently from one another and from the routers of the first plurality of routers; and

wherein each router of the second plurality of routers is configured to communicate with a corresponding physical resource of a plurality of physical resources using a communication protocol that is different from communication protocols used by the other routers of the second plurality of routers to communicate with their corresponding physical resources.

2. The NOC of claim 1 , wherein the NOC is a mesh NOC.

3. The NOC of claim 1 , wherein the NOC is implemented within a field programmable gate array (FPGA).

4. The NOC of claim 1 , wherein the NOC is implemented within an application specific integrated circuit (ASIC).

5. An integrated circuit, comprising:

the NOC of claim 1 ;

the plurality of processing elements; and

the plurality of physical resources.

6. The integrated circuit of claim 5 , wherein the processing elements each comprise a common physical configuration.

7. The integrated circuit of claim 5 , wherein the processing elements comprise one or both of general purpose processing cores and intellectual property (IP) cores.

8. The integrated circuit of claim 5 , wherein the physical resources comprise one or both of input/output (I/O) resources and memory resources.

9. The NOC of claim 1 ,

wherein a first router of the second plurality of routers is configured to communicate with a first physical resource of the plurality of physical resources using a first communication protocol; and

wherein a second router of the second plurality of routers is configured to communicate with a second physical resource of the plurality of physical resources using a second communication protocol that is different from the first communication protocol.

10. The NOC of claim 9 , wherein the first communication protocol comprises an InterLaken (ILKN) communication protocol, a Aurora protocol, a cooperative medium access control (CMAC) protocol, a Quad Small Form-factor Pluggable (QSFP) protocol, an Advanced extensible Interface (AXI) protocol, a high bandwidth memory (HBM) protocol, a Peripheral Component Interconnect Express (PCIe) protocol, a GTY transceiver protocol, a GTR transceiver protocol, or a high performance input/output (HPIO) protocol.

11. The NOC of claim 10 , wherein the second communication protocol comprises a different protocol than the first communication protocol from among the ILKN communication protocol, the Aurora protocol, the CMAC protocol, the QSFP protocol, the AXI protocol, the HBM protocol, the PCIe protocol, the GTY transceiver protocol, the GTR transceiver protocol, or the HPIO protocol.

12. The NOC of claim 1 , wherein one or more of the routers and the processing elements span multiple dies.

13. A method for providing a network-on-a-chip (NOC), the method comprising:

providing a network of routers, each router configured for use with a corresponding processing element of a plurality of processing elements;

wherein the routers comprise a first plurality of routers, each configured the same as the other routers of the first plurality of routers; and

wherein the routers further comprise a second plurality of routers, each configured differently from one another and from the routers of the first plurality of routers;

communicating information among the network of routers using interconnection channels of the NOC;

communicating information between a first router of the second plurality of routers and a first physical resource using a first communication protocol; and

communicating information between a second router of the second plurality of routers and a second physical resource using a second communication protocol that is different from the first communication protocol.

14. The method of claim 13 , wherein the first communication protocol comprises an InterLaken (ILKN) communication protocol, a Aurora protocol, a cooperative medium access control (CMAC) protocol, a Quad Small Form-factor Pluggable (QSFP) protocol, an Advanced extensible Interface (AXI) protocol, a high bandwidth memory (HBM) protocol, a Peripheral Component Interconnect Express (PCIe) protocol, a GTY transceiver protocol, a GTR transceiver protocol, or a high performance input/output (HPIO) protocol.

15. The method of claim 14 , wherein the second communication protocol comprises a different protocol than the first communication protocol from among the ILKN communication protocol, the Aurora protocol, the CMAC protocol, the QSFP protocol, the AXI protocol, the HBM protocol, the PCIe protocol, the GTY transceiver protocol, the GTR transceiver protocol, or the HPIO protocol.

16. An integrated circuit, comprising:

a plurality of physical resources;

a plurality of processing elements that each comprise a common physical configuration;

a network of routers, each router configured for use with a corresponding processing element of the plurality of processing elements;

wherein the routers are interconnected to couple the processing elements to one another;

wherein the routers comprise a first plurality of routers, each configured the same as the other routers of the first plurality of routers;

wherein the routers further comprise a second plurality of routers, each configured differently from one another and from the routers of the first plurality of routers; and

wherein each router of the second plurality of routers is configured to communicate with a corresponding physical resource of a plurality of physical resources using a communication protocol that is different from communication protocols used by the other routers of the second plurality of routers to communicate with their corresponding physical resources.

17. The integrated circuit of claim 16 , wherein the routers comprise portions of a mesh network-on-a-chip (NOC).

18. The integrated circuit of claim 16 , wherein the processing elements comprise general purpose processing cores.

19. The integrated circuit of claim 16 , wherein the physical resources comprise one or both of an input/output (I/O) resource and a memory resource.

20. The integrated circuit of claim 16 ,

wherein a first router of the second plurality of routers is configured to communicate with a first of the physical resources in accordance with a first communication protocol, and

wherein a second router of the second plurality of routers is configured to communicate with a second of the physical resources in accordance with a second communication protocol that is different from the first communication protocol.

21. The integrated circuit of claim 20 , wherein the first communication protocol comprises an InterLaken (ILKN) communication protocol, a Aurora protocol, a cooperative medium access control (CMAC) protocol, a Quad Small Form-factor Pluggable (QSFP) protocol, an Advanced extensible Interface (AXI) protocol, a high bandwidth memory (HBM) protocol, a Peripheral Component Interconnect Express (PCIe) protocol, a GTY transceiver protocol, a GTR transceiver protocol, or a high performance input/output (HPIO) protocol.

22. The integrated circuit of claim 21 , wherein the second communication protocol comprises a different protocol from among the ILKN communication protocol, the Aurora protocol, the CMAC protocol, the QSFP protocol, the AXI protocol, the HBM protocol, the PCIe protocol, the GTY transceiver protocol, the GTR transceiver protocol, or the HPIO protocol.

23. The integrated circuit of claim 20 ,

wherein a first processing element corresponding to the first router is programmed with logic configured to access the first of the physical resources, and

wherein a second processing element corresponding to the second router is programmed with logic configured to access the second of the physical resources.

24. The integrated circuit of claim 16 , wherein one or more of the routers, the processing elements, and the physical resources span multiple dies.

25. A network-on-a-chip (NOC), comprising:

a network of routers, each router configured for use with a corresponding processing element of a plurality of processing elements;

wherein the routers are interconnected to couple the processing elements to one another;

wherein the routers comprise a first plurality of routers, each configured the same as the other routers of the first plurality of routers;

wherein the routers further comprise a second plurality of routers, each configured differently from one another and from the routers of the first plurality of routers;

wherein a first router of the second plurality of routers is configured to use a first physical resource and a first communication protocol; and

wherein a second router of the second plurality of routers is configured to use a second physical resource and one or both of the first communication protocol and a second communication protocol that is different from the first communication protocol.

26. The NOC of claim 25 , wherein the first communication protocol comprises an InterLaken (ILKN) communication protocol, a Aurora protocol, a cooperative medium access control (CMAC) protocol, a Quad Small Form-factor Pluggable (QSFP) protocol, an Advanced eXtensible Interface (AXI) protocol, a high bandwidth memory (HBM) protocol, a Peripheral Component Interconnect Express (PCIe) protocol, a GTY transceiver protocol, a GTR transceiver protocol, or a high performance input/output (HPIO) protocol.

27. The NOC of claim 26 , wherein the second communication protocol comprises a different protocol than the first communication protocol from among the ILKN communication protocol, the Aurora protocol, the CMAC protocol, the QSFP protocol, the AXI protocol, the HBM protocol, the PCIe protocol, the GTY transceiver protocol, the GTR transceiver protocol, or the HPIO protocol.

28. The NOC of claim 25 , wherein the NOC is a mesh NOC.

29. The NOC of claim 25 , wherein the NOC is implemented within a field programmable gate array (FPGA).

30. The NOC of claim 25 , wherein the NOC is implemented within an application specific integrated circuit (ASIC).

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2025
From: SANDISK TECHNOLOGIES, INC.
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 070313/0840 →
PATENT COLLATERAL AGREEMENT Recorded Aug 23, 2024
From: SANDISK TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS THE AGENT
Reel/Frame 068762/0494 →
CHANGE OF NAME Recorded Jun 27, 2024
From: SANDISK TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067982/0032 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2024
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067567/0682 →
PATENT COLLATERAL AGREEMENT - DDTL LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 067045/0156 →
PATENT COLLATERAL AGREEMENT - A&R LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 064715/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2022
From: WANG, QINGBO; FREAM, MITCHELL ROBERT; BALAJI, ADARSHA; LUEKER-BODEN, MARTIN; VUCINIC, DEJAN
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 059521/0213 →
Continuity (1)
Related Publication 20230325345A1 · Oct 12, 2023
References Cited (12)
US 9160627B2 · Kumar et al. · 2015 [cited by applicant]
US 9742630B2 · Philip et al. · 2017 [cited by applicant]
US 9774498B2 · Kumar et al. · 2017 [cited by applicant]
US 11023377B2 · Kumar · 2021 [cited by applicant]
US 11412075B2 · Patrick · 2022 [cited by examiner]
US 20120147567A1 · Lee · 2012 [cited by examiner]
US 20150117261A1 · Kumar · 2015 [cited by examiner]
US 20170046198A1 · Solihin · 2017 [cited by applicant]
US 20190138493A1 · Teh · 2019 [cited by examiner]
US 20190266088A1 · Kumar · 2019 [cited by examiner]
US 20200311200A1 · Dubeyko · 2020 [cited by examiner]
US 20230207471A1 · Mallik · 2023 [cited by examiner]