IP Library Granted Patent US 12,688,138
Granted Patent B2
US 12,688,138 · App. 18/204,604 · Granted Jul 21, 2026

Active bridge chiplet with integrated cache

Inventors: Skyler J. Saleh (San Diego, CA); Ruijin Wu (San Diego, CA)
Assignee: Advanced Micro Devices, Inc.
G06F13/4027G06F12/0815G06T1/20G06F2212/1032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,688,138
App. No.
18/204,604
Filed
Jun 1, 2023
Granted
Jul 21, 2026
Kind
B2
Art Unit
2181
USPC
710/306
Abstract

A chiplet system includes a central processing unit (CPU) communicably coupled to a first GPU chiplet of a GPU chiplet array. The GPU chiplet array includes the first GPU chiplet communicably coupled to the CPU via a bus and a second GPU chiplet communicably coupled to the first GPU chiplet via an active bridge chiplet. The active bridge chiplet is an active silicon die that bridges GPU chiplets and allows partitioning of systems-on-a-chip (SoC) functionality into smaller functional chiplet groupings.

Claims (35)

1 . A processor comprising:

a chiplet array including a first chiplet, a second chiplet, and an active bridge chiplet shared by the first chiplet and the second chiplet, the active bridge chiplet configured to actively route inter-chiplet memory access requests and comprising memory shared by the first chiplet and the second chiplet,

wherein the first chiplet is configured to:

route one or more memory access requests serviceable by the active bridge chiplet or the second chiplet to the active bridge chiplet or the second chiplet for servicing.

2 . The processor of claim 1 , wherein the first chiplet is configured to receive a memory access request from a processor.

3 . The processor of claim 2 , wherein the first chiplet is further configured to

return data associated with the memory access request to the processor.

4 . The processor of claim 2 , wherein the first chiplet further comprises a scalable data fabric configured to receive the memory access request from the processor.

5 . The processor of claim 1 , wherein the first chiplet is configured to route a memory access request by routing the memory access request to the second chiplet via the active bridge chiplet.

6 . The processor of claim 5 , wherein the first chiplet is configured to route the memory access request to the second chiplet in response to data associated with the memory access request being stored in a memory associated with the second chiplet.

7 . The processor of claim 1 , wherein the first chiplet is configured to route a memory access request by routing the memory access request to the memory at the active bridge chiplet.

8 . The processor of claim 7 , wherein the memory comprises a unified cache memory that is coherent across the first chiplet and the second chiplet.

9 . The processor of claim 1 , wherein the first chiplet is configured to request data, associated with a memory access request, from the active bridge chiplet.

10 . The processor of claim 1 , wherein the active bridge chiplet communicably couples chiplets in the chiplet array.

11 . A system comprising:

a processor communicably coupled to a first chiplet of a chiplet array, wherein the chiplet array includes:

an active bridge chiplet configured to actively route inter-chiplet memory access requests and having memory shared by the first chiplet and a second chiplet;

the first chiplet communicably coupled to the processor via a bus; and

a second chiplet communicably coupled to the first chiplet via the active bridge chiplet,

wherein the first chiplet is configured to route one or more memory access requests serviceable by the active bridge chiplet or the second chiplet to the active bridge chiplet or the second chiplet for servicing.

12 . The system of claim 11 , wherein the first chiplet is further configured to:

responsive to data associated with a memory access request received from the processor being locally cached at memory coherent only within the first chiplet, service the memory access request.

13 . The system of claim 11 , wherein the first chiplet is further configured to:

responsive to data associated with a memory access request received from the processor being cached at a level of cache memory that is shared by the first chiplet and the second chiplet, route the memory access request to the active bridge chiplet for servicing.

14 . The system of claim 11 , wherein the first chiplet is further configured to:

responsive to data associated with a memory access request received from the processor being stored in a memory associated with the second chiplet, route the memory access request to the second chiplet via the active bridge chiplet for servicing.

15 . A method comprising:

receiving, at a first chiplet of a chiplet array, a memory access request from a processor;

responsive to the memory access request being serviceable by a second chiplet of the chiplet array, routing, by an active bridge chiplet controller of the first chiplet, the memory access request to the second chiplet for servicing;

responsive to the memory access request being serviceable by an active bridge chiplet having memory shared by the first chiplet and the second chiplet, routing, by the active bridge chiplet controller of the first chiplet, the memory access request to the memory at the active bridge chiplet that is shared by the first chiplet and the second chiplet for servicing; and

returning data associated with the memory access request to the processor.

16 . The method of claim 15 , wherein routing the memory access request to the second chiplet is in response to data associated with the memory access request being stored in a memory associated with the second chiplet.

17 . The method of claim 15 , wherein routing the memory access request comprises:

routing the memory access request to the second chiplet via the active bridge chiplet.

18 . The method of claim 15 , wherein the memory is a unified last level cache at the active bridge chiplet.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2024
From: SALEH, SKYLER J.; WU, RUIJIN
To: ADVANCED MICRO DEVICES, INC.
Reel/Frame 066053/0757 →
Continuity (3)
Continuation 17971116 · Oct 21, 2022
Continuation 16585452 · Sep 27, 2019
Related Publication 20230305981A1 · Sep 28, 2023
References Cited (44)
US 10803548B2 · Matam · 2020 [cited by examiner]
US 11211695B1 · Paulsen et al. · 2021 [cited by applicant]
US 11335663B2 · Liff · 2022 [cited by examiner]
US 20070273699A1 · Sasaki et al. · 2007 [cited by applicant]
US 20110072213A1 · Nickolls et al. · 2011 [cited by applicant]
US 20140176187A1 · Jayasena et al. · 2014 [cited by applicant]
US 20150171015A1 · Mahajan et al. · 2015 [cited by applicant]
US 20170365580A1 · Shih et al. · 2017 [cited by applicant]
US 20180358298A1 · Zhai et al. · 2018 [cited by applicant]
US 20180366436A1 · Wang et al. · 2018 [cited by applicant]
US 20190123022A1 · Teig et al. · 2019 [cited by applicant]
US 20190221556A1 · Gomes et al. · 2019 [cited by applicant]
CN 109904083 · 2019 [cited by applicant]
EP 3385848 · 2018 [cited by applicant]
EP 3511980 · 2019 [cited by applicant]
JP 2007316859 · 2007 [cited by applicant]
JP 2011523745 · 2009 [cited by applicant]
JP 2015524979 · 2014 [cited by applicant]
JP 2016529639 · 2016 [cited by applicant]
JP 2017503245 · 2017 [cited by applicant]
WO 2012137339 · 2012 [cited by applicant]
WO 2019032322 · 2019 [cited by applicant]
WO 2019132971 · 2019 [cited by applicant]
Notice of Allowance mailed Jul. 31, 2023 for U.S. Appl. No. 16/456,287. 7 pages. [cited by applicant]
Office Action issued in Indian Application No. 202117059190, mailed Oct. 9, 2023, 10 pages. [cited by applicant]
Office Action issued in Japanese Application No. 2022-516307, mailed Oct. 17, 2023, 4 pages. [cited by applicant]
Extended European Search Report issued in Application No. 20867435.8, mailed Oct. 10, 2023, 11 pages. [cited by applicant]
Extended European Search Report issued in Application No. 20832015, mailed Jun. 22, 2023, 12 Pages. [cited by applicant]
Yin, Jieming et al. “Modular Routing Design for Chiplet-Based Systems” 2018 ACM/IEEE 45th Annual International Symposium on Computer Achitecture (ISCA), IEEE, 2018, pp. 726-738. [cited by applicant]
Extended European Search Report issued in Application No. 20868658.4, mailed Sep. 27, 2023, 7 pages. [cited by applicant]
Beck et al., “‘Zeppelin’: An SoC for Multichip Architectures,” IEEE International Solid-State Circuits Conference, 2018, 3 pages. [cited by applicant]
Office Action issued in Korean Application No. 10-2022-7012861, mailed Feb. 14, 2024, 3 pages. [cited by applicant]
Japanese Office Action issued in Application No. 2022-516307, mailed Oct. 17, 2023, 4 pages. [cited by applicant]
Office Action issued in Indian Application No. 202217015275 mailed Aug. 28, 2024, 5 pages. [cited by applicant]
Office Action issued in Korean Application No. 10-2022-7011449, mailed Sep. 10, 2024, 7 pages. [cited by applicant]
Office Action issued in Japanese Application No. 2022-517359, mailed Oct. 1, 2024, 3 pages. [cited by applicant]
Office Action mailed Mar. 6, 2025 for Indian Application No. 202217012817, 8 pages. [cited by applicant]
Office Action mailed Mar. 11, 2025 for Japanese Application No. 2024-068210, 7 pages. [cited by applicant]
Yin J, Lin Z, Kayiran O, Poremba M, Altaf MS, Jerger NE, Loh GH. Modular routing design for chiplet-based systems. In2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) Jun. 1, 2018 (13 pgs… [cited by applicant]
Beck N, White S, Paraschou M, Naffziger S. ‘Zeppelin’: An SoC for multichip architectures. In 2018 IEEE International Solid-State Circuits Conference—(ISSCC) Feb. 11, 2018 (2 pgs). IEEE. [cited by applicant]
Office Action mailed Mar. 11, 2025 for Japanese Application No. 2022-517359, 5 pages. [cited by applicant]
Office Action (Decision of Refusal) mailed Sep. 22, 2025 for JP2022-517359, 11 pages. [cited by applicant]
Office Action mailed Sep. 26, 2025 for JP2024-068210, 12 pages. [cited by applicant]
Office Action mailed Apr. 2, 2026 for European Application No. 20868658.4, 8 pages. [cited by applicant]