IP Library › Granted Patent US 12,360,937
Granted Patent B2
US 12,360,937 · App. 18/330,360 · Granted Jul 15, 2025

Compute express Link™ (CXL) over ethernet (COE)

Inventors: Shreyas Shah (San Jose, CA); Jeffrey S. Earl (San Jose, CA); Anant Thakar (Los Altos, CA); Sagar Borikar (Milpitas, CA)
Assignee: Avago Technologies International Sales Pte. Limited
G06F13/4221G06F2213/0026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,360,937
App. No.
18/330,360
Granted
Jul 15, 2025
Kind
B2
Abstract

A Compute Express Link™ (CXL) over Ethernet (COE) station is provided to bridge a CXL fabric and an Ethernet network to allow for efficient native memory load/store access to remotely connected resources. The COE station supports CXL and Ethernet traffic through its CXL interface, scheduler/packers, decoders, VOQs and VIQs by adding COE tags to Ethernet frames. In CXL controller mode, the CXL controller drives the VOQs. In Ethernet mode, the COE module drives the VOQs, and interacts with the MAC sublayer and the PMA sublayer, which are responsible for encoding and decoding data signals for transmission through a serializer/deserializer.

Claims (30)

1. An integrated circuit device comprising:

a Compute Express Link (CXL) interface connected to a processor, memory, and a plurality of accelerators over CXL, the CXL interface comprising a plurality of virtual input queues (VIQs) and virtual output queues (VOQs);

an Ethernet interface supporting Ethernet traffic through a serializer/deserializer (SERDES);

a CXL controller configured to handle error correction and manage a flow of data between the processor, memory, and a plurality of devices;

a CXL over Ethernet (COE) module connected to the CXL interface, wherein the COE module operates to bridge Ethernet traffic with CXL signals by adding a COE tag to Ethernet frames, wherein in a first mode, the VIQs and VOQs are driven by the CXL controller and in a second mode, the VIQs and VOQs are driven by the COE module.

2. The integrated circuit device of claim 1 , wherein the first mode is a CXL mode.

3. The integrated circuit device of claim 1 , wherein the second mode is an Ethernet mode.

4. The integrated circuit device of claim 1 , wherein the integrated circuit device is a CXL over Ethernet (COE) station operating as a bridge between CXL and Ethernet.

5. The integrated circuit device of claim 1 , wherein the integrated circuit device is implemented on a system on a chip (SOC).

6. The integrated circuit device of claim 1 , wherein the plurality of accelerators include a plurality of hardware accelerators.

7. The integrated circuit device of claim 1 , wherein the integrated circuit device further includes a cache coherent switch on chip.

8. The integrated circuit device of claim 1 , wherein the integrated circuit device is communicatively coupled to the plurality of hardware accelerators, wherein the cache coherent switch on chip is configured to provide cache coherency between the plurality of hardware accelerators.

9. The integrated circuit device of claim 1 , wherein the Ethernet interface comprises a plurality of scheduler/packers and decoders.

10. The integrated circuit device of claim 1 , wherein the COE module is connected to a Media Access Control (MAC) sublayer operable to assign a unique address to each network interface card (NIC) connected to an Ethernet network.

11. The integrated circuit device of claim 1 , wherein the CXL controller is connected to a Physical Coding Sublayer (PCS), wherein the PCS is configured to encode and decode data signals for transmission over a physical media.

12. The system of claim 1 , wherein the Ethernet interface comprises a plurality of scheduler/packers and decoders.

13. A system comprising:

memory;

a processor;

a Compute Express Link (CXL) interface connected to the processor, memory, and a plurality of accelerators over CXL, the CXL interface comprising a plurality of virtual input queues (VIQs) and virtual output queues (VOQs);

an Ethernet interface supporting Ethernet traffic through a serializer/deserializer (SERDES);

a CXL controller configured to handle error correction and manage a flow of data between the processor, memory, and a plurality of devices;

a CXL over Ethernet (COE) module connected to the CXL interface, wherein the COE module operates to bridge Ethernet traffic with CXL signals by adding a COE tag to Ethernet frames, wherein in a first mode, the VIQs and VOQs are driven by the CXL controller and in a second mode, the VIQs and VOQs are driven by the COE module.

14. The system of claim 13 , wherein the first mode is a CXL mode.

15. The system of claim 13 , wherein the second mode is an Ethernet mode.

16. The system of claim 13 , wherein the system is a CXL over Ethernet (COE) station operating as a bridge between CXL and Ethernet.

17. The system of claim 13 , wherein the system is implemented on a system on a chip (SOC).

18. The system of claim 13 , wherein the plurality of accelerators include a plurality of hardware accelerators.

19. The system of claim 13 , wherein the system further includes a cache coherent switch on chip.

20. The system of claim 13 , wherein the system is communicatively coupled to the plurality of hardware accelerators, wherein the cache coherent switch on chip is configured to provide cache coherency between the plurality of hardware accelerators.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2023
From: ELASTICS.CLOUD, INC.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 065559/0657 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2023
From: SHAH, SHREYAS; EARL, JEFFREY S.; THAKAR, ANANT; BORIKAR, SAGAR
To: ELASTICS.CLOUD, INC.
Reel/Frame 064332/0135 →
Continuity (3)
Continuation In Part 17809484 · Jun 28, 2022
Provisional Application 63223045 · Jul 18, 2021
Related Publication 20230385223A1 · Nov 30, 2023
References Cited (53)
US 11074208B1 · Dastidar et al. · 2021 [cited by applicant]
US 11388268B1 · Siva et al. · 2022 [cited by applicant]
US 11573898B2 · Passint et al. · 2023 [cited by applicant]
US 20150012679A1 · Davis et al. · 2015 [cited by applicant]
US 20150169452A1 · Persson et al. · 2015 [cited by applicant]
US 20160299860A1 · Harriman · 2016 [cited by applicant]
US 20160381176A1 · Cherubini et al. · 2016 [cited by applicant]
US 20190042518A1 · Marolia et al. · 2019 [cited by applicant]
US 20190227936A1 · Jang · 2019 [cited by applicant]
US 20200192798A1 · Natu · 2020 [cited by applicant]
US 20200322287A1 · Connor et al. · 2020 [cited by applicant]
US 20200341930A1 · Cannata et al. · 2020 [cited by applicant]
US 20210011755A1 · Shah · 2021 [cited by applicant]
US 20210075633A1 · Sen et al. · 2021 [cited by applicant]
US 20210117244A1 · Herdrich et al. · 2021 [cited by applicant]
US 20210132999A1 · Haywood et al. · 2021 [cited by applicant]
US 20210240655A1 · Das Sharma · 2021 [cited by applicant]
US 20210311643A1 · Shanbhouge et al. · 2021 [cited by applicant]
US 20210311646A1 · Malladi et al. · 2021 [cited by applicant]
US 20210311739A1 · Malladi et al. · 2021 [cited by applicant]
US 20210311900A1 · Malladi et al. · 2021 [cited by applicant]
US 20210318976A1 · Zhang et al. · 2021 [cited by applicant]
US 20210320866A1 · Le et al. · 2021 [cited by applicant]
US 20210374056A1 · Malladi et al. · 2021 [cited by applicant]
US 20210382838A1 · Mittal et al. · 2021 [cited by applicant]
US 20220124038A1 · Leguay et al. · 2022 [cited by applicant]
US 20220147476A1 · Nam et al. · 2022 [cited by applicant]
US 20220164288A1 · Ramagiri et al. · 2022 [cited by applicant]
US 20220292026A1 · Hornung · 2022 [cited by examiner]
US 20220326874A1 · Del Gatto et al. · 2022 [cited by applicant]
US 20220350767A1 · McGraw et al. · 2022 [cited by applicant]
US 20220383961A1 · Lien et al. · 2022 [cited by applicant]
US 20220398207A1 · Norrie et al. · 2022 [cited by applicant]
US 20220405212A1 · Kakaiya et al. · 2022 [cited by applicant]
US 20230012822A1 · Shah et al. · 2023 [cited by applicant]
US 20230017583A1 · Shah et al. · 2023 [cited by applicant]
US 20230017643A1 · Shah et al. · 2023 [cited by applicant]
US 20230027178A1 · Shah et al. · 2023 [cited by applicant]
US 20230409302A1 · Kodama et al. · 2023 [cited by applicant]
“FlexPod Datacenter with Citrix VDI and VMware vSphere 7 for up to 2500 Seats”, Cisco, Published Apr. 2022, http://www.cisco.com/go/designzone, 497 pages. [cited by applicant]
Amir Roozbeh, “Realizing Next-Generation Data Centers via Software-Defined “Hardware” Infrastructures and Resource Disaggregation”, Doctoral Thesis KTH Royal Institute of Technology, 227 pages. [cited by applicant]
U.S. Appl. No. 17/809,484, USPTO e-Office Action: CTRS—Requirement for Restriction/Election, Jun. 5, 2023, 5 pages. [cited by applicant]
Chenjiu Wang, et al., CXL over Ethernet: A Novel FPGA-based Memory Disaggregation Design in Data Centers, Feb. 22, 2023, 9 pgs. [cited by applicant]
Davide Giri et al, “NoC-Based Support of Heterogeneous Cache—Coherence Models for Accelerators”, 2018 Twelfth IEEE/ACM International Symposium on Networks-on-Chip (NOCS), IEEE Oct. 4, 18, pp. 1-8, Section III and figure… [cited by applicant]
Donghyun Gouk, et al., Direct Access, High-Performance Memory Disaggregation with DirectCXL, https://www.usenix.org/conference/atc22/presentation/gouk, Jul. 11-13, 2022, 9 pgs. [cited by applicant]
Int'l Application Serial No. PCT/US22/73233, ISR/WO mailed Oct. 14, 229 pgs. [cited by applicant]
Kshitij Bhardwaj et al, “Determining Optimal Coherence Interface for Many-Accelerator SoC's Using Bayesian Optimization”, IEEE Computer Architecture Letters, IEEE Sep. 16, 2019, pp. 119-123 Section 3.1; and figure 2. [cited by applicant]
Kshitij Bhardwaj, et al., “A Comprehensive Methodology to Determine Optimal Coherence Interfaces for Many-Accelerator SoC's”, ISLPED '20 Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and D… [cited by applicant]
Moiz Arif, et al., Exploiting CXL-based Memory for Distributed Deep Learning, 51st International Conference on Parallel Processing (ICPP '22), Aug. 29-Sep. 1, 2022, Bordeaux, France. ACM, New York, NY, USA, 11 pages. [cited by applicant]
Prateek Shantharama, et al., “Hardware Accelerated Platforms and Infrastructures for Network Functions: A Survey of Enabling Technologies and Research Studies”.IEEE Jul. 9, 2020, Digital Object Identifier 10.1109/ACCESS… [cited by applicant]
Yakun Sophia Shao, et al. “Co-Designing Accelerators and SoC Interfaces using gem5-Aladdin”, 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO). IFEE, Oct. 15, 16, pp. 1-12, pp. 3-5 and figur… [cited by applicant]
Zuckerman, et al. “Comeleon: Learning-Based Orchestration ofAccelerator Coherence in Heterogeneous SoCs”, Columbia University, New York, New York, arXiv:2109.06382v1 [cs.AR] Sep. 14, 2021, 14 pages. [cited by applicant]
Non-Final Office Action on U.S. Appl. No. 18/605,301 DTD May 7, 2025. [cited by applicant]