IP Library Granted Patent US 12,653,069
Granted Patent B2
US 12,653,069 · App. 18/140,360 · Granted Jun 9, 2026

LED-based photonic communication and processing unit

Inventors: Nicholas C. Harris (Boston, MA); Darius Bunandar (Boston, MA)
Assignee: Lightmatter, Inc.
H10W90/00G02B6/4274G06F17/16H04B10/50572
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,653,069
App. No.
18/140,360
Granted
Jun 9, 2026
Kind
B2
Abstract

Photonic processors are described herein that are configured to perform matrix-matrix (e.g., matrix-vector) multiplication by directly encoding a first value in the output of the light source. Some embodiments relate to a photonic device configured to perform a mathematical operation, the photonic device comprising a modulatable light emitting diode (LED) and a modulatable detector. The modulatable LED being configured to emit light. The modulatable detector being optically coupled to an output of the modulatable LED. The photonic device further comprising, a controller being configured to encode a first value in the light emitted by the modulatable LED and to encode a second value in a characteristic of the modulatable detector; and a receiver configured to determine a result of the mathematical operation based on an electrical signal produced by the modulatable detector.

Claims (41)

1 . A photonic device configured to perform a mathematical operation, the photonic device comprising:

a first die comprising a plurality of modulatable LEDs, including a first modulatable LED, configured to emit visible light;

a second die comprising a plurality of modulatable detectors optically coupled to an output of the LED;

a third die comprising a photonic tree circuit optically coupling the modulatable LED to the plurality of modulatable detectors, the photonic tree circuit comprising silicon nitride optical components;

a controller electrically coupled to both the modulatable LED and the plurality of modulatable detectors, the controller being configured to encode a value in light emitted by the first modulatable LED and a vector in respective characteristics of the plurality of modulatable detectors, wherein the value is an input value of an input matrix and the vector is a weighting vector of a weighting matrix; and

a receiver configured to determine a result of the mathematical operation based on an electrical signal produced by the plurality of modulatable detectors.

2 . The photonic device of claim 1 , wherein:

the first die is disposed on top of the third die and the third die is disposed on top of the second die, and wherein the first die is electrically coupled to the second die through a plurality of vias in the third die.

3 . The photonic device of claim 1 , wherein the first modulatable LED comprises a resonant cavity configured to produce single mode light emission.

4 . The photonic device of claim 1 , wherein the plurality of modulatable LEDs comprise a plurality of blue LEDs, a plurality of red LEDs, and a plurality of green LEDs.

5 . The photonic device of claim 1 , wherein the controller is configured to encode the first value in an intensity of light emitted by the first modulatable LED.

6 . The photonic device of claim 1 , wherein the plurality of modulatable detectors detector are silicon photodetectors.

7 . A photonic device configured to perform a mathematical operation, comprising:

a modulatable light emitting diode (LED) configured to emit light;

a modulatable detector optically coupled to an output of the modulatable LED;

a controller electrically coupled to both the modulatable LED and the modulatable detector, the controller being configured to encode a first value in the light emitted by the modulatable LED and to encode a second value in a characteristic of the modulatable detector;

a receiver configured to determine a result of the mathematical operation based on an electrical signal produced by the modulatable detector; and

a photonic circuit optically coupling the modulatable LED to the modulatable detector, wherein the photonic circuit comprises silicon nitride waveguides and an input grating configured to couple visible light emitted by the modulatable LED into the silicon nitride waveguides.

8 . The photonic device of claim 7 , wherein the modulatable LED comprises a resonant cavity configured to produce single mode light emission.

9 . The photonic device of claim 7 , wherein:

the modulatable LED is formed on a first die;

the photonic circuit is formed on a second die;

the modulatable detector and the controller are formed on a third die; and

the first die is disposed on top of the second die and the second die is disposed on top of the third die, and wherein the first die is electrically coupled to the third die through a plurality of vias in the second die.

10 . The photonic device of claim 7 , wherein the modulatable LED is a first modulatable LED of a plurality of modulatable LEDs, the first value is a value of an input matrix, the modulatable detector is a first modulatable detector of a plurality of modulatable detectors, and the second value is a weighting value of a weighting matrix.

11 . The photonic device of claim 10 , wherein the plurality of modulatable LEDs comprise a plurality of blue LEDs, a plurality of red LEDs, and a plurality of green LEDs.

12 . The photonic device of claim 11 , wherein the controller is configured to encode the first value in an intensity of light emitted by the modulatable LED.

13 . The photonic device of claim 11 , wherein the modulatable detector is a silicon photodetector.

14 . The photonic device of claim 13 , wherein the controller is configured to encode the second value in a gain of the silicon photodetector.

15 . A method for performing a mathematical operation, the method comprising:

generating an encoded optical signal indicative of a first value using a modulatable light emitting diode (LED) configured to emit visible light, wherein the first value is a value of an input matrix;

setting a characteristic of a modulatable photodetector, optically coupled to the LED, to be indicative of a second value, wherein the second value is a weighting value of a weighting matrix;

generating, using the modulatable photodetector, a photocurrent indicative of both the first value and the second value; and

determining a result of the mathematical operation based on the photocurrent.

16 . The method of claim 15 , wherein generating the encoded optical signal comprises encoding the first value in an intensity of light emitted by the modulatable LED.

17 . The method of claim 15 , wherein generating the encoded optical signal comprises encoding the first value in light emitted by the modulatable LED using gain switching of modulatable LED.

18 . The method of claim 15 , wherein generating the encoded optical signal comprises encoding the first value in an amplitude of light emitted by the modulatable LED.

19 . The method of claim 15 , wherein generating the encoded optical signal comprises encoding the first value in a pulse duration of light emitted by the modulatable LED.

20 . The method of claim 15 , wherein configuring the characteristic of the modulatable photodetector comprises setting a responsivity of the photodetector based on the second value.

21 . The method of claim 15 , wherein configuring the characteristic of the modulatable photodetector comprises setting a current gain based on the second value.

22 . The photonic device of claim 1 , wherein the photonic tree circuit further comprises silicon nitride waveguides and an input grating configured to couple visible light emitted by the first modulatable LED into the silicon nitride waveguides.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2023
From: HARRIS, NICHOLAS C.; BUNANDAR, DARIUS
To: LIGHTMATTER, INC.
Reel/Frame 063515/0496 →
Continuity (2)
Provisional Application 63336216 · Apr 28, 2022
Related Publication 20230352465A1 · Nov 2, 2023
References Cited (82)
US 3944820A · Stotts · 1976 [cited by applicant]
US 4566077A · Schuocker et al. · 1986 [cited by applicant]
US 5321639A · Krishnamoorthy · 1994 [cited by examiner]
US 5877519A · Jewell · 1999 [cited by applicant]
US 6411418B1 · Deri · 2002 [cited by examiner]
US 6586778B2 · Linthicum et al. · 2003 [cited by applicant]
US 6967981B2 · Chua et al. · 2005 [cited by applicant]
US 7018580B2 · Gorczyca et al. · 2006 [cited by applicant]
US 7042020B2 · Negley · 2006 [cited by applicant]
US 7218388B1 · Keeler et al. · 2007 [cited by applicant]
US 7813401B2 · Scherer · 2010 [cited by applicant]
US 8027587B1 · Watts · 2011 [cited by applicant]
US 8450719B2 · Moon · 2013 [cited by applicant]
US 8526771B2 · Meyer et al. · 2013 [cited by applicant]
US 9930277B2 · Cok · 2018 [cited by examiner]
US 10763974B2 · Bunandar et al. · 2020 [cited by applicant]
US 11281972B2 · Shen · 2022 [cited by applicant]
US 11507818B2 · Hosseinzadeh et al. · 2022 [cited by applicant]
US 20010041025A1 · Farahi · 2001 [cited by applicant]
US 20020074528A1 · O'Connor · 2002 [cited by examiner]
US 20040119197A1 · Gorczyca et al. · 2004 [cited by applicant]
US 20060093299A1 · Ogawa · 2006 [cited by examiner]
US 20060274796A1 · Cheng et al. · 2006 [cited by applicant]
US 20080080579A1 · Scherer · 2008 [cited by applicant]
US 20090080898A1 · Anderson et al. · 2009 [cited by applicant]
US 20100317420A1 · Hoffberg · 2010 [cited by examiner]
US 20110150390A1 · Meyer et al. · 2011 [cited by applicant]
US 20120032969A1 · Sugiyama · 2012 [cited by examiner]
US 20130308898A1 · Doerr et al. · 2013 [cited by applicant]
US 20170194911A1 · Aksin · 2017 [cited by applicant]
US 20170280029A1 · Steiner · 2017 [cited by examiner]
US 20180220052A1 · Granneman · 2018 [cited by examiner]
US 20190097722A1 · McLaurin · 2019 [cited by examiner]
US 20190154439A1 · Binder · 2019 [cited by examiner]
US 20190179016A1 · Raring · 2019 [cited by examiner]
US 20190235346A1 · Royon · 2019 [cited by examiner]
US 20190354894A1 · Lazovich · 2019 [cited by examiner]
US 20190356394A1 · Bunandar · 2019 [cited by examiner]
US 20190362787A1 · Lu et al. · 2019 [cited by applicant]
US 20190370652A1 · Shen · 2019 [cited by examiner]
US 20190372589A1 · Gould · 2019 [cited by examiner]
US 20200110992A1 · Hosseinzadeh et al. · 2020 [cited by applicant]
US 20200142441A1 · Bunandar et al. · 2020 [cited by applicant]
US 20200150345A1 · Nahmias · 2020 [cited by applicant]
US 20200166328A1 · Zhou · 2020 [cited by examiner]
US 20200250532A1 · Shen · 2020 [cited by examiner]
US 20200250533A1 · Shen et al. · 2020 [cited by applicant]
US 20200250534A1 · Shen et al. · 2020 [cited by applicant]
US 20200301874A1 · Shainline · 2020 [cited by examiner]
US 20200355678A1 · Ozdemir et al. · 2020 [cited by applicant]
US 20210157878A1 · Bunandar · 2021 [cited by examiner]
US 20210201126A1 · Meng · 2021 [cited by examiner]
US 20210272005A1 · King et al. · 2021 [cited by applicant]
US 20210272006A1 · King et al. · 2021 [cited by applicant]
US 20210333818A1 · Harris et al. · 2021 [cited by applicant]
US 20210336414A1 · Harris · 2021 [cited by examiner]
US 20210365240A1 · Harris et al. · 2021 [cited by applicant]
US 20220004029A1 · Meng · 2022 [cited by examiner]
US 20220026920A1 · Ebrahimi Afrouzi · 2022 [cited by examiner]
US 20220146753A1 · Zhang · 2022 [cited by examiner]
US 20220166522A1 · Paraiso · 2022 [cited by examiner]
US 20220179159A1 · Wu · 2022 [cited by examiner]
US 20220215257A1 · Shen et al. · 2022 [cited by applicant]
US 20230018654A1 · Winzer · 2023 [cited by examiner]
US 20230251421A1 · Yasuda · 2023 [cited by examiner]
TW 202005312A · 2020 [cited by applicant]
TW 202013265A · 2020 [cited by applicant]
WO WO2017210550A1 · 2017 [cited by applicant]
Nicholas C. Harris et al., “Accelerating artificial intelligence with silicon photonics,” May 4, 2020, 2020 Optical Fiber Communications Conference and Exhibition (OFC), pp. 1-3. [cited by examiner]
Ryan Hamerly et al., “Large-Scale Optical Neural Networks Based on Photoelectric Multiplication,” May 16, 2019, Physical Review X, the American Physical Society, pp. 021032-1-9. [cited by examiner]
Extended European Search Report dated Apr. 10, 2024, in connection with European Application No. 21796097. [cited by applicant]
Hamerly et al., Large-Scale Optical Neural Networks Based on Photoelectric Multiplication. Physical Review X. May 16, 2019;9(2):21032-1-10. [cited by applicant]
Hamerly et al., [Supplementary] Large-scale optical neural networks based on photoelectric Multiplication. Physical Review X. Feb. 21, 2019;9(021032). 11 Pages. [cited by applicant]
Harris et al., Accelerating artificial intelligence with silicon photonics. 2020 Optical Fiber Communications Conference and Exhibition (OFC). Mar. 8, 2020. 4 Pages. DOI:10.1364/OFC.2020.W3A.3. [cited by applicant]
Shen et al., Deep learning with coherent nanophotonic circuits. Jun. 12, 2017;11(7):441-446. [cited by applicant]
TW 110115070, Jul. 1, 2024, Taiwan Notice of Allowance. [cited by applicant]
PCT/US23/20205, Aug. 25, 2023, International Search Report and Written Opinion. [cited by applicant]
Taiwan Notice of Allowance dated Jul. 1, 2024, in connection with Taiwan Application No. 110115070, and English translation thereof. [cited by applicant]
International Search Report and Written Opinion dated Aug. 25, 2023, in connection with International Application No. PCT/US23/20205. [cited by applicant]
International Search Report and Written Opinion mailed Sep. 22, 2021, in connection with International Application No. PCT/US2021/029150. [cited by applicant]
International Preliminary Report on Patentability mailed Nov. 10, 2022, in connection with International Application No. PCT/US2021/029150. [cited by applicant]
Invitation to Pay Additional Fees mailed Jun. 24, 2021, in connection with International Application No. PCT/US2021/029150. [cited by applicant]