IP Library Granted Patent US 12,222,454
Granted Patent B2
US 12,222,454 · App. 18/169,909 · Granted Feb 11, 2025

Integrated lidar image-sensor devices and systems and related methods of operation

Inventors: Hod Finkelstein (Berkeley, CA); Dietrich Dehlinger (San Francisco, CA); Scott Burroughs (Raleigh, NC); Brent Fisher (Bethesda, MD)
Assignee: Sense Photonics, Inc.
G01S7/4863G01S7/4816G01S7/4876
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,222,454
App. No.
18/169,909
Granted
Feb 11, 2025
Kind
B2
Abstract

A Light Detection and Ranging (LIDAR) apparatus includes a detector having a first pixel and a second pixel configured to output respective detection signals responsive to light incident thereon, and receiver optics configured to collect the light over a field of view and direct first and second portions of the light to the first and second pixels, respectively. The first pixel includes one or more time of flight (ToF) sensors, and the second pixel includes one or more image sensors. At least one of the receiver optics or arrangement of the first and second pixels in the detector is configured to correlate the first and second pixels such that depth information indicated by the respective detection signals output from the first pixel is correlated with image information indicated by the respective detection signals output from the second pixel. Related devices and methods of operation are also discussed.

Claims (27)

1. A Light Detection and Ranging (LIDAR) apparatus, comprising:

a detector comprising a first pixel and a second pixel configured to output respective detection signals responsive to light incident thereon, the first pixel comprising one or more time of flight (ToF) sensors, and the second pixel comprising one or more image sensors; and

a gate structure that overlaps at least a portion of the first pixel and at least a portion of the second pixel in plan view.

2. The LIDAR apparatus of claim 1 , wherein the first and second pixels are configured to detect light of different first and second wavelength ranges, respectively, and wherein the gate structure is transparent to the light of one of the first and second wavelength ranges.

3. The LIDAR apparatus of claim 2 , wherein the gate structure is not transparent to the light of another of the first and second wavelength ranges.

4. The LIDAR apparatus of claim 2 , wherein respective junction regions of the first and second pixels overlap in plan view.

5. The LIDAR apparatus of claim 2 , wherein respective junction regions of the first and second pixels are arranged side-by-side in plan view.

6. The LIDAR apparatus of claim 5 , wherein the gate structure comprises a plurality of gate structures arranged adjacent a periphery of the first pixel.

7. The LIDAR apparatus of claim 6 , wherein the second pixel comprises a plurality of sub-pixels arranged adjacent the periphery of the first pixel.

8. The LIDAR apparatus of claim 7 , wherein the first and second pixels comprise first and second wavelength-selective filters that are configured to selectively transmit light of the first and second wavelength ranges, respectively, to respective junction regions of the first and second pixels.

9. The LIDAR apparatus of claim 8 , wherein the first wavelength range comprises near infrared wavelengths, and wherein the second wavelength range comprises red, green, or blue wavelengths.

10. The LIDAR apparatus of claim 1 , wherein the first and second pixels are provided in a same substrate.

11. The LIDAR apparatus of claim 10 , wherein respective junction regions of the first and second pixels are provided at different depths relative to a surface of the substrate.

12. The LIDAR apparatus of claim 10 , further comprising: receiver optics configured to collect the light over a field of view and direct first and second portions of the light to the first and second pixels, respectively.

13. The LIDAR apparatus of claim 10 , further comprising:

isolation structures in or on the substrate, wherein the isolation structures separate respective junction regions of the first pixel from respective junction regions of the second pixel.

14. The LIDAR apparatus of claim 13 , wherein the isolation structures comprise intermediate junction regions.

15. A Light Detection and Ranging (LIDAR) detector array, comprising:

a plurality of first pixels and a plurality of second pixels configured to output respective detection signals responsive to light incident thereon, the first pixels comprising time of flight (ToF) sensors, and the second pixels comprising image sensors; and

a plurality of gate structures, wherein each gate structure overlaps at least a portion of a corresponding first pixel and at least a portion of a corresponding second pixel in plan view.

16. The LIDAR detector array of claim 15 , further comprising: a substrate comprising the plurality of first pixels and the plurality of second pixels therein.

17. The LIDAR detector array of claim 15 , wherein the first and second pixels are configured to detect light of different first and second wavelength ranges, respectively, and the gate structures are transparent to the light of one of the first and second wavelength ranges but are not transparent to the light of another of the first and second wavelength ranges.

18. The LIDAR detector array of claim 15 , wherein the gate structures are arranged adjacent a periphery of respective ones of the first pixels.

19. The LIDAR detector array of claim 18 , wherein the second pixels respectively comprise red, green, and blue sub-pixels arranged adjacent the periphery of the respective ones of the first pixels.

20. The LIDAR detector array of claim 15 , further comprising:

first and second readout circuits; and

a plurality of input/output (I/O) pads electrically connected to respective pixels of the first and second pixels, wherein the I/O pads are configured to output the respective detection signals from the first and second pixels to the first and second readout circuits, respectively.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2023
From: FINKELSTEIN, HOD; DEHLINGER, DIETRICH; BURROUGHS, SCOTT; FISHER, BRENT
To: SENSE PHOTONICS, INC.
Reel/Frame 062715/0137 →
Continuity (3)
Continuation 16542696 · Aug 16, 2019
Provisional Application 62764895 · Aug 16, 2018
Related Publication 20230194679A1 · Jun 22, 2023
References Cited (28)
US 9264676B2 · Cohen et al. · 2016 [cited by applicant]
US 10141366B2 · Wan · 2018 [cited by applicant]
US 10488496B2 · Campbell · 2019 [cited by applicant]
US 20050285966A1 · Bamji et al. · 2005 [cited by applicant]
US 20120044093A1 · Pala · 2012 [cited by applicant]
US 20130234029A1 · Bikumandla · 2013 [cited by applicant]
US 20150285625A1 · Deane · 2015 [cited by applicant]
US 20160161599A1 · Seliuchenko · 2016 [cited by applicant]
US 20160165213A1 · Lee et al. · 2016 [cited by applicant]
US 20160181226A1 · Wan · 2016 [cited by applicant]
US 20170131387A1 · Campbell et al. · 2017 [cited by applicant]
US 20170146657A1 · Xu · 2017 [cited by examiner]
US 20170257617A1 · Retterath · 2017 [cited by applicant]
US 20180084238A1 · Chossat et al. · 2018 [cited by applicant]
CN 102445688A · 2012 [cited by applicant]
CN 106471621A · 2017 [cited by applicant]
CN 108369274A · 2018 [cited by applicant]
JP 2016211881A · 2016 [cited by applicant]
KR 20140111017A · 2014 [cited by applicant]
KR 20140147376A · 2014 [cited by applicant]
Extended European Search Report corresponding to EP Application No. 19850045.6 (Feb. 2, 2022). [cited by applicant]
Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration, in corresponding PCT Application No. PCT/US2019/046806 (Dec. 6, 2019). [cited by applicant]
Cn2019800607778, “Office Action”, Oct. 19, 2023, 24 pages. [cited by applicant]
CN201980060777.8, “Office Action”, Jul. 23, 2024, 27 pages. [cited by applicant]
CN201980060777.8, “Office Action”, Apr. 20, 2024, 25 pages. [cited by applicant]
CN201980060777.8, “Office Action”, Oct. 11, 2024, 22 pages. [cited by applicant]
EP19850045.6, “Office Action”, Sep. 26, 2024, 7 pages. [cited by applicant]
KR 1020217006508, “Office Action”, Nov. 27, 2024, 27 pages. [cited by applicant]