IP Library › Granted Patent US 11,725,933
Granted Patent B2
US 11,725,933 · App. 17/316,701 · Granted Aug 15, 2023

CMOS image sensor for RGB imaging and depth measurement with laser sheet scan

Inventors: Yibing Michelle Wang (Pasadena, CA); Kwang Oh Kim (Cerritos, CA)
G01B11/22G01B11/2518G03B15/02G06T7/521H04N23/56H04N23/667G03B17/54G06T2207/10028H04N13/271H04N2213/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,725,933
App. No.
17/316,701
Granted
Aug 15, 2023
Kind
B2
Abstract

An imaging unit includes a light source and a pixel array. The light source projects a line of light that is scanned in a first direction across a field of view of the light source. The line of light oriented in a second direction that is substantially perpendicular to the first direction. The pixel array is arranged in at least one row of pixels that extends in a direction that is substantially parallel to the second direction. At least one pixel in a row is capable of generating two-dimensional color information of an object in the field of view based on a first light reflected from the object and is capable of generating three-dimensional (3D) depth information of the object based on the line of light reflecting from the object. The 3D-depth information includes time-of-flight information.

Claims (23)

1. A pixel array for an imaging unit, the pixel array comprising:

two or more rows of pixels that extend in a first direction; and

at least one pixel in a row that is capable of generating two-dimensional (2D) color information of an object in a field of view of the pixel array based on a first light reflected from the object and capable of generating three-dimensional (3D) depth information of the object based on a line of light reflecting from the object, the line of light being oriented in a second direction across a field of view of the pixel array and being scanned across the field of view of the pixel array in the first direction, the second direction being substantially perpendicular to the first direction.

2. The pixel array of claim 1 , further comprising a time-to-digital converter coupled to the pixel, the time-to-digital converter generating the 3D-depth information based on the pixel detecting the line of light being reflected from the object.

3. The pixel array of claim 1 , further comprising a plurality of time-to-digital converters, each pixel in a row of the pixel array being coupled to a corresponding time-to-digital converter that generates the 3D-depth information for the pixel based on the pixel detecting the line of light being reflected from the object.

4. The pixel array of claim 3 , further comprising a controller coupled to the plurality of time-to-digital converters, the controller controlling the time-to-digital converters to be synchronized with the line of light that is scanned across the field of view of the pixel array.

5. The pixel array of claim 1 , further comprising a time-to-digital converter coupled to a group of pixels capable of generating 2D-color information and 3D-depth information, the time-to-digital converter generating the 3D-depth information based on at least one pixel of the group of pixels detecting the line of light being reflected from the object.

6. The pixel array of claim 1 , wherein the first direction comprises substantially a horizontal direction with respect to the field of view of the pixel array, and the second direction comprises substantially a vertical direction with respect to the field of view of the pixel array.

7. The pixel array of claim 1 , wherein the first direction comprises substantially a vertical direction with respect to the field of view of the pixel array, and the second direction comprises substantially a horizontal direction with respect to the field of view of the pixel array.

8. An image sensor unit, comprising:

a pixel array comprising a plurality of pixels arranged in two or more rows that extend in a first direction, at least one pixel generating two-dimensional (2D) color information of an object based on a first light reflected from the object in a field of view of the pixel array and generating 3D-depth information of the object based on a line of light reflecting from the object, the light of light being oriented in a second direction that is substantially perpendicular to the first direction, and the line of light being scanned across the field of view of the pixel array in substantially the first direction; and

a time-to-digital converter that generates the 3D-depth information based on the at least one pixel detecting the line of light being reflected from the object.

9. The image sensor unit of claim 8 , further comprising a plurality of time-to-digital converters, each pixel in a row of the pixel array being coupled to a corresponding time-to-digital converter that generates the 3D-depth information for the pixel based on the pixel detecting the line of light being reflected from the object.

10. The image sensor unit of claim 9 , further comprising a controller coupled to the plurality of time-to-digital converters, the controller controlling the time-to-digital converters to be synchronized with the line of light that is scanned across the field of view of the pixel array.

11. The image sensor unit of claim 8 , wherein the time-to-digital converter is coupled to a group of pixels capable of generating 2D-color information and 3D-depth information, the time-to-digital converter generating the 3D-depth information based on at least one pixel of the group of pixels detecting the line of light being reflected from the object.

12. The image sensor unit of claim 8 , wherein the first direction comprises substantially a horizontal direction with respect to the field of view of the pixel array, and the second direction comprises substantially a vertical direction with respect to the field of view of the pixel array.

13. The image sensor unit of claim 8 , wherein the first direction comprises substantially a vertical direction with respect to the field of view of the pixel array, and the second direction comprises substantially a horizontal direction with respect to the field of view of the pixel array.

14. The image sensor unit of claim 8 , further comprising a light source that projects the line of light that is scanned in the first direction across a field of view of the pixel array.

15. A method, comprising:

receiving at a pixel array a line of light that is oriented in a first direction and that is scanned across a field of view of the pixel array in a second direction that is substantially perpendicular to the first direction; and

generating at a pixel of the pixel array two-dimensional (2D) color information of an object in the field of view of the pixel array based on a first light reflected from the object and three-dimensional (3D) depth information of the object based on the line of light reflecting from the object, the pixel being capable of generating 2D color information of the object and 3D-depth information of the object, the pixel array being arranged in at least one row of pixels that extends in a direction that is substantially parallel to the second direction, and the pixel being in a row of the pixel array.

16. The method of claim 15 , wherein the first direction comprises substantially a horizontal direction with respect to the field of view of the pixel array, and the second direction comprises substantially a vertical direction with respect to the field of view of the pixel array.

17. The method of claim 15 , wherein the first direction comprises substantially a vertical direction with respect to the field of view of the pixel array, and the second direction comprises substantially a horizontal direction with respect to the field of view of the pixel array.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: WANG, YIBING MICHELLE; KIM, KWANG OH
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 064088/0574 →
Continuity (10)
Continuation 16988593 · Aug 7, 2020
Continuation 16595461 · Oct 7, 2019
Continuation In Part 16191415 · Nov 14, 2018
Continuation In Part 16186477 · Nov 9, 2018
Continuation 14842825 · Sep 1, 2015
Continuation 14842825 · Sep 1, 2015
Provisional Application 62783164 · Dec 20, 2018
Provisional Application 62182404 · Jun 19, 2015
Provisional Application 62150252 · Apr 20, 2015
Related Publication 20210262784A1 · Aug 26, 2021
Cited By (2)
US 12,189,057 US 12,352,892