IP Library › Granted Patent US 9,918,073
Granted Patent B2
US 9,918,073 · App. 14/579,587 · Granted Mar 13, 2018

Integrated camera system having two dimensional image capture and three dimensional time-of-flight capture with movable illuminated region of interest

Inventors: Jamyuen Ko (San Jose, CA); Chung Chun Wan (Fremont, CA)
Assignee: Google LLC
H04N13/0285G01S7/4813G01S7/4815G01S7/4817G01S17/89H04N13/0253H04N13/0271
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,918,073
App. No.
14/579,587
Filed
Dec 22, 2014
Granted
Mar 13, 2018
Kind
B2
Art Unit
2486
USPC
348/46
Abstract

An apparatus is described having an integrated two-dimensional image capture and three-dimensional time-of-flight depth capture system. The integrated two-dimensional image capture and three-dimensional time-of-flight depth capture system includes an illuminator to generate light for the time-of-flight depth capture system. The illuminator includes an array of light sources and a movable lens assembly. The movable lens assembly is to movably direct an emitted beam of the light to one of any of a plurality of locations within the illuminator's field of view to form an illuminated region of interest within the illuminator's field of view. The illuminated region of interest has a size that is smaller than the illuminator's field of view.

Claims (39)

1. An apparatus, comprising:

an integrated two-dimensional image capture and three-dimensional time-of-flight depth capture system, comprising:

an illuminator to generate light for the time-of-flight depth capture system, the illuminator comprising:

an array of light sources, and

a movable lens assembly comprising:

a single lens that defines a z axis aligned with the optical axis of the single lens, and an x axis and a y axis that are each perpendicular to the z axis and to each other,

an x axis actuator that is configured to tilt the single lens about the x axis, and

a y axis actuator that is configured to tilt the single lens about the y axis,

wherein the x axis actuator and they axis actuator of the movable lens assembly are collectively configured to movably direct an emitted beam of the light that passes through the single lens to one of any of a plurality of locations within the illuminator's field of view to form an illuminated region of interest within the illuminator's field of view,

wherein the illuminated region of interest having a size that is smaller than the illuminator's field of view, and

wherein the single lens of the movable lens assembly is positioned to receive light from the array of light sources.

2. The apparatus of claim 1 wherein the integrated traditional two-dimensional image capture and three-dimensional time-of-flight system further comprise an integrated image sensor having a first set of pixels to detect traditional images and second set of pixels to detect light from said illuminator that has been reflected from an object of interest.

3. The apparatus of claim 2 wherein the array of light sources further comprises an array of VCSEL lasers integrated on a same semiconductor die.

4. The apparatus of claim 1 wherein the x axis actuator of the movable lens assembly and they axis actuator of the movable lens assembly comprise voice coil motors.

5. The apparatus of claim 1 wherein the movable lens assembly is configured to scan the illuminated region of interest over a portion of the field of view to create an effectively larger illuminated region of interest.

6. The apparatus of claim 1 wherein the x axis actuator of the movable lens assembly and they axis actuator of the movable lens assembly are configured to move the single lens both vertically and laterally in relation to the light source array.

7. The apparatus of claim 6 wherein the movable lens assembly is configured to scan the illuminated region of interest over a portion of the field of view to create an effectively larger illuminated region of interest.

8. The apparatus of claim 1 wherein the emitted beam of the light has less divergence than light emitted from the light source array.

9. A computing system, comprising:

a plurality of general purpose processing cores;

a memory controller coupled to a system memory;

an image signal processor coupled to an integrated two-dimensional image capture and three-dimensional time-of-flight depth capture system, comprising:

an illuminator to generate light for the time-of-flight depth capture system, the illuminator comprising:

an array of light sources,

and a movable lens assembly comprising:

a single lens that defines a z axis aligned with the optical axis of the single lens, and an x axis and a y axis that are each perpendicular to the z axis and to each other,

an x axis actuator that is configured to tilt the single lens about the x axis, and

a y axis actuator that is configured to tilt the single lens about the y axis,

wherein the x axis actuator and they axis actuator of the movable lens assembly are collectively configured to movably direct an emitted beam of the light that passes through the single lens to one of any of a plurality of locations within the illuminator's field of view to form an illuminated region of interest within the illuminator's field of view,

wherein the illuminated region of interest having a size that is smaller than the illuminator's field of view, and

wherein the single lens of the movable lens assembly is positioned to receive light from the array of light sources.

10. The computing system of claim 9 wherein the computing system is a mobile computer having an applications processor, the plurality of general purpose processing cores and the memory controller being integrated on the applications processor.

11. The computing system of claim 10 wherein the image signal processor is integrated on the applications processor.

12. The computing system of claim 10 wherein the mobile computer is one of:

a tablet computer;

a smartphone.

13. The computing system of claim 9 wherein the integrated traditional two-dimensional image capture and three-dimensional time-of-flight system further comprise an integrated image sensor having a first set of pixels to detect traditional images and second set of pixels to detect light from said illuminator that has been reflected from an object of interest.

14. The apparatus of claim 9 wherein the x axis actuator and the y axis actuator of the movable lens assembly comprise voice coil motors that are configured to move the single lens of the movable lens laterally and vertically with respect to the light source array.

15. The apparatus of claim 9 wherein the x axis actuator and the y axis actuator of the movable lens assembly comprise voice coil motors that are configured to tilt the movable lens with respect to the light source array.

Assignments (2)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2014
From: KO, JAMYUEN; WAN, CHUNG CHAN
To: GOOGLE INC.
Reel/Frame 034570/0890 →
Continuity (1)
Related Publication 20160182895A1 · Jun 23, 2016