IP Library › Granted Patent US 11,366,230
Granted Patent B2
US 11,366,230 · App. 16/604,006 · Granted Jun 21, 2022

Device and method of optical range imaging

Inventors: Ralph Spickermann (Redwood City, CA); Srinath Kalluri (Palo Alto, CA); Siddharth Jain (San Mateo, CA)
G01S17/894G01S7/4816G01S7/4817G01S7/4863
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,366,230
App. No.
16/604,006
Granted
Jun 21, 2022
Kind
B2
Abstract

An optical device creates 3D images comprising a field of points, each point comprising horizontal, vertical, and distance metrics. The device comprises an illumination subsystem, comprising light sources, such as LEDs, a non-resonant beam steering element such as a micro-electro-mechanical system (MEMs) mirror, beam-shaping optics, a beam director plate, and a diffuser. The device also comprises an imaging subsystem with one or more optical detector chips that measure time-of-flight (TOF). Devices may dynamically and sequentially images solid-angle sub-regions of interest, in an arbitrary order, out of a total FOV, using eye-safe illumination. The corresponding received image portions are stitched together. The beam steering element is non-resonant, allowing arbitrary and rapid changes to its pointing vector. Beam shaping optics generates rectangular solid-angle illumination. One detector chip integrates light from one sub-region while another chip is reads out image data.

Claims (67)

1. An optical range imaging system comprising:

an illumination subsystem comprising:

a continuous wave light source, modulated by a light modulator;

a non-resonant MEMs mirror adapted to rotate independently on one or two rotational axes;

a beam director comprising P beam direction angles;

a diffuser comprising P diffuser segments; wherein each of the P beam direction angles corresponds with one of the P diffuser segments;

wherein the illumination subsystem is adapted to direct light from the continuous wave light source, then reflecting off the MEMs mirror, then aimed to one of P beam direction angles, and then through a corresponding diffuser segment towards one of P illumination reduced fields of view, wherein the P illumination reduced fields of view define, as a group, a total illuminated field of view;

wherein a controller is adapted to select a desired one of P beam direction angles of the beam director by setting one MEMs mirror rotational angle for each MEMs mirror rotational axis;

an imaging subsystem comprising:

a lens array comprising N focus lenses; wherein N is two or more;

a sensor array comprising N two-dimensional arrays of light sensors;

wherein each two-dimensional array comprises a light demodulator synchronous with the light modulator;

an output comprising a plurality of time-of-flight outputs;

wherein each time-of-flight output is responsive to a time-of-flight of reflected light from the illumination subsystem to a portion of at least one of the N two-dimensional arrays of light sensors;

wherein each of the N focus lenses corresponds to exactly one of the N two-dimensional arrays of light sensors;

wherein each of N focus lenses focuses light, from one of N imaging reduced fields of view, respectively, to the corresponding each two-dimensional array of light sensors;

wherein the N imaging reduced fields of view define, as a group, a total imaged field of view;

wherein the controller is operatively connected to the continuous wave light source, the light modulator, the MEMs mirror, and the N two-dimensional arrays of light sensors; and

wherein the controller is adapted to select the MEMs mirror rotational angles in any arbitrary sequence.

2. The optical range imaging system of claim 1 , wherein:

the beam director comprising P beam direction angles comprises a prism array comprising P prisms.

3. The optical range imaging system of claim 1 , wherein:

the beam director comprising P beam direction angles comprises a diffractive optical element with P segments, wherein each of the P segments is adapted to direct reflected light from the MEMs mirror to a fixed beam direction angle.

4. The optical range imaging system of claim 1 , wherein:

the total illumination field of view, the total imaging field of view, the number P, and the number N, are predetermined.

5. The optical range imaging system of claim 1 , wherein:

the total illumination field of view is functionally the same as the total imaging field of view.

6. The optical range imaging system of claim 1 , wherein:

P is larger than N.

7. The optical range imaging system of claim 1 , wherein:

P is equal to N times an integer larger than one.

8. The optical range imaging system of claim 1 , wherein:

the imaging subsystem has no moving parts in normal use of the embodiment.

9. The optical range imaging system of claim 1 , wherein:

the embodiment is free of moving parts, in normal use of the embodiment, other than the MEMs mirror.

10. The optical range imaging system of claim 1 , wherein:

the embodiment is eye-safe per international standards in effect as of the filing date.

11. The optical range imaging system of claim 1 , wherein:

the embodiment is eye-safe using a light source in the range of 800 to 1000 nm.

12. The optical range imaging system of claim 1 , further comprising:

a light collimator located in an optical path between the continuous wave light source and the beam director.

13. The optical range imaging system of claim 1 , wherein:

the illumination subsystem illuminates continuous object surfaces in an illumination reduced field of view, free of illumination gaps.

14. The optical range imaging system of claim 1 , wherein:

the imaging subsystem images continuous object surfaces in an imaging reduced field of view, free of image gaps.

15. The optical range imaging system of claim 1 , wherein:

each of the N two-dimensional arrays of light sensors comprises a light integration time and a data read out time; and

wherein N is greater than or equal to: [(the read out time divided by the integration time) plus one].

16. The optical range imaging system of claim 15 , wherein:

the light integration time of a first of the N two-dimensional arrays of light sensors overlaps with the data read out time of a second of the N two-dimensional arrays of light sensors.

17. A method of optical range imaging using a device comprising all of the elements of claim 1 , comprising steps:

(a) moving the MEMs mirror to a first one of P positions;

(b) holding the MEMs mirror still for a first arbitrary amount of time;

(c) illuminating a first selected one of P illumination reduced fields of view;

(d) integrating light from the first selected illumination reduced field of view on a first of the N two-dimensional arrays of light sensors;

(e) moving the MEMs mirror to a second, different one of P positions;

(f) holding the MEMs mirror still for a second arbitrary amount of time;

(g) illuminating a second, different, selected one of P illumination reduced fields of view;

(h) integrating light from the second imaging reduced field of view on a second, different one of the N two-dimensional arrays of light sensors;

(i) reading output data, responsive to the light from step (d), from the first selected one of P illumination reduced fields of view; simultaneously with step (h) above; and

(j) repeating steps (a) through (i) until all N two-dimensional arrays of light sensors have been used for integrating light and reading output data.

18. The method of optical range imaging of claim 17 , wherein:

the reading output data in step (i), for one of N two-dimensional arrays of light sensors, overlaps with more than one integrating light in steps (h).

19. The method of optical range imaging of claim 17 , comprising the additional step:

(k) repeating steps (a) through (j) until all P positions have been used.

20. The method of optical range imaging of claim 17 , comprising the additional step:

(l) repeating steps (a) through (j) until an entire target field of view has been illuminated, piecewise, one selected illumination reduced field of view at a time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2023
From: OYLA, INC.
To: AAC OPTICS SOLUTIONS PTE. LTD.
Reel/Frame 062593/0461 →
Continuity (2)
Provisional Application 62688165 · Jun 21, 2018
Related Publication 20210325540A1 · Oct 21, 2021
Cited By (1)
US 12,631,755