IP Library Granted Patent US 10,873,711
Granted Patent B2
US 10,873,711 · App. 16/272,511 · Granted Dec 22, 2020

3-dimensional hybrid camera and production system

Inventors: Roger Stettner (Santa Barbara, CA); Brad Short (Goleta, CA); Patrick Gilliland (Santa Barbara, CA); Thomas Laux (Solvang, CA); Laurent Heughebaert (Santa Paula, CA)
Assignee: Continental Advanced Lidar Solutions US, LLC.
H04N5/33G01S17/86G01S17/89H04N5/2251H04N5/2253H04N5/2254H04N13/189H04N13/239H04N5/3415H04N13/25H04N13/254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,873,711
App. No.
16/272,511
Granted
Dec 22, 2020
Kind
B2
Abstract

A three-dimensional imaging system includes a ladar sensor with a first field of view adapted to produce a three-dimensional image. The system also includes a visible light camera with a second field of view overlapping the first field of view and adapted to produce a two-dimensional image output. At least one digital processor is connected to the ladar sensor and the visible light camera and adapted to merge the three-dimensional image output with the two-dimensional image output into a three-dimensional point cloud output.

Claims (50)

1. A three-dimensional imaging system comprising:

a ladar sensor having a first field of view, said ladar sensor including

a laser transmitter configured to produce a modulated laser light output upon command from a system controller, said laser transmitter providing a zero range reference output indicating the initiation of laser light output,

an optical receiver comprised of an array of optical detector elements, each of said detector elements connected to a unit cell electrical circuit,

each unit cell electrical circuit also connected to said zero range reference output,

each unit cell electrical circuit adapted to measure the range to a reflecting surface in the first field of view and to produce a pixel range output, and

a readout integrated circuit connected to each unit cell electrical circuit and adapted to produce a three-dimensional image output comprised of a plurality of the pixel range outputs;

a visible light camera having a second field of view overlapping the first field of view and adapted to produce a two-dimensional image output; and

at least one digital processor connected via a first communications link to said at least one ladar sensor and connected via a second communications link to said visible light camera;

said at least one digital processor adapted to merge the three-dimensional image output with the two-dimensional image output into a three-dimensional point cloud output.

2. The three-dimensional imaging system of claim 1 wherein said first communications link and said second communications link are electrical connections.

3. The three-dimensional imaging system of claim 1 wherein said first communications link and said second communications link have at least one fiber optic waveguide.

4. The three-dimensional imaging system of claim 1 wherein said digital processor merges said three-dimensional output with said two-dimensional output using spatial overlay.

5. The three-dimensional imaging system of claim 1 wherein said digital processor merges said three-dimensional image output with said two-dimensional image output by using a compression algorithm to compress the two-dimensional image output.

6. The three-dimensional imaging system of claim 1 wherein said digital processor merges said three-dimensional image output with said two-dimensional image output using wavelets.

7. The three-dimensional imaging system of claim 1 wherein said two dimensional array of optical detector elements is comprised of avalanche photodiodes.

8. A three-dimensional imaging system comprising:

a first ladar sensor having a first field of view and first optical axis;

a second ladar sensor having a second field of view and second optical axis, the second field of view overlapping the first field of view, and the second optical axis having a converging angle with respect to the first optical axis;

said first ladar sensor and second ladar sensor each having

a laser transmitter configured to produce a modulated laser light output upon command from a system controller, said laser transmitter providing a zero range reference output indicating the initiation of laser light output,

an optical receiver comprised of an array of optical detector elements,

a plurality of unit cell electrical circuits, each unit cell electrical circuit connected to one of said optical detector elements and said zero range reference output,

each unit cell electrical circuit adapted to measure the range to a reflecting surface in the field of view and to produce a pixel range output, and

a readout integrated circuit connected to each unit cell electrical circuit, and adapted to produce a three-dimensional image output comprised of a plurality of the pixel range outputs;

a visible light camera having a field of view overlapping at least one of the first field of view and the second field of view, and adapted to produce a two-dimensional image output; and

a digital processor connected via a first communications link to said first ladar sensor, connected to said second ladar sensor via a second communications link, and connected via a third communications link to said visible light camera;

said digital processor adapted to merge said three-dimensional image outputs with said two-dimensional image output into a three-dimensional point cloud output.

9. The three-dimensional imaging system of claim 8 wherein said first communications link and said second communications link are electrical connections.

10. The three-dimensional imaging system of claim 8 wherein said first communications link and said second communications link have at least one fiber optic waveguide.

11. The three-dimensional imaging system of claim 8 wherein said digital processor merges said three-dimensional image outputs with said two-dimensional image output using spatial overlay.

12. The three-dimensional imaging system of claim 8 wherein said digital processor merges said three-dimensional image outputs with said two-dimensional image output by using a compression algorithm to compress the two-dimensional image output.

13. The three-dimensional imaging system of claim 8 wherein said digital processor merges said three-dimensional image output with said two-dimensional image output using wavelets.

14. The three-dimensional imaging system of claim 8 wherein said array of optical detector elements is comprised of avalanche photodiodes.

15. An object recognition system comprising:

a ladar sensor having a first field of view, said ladar sensor including

a laser transmitter producing a modulated laser light output upon command from a system controller, said laser transmitter providing a zero range reference output indicating the initiation of laser light output,

an optical receiver comprised of an array of optical detector elements,

a plurality of unit cell electrical circuits, each unit cell electrical circuit connected to one of said optical detector elements and said zero range reference output,

each of said unit cell electrical circuits adapted to measure the range to a reflecting surface in the first field of view and to produce a pixel range output, and

a readout integrated circuit connected to each unit cell electrical circuit, and adapted to produce a three-dimensional image output comprised of a plurality of said pixel range outputs;

a visible light camera having a second field of view overlapping the first field of view and adapted to produce a two-dimensional image output;

a digital processor connected via a first communications link to said ladar sensor and connected via a second communications link to said at least one visible light camera;

said digital processor adapted to merge said three-dimensional image output with said two-dimensional image output into a three-dimensional point cloud output frame; and

and an image processor adapted to search a plurality of three-dimensional point cloud output frames and to identify a number of objects in the first field of view.

16. The three-dimensional imaging system of claim 15 wherein said first communications link and said second communications link are electrical connections.

17. The three-dimensional imaging system of claim 15 wherein said first communications link and said second communications link have at least one fiber optic waveguide.

18. The three dimensional imaging system of claim 15 wherein said digital processor merges said three-dimensional image outputs with said two-dimensional image output using spatial overlay.

19. The three dimensional imaging system of claim 15 wherein said digital processor merges said three-dimensional image outputs with said two-dimensional image output by using a compression algorithm to compress the two-dimensional image output.

20. The three dimensional imaging system of claim 15 wherein said digital processor merges said three-dimensional image output with said two-dimensional image output using wavelets.

Assignments (5)
CHANGE OF NAME Recorded May 15, 2024
From: CONTINENTAL ADVANCED LIDAR SOLUTIONS US, LLC
To: CONTINENTAL AUTONOMOUS MOBILITY US, LLC
Reel/Frame 067412/0467 →
CHANGE OF NAME Recorded Aug 23, 2022
From: CONTINENTAL ADVANCED LIDAR SOLUTIONS US, LLC
To: CONTINENTAL AUTONOMOUS MOBILITY US, LLC
Reel/Frame 061299/0981 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2022
From: STETTNER, ROGER; SHORT, BRAD; GILLILAND, PATRICK; LAUX, THOMAS; HEUGHEBAERT, LAURENT
To: ADVANCED SCIENTIFIC CONCEPTS INC.
Reel/Frame 060836/0761 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2022
From: ADVANCED SCIENTIFIC CONCEPTS INC.
To: CONTINENTAL ADVANCED LIDAR SOLUTIONS US, INC.
Reel/Frame 060837/0332 →
CHANGE OF NAME Recorded Aug 17, 2022
From: CONTINENTAL ADVANCED LIDAR SOLUTIONS US, INC.
To: CONTINENTAL ADVANCED LIDAR SOLUTIONS US, LLC.
Reel/Frame 061204/0332 →
Continuity (4)
Continuation 14253558 · Apr 15, 2014
Continuation 12782845 · May 19, 2010
Provisional Application 61179949 · May 20, 2009
Related Publication 20190174076A1 · Jun 6, 2019