IP Library Granted Patent US 11,695,911
Granted Patent B2
US 11,695,911 · App. 17/229,671 · Granted Jul 4, 2023

Stereoscopic image capturing systems

Inventor: Angus Pacala (San Francisco, CA)
Assignee: Ouster, Inc.
H04N13/25G01S17/10G01S17/86G01S17/894H04N13/243H04N13/254H04N13/296H04N23/58H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,695,911
App. No.
17/229,671
Granted
Jul 4, 2023
Kind
B2
Abstract

A stereoscopic imager system, comprising: a sensor array comprising a first plurality of photosensors and a second plurality of photosensors spaced apart from the first plurality of photosensors by a gap, the first plurality of photosensors and the second plurality of photosensors being configured to detect ambient light in a scene; a moving component coupled to the sensor array and operable to move the sensor array between a first position and a second position within a full rotational image capturing cycle; and a system controller coupled to the sensor array and the moving component. The system controller can be configured to: move a field of view of a sensor array by instructing the moving component to capture a first image of an object in the scene with the first plurality of photosensors from a first perspective at the first position, and to capture a second image of the scene of the object in the scene with the second plurality of photosensors from a second perspective at the second position; and calculate, based on the first image and the second image, a distance to the object using an optical baseline defined by the gap.

Claims (49)

1. A stereoscopic imager system, comprising:

a sensor array comprising:

a plurality of ranging photosensors that detect light emitted from an emitter array once it has reflected off of an object in a scene;

a first plurality of imaging photosensors positioned at a first side of the ranging photosensors; and

a second plurality of imaging photosensors positioned at a second side of the ranging photosensors opposite from the first side, the first plurality of imaging photosensors and the second plurality of imaging photosensors detect ambient light in the scene and are spaced apart by a gap;

a moving component coupled to the sensor array and operable to move the sensor array between a first position and a second position within a full rotational image capturing cycle; and

a system controller coupled to the sensor array and the moving component, the system controller configured to:

determine a first distance to an object in the scene using the plurality of ranging photosensors by way of time-of-flight calculations;

capture a first image of the scene at the first position with the first plurality of imaging photosensors and a second image of the scene at the second position with the second plurality of imaging photosensors;

calculate a second distance to the object based on the first image and the second image and an optical baseline determined by the gap; and

determine a final distance to the object based on the first distance augmented by or superseded by the second distance.

2. The stereoscopic imager system of claim 1 , wherein the plurality of ranging photosensors are organized in a diagonally staggered arrangement, and the first and second pluralities of imaging photosensors are each organized in a rectangular arrangement.

3. The stereoscopic imager system of claim 2 , wherein at least some of the first plurality of imaging photosensors and at least some of the plurality of second imaging photosensors are positioned along the same horizontal line.

4. The stereoscopic imager system of claim 1 , wherein the moving component is an electric motor that rotates the sensor array around a center axis.

5. The stereoscopic imager system of claim 1 , wherein the moving component is a micro-electrical mechanical system (MEMS) device that reflects light to move the field of view.

6. The stereoscopic imager system of claim 1 , wherein the system controller is further configured to determine the final distance to the object by averaging the first and second distances together.

7. The stereoscopic imager system of claim 1 , wherein the system controller is further configured to determine the final distance to the object by replacing the first distance with the second distance.

8. A method of distance measurement, comprising:

moving a field of view of a sensor array including a first array of imaging photosensors and a second array of imaging photosensors spaced apart from each other by a gap;

measuring a first distance to the object using an array of ranging photosensors;

capturing a first image of an object in a scene with the first array of imaging photosensors from a first perspective at a first instance of time as the field of view moves;

capturing a second image of the scene of the object in the scene with the second array of imaging photosensors from a second perspective at a second instance of time as the field of view moves;

calculating, based on the first image and the second image, a second distance to the object using an optical baseline defined by the gap; and

determining a final distance to the object based on the first distance augmented by or superseded by the second distance.

9. The method of claim 8 , further comprising:

comparing shared features of the object captured in the first image and the second image; and

using the results from the comparison to calculate the second distance to the object.

10. The method of claim 8 , wherein the sensor array is formed of a two-dimensional array of imaging photosensors, and the first array of imaging photosensors and the second array of imaging photosensors are each a subset of the two-dimensional array of imaging photosensors.

11. The method of claim 8 wherein the ranging photosensor is in a two-dimensional array of ranging photosensors and the first and second arrays of imaging photosensors are located on opposing sides of the array of ranging photosensors.

12. The method of claim 11 wherein array of ranging photosensors is organized in a diagonally staggered arrangement and the first and second arrays of imaging photosensors are organized in a rectangular arrangement.

13. The method of claim 8 wherein the final distance to the object is determined by averaging the first and second distances together.

14. The method of claim 8 wherein the final is determined by replacing the first distance with the second distance.

15. An imaging system comprising:

an array of light emitters configured to output a plurality of narrowband light rays into a field external to the imaging system;

an array of ranging photosensors operable to detect photons emitted by the array of light emitters after the photons are reflected from surfaces within the field;

a first plurality of imaging photosensors positioned at a first side of the array of ranging photosensors and operable to detect ambient light from the field;

a second plurality of imaging photosensors spaced apart from the first plurality of imaging photosensors by a gap, and positioned along a second side of the array of ranging photosensors opposite the first side, the second plurality of photosensors being operable to detect ambient light from the field;

wherein the array of ranging photosensors, first plurality of imaging photosensors and second plurality of imaging photosensors all have a shared field of view within the field; and

a system controller coupled to the array of light emitters, the array of ranging photosensors, and the first and second pluralities of imaging photosensors, and configured to:

collect three-dimensional distance data representing a scene in the shared field of view of the system based on output from the array of ranging photosensors;

capture a first image of the scene with the first plurality of imaging photosensors from a first perspective;

capture a second image of the scene with the second plurality of imaging photosensors from a second perspective;

calculate distances to objects in the scene based on the first image and the second image; and

augment the three-dimensional distance data based on output from the array of ranging photosensors with distances to objects in the scene calculated from the first and second images.

16. The imaging system set forth in claim 15 wherein the three-dimensional distance data is used to construct a topographical map of a portion of the field and the light captured by the first and second pluralities of imaging photosensors are used to construct an Red-Green-Blue (RGB) image of the portion of the field that is highly correlated with the topographical map.

17. The imaging system set forth in claim 15 further comprising a moving component operable to rotate the array of light emitters, the array of ranging photosensors and the first and second pluralities of imaging photosensors about a full 360 degree rotation axis of the system.

18. The imaging system set forth in claim 15 wherein the second plurality of imaging photosensors is spaced apart from the first plurality of imaging photosensors by a gap and the system controller is configured to calculate distances to objects in the scene based on the first image and the second image and an optical baseline determined by the gap.

19. The imaging system set forth in claim 15 wherein the three-dimensional distance data based on output from the array of ranging photosensors is augmented by averaging at least some distances in the three-dimensional distance data with distances calculated based on the first and second images.

20. The imaging system set forth in claim 15 wherein the three-dimensional distance data based on output from the array of ranging photosensors is augmented by replacing at least some distances in the three-dimensional distance data with distances calculated based on the first and second images.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE ADD THE SECOND ASSIGNEE PREVIOUSLY RECORDED AT REEL: 65350 FRAME: 826. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 29, 2023
From: HERCULES CAPITAL, INC.
To: OUSTER, INC.; SENSE PHOTONICS, INC.
Reel/Frame 066432/0458 →
RELEASE OF INTELLECTUAL PROPERTY SECURITY INTEREST AT REEL/FRAME NO. 059859/0035 Recorded Oct 25, 2023
From: HERCULES CAPITAL, INC.
To: OUSTER, INC.
Reel/Frame 065350/0826 →
SECURITY INTEREST Recorded Apr 29, 2022
From: OUSTER, INC.; SENSE PHOTONICS, INC.
To: HERCULES CAPITAL, INC., AS AGENT
Reel/Frame 059859/0035 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2021
From: PACALA, ANGUS
To: OUSTER, INC.
Reel/Frame 056900/0286 →
Continuity (2)
Provisional Application 63016118 · Apr 27, 2020
Related Publication 20210337178A1 · Oct 28, 2021
Cited By (1)
US 12,200,183