IP Library Granted Patent US 11,218,688
Granted Patent B2
US 11,218,688 · App. 15/398,531 · Granted Jan 4, 2022

Apparatus and methods for three-dimensional sensing

Inventors: Jeffrey Roger Powers (San Francisco, CA); Vikas Muppidi Reddy (Boulder, CO); Paul Jakob Schroeder (Boulder, CO); Christopher Caleb Slaughter (Boulder, CO); Roger Wayne Landowski (Boulder, CO); Davis Thorp Foster (Boulder, CO); Evan Haley Fletcher (Boulder, CO)
Assignee: Occipital, Inc.
H04N13/254G01J1/4204G01J1/4257G02B27/106G02B27/1086G02B27/30G02B27/4205G06T7/521G06T7/593H01S5/0014H01S5/024H01S5/02325H01S5/02345H01S5/02355H01S5/423H04N5/2256H04N5/23241H04N5/332H04N5/3572H04N5/361H04N13/239H04N13/271H04N13/296H04N17/002G01J2001/446G06T2207/10012G06T2207/10048H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,218,688
App. No.
15/398,531
Granted
Jan 4, 2022
Kind
B2
Abstract

A three-dimensional (3D) sensing apparatus together with a projector subassembly is provided. The 3D sensing apparatus includes two cameras, which may be configured to capture ultraviolet and/or near-infrared light. The 3D sensing apparatus may also contain an optical filter and one or more computing processors that signal a simultaneous capture using the two cameras and processing the captured images into depth. The projector subassembly of the 3D sensing apparatus includes a laser diode, one or optical elements, and a photodiode that are useable to enable 3D capture.

Claims (46)

1. A module comprising:

a rigid-flex printed circuit board;

a light source to output light mounted to the rigid-flex circuit board;

at least one diffractive optical element that diffracts the light;

a first photodiode that is mounted to the rigid-flex circuit board and positioned adjacent to the light source so that a photoreceptor of the photodiode is pointed towards the light source to collect the light that is output by the light source and generate an illumination power signal;

a second photodiode to determine an ambient light signal; and

a fault detector to determine that a fault has occurred based at least in part on a fault detection threshold, the illumination power signal, and the ambient light signal and responsive to determining the fault has occurred, causing the light source to shut down.

2. The projector module of claim 1 , wherein the first photodiode is positioned within a housing of the projector module and the second photodiode is positioned external to the housing.

3. A module comprising:

a semi-conductor substrate;

an array of vertical-cavity surface-emitting laser (VCSEL) elements positioned along the semi-conductor substrate;

a diffractive optical element that diffracts light from the array of VCSEL elements;

a photodiode that is positioned adjacent to the VCSEL elements on the semi-conductor substrate and directed away from the VSCEL elements so that a photoreceptor of the photodiode collects at least a portion of the light diffracted by the diffractive optical element and generate an illumination power signal;

a second photodiode to determine an ambient light signal; and

a fault detector to determine that a fault has occurred based at least in part on a fault detection threshold, the illumination power signal, and the ambient light signal and responsive to determining the fault has occurred, causing the VCSEL elements to shut down.

4. The module of claim 3 , wherein the diffractive optical element diffracts light from the array of VCSEL elements and produces multiple adjacent copies of the light.

5. The module of claim 3 , wherein the photodiode that is positioned within a housing of the projector module.

6. The projector module of claim 5 , wherein the photodiode is positioned in a same direction as the VCSEL elements.

7. A module comprising:

a first camera to capture a first image at a first time;

a second camera to capture a second image at the first time;

a projector, the projector including:

a rigid-flex printed circuit board;

a light source mounted to the rigid-flex printed circuit board;

an optical collimator that collimates light output by the light source; and

a photodiode that is positioned on the rigid-flex printed circuit board adjacent to the light source and such that a photoreceptor of the photodiode is pointed towards the light source to collect the light that is output by the light source;

an error correction and undistortion component to align the first image and the second image;

a depth mask component to determine a depth sensing mask based at least in part on a local image region salience associated with a pixel of the first image;

a matcher component to match the pixel with a region of the second image; and

a depth component to estimate a depth of the pixel based at least in part on a location of the pixel in the first image and a location of the region of the second image.

8. The module of claim 7 , further comprising a housing, the housing having a first opening configured to align with the light source and a second opening configured to align with the photodiode.

9. The module of claim 7 , wherein the light source has an optical axis substantially parallel to an optical axis of the first camera and an optical axis of the second camera.

10. The module of claim 7 , wherein a focal point of the projector is positioned to be substantially collinear with a focal point of the first camera and a focal point of second camera.

11. The module of claim 7 , wherein the light source has an optical axis substantially parallel to an optical axis of the first camera.

12. The module of claim 1 , wherein the first photodiode and the light source are mounted to the rigid-flex printed circuit board.

13. The module of claim 1 , wherein the first photodiode and the light source are mounted in a substantially coplanar alignment to the rigid-flex printed circuit board.

14. The module of claim 1 , wherein the first photodiode is mounted to the rigid-flex printed circuit board.

15. The module of claim 5 , further comprising a thermistor positioned within the housing.

16. The module of claim 3 , further comprising a housing, the housing having a first opening configured to align with the VCSEL elements and a second opening configured to align with the photodiode.

17. The module of claim 3 , wherein the semi-conductor substrate is a rigid-flex printed circuit board.

18. The module of claim 3 , further comprising a thermistor mounted to the semi-conductor substrate.

19. The module of claim 1 , further comprising: at least one optical collimator that collimates the light output by the light source.

20. The module of claim 7 , further comprising:

a reference selection component to select a reference image from a set of one or more reference images; and

wherein the depth component includes a machine learning system to determine the depth of the pixel based at least in part on the local image region, the depth sensing mask, and the reference image.

21. The module of claim 20 , wherein the machine learning system also generates a two-parameter normal vector for the pixel.

Assignments (4)
SECURITY INTEREST Recorded Apr 21, 2026
From: XRPRO, LLC
To: DANLAW, INC.
Reel/Frame 075436/0662 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2022
From: OCCIPITAL, INC.
To: XRPRO, LLC
Reel/Frame 061296/0846 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2022
From: OCCIPITAL, INC.
To: XRPRO, LLC
Reel/Frame 061408/0869 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2017
From: POWERS, JEFFREY ROGER; REDDY, VIKAS MUPPIDI; SCHROEDER, PAUL JAKOB; SLAUGHTER, CHRISTOPHER CALEB; LANDOWSKI, ROGER WAYNE; FOSTER, DAVIS THORP; FLETCHER, EVAN HALEY
To: OCCIPITAL, INC.
Reel/Frame 041256/0118 →
Continuity (2)
Provisional Application 62274713 · Jan 4, 2016
Related Publication 20170194768A1 · Jul 6, 2017