IP Library Granted Patent US 10,469,722
Granted Patent B2
US 10,469,722 · App. 15/249,938 · Granted Nov 5, 2019

Spatially tiled structured light projector

Inventor: Nicholas Daniel Trail (Bothell, WA)
Assignee: Facebook Technologies, LLC
H04N5/2256G01S17/89G02B27/0172G06F3/011G06K9/00335G06K9/00671G06K9/209G06K9/2036G06T7/50H04N5/2226H04N5/2354G02B2027/014G02B2027/0134G02B2027/0138G06T2207/10028G06T2207/10152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,469,722
App. No.
15/249,938
Granted
Nov 5, 2019
Kind
B2
Abstract

An illumination source in a depth camera assembly (DCA) includes multiple emitters on a single substrate and a diffractive optical element (DOE) assembly including multiple DOEs. Each DOE is configured to generate a structured light pattern from the light emitted from a corresponding emitter. The DOE assembly projects the structured light patterns onto portions of a local area based in part on DOE projection geometries associated with the DOEs. The illumination source may also include a second DOE assembly common to the multiple emitters.

Claims (39)

1. A depth camera assembly (DCA) comprising:

an illumination source comprising:

a plurality of emitters on a single substrate, each emitter configured to emit light, and

a diffractive optical element (DOE) assembly including a plurality of diffractive optical elements (DOEs) that each have a different corresponding emitter, wherein each DOE is configured to generate a structured light pattern from light emitted from its respective corresponding emitter, of the plurality of emitters, wherein the DOE assembly projects the structured light patterns onto portions of a local area based in part on DOE projection geometries associated with the DOEs; and

an imaging device configured to capture one or more images of the local area illuminated with at least some of the structured light patterns; and

a controller configured to:

instruct at least one of the plurality of emitters to emit light based in part on depth information associated with one or more objects in the local area.

2. The DCA of claim 1 , wherein the structured light patterns include at least two different pattern types.

3. The DCA of claim 1 , wherein the DOE projection geometries are such that at least one structured light pattern covers an area that is not covered by another structured light pattern.

4. The DCA of claim 1 , wherein the DOE projection geometries are such that at least one structured light pattern covers a portion of the local area that is larger than a portion of the local area covered by another structured light pattern.

5. The DCA of claim 4 , wherein the at least one structured light pattern is projected onto a smaller portion of the local area than the other structured light pattern, and the at least one structured light pattern has a lower irradiance value than the other structured light pattern.

6. The DCA of claim 1 , wherein the illumination source further comprises an additional DOE, and the light from each of the emitters passes through the additional DOE before reaching the DOE assembly.

7. The DCA of claim 1 , wherein the plurality of emitters emit light having characteristics selected from a group consisting of: polarization, range of wavelengths, amplitude, temporal modulation, intensity, some other feature that describes emitted light, and some combination thereof.

8. The DCA of claim 7 , wherein the plurality of emitters include at least one emitter that emits light having different characteristics than another emitter of the plurality of emitters.

9. The DCA of claim 8 , wherein the at least one emitter emits light in a different range of wavelengths than the other emitter of the plurality of emitters.

10. The DCA of claim 1 , wherein the controller is further configured to determine the depth information for objects in the local area using the one or more images.

11. The DCA of claim 1 , wherein the DCA is part of a head mounted display (HMD) comprising:

an electronic display element configured to display a virtual object based in part on the depth information; and

an optics block configured to direct light from the electronic display element to an exit pupil of the HMD.

12. A depth camera assembly (DCA) comprising:

an illumination source comprising:

a plurality of emitters on a single substrate, each emitter configured to emit light, and

a diffractive optical element (DOE) assembly including a plurality of diffractive optical elements (DOEs) that each have a different corresponding emitter, wherein each DOE is configured to generate a structured light pattern from light emitted from its respective corresponding emitter, of the plurality of emitters, wherein the DOE assembly projects the structured light patterns onto portions of a local area based in part on DOE projection geometries associated with the DOEs; and

an imaging device configured to capture one or more images of the local area illuminated with at least some of the structured light patterns; and

a controller configured to determine depth information for objects in the local area using the one or more images.

13. The DCA of claim 12 , wherein the structured light patterns include at least two different pattern types.

14. The DCA of claim 12 , wherein the DOE projection geometries are such that at least one structured light pattern covers an area that is not covered by another structured light pattern.

15. The DCA of claim 12 , wherein the DOE projection geometries are such that at least one structured light pattern covers a portion of the local area that is larger than a portion of the local area covered by another structured light pattern.

16. The DCA of claim 15 , wherein the at least one structured light pattern is projected onto a smaller portion of the local area than the other structured light pattern, and the at least one structured light pattern has a lower irradiance value than the other structured light pattern.

17. The DCA of claim 12 , wherein the illumination source further comprises an additional DOE, and the light from each of the emitters passes through the additional DOE before reaching the DOE assembly.

18. The DCA of claim 17 , wherein the DOE assembly further comprises one or more optical windows, wherein each optical window is configured to allow light emitted from a corresponding emitter of the plurality of emitters to pass through the DOE assembly.

19. The DCA of claim 12 , wherein the plurality of emitters emit light having characteristics selected from a group consisting of: polarization, range of wavelengths, amplitude, temporal modulation, intensity, some other feature that describes emitted light, and some combination thereof and the plurality of emitters include at least one emitter that emits light having different characteristics than another emitter of the plurality of emitters.

20. The DCA of claim 12 , wherein the controller is configured to instruct at least one of the plurality of emitters to emit light based in part on depth information associated with one or more objects in the local area.

21. A depth camera assembly (DCA) comprising:

an illumination source comprising:

a plurality of emitters on a single substrate, each emitter configured to emit light, and

a diffractive optical element (DOE) assembly including a plurality of diffractive optical elements (DOEs) that each have a different corresponding emitter, wherein each DOE is configured to generate a structured light pattern from light emitted from its respective corresponding emitter, of the plurality of emitters, wherein the DOE assembly projects the structured light patterns onto portions of a local area based in part on DOE projection geometries associated with the DOEs; and

an imaging device configured to capture one or more images of the local area illuminated with at least some of the structured light patterns; and

a controller configured to provide the one or more images to a console, wherein the console is configured to determine depth information based in part on the one or more images and generate a virtual object based in part on the depth information.

Assignments (3)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
CHANGE OF NAME Recorded Sep 12, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047178/0616 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2016
From: TRAIL, NICHOLAS DANIEL
To: OCULUS VR, LLC
Reel/Frame 040337/0202 →
Continuity (1)
Related Publication 20180063390A1 · Mar 1, 2018
Cited By (2)
US 12,300,017 US 12,475,583