IP Library Granted Patent US 9,134,593
Granted Patent B1
US 9,134,593 · App. 12/977,760 · Granted Sep 15, 2015

Generation and modulation of non-visible structured light for augmented reality projection system

Inventors: William Spencer Worley, III (Half Moon Bay, CA); William Thomas Weatherford (San Mateo, CA); Christopher Coley (Morgan Hill, CA); Edward Dietz Crump (Santa Cruz, CA)
Assignee: Amazon Technologies, Inc.
G03B21/147G03B21/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,134,593
App. No.
12/977,760
Granted
Sep 15, 2015
Kind
B1
Abstract

A display system having a modulated light source is configured to include one or more non-visible wavelengths as part of the display sequence. In one implementation a color wheel, configured to modulate the wavelengths emitted by a projector, includes an infrared (IR) segment, allowing for projection of an IR image. The wavelength modulated non-visible light may be spatially modulated to generate a structured light pattern, for signaling, to synchronization with other devices, and so forth.

Claims (58)

1. An image projection system comprising:

a light source configured to generate light having a plurality of wavelengths both visible and non-visible;

a color wheel optically coupled to the light source and configured to selectively pass a pre-determined range of wavelengths from the light source, the color wheel comprising:

a plurality of visible light segments, each being configured to pass a pre-determined range of visible wavelengths;

one or more non-visible light segments, each being configured to pass a pre-determined range of non-visible wavelengths;

an imaging modulator configured to generate an image from the light passed by the color wheel and to generate at least a portion of a structured light pattern while the one or more non-visible light segments of the color wheel are passing the pre-determined range of non-visible wavelengths;

a camera configured to detect the non-visible light and gather structured light data indicative of the structured light pattern projected onto a physical scene; and

a computing device configured to:

determine a topology of the physical scene by analyzing distortion in the structured light data; and

based on the analyzed distortion in the structured light data, cause adjustment of at least one of a frequency, a duration, or a sequencing of the non-visible wavelengths passed by the one or more non-visible light segments of the color wheel.

2. The system of claim 1 , further comprising:

a color wheel motor coupled to the color wheel and configured to rotate the color wheel; and

a controller coupled to and configured to synchronize the color wheel motor and the imaging modulator.

3. The system of claim 2 , wherein the controller is further configured to generate a synchronization signal indicating a state of the color wheel.

4. The system of claim 3 , wherein the camera is configured to accept the synchronization signal indicating the state of the color wheel.

5. The system of claim 1 , wherein the visible wavelengths extend from about 390 nanometers to about 750 nanometers.

6. The system of claim 1 , wherein the non-visible wavelengths are less than about 390 nanometers or greater than about 750 nanometers.

7. The system of claim 1 , wherein the imaging modulator comprises a digital micromirror device.

8. A system comprising:

a projector comprising:

a wavelength modulated light source configured to generate light having a particular pre-determined range of wavelengths both visible and non-visible; and

one or more imaging modulators configured to generate visible and non-visible images from the light generated by the wavelength modulated light source;

wherein the projector is configured to project the visible and non-visible images onto a physical scene in an environment;

a camera configured to capture the non-visible images projected onto the physical scene to characterize a topology of the physical scene; and

wherein the wavelength modulated light source is further configured to adjust a range of wavelengths of the non-visible light based at least in part on the non-visible images captured by the camera.

9. The system of claim 8 , wherein the wavelength modulated light source generates non-visible wavelengths at a pre-determined periodic interval.

10. The system of claim 8 , wherein the wavelength modulated light source generates non-visible wavelengths upon receipt of a signal from a controller.

11. The system of claim 8 , wherein the wavelength modulated light source is further configured to alternate between a pre-determined wavelength modulation pattern of visible and non-visible wavelengths.

12. The system of claim 8 , wherein the one or more imaging modulators comprise a digital micromirror device.

13. The system of claim 8 , wherein the one or more imaging modulators comprise a liquid crystal.

14. The system of claim 8 , wherein the wavelength modulated light source comprises one or more lasers.

15. The system of claim 8 , wherein the wavelength modulated light source comprises a solid state light source.

16. The system of claim 15 , wherein the solid state light source comprises a light emitting diode.

17. The system of claim 8 , wherein the wavelength modulated light source comprises a lamp coupled to a color wheel, the color wheel comprising:

one or more visible light segments, each being configured to pass a pre-determined range of visible wavelengths; and

one or more non-visible light segments, each being configured to pass a pre-determined range of non-visible wavelengths.

18. The system of claim 8 , wherein the wavelength modulated light source comprises a lamp coupled to a wavelength modulator, the wavelength modulator configured to:

pass a pre-determined range of visible wavelengths at a first time; and

pass a pre-determined range of non-visible wavelengths at a second time.

19. The system of claim 18 , wherein the wavelength modulator comprises a liquid crystal device.

20. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:

modulating one or more light sources to produce light having a pre-determined range of non-visible wavelengths;

generating a structured light pattern with the non-visible wavelengths;

projecting the structured light pattern onto a physical scene;

modulating the one or more light sources to produce a pre-determined range of visible wavelengths;

generating a visible light image with the visible wavelengths;

projecting the visible light image onto the physical scene;

capturing an image of the structured light pattern projected into the physical scene;

analyzing the captured image to identify distortion in the structured light pattern to determine characteristics of a topology of the physical scene;

generating an adjusted structural light pattern based at least in part on the determined characteristics of the topology of the physical scene; and

projecting the adjusting structural light pattern onto the physical scene.

21. The one or more non-transitory computer-readable storage media of claim 20 , wherein the generating images comprises controlling one or more imaging modulators.

22. The one or more non-transitory computer-readable storage media of claim 20 , further comprising synchronizing the generation of the structured light pattern with the capturing of the image.

23. The one or more non-transitory computer-readable storage media of claim 20 , wherein the modulating the light source comprises controlling a color wheel motor.

24. The one or more non-transitory computer-readable storage media of claim 20 , wherein the modulating the light source comprises controlling activation of one or more solid state light sources.

25. The one or more non-transitory computer-readable storage media of claim 20 , further comprising receiving a wavelength modulation synchronization signal.

26. The one or more non-transitory computer-readable storage media of claim 20 , further comprising:

synchronizing a plurality of projectors such that each projector is configured to generate the structured light pattern with the non-visible wavelengths at different times, using different pre-determined ranges of non-visible wavelengths, or both.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2015
From: RAWLES LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 037103/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2011
From: WORLEY III, WILLIAM SPENCER; WEATHERFORD, WILLIAM THOMAS; CRUMP, EDWARD DIETZ; COLEY, CHRISTOPHER
To: RAWLES LLC
Reel/Frame 026118/0539 →