IP Library Granted Patent US 11,614,628
Granted Patent B2
US 11,614,628 · App. 17/581,773 · Granted Mar 28, 2023

System and method for presenting image content on multiple depth planes by providing multiple intra-pupil parallax views

Inventors: Michael Anthony Klug (Austin, TX); Robert Konrad (Palo Alto, CA); Gordon Wetzstein (Palo Alto, CA); Brian T. Schowengerdt (Seattle, WA); Michal Beau Dennison Vaughn (Round Rock, TX)
Assignee: Magic Leap, Inc.
G02B27/0172G02B27/0179G02B30/24G02B30/34H04N13/128H04N13/339H04N13/341H04N13/344H04N13/383H04N13/398G02B2027/0134G02B2027/0187H04N13/324H04N13/346H04N2213/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,614,628
App. No.
17/581,773
Granted
Mar 28, 2023
Kind
B2
Abstract

An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity. Advantageously, the wavefront divergence, and the accommodation cue provided to the eye of the user, may be varied by appropriate selection of parallax disparity, which may be set by selecting the amount of spatial separation between the locations of light output.

Claims (27)

1. A head-mounted display system comprising:

a light source comprising a plurality of spatially distinct light output locations;

a spatial light modulator configured to modulate light from the light source; and

projection optics configured to direct light from the spatial light modulator for propagation into an eye of a viewer,

wherein the display system is configured to display a virtual object on a depth plane by injecting a set of parallactically-disparate intra-pupil images of the virtual object into the eye,

wherein injecting the set of parallactically-disparate intra-pupil images comprises changing a path of light from a light source to the spatial light modulator of the head-mounted display by activating different ones of the light output locations to increase a magnitude of parallax disparity between the parallactically-disparate intra-pupil images as the virtual object decreases in perceived distance to the viewer.

2. The display system of claim 1 , configured to decrease a lateral separation between activated light output locations with decreases in the perceived distance of the virtual object to the viewer.

3. The display system of claim 1 , configured to change the activated light output locations during injection of at least one of the intra-pupil images into the eye.

4. The display system of claim 3 , configured to change the activated light output locations at a speed higher than an update rate of the parallax image on the spatial light modulator.

5. The display system of claim 1 , configured to synchronize activation of different light output locations with formation of different parallactically-disparate intra-pupil images by the spatial light modulator.

6. The display system of claim 5 , wherein the different parallactically-disparate intra-pupil images are formed at different locations across the spatial light modulator.

7. The display system of claim 6 , further comprising a lenslet array between the spatial light modulator and the projection optics, wherein the lenslet array is configured to direct light from the different locations of the spatial light modulator at different angles to the projection optics.

8. The display system of claim 1 , further comprising a prism between the spatial light modulator and the projection optics, wherein the prism is configured to direct light from different locations of the spatial light modulator at different angles to the projection optics.

9. The display system of claim 1 , wherein the light source, the spatial light modulator, and the projection optics are configured to direct a plurality of beams of light to the eye of the viewer, wherein each beam of light corresponds to an associated parallactically-disparate image, and wherein each beam of light is collimated.

10. The display system of claim 9 , wherein each collimated beam of light has a diameter less than about 0.5 mm when incident on the eye.

11. The display system of claim 1 , wherein the spatial light modulator is a digital light processing (DLP) chip.

12. The display system of claim 1 , wherein the projection optics directs the light to a waveguide comprising incoupling optical elements and outcoupling optical elements, wherein the incoupling optical elements are configured to incouple the light into the waveguide and the outcoupling optical elements are configured to output the light from the waveguide into the eye of the viewer.

13. The display system of claim 1 , wherein the light source comprises a light-emitting diode array.

14. The display system of claim 13 , wherein the light-emitting diode array is a 2d array.

15. The display system of claim 1 , wherein the light source comprises:

a light emitter; and

a spatial light modulator configured to selectively change a location of light received from the light emitter and propagating away from the spatial light modulator.

16. The display system of claim 1 , wherein the light source comprises a fiber scanner.

17. The display system of claim 1 , wherein injecting the set of parallactically-disparate intra-pupil images comprises simultaneously injecting multiple ones of the intra-pupil images.

18. The display system of claim 17 , wherein the set of parallactically-disparate intra-pupil images consists of two or more views of the virtual object.

19. The display system of claim 1 , configured to inject the set of parallactically-disparate intra-pupil images by temporally sequentially injecting the parallactically-disparate intra-pupil images into the eye of the viewer within a flicker fusion threshold.

20. The display system of claim 19 , wherein the flicker fusion threshold is 1/60 of a second.

Assignments (3)
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2023
From: KLUG, MICHAEL ANTHONY; KONRAD, ROBERT; WETZSTEIN, GORDON; SCHOWENGERDT, BRIAN T.; VAUGHN, MICHAL BEAU DENNISON
To: MAGIC LEAP, INC.
Reel/Frame 062318/0315 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
Cited By (1)
US 12,282,170