IP Library Granted Patent US 11,630,312
Granted Patent B2
US 11,630,312 · App. 17/367,872 · Granted Apr 18, 2023

Foveated display for augmented reality

Inventors: Jonghyun Kim (Palo Alto, CA); Youngmo Jeong (Sungdong-gu, KR); Michael Stengel (Cupertino, CA); Morgan McGuire (Waterloo, CA); David Luebke (Charlottesville, VA)
Assignee: NVIDIA Corp.
G02B27/0172G02B27/0179G02B2027/0105G02B2027/0123G02B2027/0174G02B2027/0178G02B2027/0187G03H2001/2284G03H2270/55
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,630,312
App. No.
17/367,872
Granted
Apr 18, 2023
Kind
B2
Abstract

An augmented reality display system includes a first beam path for a foveal inset image on a holographic optical element, a second beam path for a peripheral display image on the holographic optical element, and pupil position tracking logic that generates control signals to set a position of the foveal inset as perceived through the holographic optical element, to determine the peripheral display image, and to control a moveable stage.

Claims (30)

1. An augmented reality display system comprising:

a first beam path for a foveal inset image projected through a holographic optical element, the first beam path forming a reflective magnifier lens;

a second beam path for a peripheral display image on the holographic optical element;

pupil position tracking logic; and

the pupil position tracking logic generating control signals to set a position of the foveal inset on the holographic optical element, to determine the peripheral display image, and to control a moveable stage coupled to the holographic optical element.

2. The augmented reality display system of claim 1 , wherein the peripheral display image is generated at a lower resolution than the inset display.

3. The augmented reality display system of claim 2 , arranged such that light for the peripheral display image reflects off the holographic optical element and converge to the pupil position.

4. The augmented reality display system of claim 1 , the holographic optical element configured to be operable as a hybrid reflective and transparent image combiner.

5. The augmented reality display system of claim 1 , further comprising an infrared light-emitting diode device.

6. The augmented reality display system of claim 5 , arranged such that emitted infrared light from the infrared light-emitting diode device is reflected off a cornea of a user of the augmented reality display system toward a half mirror that acts as a beam splitter.

7. The augmented reality display system of claim 6 , the pupil position tracking logic configured to utilize the infrared light reflected off the cornea to determine the pupil position.

8. The augmented reality display system of claim 1 , further configured to generate the foveal inset image at a higher resolution than the peripheral display image.

9. An augmented reality device, comprising:

a peripheral region display generator comprising:

a lens; and

a holographic optical element to reflect light from the lens to an intended pupil position;

a foveal inset display generator comprising:

a camera;

a display device coupled to receive an output of the camera; and

a half mirror arranged to direct light output from the display device through the holographic optical element to the intended pupil position.

10. The augmented reality device of claim 9 , wherein the display comprises a micro-organic light-emitting diode display.

11. The augmented reality device of claim 9 , wherein the camera comprises an eye-tracking camera.

12. The augmented reality device of claim 9 , further comprising:

a moveable stage configured to enable positioning of the lens holographic optical element in at least one spatial dimension.

13. The augmented reality device of claim 12 , the moveable stage further configured to enable positioning of the display device in the at least one spatial dimension.

14. The augmented reality device of claim 9 , further comprising:

the holographic optical element comprising diodes to generate infrared light directed to the intended pupil position and to pass infrared light reflected from the intended pupil position to the half mirror;

the half mirror arranged to reflect the infrared light reflected from the intended pupil position to the camera; and

logic to position one or both of the display device and the holographic optical element based on the infrared light reflected to the camera.

15. The augmented reality device of claim 9 , the display device configured to emit light to the pupil position at a higher resolution than a resolution of the light from the lens.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2021
From: KIM, JONGHYUN; JEONG, YOUNGMO; STENGEL, MICHAEL; MCGUIRE, MORGAN; LUEBKE, DAVID
To: NVIDIA CORP.
Reel/Frame 057485/0809 →
Continuity (3)
Continuation 16428713 · May 31, 2019
Provisional Application 62820768 · Mar 19, 2019
Related Publication 20210341741A1 · Nov 4, 2021