IP Library Granted Patent US 11,454,495
Granted Patent B2
US 11,454,495 · App. 16/744,108 · Granted Sep 27, 2022

Dynamic display calibration based on eye-tracking

Inventors: Lionel E. Edwin (Hollywood, FL); Ivan L. Yeoh (Fort Lauderdale, FL); Samuel A. Miller (Hollywood, FL)
Assignee: Magic Leap, Inc.
G01B11/14G01B11/22G02B27/01G02B27/017G06F3/013G06T15/20G06T19/006G09G3/003G09G3/006G09G5/02H04N13/144H04N13/327H04N13/344H04N13/383H04N13/398G02B2027/011G02B2027/0178G06F2203/011G06T3/20G06T3/40G06T3/60G06T2207/10012G06T2207/10052G09G3/2092G09G3/3406G09G2320/028G09G2320/029G09G2320/0233G09G2320/0242G09G2320/0276G09G2320/0626G09G2320/0666G09G2320/0673G09G2320/0693G09G2340/0464G09G2360/16H04N13/395
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,454,495
App. No.
16/744,108
Granted
Sep 27, 2022
Kind
B2
Abstract

Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.

Claims (24)

1. A head-mounted display system comprising:

a wearable display configured to be disposed in front of an eye of a wearer of the head-mounted display system, the wearable display configured to present virtual image content to the eye of the wearer, the wearable display having a plurality of depth planes associated therewith, wherein the wearable display is configured to present different virtual images at different depth planes, the wearable display comprising a plurality of waveguides comprising a first waveguide and a second waveguide configured to output first and second colors, respectively;

non-transitory data storage configured to store a calibration associated with the first and second waveguides of the wearable display, wherein the calibration comprises a chromatic calibration; and

a hardware processor in communication with the wearable display and the non-transitory data storage, the hardware processor programmed to:

access the chromatic calibration associated with the first and second waveguides of the wearable display; and

apply correction to the wearable display based on the chromatic calibration.

2. The head-mounted display system of claim 1 , wherein the wearable display comprises a light field display.

3. The head-mounted display system of claim 1 , wherein the plurality of waveguides are configured to direct light to the wearer's eye to form images in said wearer's eye.

4. The head-mounted display system of claim 3 , wherein different depth planes in the plurality of depth planes are associated with different waveguides of the plurality of waveguides.

5. The head-mounted display system of claim 1 , wherein the correction is configured to correct for a chromatic non-uniformity.

6. The head-mounted display system of claim 1 , wherein the correction is configured to provide color balancing.

7. The head-mounted display system of claim 1 , wherein the correction comprises balancing a white point.

8. The head-mounted display system of claim 1 , wherein the hardware processor is further programmed to correct for luminance flattening.

9. The head-mounted display system of claim 1 , wherein the calibration further comprises a spatial calibration, the spatial calibration associated with a vector field comprising vectors corresponding to deviations between projected positions and expected positions of points of at least one of the virtual images at least one of the plurality of depth planes.

10. The head-mounted display system of claim 9 , wherein the spatial calibration is associated with a divergence or a curl of the vector field.

11. The head-mounted display system of claim 9 , wherein the vector field comprises a three-dimensional (3D) vector field corresponding to in-plane and out-of-plane deviations between projected positions and expected positions of points of the virtual images.

12. The head-mounted display system of claim 1 , wherein the correction further corrects for at least one of an in-plane translation, rotation, scaling, warping error, or an out-of-plane focal depth error for at least one of the plurality of depth planes of the wearable display.

13. The head-mounted display system of claim 1 , wherein the wearable display comprises a first display associated with a first eye of the wearer and a second display associated with a second eye of the wearer, and wherein the calibration comprises a first calibration for the first display and a second calibration for the second display.

14. The head-mounted display system of claim 1 , wherein the chromatic calibration is configured to correct for a chromatic imperfection of the wearable display that comprises a chromatic mismatch between the first waveguide and second waveguide.

15. The head-mounted display system of claim 1 , wherein the chromatic calibration comprises an adjustment in luminance for at least one of the plurality of depth planes.

16. The head-mounted display system of claim 1 , wherein the calibration comprises a plurality of calibrations, and wherein different calibrations of the plurality of calibrations is associated with a corresponding calibration position relative to the wearable display.

17. The head-mounted display system of claim 1 , wherein the hardware processor is programmed to apply the correction via a feedback loop that monitors change in eye position.

18. The head-mounted display system of claim 1 , wherein the hardware processor is programmed to determine a change in eye position relative to a previous eye position, and to calculate the correction if the change exceeds a threshold.

19. The head-mounted display system of claim 1 , wherein the calibration further comprises a spatial calibration.

Assignments (3)
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2021
From: EDWIN, LIONEL E.; YEOH, IVAN L.; MILLER, SAMUEL A.
To: MAGIC LEAP, INC.
Reel/Frame 056460/0305 →