IP Library Granted Patent US 11,789,274
Granted Patent B2
US 11,789,274 · App. 17/747,444 · Granted Oct 17, 2023

Displays and methods of operating thereof

Inventors: Timothy Paul Bodiya (Toronto, CA); Shreyas Potnis (Kitchener, CA); Stuart James Myron Nicholson (Waterloo, CA); Bergen Fletcher (St. Jacobs, CA)
Assignee: GOOGLE LLC
G02B27/0172G02B27/0093G09G5/10H04N9/3155G02B2027/0178G09G2360/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,789,274
App. No.
17/747,444
Granted
Oct 17, 2023
Kind
B2
Abstract

There is provided a method of operating a wearable heads-up display (WHUD). The WHUD may include a light source, a spatial modulator, and a display optic. The method may include generating, by the light source, an output light to form an image viewable by a user of the WHUD. The method may also include receiving a position of a pupil of the user relative to an eyebox of the WHUD, and obtaining an image correction map based on the position of the pupil. Moreover, the method may include adjusting the output light to form an adjusted output light. The adjusted output light may be adjusted based on the image correction map to reduce at least one of an intensity non-uniformity and a color balance non-uniformity of the image. The method may also include directing, by the display optic, the adjusted output light into a field of view of the user.

Claims (72)

1. A method of operating a wearable heads-up display (WHUD), the WHUD comprising a light source, a spatial modulator, and a display optic, the method comprising:

generating, by the light source, an output light comprising a plurality of wavelengths and having a plurality of incoupling losses corresponding to the plurality of wavelengths, the output light to form an image viewable by a user of the WHUD, the output light comprising a first light having a first wavelength and a second light having a second wavelength;

receiving a position of a pupil of the user relative to an eyebox of the WHUD;

obtaining an image correction map from a plurality of image correction maps based on the position of the pupil; and

adjusting the output light to form an adjusted output light, the adjusted output light adjusted based on the image correction map to reduce at least one of an intensity non-uniformity and a color balance non-uniformity of the image caused by a difference between a first incoupling loss of the plurality of incoupling losses and a second incoupling loss of the plurality of incoupling losses.

2. The method of claim 1 , wherein the receiving the position of the pupil comprises tracking a gaze of a corresponding eye of the user, and the method further comprising:

obtaining a region of interest in the image corresponding to the gaze; and wherein:

the adjusting the output light based on the image correction map comprises adjusting the output light based on the image correction map to reduce at least one of the intensity non-uniformity and the color balance non-uniformity in the region of interest of the image.

3. The method of claim 1 , wherein the obtaining the image correction map comprises at least one of:

retrieving the image correction map from a repository storing a plurality of image correction maps in association with corresponding positions of the pupil relative to the eyebox; and/or

calculating the image correction map based on the position of the pupil.

4. The method of claim 1 , wherein the adjusting the output light comprises at least one of controlling the light source to adjust an intensity of the output light and/or adjusting a polarization of the output light.

5. The method of claim 1 , wherein:

the obtaining the image correction map comprises obtaining the image correction map further based on an indication of a size of the pupil;

the indication of the size of the pupil comprises an ambient brightness; and

the obtaining the image correction map further based on the indication of the size of the pupil comprises obtaining the image correction map further based on the ambient brightness.

6. The method of claim 1 , further comprising:

operating the WHUD to display a plurality of corrected test images to the user; and

receiving user input selecting a given corrected test image from the plurality of corrected test images; and wherein:

the obtaining the image correction map comprises determining the image correction map corresponding to the given corrected test image.

7. The method of claim 1 , wherein:

the image comprises a plurality of pixels, each pixel having a corresponding field position comprising spatial coordinates of the pixel in the image;

for each given pixel, an incoupler is to receive the output light at an incidence position on and an incidence angle relative to the incoupler based on the field position of the given pixel; and

the adjusting the output light comprises adjusting the output light based on the image correction map to reduce at least one of the intensity non-uniformity and the color balance non-uniformity of the image further caused by variations in the incidence position and the incidence angle from one pixel to another.

8. The method of claim 1 , wherein each image correction map of the plurality of image correction maps is associated with a corresponding position defining a portion of the eyebox and comprises output light adjustment information associated with the portion of the eyebox.

9. A wearable heads-up display (WHUD) comprising:

a light source to generate an output light comprising a plurality of wavelengths and having a plurality of incoupling losses corresponding to the plurality of wavelengths;

a spatial modulator to receive the output light from the light source;

a display optic to receive the output light from the spatial modulator and direct the output light towards an eye of a user of the WHUD to form an image viewable by the user; and

a controller in communication with the light source and the spatial modulator, the controller to:

receive a position of a pupil of the user relative to an eyebox of the WHUD;

obtain an image correction map from a plurality of image correction maps based on the position of the pupil; and

adjust the output light to form an adjusted output light, the adjusted output light adjusted based on the image correction map to reduce at least one of an intensity non-uniformity and a color balance non-uniformity of the image caused by a difference between a first incoupling loss of the plurality of incoupling losses and a second incoupling loss of the plurality of incoupling losses.

10. The WHUD of claim 9 , wherein to receive the position of the pupil the controller is to receive gaze position information of a gaze of the eye of the user, and wherein the WHUD further comprises:

a gaze tracking module to track the gaze of the eye of the user, the gaze tracking module in communication with the controller; and wherein:

to receive the position of the pupil the controller is to receive the gaze position information from the gaze tracking module.

11. The WHUD of claim 10 , wherein:

the controller is to receive an indicator of a region of interest in the image corresponding to the gaze; and

to adjust the output light based on the image correction map the controller is to adjust the output light based on the image correction map to reduce at least one of the intensity non-uniformity and the color balance non-uniformity in the region of interest of the image.

12. The WHUD of claim 9 , wherein:

to obtain the image correction map the controller is to obtain the image correction map further based on an indication of a size of the pupil;

the indication of the size of the pupil comprises an ambient brightness; and

to obtain the image correction map further based on the indication of the size of the pupil the controller is to obtain the image correction map further based on the ambient brightness.

13. The WHUD of claim 12 , further comprising:

an ambient brightness sensor in communication with the controller, the ambient brightness sensor to sense the ambient brightness and to communicate the ambient brightness to the controller.

14. The WHUD of claim 9 , wherein the controller is further to:

control the light source and the spatial modulator to display a plurality of corrected test images to the user; and

receive user input selecting a given corrected test image from the plurality of corrected test images; and wherein:

to obtain the image correction map the controller is to determine the image correction map corresponding to the given corrected test image.

15. The WHUD of claim 9 , wherein:

the image comprises a plurality of pixels, each pixel having a corresponding field position comprising spatial coordinates of the pixel in the image;

for each given pixel, an incoupler is to receive the output light at an incidence position on and an incidence angle relative to the incoupler based on the field position of the given pixel; and

to adjust the output light the controller is to adjust the output light based on the image correction map to reduce at least one of the intensity non-uniformity and the color balance non-uniformity of the image further caused by variations in the incidence position and the incidence angle from one pixel to another.

16. The WHUD of claim 9 , wherein each image correction map of the plurality of image correction maps is associated with a corresponding position defining a portion of the eyebox and comprises output light adjustment information associated with the portion of the eyebox.

17. A wearable heads-up display (WHUD) comprising:

a light source to generate an output light comprising a plurality of wavelengths and having a plurality of incoupling losses corresponding to the plurality of wavelengths, the output light to form an image;

a spatial modulator to receive the output light from the light source;

a light guide;

an incoupler carried by the light guide;

an outcoupler carried by the light guide; and

a controller in communication with the light source and the spatial modulator, the controller to:

obtain an image correction map from a plurality of image correction maps based on a position of a pupil of a user relative to an eyebox of the WHUD being worn by the user, wherein each image correction map of the plurality of image correction maps is associated with a position defining a portion of the eyebox; and

adjust the output light based on the image correction map to reduce at least one of an intensity non-uniformity and a color balance non-uniformity of the image caused by a difference between a first incoupling loss of the plurality of incoupling losses based on a first light bounce position at one or more of the incoupler or light guide and a second incoupling loss of the plurality of incoupling losses based on a second light bounce position at one or more of the incoupler or light guide.

18. The WHUD of claim 17 , wherein:

the output light comprises a first light having a first wavelength and a second light having a second wavelength; and

the incoupler is to direct at least a portion of the first light and at least a portion of the second light into the light guide, the light guide to internally reflect the portion of the first light and the portion of the second light to form a first reflected light and a second reflected light, respectively, the first reflected light incident upon a reflective surface of at least one of the incoupler and the light guide at the first light bounce position and the second reflected light incident upon the reflective surface of at least one of the incoupler and the light guide the second light bounce position, the first light having the first incoupling loss based on the first light bounce position and the second light having the second incoupling loss based on the second light bounce position.

19. The WHUD of claim 17 , wherein:

the image comprises a plurality of pixels, each pixel having a corresponding field position comprising spatial coordinates of the pixel in the image;

for each given pixel, the incoupler is to receive the output light at an incidence position on and an incidence angle relative to the incoupler based on the field position of the given pixel; and

the controller is further to:

adjust the output light based on the image correction map to reduce at least one of the intensity non-uniformity and the color balance non-uniformity of the image further caused by variations in the incidence position and the incidence angle from one pixel to another.

20. The WHUD of claim 17 , wherein the incoupler to receive the output light from the spatial modulator and direct at least a portion of the output light into the light guide, the light guide to internally reflect the portion of the output light to form a reflected light.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2022
From: BODIYA, TIMOTHY PAUL; POTNIS, SHREYAS; NICHOLSON, STUART JAMES MYRON; FLETCHER, BERGEN
To: NORTH INC.
Reel/Frame 059947/0595 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2022
From: NORTH INC.
To: GOOGLE LLC
Reel/Frame 060383/0876 →
Continuity (4)
Continuation 16738074 · Jan 9, 2020
Provisional Application 62904742 · Sep 24, 2019
Provisional Application 62791514 · Jan 11, 2019
Related Publication 20220342221A1 · Oct 27, 2022