IP Library Granted Patent US 10,861,415
Granted Patent B2
US 10,861,415 · App. 16/103,684 · Granted Dec 8, 2020

Display device with throughput calibration

Inventors: Yijing Fu (Redmond, WA); Pasi Saarikko (Kirkland, WA); Hee Yoon Lee (Bellevue, WA); Wanli Chi (Sammamish, WA)
Assignee: FACEBOOK TECHNOLOGIES, LLC
G09G5/06G02B6/0036G02B6/10G02B6/27G02B27/00G02B27/0172G02B27/0179G02B2027/0123G02B2027/0138G02B2027/0178G02B2027/0187G09G2320/0242G09G2320/0666G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,861,415
App. No.
16/103,684
Granted
Dec 8, 2020
Kind
B2
Abstract

A wearable display device and a calibration method for the wearable display device are provided. The wearable display device or its component(s) may exhibit optical throughput dependent on beam angle or beam coordinate at the eyebox. The linear or angular dependencies of throughput may be accounted for when generating an image to be displayed, to lessen or offset these dependencies during operation of the wearable display.

Claims (38)

1. A near-eye display (NED) comprising:

an image projector for providing image light comprising a channel;

a waveguide pupil expander coupled to the image projector for relaying the image light to an eyebox of the NED, wherein throughput of the waveguide pupil expander has a dependence on a beam coordinate and a beam angle at the eyebox;

an eye tracking system for providing a position of a pupil of the user's eye at the eyebox; and

a controller operably coupled to the image projector and the eye tracking system and configured to adjust an angular distribution of optical power density of the channel of the image light depending on the position of the pupil of the user's eye at the eyebox, to at least partially offset the dependence of throughput of the waveguide pupil expander on the beam coordinate and the beam angle.

2. The NED of claim 1 , wherein the eye tracking system is configured to provide at least one of position or orientation of a user's eye at the eyebox, wherein the controller is configured to adjust the angular distribution of optical power density of the channel depending on the at least one of position or orientation of the user's eye determined by the eye tracking system.

3. The NED of claim 2 , wherein the controller is configured to use the at least one of the position or orientation of the user's eye to determine the position of the pupil of the user's eye at the eyebox.

4. The NED of claim 1 , wherein the channel comprises at least one of a color channel or a luminance channel.

5. The NED of claim 1 , wherein the image light comprises a plurality of color channels including the channel, wherein throughput of the waveguide pupil expander for each color channel has an angular dependence, whereby the waveguide pupil expander has an angular-dependent color transfer function variation; and

wherein the controller is configured to adjust the angular distribution of optical power density of at least one of the plurality of color channels to at least partially offset the angular-dependent color transfer function variation of the waveguide pupil expander.

6. The NED of claim 5 , wherein the controller is configured to adjust the angular distribution of optical power density of the at least one of the plurality of color channels depending on the pupil position of the user's eye determined by the eye tracking system.

7. The NED of claim 1 ,

wherein the channel comprises a color channel, and wherein the waveguide pupil expander has a color transfer function having a dependence on the pupil position, and wherein the controller is configured to:

obtain an image to be displayed by the NED; and

modify a color distribution of the image to at least partially offset the dependence of the color transfer function of the waveguide pupil expander on the pupil position determined by the eye tracking system.

8. The NED of claim 7 , further comprising memory having stored thereon data for modifications of the color distribution of the image at each pupil position at the eyebox;

wherein the controller is operably coupled to the memory for retrieving at least a portion of the data corresponding to the pupil position determined by the eye tracking system, for modifying the color distribution of the image to at least partially offset the dependence of the color transfer function on the pupil position.

9. The NED of claim 8 , wherein the data comprises a look-up table.

10. The NED of claim 1 , wherein the waveguide pupil expander comprises a two-dimensional (2D) waveguide pupil expander.

11. A display device comprising:

an electronic display comprising a plurality of pixels for providing a plurality of light beams in accordance with image data received by the electronic display;

an optics block configured to receive the plurality of light beams and to provide the plurality of light beams to an eyebox of the display device, such that an angle of a first light beam of the plurality of light beams at the eyebox corresponds to a coordinate of a corresponding first pixel of the plurality of pixels of the electronic display, wherein throughput of the optics block for the first light beam has a dependence on a beam coordinate and a beam angle of the first light beam at the eyebox;

an eye tracking system for providing a position of a pupil of the user's eye at the eyebox; and

a controller operably coupled to the electronic display and the eye tracking system and configured to modify the image data by at least one of: pre-emphasizing an image to be displayed in areas of low throughput; or attenuating the image in areas of high throughput, depending on the position of the pupil of the user's eye at the eyebox provided by the eye tracking system, so as to at least partially offset the dependence of the throughput of the optics block on the beam coordinate and the beam angle.

12. The display device of claim 11 , wherein the eye tracking system is configured to determine at least one of position and orientation of a user's eye at the eyebox; and

wherein the controller is configured to update the image data so as to at least partially offset the dependence of the throughput on the coordinate and the angle of the first light beam, by taking into account the at least one of position and orientation of the user's eye determined by the eye tracking system.

13. The display device of claim 12 , wherein the electronic display comprises a plurality of color channels, wherein the throughput of the optics block has a dependence on the coordinate and the angle of the first light beam for each color channel; and

wherein the controller is configured to update the image data on per color channel basis, to at least partially offset the dependence of the throughput of the optics block on the coordinate and the angle of the first light beam for each color channel, by taking into account the at least one of position and orientation of a user's eye determined by the eye tracking system.

14. The display device of claim 11 , wherein the optics block comprises a waveguide pupil expander.

15. A method for providing an image, the method comprising:

providing image light at an input pupil of a pupil expander, the image light comprising a channel;

obtaining an angular distribution of optical power density of the channel at a plurality of locations at an output pupil of the pupil expander;

determining an angular dependence of throughput of the pupil expander from the obtained angular distribution at each one of the plurality of locations; and

adjusting an image to be displayed to at least partially offset the determined angular dependence of throughput of the pupil expander depending on a position of a pupil of a user's eye at an eyebox determined by an eye tracking system.

16. The method of claim 15 , wherein determining the angular dependence of throughput at the first location comprises placing a camera at the first location and obtaining a first image with the camera.

17. The method of claim 15 , wherein determining the angular dependence of throughput at the plurality of locations comprises placing a camera at each location and obtaining a corresponding image with the camera.

18. The method of claim 15 , wherein the pupil expander comprises a waveguide pupil expander.

19. The method of claim 15 , wherein the channel comprises at least one of a color channel or a luminance channel.

Assignments (2)
CHANGE OF NAME Recorded Jan 20, 2023
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 062444/0855 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2020
From: FU, YIJING; SAARIKKO, PASI; LEE, HEE YOON; CHI, WANLI
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 051414/0228 →
Continuity (1)
Related Publication 20200058266A1 · Feb 20, 2020