IP Library Granted Patent US 11,887,550
Granted Patent B2
US 11,887,550 · App. 17/639,406 · Granted Jan 30, 2024

Viewing-angle-dependent color/brightness correction for display system

Inventors: Patrick Llull (Mountain View, CA); John D. Perreault (Mountain View, CA); Andrew Huibers (Los Altos, CA)
Assignee: GOOGLE LLC
G09G3/3426G06F3/012G06F3/013G09G5/026G09G2320/028G09G2320/0285
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,887,550
App. No.
17/639,406
Granted
Jan 30, 2024
Kind
B2
Abstract

A display system including a tracking subsystem configured to track one of a pose of a head of a viewer or a pose of an eye of the viewer. The display system further includes an image correction module configured to, for each pixel of at least a subset of pixels of an input image, determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye, determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image. The display system further includes a display panel to display the angle-corrected image.

Claims (44)

1. A display system comprising:

a tracking subsystem configured to track at least one of a pose of a head or a pose of an eye of a viewer;

an image correction module configured to:

for each pixel of at least a subset of pixels of an input image:

determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye;

determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and

provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image; and

apply at least one of a spatial dithering pattern or a temporal dithering pattern to corrected pixel values of the angle-corrected image; and

a display panel to display the angle-corrected image.

2. The display system of claim 1 , wherein the corrected pixel value represents a corrective adjustment to counteract a viewing-angle-dependent brightness or color response of a corresponding pixel of the display panel.

3. The display system of claim 1 , wherein the corrected pixel value is at least one of luminance or color.

4. The display system of claim 1 , further comprising:

a correction transform component configured based on relationships between pixel luminance and view angle of a pixel of the display panel for a plurality of pixel values; and

wherein the image correction module determines the corrected pixel value using the correction transform.

5. The display system of claim 4 , wherein the relationships are determined based on one of empirical measurement, simulation, or modeling of the display panel.

6. The display system of claim 4 , wherein the correction transform component comprises one of a look up table or an analytical function.

7. The display system of claim 1 , wherein the image correction module is configured to use an activation function to selectively correct the input pixel value.

8. The display system of claim 1 , wherein the image correction module is configured to pre-darken pixel values of one of the input image or the angle-corrected image using one of: a uniform pre-darkening of the pixel values based on the pose of the head or the pose of the eye; and a static pre-darkening of the pixel values based on positions of pixels within the input image.

9. The display system of claim 8 , further comprising:

a backlight comprising a plurality of independently-controllable segments, wherein the backlight is controlled to compensate for the pre-darkening of the pixel values on a segment-by-segment basis.

10. The display system of claim 1 , wherein the display panel comprises a display panel of one of: a television; a smartphone; a tablet computer; a notebook computer; a computer monitor, a near-eye display device; and a lightfield display device.

11. The display system of claim 1 , wherein the tracking subsystem comprises a camera-based head-tracking subsystem.

12. A method for implementation in a display system, the method comprising:

tracking at least one of a pose of a viewer's head or a pose of a viewer's eye;

for each pixel of at least a subset of pixels of an input image:

determining a pixel view angle for the pixel based on the pose of the viewer's head or the pose of the viewer's eye;

determining a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and

providing the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image;

applying at least one of a spatial dithering pattern or a temporal dithering pattern to corrected pixel values of the angle-corrected image; and

providing the angle-corrected image for display at a display panel of the display system.

13. The method of claim 12 , wherein the corrected pixel value represents an corrective adjustment to counteract an viewing-angle-dependent brightness or color response of the corresponding pixel of the display panel.

14. The method of claim 12 , wherein the corrected pixel value is at least one of a luminance value or a color value.

15. The method of at least one of claim 12 , further comprising:

configuring a correction transform component based on relationships between pixel luminance and view angle of a pixel of the display panel for a plurality of pixel values; and

wherein determining the corrected pixel value comprises determining the corrected pixel value using the correction transform.

16. The method of claim 15 , further comprising:

determining the relationships based on one of empirical measurement, simulation, or modeling of the display panel.

17. The method of claim 12 , further comprising:

selectively correcting the input pixel value based on an activation function.

18. The method of claim 12 , further comprising:

pre-darkening pixel values of one of the input image or the angle-corrected image using one of: a uniform pre-darkening of the pixel values based on the pose of the viewer's head or the pose of the viewer's eye; and a static pre-darkening of the pixel values based on positions of pixels within the input image.

19. The method of claim 18 , further comprising:

controlling individually-controllable segments of a backlight to compensate for the pre-darkening of the pixel values on a segment-by-segment basis.

20. The method of claim 12 , wherein the display panel comprises a display panel of one of: a television; a smartphone; a tablet computer; a notebook computer; a computer monitor, a near-eye display device; and a lightfield display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2022
From: LLULL, PATRICK; PERREAULT, JOHN D.; HUIBERS, ANDREW
To: GOOGLE LLC
Reel/Frame 059170/0674 →
Continuity (1)
Related Publication 20220319453A1 · Oct 6, 2022
Cited By (1)
US 12,542,100