IP Library Granted Patent US 11,698,530
Granted Patent B2
US 11,698,530 · App. 17/027,521 · Granted Jul 11, 2023

Switch leakage compensation for global illumination

Inventors: Min Hyuk Choi (San Jose, CA); Zhiming Zhuang (Sammamish, WA); Wonjae Choi (San Jose, CA)
Assignee: Meta Platforms Technologies, LLC
G02B27/0172G02B27/0093G06F3/013G06F3/015G09G3/3233G02B2027/014G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,698,530
App. No.
17/027,521
Filed
Sep 21, 2020
Granted
Jul 11, 2023
Kind
B2
Art Unit
2691
USPC
345/8
Abstract

A method of leakage-compensated global illumination comprises obtaining position data for at least one of a head or an eye of a user of a display system by an application processor, rendering image data for an image frame by the application processor based on the position data, modifying the image data to compensate for leakage associated with a global illumination by a display of the display system, and sending the image data to a display driver circuit of the display system for displaying the image frame on the display through the global illumination.

Claims (53)

1. A method comprising:

obtaining, by an application processor, position data for at least one of a head or an eye of a user of a display system;

rendering, by the application processor based on the position data, image data for an image frame;

modifying pixel values for each row of pixels of the image data for the image frame based on a time delay between a loading time of the row of pixels of the image data for the image frame and a time of a global illumination of the image frame, and using a pre-determined leakage current of a transistor of a driving circuit for a pixel in the row of pixels to compensate for leakage associated with the global illumination of the image frame by a display of the display system, wherein the pre-determined leakage current is a predicted leakage current between a drain and a source of the transistor of the driving circuit determined according to a voltage on a gate of the transistor and a voltage between the source and the drain of the transistor; and

sending the image data to a display driver circuit of the display system for displaying the image frame on the display through the global illumination.

2. The method of claim 1 , further comprising, before modifying the image data, re-projecting, based on updated position data, the image data rendered by the application processor.

3. The method of claim 1 , further comprising, before modifying the image data:

estimating a position of at least one of the head or the eye of the user at the time of the global illumination; and

re-projecting, based on the estimated position of at least one of the head or the eye of the user, the image data rendered by the application processor.

4. The method of claim 1 , further comprising, before modifying the image data:

obtaining a new position of at least one of the head or the eye of the user at a time after the image data is rendered; and

re-projecting, based on the new position of at least one of the head or the eye of the user, the image data rendered by the application processor.

5. The method of claim 1 , further comprising:

estimating, based on the position data, a position of at least one of the head or the eye of the user at the time of the global illumination,

wherein rendering the image data by the application processor comprises rendering the image data based on the estimated position of at least one of the head or the eye of the user at the time of the global illumination.

6. The method of claim 1 , further comprising:

loading the image data into pixel driving circuits of the display system; and

turning on, by the display driver circuit, pixels of the display system for the global illumination.

7. The method of claim 1 , wherein obtaining the position data for at least one of the head or the eye of the user includes receiving the position data from at least one of a head-tracking sensor or an eye-tracking sensor.

8. The method of claim 1 , wherein rendering the image data for the image frame comprises:

executing an application based on the position data to determine a scene for the eye of the user; and

converting the scene for the eye of the user to drawing commands.

9. A display system comprising:

a display including a plurality of light sources and corresponding light source driving circuits, the plurality of light sources arranged in a plurality of rows;

a display driver circuit coupled to the display; and

an application processor coupled to the display driver circuit and configured to:

obtain position data for at least one of a head or an eye of a user of the display system;

render, based on the position data, image data for an image frame;

modify pixel values for each row of pixels of the image data for the image frame based on a time delay between a loading time of the row of pixels of the image data for the image frame and a time of a global illumination of the image frame, and using a pre-determined leakage current of a transistor of a driving circuit for a pixel in the row of, to compensate for leakage associated with the global illumination of the image frame by the display, wherein the pre-determined leakage current is a predicted leakage current between a drain and a source of the transistor of the driving circuit determined according to a voltage on a gate of the transistor and a voltage between the source and the drain of the transistor; and

send the image data to the display driver circuit for displaying the image frame on the display through the global illumination.

10. The display system of claim 9 , wherein the application processor is further configured to, before modifying the image data, re-project the image data based on updated position data.

11. The display system of claim 9 , wherein the application processor is further configured to, before modifying the image data:

estimate a position of at least one of the head or the eye of the user at the time of the global illumination; and

re-project the image data based on the estimated position of at least one of the head or the eye of the user.

12. The display system of claim 9 , wherein the application processor is further configured to, before modifying the image data:

obtain a new position of at least one of the head or the eye of the user at a time after the image data is rendered; and

re-project the image data based on the new position of at least one of the head or the eye of the user.

13. The display system of claim 9 , wherein the application processor is configured to:

estimate, based on the position data, a position of at least one of the head or the eye of the user at the time of the global illumination; and

render the image data based on the estimated position of at least one of the head or the eye of the user.

14. The display system of claim 9 , wherein the application processor is configured to render the image data for the image frame by:

executing an application based on the position data to determine a scene for the eye of the user; and

converting the scene for the eye of the user to drawing commands.

15. The display system of claim 9 , wherein the display driver circuit is configured to:

load the image data into the corresponding light source driving circuits for the plurality of light sources; and

control the corresponding light source driving circuits to turn on the plurality of light sources for the global illumination.

16. The display system of claim 9 , wherein the application processor includes at least one of a central processing unit or a graphic processing unit.

17. The display system of claim 9 , wherein the plurality of light sources includes an array of organic light emitting diodes (OLEDs) or an array of micro-light emitting diodes (micro-LEDs).

18. A non-transitory machine-readable storage medium including instructions stored thereon, the instructions, when executed by one or more processors, cause the one or more processors to perform operations including:

obtaining position data for at least one of a head or an eye of a user of a display system;

rendering, based on the position data, image data for an image frame;

modifying pixel values for each row of pixels of the image data for the image frame based on a time delay between a loading time of the row of pixels of the image data for the image frame and a time of a global illumination of the image frame, and using a pre-determined leakage current of a transistor of a driving circuit for a pixel in the row of pixels, to compensate for leakage associated with the global illumination of the image frame by a display of the display system, wherein the pre-determined leakage current is a predicted leakage current between a drain and a source of the transistor of the driving circuit determined according to a voltage on a gate of the transistor and a voltage between the source and the drain of the transistor; and

sending the image data to a display driver circuit of the display system for displaying the image frame on the display through the global illumination.

Assignments (2)
CHANGE OF NAME Recorded May 19, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060130/0404 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2020
From: CHOI, MIN HYUK; ZHUANG, ZHIMING; CHOI, WONJAE
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 053836/0275 →
Continuity (1)
Related Publication 20220091418A1 · Mar 24, 2022