IP Library Granted Patent US 11,009,944
Granted Patent B1
US 11,009,944 · App. 16/521,522 · Granted May 18, 2021

Systems and methods for displaying foveated images

Inventors: Min Hyuk Choi (San Jose, CA); Cheonhong Kim (Mountain View, CA); Youngshik Yoon (Cupertino, CA)
Assignee: Facebook Technologies, LLC
G06F3/013G09G3/2003G09G3/3266G09G3/3275G09G2300/0804G09G2310/0243G09G2310/08G09G2340/0407G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,009,944
App. No.
16/521,522
Granted
May 18, 2021
Kind
B1
Abstract

In one embodiment, a computing system may determine a first region and a second region of an image based on gaze data of a user. The second region may be displayed with lower image resolution than the first region. The system may access a first pixel value associated with the first region of the image. The system may cause a first source driver circuit of a display to generate a first pixel signal. The first pixel signal may be configured to control a luminance of a first number of pixels. The system may access a second pixel value associated with the second region of the image. The system may cause a second source driver circuit of the display to generate a second pixel signal which may be configured to control a luminance of a second number of pixels. The second number may be larger than the first number.

Claims (43)

1. A method comprising, by a computing system:

determining a first region and a second region of an image based on gaze data of a user, wherein the second region of the image is to be displayed with lower image resolution than the first region of the image;

accessing a first pixel value associated with the first region of the image;

causing a first gate driver circuit of a display to generate a first clock signal for the first pixel value, the first clock signal being configured to control a luminance of a first number of pixels of the display;

accessing a second pixel value associated with the second region of the image; and

causing a second gate driver circuit of the display to generate a second clock signal for the second pixel value, the second clock signal being configured to control a luminance of a second number of pixels of the display, wherein the second number is larger than the first number, and wherein the second clock signal comprises a longer pulse duration than the first clock signal.

2. The method of claim 1 , wherein the gaze data comprises a gazing point of the user, wherein the first region of the image corresponds to a first display region encompassing the gazing point of the user, and wherein the second region of the image corresponds to a second display region excluding the first display region.

3. The method of claim 2 , wherein the first number of pixels of the display are within the first display region, and wherein the second number of pixels of the display are within the second display region.

4. The method of claim 2 , wherein the gazing point of the user is determined based on one or more sensors embedded in the display, and wherein one or more of the sensors are embedded in the display at one or more transparent areas of the display.

5. The method of claim 1 , further comprising:

causing a first source driver circuit of the display to generate a first pixel signal corresponding to the first pixel value, the first pixel signal being configured to control the luminance of the first number of pixels of the display; and

causing a second source driver circuit of the display to generate a second pixel signal corresponding to the second pixel value, the second pixel signal being configured to control the luminance of the second number of pixels of the display, wherein the first pixel signal and the second pixel signal comprise respective signal amplitudes corresponding to the first pixel value and the second pixel value.

6. The method of claim 5 , wherein the second number of pixels comprise pixels from two or more pixel columns associated with a color channel, and wherein the second pixel signal is routed to the two or more pixel columns through a switch.

7. The method of claim 5 , wherein the second pixel signal comprises a longer pulse duration than the first pixel signal.

8. The method of claim 5 , wherein the first pixel signal has a signal amplitude corresponding to the first pixel value.

9. The method of claim 5 , wherein the second pixel signal has a signal amplitude corresponding to the second pixel value.

10. The method of claim 5 , wherein the second number of pixels comprise pixels associated with one or more pixel rows, and wherein the second pixel signal is routed to the one or more pixel rows through a switch.

11. The method of claim 1 , wherein the second number of pixels comprise pixels from two or more pixel rows, and wherein the second clock signal is routed to the two or more pixel rows through a switch.

12. The method of claim 1 , wherein the first number of pixels of the display comprise one or more pixels.

13. The method of claim 1 , wherein the first number of pixels of the display comprise two or more pixels.

14. The method of claim 1 , wherein the second number of pixels comprise pixels associated with two or more pixel columns, and wherein the second clock signal is routed to the two or more pixel columns through a switch.

15. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

determine a first region and a second region of an image based on gaze data of a user, wherein the second region of the image is to be displayed with lower image resolution than the first region of the image;

access a first pixel value associated with the first region of the image;

cause a first gate driver circuit of a display to generate a first clock signal for the first pixel value, the first clock signal being configured to control a luminance of a first number of pixels of the display;

access a second pixel value associated with the second region of the image; and

cause a second gate driver circuit of the display to generate a second clock signal for the second pixel value, the second clock signal being configured to control a luminance of a second number of pixels of the display, wherein the second number is larger than the first number, and wherein the second clock signal comprises a longer pulse duration than the first clock signal.

16. The media of claim 15 , wherein the gaze data comprises a gazing point of the user, wherein the first region of the image corresponds to a first display region encompassing the gazing point of the user, and wherein the second region of the image corresponds to a second display region excluding the first display region.

17. The media of claim 15 , further embodying software that is operable when executed to:

cause a first source driver circuit of the display to generate a first pixel signal corresponding to the first pixel value, the first pixel signal being configured to control the luminance of the first number of pixels of the display; and

cause a second source driver circuit of the display to generate a second pixel signal corresponding to the second pixel value, the second pixel signal being configured to control the luminance of the second number of pixels of the display, wherein the second pixel signal comprises a longer pulse duration than the first pixel signal.

18. A system comprising:

one or more processors; and

one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:

determine a first region and a second region of an image based on gaze data of a user, wherein the second region of the image is to be displayed with lower image resolution than the first region of the image;

access a first pixel value associated with the first region of the image;

cause a first gate driver circuit of a display to generate a first clock signal for the first pixel value, the first clock signal being configured to control a luminance of a first number of pixels of the display;

access a second pixel value associated with the second region of the image; and

cause a second gate driver circuit of the display to generate a second clock signal for the second pixel value, the second clock signal being configured to control a luminance of a second number of pixels of the display, wherein the second number is larger than the first number, and wherein the second clock signal comprises a longer pulse duration than the first clock signal.

19. The system of claim 18 , wherein the gaze data comprises a gazing point of the user, wherein the first region of the image corresponds to a first display region encompassing the gazing point of the user, and wherein the second region of the image corresponds to a second display region excluding the first display region.

20. The system of claim 18 , wherein the system is further configured to:

cause a first source driver circuit of the display to generate a first pixel signal corresponding to the first pixel value, the first pixel signal being configured to control the luminance of the first number of pixels of the display; and

cause a second source driver circuit of the display to generate a second pixel signal corresponding to the second pixel value, the second pixel signal being configured to control the luminance of the second number of pixels of the display, wherein the second pixel signal comprises a longer pulse duration than the first pixel signal.

Assignments (2)
CHANGE OF NAME Recorded Jul 6, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060591/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2019
From: CHOI, MIN HYUK; KIM, CHEONHONG; YOON, YOUNGSHIK
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 049872/0644 →