IP Library Granted Patent US 12,197,643
Granted Patent B2
US 12,197,643 · App. 18/456,307 · Granted Jan 14, 2025

Electronic devices with display operation based on eye activity

Inventors: Mehmet N. Agaoglu (Dublin, CA); Andrew B. Watson (Los Gatos, CA)
Assignee: Apple Inc.
G06F3/013G02B27/0172G06F1/3265G09G2320/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,197,643
App. No.
18/456,307
Granted
Jan 14, 2025
Kind
B2
Abstract

An electronic device may have a display for displaying image content. Head-mounted support structures in the device may be used to support the display. The electronic device may have an eye monitoring system that detects eye saccades and eye blinks. Control circuitry in the electronic device may coordinate operation of the display with periods of suppressed visual sensitivity that are associated with the saccades and blinks. By making adjustments to display circuitry and image content during periods of suppressed visual sensitivity, potentially visually obtrusive changes to displayed images can be hidden from a user of the electronic device. Adjustments to display operation may help reduce burn-in effects, may help reduce power consumption, and may otherwise improve device performance.

Claims (27)

1. An electronic device, comprising:

a display comprising an array of pixels configured to display an image; and

an eye monitor configured to detect eye activity, wherein the display is configured to be adjusted by shifting pixels of the displayed image in response to the eye activity to reduce image burn-in effects on the display while the array of pixels is displaying the image.

2. The electronic device of claim 1 , wherein the eye activity comprises a blinking time in which an eye is closed, and the display is configured to be adjusted entirely within the blinking time.

3. The electronic device of claim 2 , wherein the blinking time is between 200 ms and 500 ms.

4. The electronic device of claim 2 , wherein the display is configured to be adjusted by adjusting image data values for the display.

5. The electronic device of claim 1 , wherein the eye activity comprises a saccade, and the display is configured to be adjusted entirely during the saccade.

6. The electronic device of claim 1 , wherein the display is configured to be adjusted by shifting the pixels of the displayed image by at least 10 pixels.

7. The electronic device of claim 1 , wherein the display is configured to be adjusted by displaying images with complementary burn-in correcting pixel values during the eye activity.

8. The electronic device of claim 1 , wherein the display is configured to be adjusted by applying a geometric image transform to the image displayed by the display during the eye activity.

9. The electronic device of claim 1 , wherein the eye monitor comprises an infrared light source and an infrared light detector to detect eye blinks and saccades.

10. The electronic device of claim 1 , wherein the eye monitor comprises a camera configured to detect eye blinks.

11. The electronic device of claim 1 , wherein the display is configured to be adjusted by displaying a scrambled image in response to the eye activity.

12. The electronic device of claim 1 , wherein the display is configured to display a first image and wherein the display is configured to be adjusted by displaying a second image, different than the first image, in response to the eye activity.

13. The electronic device of claim 1 , wherein the image comprises image light.

14. An electronic device, comprising:

head-mounted support structures;

an eye monitoring system coupled to the head-mounted support structures, wherein the eye monitoring system is configured to detect a blink or saccade; and

a display coupled to the head-mounted support structures, wherein a luminance of the display is configured to be increased in response to the blink or saccade.

15. The electronic device of claim 14 , wherein a color cast of the display is configured to be adjusted in response to the blink or saccade.

16. The electronic device of claim 14 , wherein the display comprises a backlight unit, and wherein increasing the luminance of the display comprises increasing an amount of light output by the backlight unit.

17. The electronic device of claim 14 , wherein increasing the luminance of the display comprises adjusting image data values for the display.

18. An electronic device, comprising:

a display configured to display images; and

an eye monitoring system configured to detect eye activity, wherein a white point of the display is configured to be adjusted during the eye activity.

19. The electronic device of claim 18 , wherein the white point of the display is configured to be adjusted incrementally during consecutive eye activities detected by the eye monitor.

20. The electronic device of claim 19 , wherein the white point of the display is configured to be adjusted when the electronic device moves from a first environment with ambient light of a first color to a second environment with ambient light of a second color that is different from the first color.

Continuity (4)
Continuation 17063382 · Oct 5, 2020
Continuation 16443214 · Jun 17, 2019
Provisional Application 62697286 · Jul 12, 2018
Related Publication 20230400921A1 · Dec 14, 2023
References Cited (47)
US 8225229B2 · Thorn et al. · 2012 [cited by applicant]
US 8687840B2 · Singhar et al. · 2014 [cited by applicant]
US 9355612B1 · Shepard · 2016 [cited by examiner]
US 9361833B2 · Kamhi · 2016 [cited by applicant]
US 9378695B2 · Kim et al. · 2016 [cited by applicant]
US 9874933B1 · Carryer · 2018 [cited by applicant]
US 10082870B2 · Thunström et al. · 2018 [cited by applicant]
US 10229540B2 · Bavor, Jr. et al. · 2019 [cited by applicant]
US 10255874B2 · Wang · 2019 [cited by applicant]
US 10353464B2 · Skogöet al. · 2019 [cited by applicant]
US 10359631B2 · Samec et al. · 2019 [cited by applicant]
US 10802585B2 · Agaoglu et al. · 2020 [cited by applicant]
US 20070046815A1 · Lee · 2007 [cited by examiner]
US 20120288139A1 · Singhar · 2012 [cited by examiner]
US 20140092006A1 · Boelter et al. · 2014 [cited by applicant]
US 20140247216A1 · Fang · 2014 [cited by applicant]
US 20150029096A1 · Ishihara · 2015 [cited by applicant]
US 20150169053A1 · Bozarth et al. · 2015 [cited by applicant]
US 20150187253A1 · Kimura · 2015 [cited by applicant]
US 20160035320A1 · Yoon et al. · 2016 [cited by applicant]
US 20160131911A1 · Border et al. · 2016 [cited by applicant]
US 20160334868A1 · Pacheco et al. · 2016 [cited by applicant]
US 20170255259A1 · Mor · 2017 [cited by examiner]
US 20170285735A1 · Young · 2017 [cited by examiner]
US 20170285736A1 · Young et al. · 2017 [cited by applicant]
US 20180053284A1 · Rodriguez et al. · 2018 [cited by applicant]
US 20180314325A1 · Gibson et al. · 2018 [cited by applicant]
US 20180335836A1 · Miller · 2018 [cited by examiner]
US 20190235247A1 · Norden · 2019 [cited by applicant]
US 20190287493A1 · Neustein · 2019 [cited by applicant]
US 20210142443A1 · Eble et al. · 2021 [cited by applicant]
US 20240095879A1 · Gapel et al. · 2024 [cited by applicant]
CN 1925579A · 2007 [cited by applicant]
CN 102054399A · 2011 [cited by applicant]
CN 102928979A · 2013 [cited by applicant]
CN 106462370A · 2017 [cited by applicant]
CN 107430439A · 2017 [cited by applicant]
CN 108028910A · 2018 [cited by applicant]
CN 108136258A · 2018 [cited by applicant]
CN 109074785A · 2018 [cited by applicant]
EP 1847978A2 · 2007 [cited by applicant]
EP 3109689A1 · 2016 [cited by applicant]
JP 2016000510A · 2016 [cited by applicant]
WO 2017040214A1 · 2017 [cited by applicant]
Lang, Ben, Researchers Exploit Natural Quirk of Human Vision for Hidden Redirected Walking in VR, Apr. 27, 2018, [retrieved May 29, 2018]. Retrieved from the Internet <roadtovr.com/researchers-exploit-natural-quirk-of-h… [cited by applicant]
B.S. Sourab et al., Implementation of Home Automation using Eye Blink Sensor, 2014 International Conference on Electronics, Communication and Computational Engineering (ICECCE), 2014, pp. 242-244, IEEE, New York, New Yo… [cited by applicant]
Yue Peng et al., Design principle of an eye-movement brain-computer interface, Advances in computer technology and applications, 2006, China Academic Journal Electronic Publishing House, Beijing, China. [cited by applicant]