IP Library › Granted Patent US 10,162,478

Granted Patent B2

US 10,162,478 · App. 14/878,983 · Granted Dec 25, 2018

Delay of display event based on user gaze

Inventors: Imran Chaudhri (San Francisco, CA); Stephen O. Lemay (Palo Alto, CA)

Assignee: Apple Inc.

G06F3/04817 G06F3/013 G06F3/0481 G06F9/451

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 10,162,478
App. No.: 14/878,983
Granted: Dec 25, 2018
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Methods and systems of delaying the execution of a display event based on a detected user gaze are provided. Display events may be generated and executed to change a user interface of a display. For example, an autocorrect algorithm can automatically replace a typed word with a corrected word in a text field, generating a display event that causes the corrected word to be displayed instead of the typed word. Such a display event may be executed as soon as possible after its generation. However, a gaze detection device can obtain information that indicates a user is not looking at the typed word on the display. In such a situation, it may be more intuitive to delay the execution of the display event until the gaze information indicates that the user is looking at the typed word.

Claims (122)

1. A method comprising:

at an electronic device with a display and a gaze detection device:

displaying, in a target region of the display, one or more words entered by a user of the electronic device;

while displaying the one or more words, receiving a sequence of character inputs;

in response to receiving the sequence of character inputs, displaying, in the target region, a sequence of user-input characters that corresponds to the sequence of character inputs, wherein the sequence of user-input characters has an associated sequence of autocorrect characters that is different from the sequence of user-input characters; and

after displaying the sequence of user-input characters:

determining whether a gaze region of the user of the electronic device, obtained from the gaze detection device, and the target region of the display overlap;

in accordance with a determination that the gaze region and the target region do overlap, replacing, on the display, the sequence of user-input characters with the sequence of autocorrect characters; and

in accordance with a determination that the gaze region and the target region do not overlap, delaying replacing the sequence of user-input characters with the sequence of autocorrect characters.

2. The method of claim 1 , further comprising:

after delaying replacing the sequence of user-input characters with the sequence of autocorrect characters, determining that the gaze region of the user of the electronic device overlaps with the target region of the display; and

in response to determining that the gaze region overlaps with the target region, replacing, on the display, the sequence of user-input characters with the sequence of autocorrect characters.

3. The method of claim 2 , further comprising:

after delaying replacing the sequence of user-input characters with the sequence of autocorrect characters:

receiving a second sequence of character inputs; and

in response to receiving the second sequence of character inputs, displaying, on the display, a second sequence of user-input characters that corresponds to the second sequence of character inputs,

wherein determining that the gaze region overlaps with the target region, and replacing, on the display, the sequence of user-input characters with the sequence of autocorrect characters, occur while displaying, on the display, the second sequence of user-input characters.

4. The method of claim 1 , further comprising:

concurrently displaying the sequence of user-input characters with an autocorrect indicator that includes the sequence of autocorrect characters,

wherein:

replacing, on the display, the sequence of user-input characters with the sequence of autocorrect characters includes ceasing display of the autocorrect indicator, and

delaying replacing the sequence of user-input characters with the sequence of autocorrect characters includes maintaining display of the autocorrect indicator.

5. The method of claim 1 , further comprising:

while displaying the sequence of user-input characters:

receiving a second sequence of character inputs; and

in response to receiving the second sequence of character inputs, displaying, in the target region, a second sequence of user-input characters that corresponds to the second sequence of character inputs, wherein the second sequence of user-input characters has an associated second sequence of autocorrect characters that is different from the second sequence of user-input characters; and

while displaying the sequence of user-input characters and the second sequence of user-input characters:

determining whether the gaze region of the user of the electronic device, obtained from the gaze detection device, and the target region of the display overlap;

in accordance with a determination that the gaze region and the target region do overlap, replacing, on the display:

the sequence of user-input characters with the sequence of autocorrect characters; and

the second sequence of user-input characters with the second sequence of autocorrect characters; and

in accordance with a determination that the gaze region and the target region do not overlap, delaying replacing:

the sequence of user-input characters with the sequence of autocorrect characters; and

the second sequence of user-input characters with the second sequence of autocorrect characters.

6. The method of claim 5 , further comprising:

after delaying replacing the sequence of user-input characters with the sequence of autocorrect characters and the second sequence of user-input characters with the second sequence of autocorrect characters, determining that the gaze region of the user of the electronic device overlaps with the target region of the display; and

in response to determining that the gaze region overlaps with the target region, replacing, on the display:

the sequence of user-input characters with the sequence of autocorrect characters; and

the second sequence of user-input characters with the second sequence of autocorrect characters.

7. The method of claim 1 , wherein the target region includes an entirety of the display.

8. A non-transitory computer readable storage medium having stored therein instructions, which when executed by an electronic device with a display and a gaze detection device, cause the electronic device to perform a method comprising:

displaying, in a target region of the display, one or more words entered by a user of the electronic device;

while displaying the one or more words, receiving a sequence of character inputs;

after displaying the sequence of user-input characters:

determining whether a gaze region of the user of the electronic device, obtained from the gaze detection device, and the target region of the display overlap;

in accordance with a determination that the gaze region and the target region do not overlap, delaying replacing the sequence of user-input characters with the sequence of autocorrect characters.

9. The non-transitory computer readable storage medium of claim 8 , the method further comprising:

in response to determining that the gaze region overlaps with the target region, replacing, on the display, the sequence of user-input characters with the sequence of autocorrect characters.

10. The non-transitory computer readable storage medium of claim 9 , the method further comprising:

after delaying replacing the sequence of user-input characters with the sequence of autocorrect characters:

receiving a second sequence of character inputs; and

in response to receiving the second sequence of character inputs, displaying, on the display, a second sequence of user-input characters that corresponds to the second sequence of character inputs,

11. The non-transitory computer readable storage medium of claim 8 , the method further comprising:

concurrently displaying the sequence of user-input characters with an autocorrect indicator that includes the sequence of autocorrect characters,

wherein:

replacing, on the display, the sequence of user-input characters with the sequence of autocorrect characters includes ceasing display of the autocorrect indicator, and

delaying replacing the sequence of user-input characters with the sequence of autocorrect characters includes maintaining display of the autocorrect indicator.

12. The non-transitory computer readable storage medium of claim 8 , the method further comprising: