IP Library Granted Patent US 9,304,586
Granted Patent B2
US 9,304,586 · App. 14/573,502 · Granted Apr 5, 2016

Eye-typing term recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,304,586
App. No.
14/573,502
Granted
Apr 5, 2016
Kind
B2
Abstract

Various embodiments related to entering text into a computing device via eye-typing are disclosed. For example, one embodiment provides a method that includes receiving a data set including a plurality of gaze samples, each gaze sample including a gaze location and a corresponding point in time. The method further comprises processing the plurality of gaze samples to determine one or more likely terms represented by the data set.

Claims (50)

1. A computing device, comprising:

a logic subsystem, and

a data-holding subsystem comprising instructions executable by the logic subsystem to

receive a data set comprising a plurality of gaze samples, each gaze sample comprising a gaze location and a corresponding point in time;

process the plurality of gaze samples to determine one or more likely terms represented by the data set by comparing the plurality of gaze samples to a layout of user input keys displayed on a display, and

based on overlapping user input key and gaze locations and a length of time spent gazing at each user input key, assign a per-key score to a plurality of user input keys for each gaze sample; and

provide the one or more likely terms to a display device for display.

2. The computing device of claim 1 , wherein the data set is received from a remote device via a network.

3. The computing device of claim 1 , wherein the instructions are executable to receive the data set by

receiving a trigger input indicating an initiation of eye-typing input;

receiving the plurality of gaze samples from one or more image sensors; and

receiving an input signaling an end of the eye-typing input, wherein the corresponding point in time is a time from the trigger.

4. The computing device of claim 1 , wherein the instructions are further executable to, based on the per-key scores, compile a string likelihood score for each character string in a character string database.

5. The computing device of claim 4 , wherein the instructions are executable to compile the string likelihood score such that the string likelihood score rewards character strings including two or more characters in a similar order to an order in which corresponding user input keys received a user gaze.

6. The computing device of claim 1 , wherein the instructions are further executable to present to the user one or more character strings having a high string likelihood score as the one or more likely terms.

7. The computing device of claim 1 , wherein the instructions are further executable to convert a set of per-key scores to one or more intervals in time, and assign an interval score to each interval.

8. The computing device of claim 7 , wherein the instructions are further executable to

compile a directed graph of one or more characters, each character corresponding to a user input key having an interval score above a threshold over a period of time; and

compare each character string from a character string database to the directed graph, and send to the display one or more character strings that match a path from the directed graph to be displayed as the one or more likely terms.

9. The computing device of claim 1 , wherein the instructions are further executable to

display the one or more likely terms via a display;

receive a gaze sample indicative of a selection of one of the one or more likely terms; and

request from a service information relating to the selected term.

10. A computing device, comprising:

a display;

a logic subsystem comprising a processor configured to execute instructions; and

a storage subsystem comprising instructions executable by the logic subsystem to receive a trigger input indicating initiation of eye-typing;

receive a plurality of gaze samples each comprising a gaze location and a corresponding time from the trigger;

receive an input signaling an end of the eye-typing input;

compare the plurality of gaze samples to a layout of user input keys displayed on the display, and based on overlapping user input key and gaze locations, assigning a per-key score to each user input key for each point in time;

based on the per-key scores, compile a string likelihood score for each character string in a character string database; and

display on the display one or more likely terms corresponding to character strings having a high string likelihood score.

11. The computing device of claim 10 , wherein instructions are executable to receive the trigger input by receiving an input of a gaze location at a trigger region displayed on the display.

12. The computing device of claim 10 , wherein the string likelihood score is configured to reward character strings including two or more characters in a similar order to an order at which corresponding user input keys were gazed.

13. The computing device of claim 10 , wherein the string likelihood score is configured to penalize character strings having a length greater than a threshold.

14. The computing device of claim 10 , wherein the display comprises a see-through display.

15. A computing device, comprising:

a display;

a logic subsystem comprising a processor configured to execute instructions; and

a storage subsystem comprising instructions executable by the logic subsystem to receive a trigger input indicating initiation of eye-typing;

receive a plurality of gaze samples each comprising a gaze location and a corresponding time from the trigger;

receive an input signaling an end of the eye-typing input;

compare the plurality of gaze samples to a layout of user input keys displayed on the display, and based on overlapping user input key and gaze locations, assign a per-key score to each user input key for each point in time;

convert a set of per-key scores to one or more intervals in time, and assigning an interval score to each interval;

compile a directed graph of one or more characters, each character corresponding to a user input key having an interval score above a threshold; and

compare each character string from a character string database to the directed graph, and display on the display one or more likely terms corresponding to character strings that match a path from the directed graph.

16. The computing device of claim 15 , wherein the instructions are executable to assign each per-key score based on a length of time each respective key was gazed at.

17. The computing device of claim 15 , wherein the instructions are executable to convert the set of per-key scores to one or more intervals in time by assigning an interval in time to a particular key, the interval including a time duration from when a per-key score for that particular key reached a threshold to when that key's per-key score dropped below the threshold.

18. The computing device of claim 15 , wherein the interval score comprises an average per-key score for that particular key during the interval.

19. The computing device of claim 15 , wherein the instructions are executable to display on the display one or more likely terms corresponding to character strings that match a path from the directed graph further by displaying on the display one or more likely terms corresponding to character strings that are less than a threshold edit distance from a path of the directed graph.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034819/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 17, 2014
From: NISTER, DAVID; THUKRAL, VAIBHAV; NIJEMCEVIC, DJORDJE; BHARGAVA, RUCHI
To: MICROSOFT CORPORATION
Reel/Frame 034530/0016 →