Eye-typing term recognition
View Patent ↗Various embodiments related to entering text into a computing device via eye-typing are disclosed. For example, one embodiment provides a method that includes receiving a data set including a plurality of gaze samples, each gaze sample including a gaze location and a corresponding point in time. The method further comprises processing the plurality of gaze samples to determine one or more likely terms represented by the data set.
1. A computing device, comprising:
a logic subsystem, and
a data-holding subsystem comprising instructions executable by the logic subsystem to
receive a data set comprising a plurality of gaze samples, each gaze sample comprising a gaze location and a corresponding point in time;
process the plurality of gaze samples to determine one or more likely terms represented by the data set by comparing the plurality of gaze samples to a layout of user input keys displayed on a display, and
based on overlapping user input key and gaze locations and a length of time spent gazing at each user input key, assign a per-key score to a plurality of user input keys for each gaze sample; and
provide the one or more likely terms to a display device for display.
2. The computing device of claim 1 , wherein the data set is received from a remote device via a network.
3. The computing device of claim 1 , wherein the instructions are executable to receive the data set by
receiving a trigger input indicating an initiation of eye-typing input;
receiving the plurality of gaze samples from one or more image sensors; and
receiving an input signaling an end of the eye-typing input, wherein the corresponding point in time is a time from the trigger.
4. The computing device of claim 1 , wherein the instructions are further executable to, based on the per-key scores, compile a string likelihood score for each character string in a character string database.
5. The computing device of claim 4 , wherein the instructions are executable to compile the string likelihood score such that the string likelihood score rewards character strings including two or more characters in a similar order to an order in which corresponding user input keys received a user gaze.
6. The computing device of claim 1 , wherein the instructions are further executable to present to the user one or more character strings having a high string likelihood score as the one or more likely terms.
7. The computing device of claim 1 , wherein the instructions are further executable to convert a set of per-key scores to one or more intervals in time, and assign an interval score to each interval.
8. The computing device of claim 7 , wherein the instructions are further executable to
compile a directed graph of one or more characters, each character corresponding to a user input key having an interval score above a threshold over a period of time; and
compare each character string from a character string database to the directed graph, and send to the display one or more character strings that match a path from the directed graph to be displayed as the one or more likely terms.
9. The computing device of claim 1 , wherein the instructions are further executable to
display the one or more likely terms via a display;
receive a gaze sample indicative of a selection of one of the one or more likely terms; and
request from a service information relating to the selected term.
10. A computing device, comprising:
a display;
a logic subsystem comprising a processor configured to execute instructions; and
a storage subsystem comprising instructions executable by the logic subsystem to receive a trigger input indicating initiation of eye-typing;
receive a plurality of gaze samples each comprising a gaze location and a corresponding time from the trigger;
receive an input signaling an end of the eye-typing input;
compare the plurality of gaze samples to a layout of user input keys displayed on the display, and based on overlapping user input key and gaze locations, assigning a per-key score to each user input key for each point in time;
based on the per-key scores, compile a string likelihood score for each character string in a character string database; and
display on the display one or more likely terms corresponding to character strings having a high string likelihood score.
11. The computing device of claim 10 , wherein instructions are executable to receive the trigger input by receiving an input of a gaze location at a trigger region displayed on the display.
12. The computing device of claim 10 , wherein the string likelihood score is configured to reward character strings including two or more characters in a similar order to an order at which corresponding user input keys were gazed.
13. The computing device of claim 10 , wherein the string likelihood score is configured to penalize character strings having a length greater than a threshold.
14. The computing device of claim 10 , wherein the display comprises a see-through display.
15. A computing device, comprising:
a display;
a logic subsystem comprising a processor configured to execute instructions; and
a storage subsystem comprising instructions executable by the logic subsystem to receive a trigger input indicating initiation of eye-typing;
receive a plurality of gaze samples each comprising a gaze location and a corresponding time from the trigger;
receive an input signaling an end of the eye-typing input;
compare the plurality of gaze samples to a layout of user input keys displayed on the display, and based on overlapping user input key and gaze locations, assign a per-key score to each user input key for each point in time;
convert a set of per-key scores to one or more intervals in time, and assigning an interval score to each interval;
compile a directed graph of one or more characters, each character corresponding to a user input key having an interval score above a threshold; and
compare each character string from a character string database to the directed graph, and display on the display one or more likely terms corresponding to character strings that match a path from the directed graph.
16. The computing device of claim 15 , wherein the instructions are executable to assign each per-key score based on a length of time each respective key was gazed at.
17. The computing device of claim 15 , wherein the instructions are executable to convert the set of per-key scores to one or more intervals in time by assigning an interval in time to a particular key, the interval including a time duration from when a per-key score for that particular key reached a threshold to when that key's per-key score dropped below the threshold.
18. The computing device of claim 15 , wherein the interval score comprises an average per-key score for that particular key during the interval.
19. The computing device of claim 15 , wherein the instructions are executable to display on the display one or more likely terms corresponding to character strings that match a path from the directed graph further by displaying on the display one or more likely terms corresponding to character strings that are less than a threshold edit distance from a path of the directed graph.