IP Library Granted Patent US 10,528,663
Granted Patent B2
US 10,528,663 · App. 15/795,955 · Granted Jan 7, 2020

Touch keyboard using language and spatial models

Inventors: Shumin Zhai (Los Altos, CA); Ciprian Ioan Chelba (Palo Alto, CA)
Assignee: Google LLC
G06F17/277G06F3/0237G06F3/04883G06F3/04886G06F17/275G06F17/2735
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,528,663
App. No.
15/795,955
Granted
Jan 7, 2020
Kind
B2
Abstract

A computing device outputs for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys, receives an indication of at least one gesture to select a group of keys of the plurality of keys, and determines at least one characteristic associated with the at least one gesture to select the group of keys of the plurality of keys. The computing device modifies a spatial model based at least in part on the at least one characteristic and determines a candidate word based at least in part on data provided by the spatial model and a language model, wherein the spatial model provides data based at least in part on the indication of the at least one gesture and wherein the language model provides data based at least in part on a lexicon. The computing device outputs for display at the presence-sensitive display, the candidate word.

Claims (44)

1. A method comprising:

presenting, via a display, a graphical keyboard, each key of the graphical keyboard is defined by a respective touch-point distribution pattern for that key, the respective touch-point distribution pattern for each key of the graphical keyboard specifies a variability in expected touch points for the key, and a respective standard deviation value associated with each key of the graphical keyboard indicates an amount of variability in the expected touch points for the key;

receiving, by a computing device and from a presence-sensitive input device that is operatively coupled to the display, a plurality of indications of input, each indication of input from the plurality of indications of input corresponding to a respective location of the display that presents the graphical keyboard;

determining, based on the respective locations of the plurality of indications of input, a first likelihood that the plurality of indications of input corresponds to a set of characters from the graphical keyboard;

determining a second likelihood that the set of characters from the graphical keyboard is included in a word in a lexicon;

improving accuracy of the first likelihood by modifying the first likelihood based on the second likelihood by increasing or decreasing a respective standard deviation value associated with a key of the graphical keyboard that is located at the respective location of the display corresponding to at least one of the plurality of indications of input;

determining, by the computing device, based on a product of the modified first likelihood and the second likelihood, at least one predicted current word; and

outputting, by the computing device and for display, the at least one predicted current word as a soft commit word in a text entry area of a graphical user interface.

2. The method of claim 1 , wherein determining the first likelihood that the plurality of indications of input corresponds to the set of characters from the graphical keyboard comprises:

for each respective indication of input from the plurality of indications of input, incrementally modifying, by the computing device and based on the second likelihood, a respective spatial model score associated with each character from the set of characters; and

determining the first likelihood from the respective spatial model scores associated with the characters from the set of characters.

3. The method of claim 1 , wherein modifying the first likelihood based on the second likelihood further comprises multiplying the second likelihood with the first likelihood to compute the product.

4. The method of claim 1 , wherein increasing the respective standard deviation value associated with the key of the graphical keyboard that is located at the respective location of the display corresponding to the at least one of the plurality of indications of input decreases the first likelihood.

5. The method of claim 1 , wherein decreasing the respective standard deviation value associated with the key of the graphical keyboard that is located at the respective location of the display corresponding to the at least one of the plurality of indications of input increases the first likelihood.

6. The method of claim 1 , wherein modifying the first likelihood based on the second likelihood occurs incrementally while each of the plurality of indications of input is received.

7. The method of claim 1 , further comprising:

determining, by the computing device and based at least in part on the at least one predicted current word, at least one predicted next word that follows the at least one predicted current word, wherein the at least one predicted next word that follows the at least one predicted current word and the at least one predicted current word are output for display in the text entry area of the graphical user interface.

8. A computing device comprising:

at least one processor; and

memory configured to store instructions that, when executed, cause the at least one processor to:

present, via a display, a graphical keyboard, each key of the graphical keyboard is defined by a respective touch-point distribution pattern for that key, the respective touch-point distribution pattern for each key of the graphical keyboard specifies a variability in expected touch points for the key, and a respective standard deviation value associated with each key of the graphical keyboard indicates an amount of variability in the expected touch points for the key;

receive, from a presence-sensitive input device that is operatively coupled to the display, a plurality of indications of input, each respective indication of input from the plurality of indications of input corresponding to a respective location of the display that presents the graphical keyboard;

determine, based on the respective locations of the plurality of indications of input, a first likelihood that the plurality of indications of input corresponds to a set of characters from the graphical keyboard;

determine a second likelihood that the set of characters from the graphical keyboard is included in a word in a lexicon;

improve accuracy of the first likelihood by modifying the first likelihood based on the second likelihood by increasing or decreasing a respective standard deviation value associated with a key of the graphical keyboard that is located at the respective location of the display corresponding to at least one of the plurality of indications of input;

determine, based on a product of the modified first likelihood and the second likelihood, at least one predicted current word; and

output, for display, the at least one predicted current word as a soft commit word in a text entry area of a graphical user interface.

9. The computing device of claim 8 , wherein the instructions, when executed, further cause the at least one processor to determine the first likelihood that the plurality of indications of input corresponds to the set of characters from the graphical keyboard by:

for each respective indication of input from the plurality of indications of input, incrementally modifying, based on second likelihood, a respective spatial model score associated with each character from the set of characters; and

determining the first likelihood from the respective spatial model scores associated with the characters from the set of characters.

10. The computing device of claim 8 , wherein the instructions, when executed, cause the at least one processor to further modify the first likelihood based on the second likelihood by multiplying the second likelihood with the first likelihood to compute the product.

11. The computing device of claim 8 , wherein the instructions, when executed, further cause the at least one processor to increase the standard deviation value associated with the key of the graphical keyboard that is located at the respective location of the display corresponding to the at least one of the plurality of indications of input to decrease the first likelihood.

12. The computing device of claim 8 , wherein the instructions, when executed, further cause the at least one processor to decrease the standard deviation value associated with the key of the graphical keyboard that is located at the respective location of the display corresponding to the at least one of the plurality of indications of input to decrease the first likelihood.

13. A non-transitory, non-signal computer-readable storage medium encoded with instructions that, when executed, cause at least one processor to:

present, via a display, a graphical keyboard, each key of the graphical keyboard is defined by a respective touch-point distribution pattern for that key, the respective touch-point distribution pattern for each key of the graphical keyboard specifies a variability in expected touch points for the key, and a respective standard deviation value associated with each key of the graphical keyboard indicates an amount of variability in the expected touch points for the key;

receive a plurality of indications of input, each respective indication of input from the plurality of indications of input corresponding to a respective location of the display that presents the graphical keyboard;

determine, based on the respective locations of the plurality of indications of input, a first likelihood that the plurality of indications of input corresponds to a set of characters from the graphical keyboard;

determine a second likelihood that the set of characters from the graphical keyboard is included in a word in a lexicon;

improve accuracy of the first likelihood by modifying the first likelihood based on the second likelihood by increasing or decreasing a respective standard deviation value associated with a key of the graphical keyboard that is located at the respective location of the display corresponding to at least one of the plurality of indications of input;

determine, based on a product of the modified first likelihood and the second likelihood, at least one predicted current word; and

output, for display, the at least one predicted current word as a soft commit word in a text entry area of a graphical user interface.

14. The non-transitory, non-signal computer-readable storage medium of claim 13 , wherein the instructions, when executed, further cause the at least one processor to:

increase the respective standard deviation value associated with the key of the graphical keyboard that is located at the respective location of the display corresponding to the at least one of the plurality of indications of input to decrease the first likelihood.

15. The non-transitory, non-signal computer-readable storage medium of claim 13 , wherein the instructions, when executed, further cause the at least one processor to decrease the respective standard deviation value associated with the key of the graphical keyboard that is located at the respective location of the display corresponding to the at least one of the plurality of indications of input to increase the first likelihood.

Assignments (2)
CHANGE OF NAME Recorded Mar 9, 2018
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 045546/0016 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2018
From: ZHAI, SHUMIN; CHELBA, CIPRIAN IOAN
To: GOOGLE INC.
Reel/Frame 044599/0327 →
Continuity (4)
Continuation 14477490 · Sep 4, 2014
Continuation 13789106 · Mar 7, 2013
Provisional Application 61752790 · Jan 15, 2013
Related Publication 20180046612A1 · Feb 15, 2018