IP Library Granted Patent US 9,104,312
Granted Patent B2
US 9,104,312 · App. 13/583,840 · Granted Aug 11, 2015

Multimodal text input system, such as for use with touch screens on mobile phones

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,104,312
App. No.
13/583,840
Granted
Aug 11, 2015
Kind
B2
Abstract

A system and method for entering text from a user includes a programmed processor that receives inputs from the user and disambiguates the inputs to present word choices corresponding to the text. In one embodiment, inputs are received in two or more modalities and are analyzed to present the word choices. In another embodiment, a keyboard is divided into zones each of which represents two more input characters. A sequence of zones selected by the user is analyzed to present word choices corresponding to the zone selected.

Claims (58)

1. A method, performed using one or more processors and a memory, for data input, the method comprising:

receiving, through an input device and using the one or more processors, a first user input as part of a gesture,

wherein the gesture comprises at least a first input selection that represents less than an entire word and a second input selection; and

wherein the gesture is a continuous stroke across a virtual keyboard from a first simulated key across one or more other simulated keys;

identifying, in the first user input, a bend from the first input selection to a current input location along the gesture;

determining that the bend indicates a third input selection that represents a portion of the word between the first input selection and the second input selection;

assigning to the bend a directional classification from a discrete set of directional classifications;

determining one or more candidates for the third input selection based on the candidates for the third input selection being in a direction, relative to the first input selection, corresponding to the assigned directional classification;

determining, using the one or more processors, one or more possible word suggestions based upon the first input selection and the one or more candidates for the third input selection,

wherein the one or more possible word suggestions are determined prior to receiving the second input selection; and

providing, using a display, the possible word suggestions to the user.

2. The method of claim 1 , wherein the one or more candidates for the third input selection are determined without regard for the proximity of the bend to a representation of the third input selection.

3. The method of claim 1 , wherein the discrete set of directional classifications comprise directional classifications corresponding to up, down, left, and right.

4. The method of claim 1 , wherein the discrete set of directional classifications comprises eight or less directions.

5. The method of claim 1 , wherein assigning to the bend the directional classification comprises:

determining an angle off a horizontal direction or a vertical direction; and

selecting a direction that amounts to one of: up, down, left, or right, wherein selecting the direction is based on a closest correspondence to the determined angle.

6. The method of claim 1 , wherein determining that the bend indicates the third input selection comprises determining that the bend indicates a single character between the first input selection and the second input selection.

7. The method of claim 1 , wherein the first input selection indicates a jumper point for a zone including at least two characters.

8. A non-transitory computer readable medium, storing instructions that, when executed by a computing system, cause the computing system to perform operations for data input, the operations comprising:

receiving a first user input as part of a gesture,

wherein the gesture comprises at least a first input selection that represents less than an entire word and a second input selection; and

wherein the gesture is a continuous stroke across a virtual keyboard from a first simulated key across one or more other simulated keys;

identifying, in the first user input, a bend from the first input selection to a current input location along the gesture;

determining that the bend indicates a third input selection that represents a portion of the word between the first input selection and the second input selection;

assigning to the bend a directional classification from a discrete set of directional classifications;

determining one or more candidates for the third input selection based on the candidates for the third input selection being in a direction, relative to the first input selection, corresponding to the assigned directional classification;

determining one or more possible word suggestions based upon the first input selection and the one or more candidates for the third input selection,

wherein the one or more possible word suggestions are determined prior to receiving the second input selection; and

providing, using a display, the possible word suggestions to the user.

9. The non-transitory computer readable medium of claim 8 , wherein the one or more candidates for the third input selection are determined without regard for the proximity of the bend to a representation of the third input selection.

10. The non-transitory computer readable medium of claim 8 , wherein the discrete set of directional classifications comprise directional classifications corresponding to up, down, left, and right.

11. The non-transitory computer readable medium of claim 8 , wherein the discrete set of directional classifications comprises eight or less directions.

12. The non-transitory computer readable medium of claim 8 , wherein assigning to the bend the directional classification comprises:

determining an angle off a horizontal direction or a vertical direction; and

selecting a direction that amounts to one of: up, down, left, or right, wherein selecting the direction is based on a closest correspondence to the determined angle.

13. The non-transitory computer readable medium of claim 8 , wherein determining that the bend indicates the third input selection comprises determining that the bend indicates a single character between the first input selection and the second input selection.

14. The non-transitory computer readable medium of claim 8 , wherein the first input selection indicates a jumper point for a zone including at least two characters.

15. A computing system configured to perform data input, the system comprising:

one or more processors;

a memory;

a touch sensitive input configured to:

receive, using the one or more processors, a first user input as part of a gesture,

wherein the gesture comprises at least a first input selection that represents less than an entire word and a second input selection; and

wherein the gesture is a continuous stroke across a virtual keyboard from a first simulated key across one or more other simulated keys;

an input recognition module configured to:

identify, in the first user input, a bend from the first input selection to a current input location along the gesture;

determine that the bend indicates a third input selection that represents a portion of the word between the first input selection and the second input selection;

assign to the bend a directional classification from a discrete set of directional classifications;

determine one or more candidates for the third input selection based on the candidates for the third input selection being in a direction, relative to the first input selection, corresponding to the assigned directional classification; and

determine, using the one or more processors, one or more possible word suggestions based upon the first input selection and the one or more candidates for the third input selection,

wherein the one or more possible word suggestions are determined prior to receiving the second input selection; and

a display configured to provide the possible word suggestions to the user.

16. The computing system of claim 15 , wherein the one or more candidates for the third input selection are determined without regard for the proximity of the bend to a representation of the third input selection.

17. The computing system of claim 15 , wherein the discrete set of directional classifications comprise directional classifications corresponding to up, down, left, and right.

18. The computing system of claim 15 , wherein the discrete set of directional classifications comprises eight or fewer directions.

19. The computing system of claim 15 , wherein determining that the bend indicates the third input selection comprises determining that the bend indicates a single character between the first input selection and the second input selection.

20. The computing system of claim 15 , wherein the first input selection indicates a jumper point for a zone including at least two characters.

Assignments (5)
RELEASE (REEL 067417 / FRAME 0303) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0422 →
SECURITY AGREEMENT Recorded Apr 15, 2024
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 067417/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2023
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 064723/0519 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2021
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 055927/0620 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2012
From: KAY, DAVID JON; VAN MEURS, PIM; UNRUH, ERLAND; SHARAN, SANTOSH; KESSLER, GORDON; AGARWAL, MAYANK; SIGEL, GREG
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 029135/0004 →