IP Library Granted Patent US 8,780,077
Granted Patent B2
US 8,780,077 · App. 13/222,483 · Granted Jul 15, 2014

User interface for handwriting inputs

Inventors: Juan Dai (Redmond, WA); Yi Zhou (Beijing, CN); Mingqin Li (Beijing, CN); Liang Chen (Redmond, WA)
Assignee: Microsoft Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,780,077
App. No.
13/222,483
Granted
Jul 15, 2014
Kind
B2
Abstract

A method, medium, device, and user interface are provided for receiving a handwriting input and for presenting prediction candidates based on the handwriting input. A pen down event is detected in a writing panel of a user interface. The writing panel is expanded to overlie function keys and a candidate window of the user interface such that those features are made inaccessible for inadvertent selections thereof. Upon detection of a pen up event the writing panel is decreased in size to again reveal the features. Recognition candidates are identified based on the handwriting input. Prediction candidates are also identified based on a highest ranking recognition candidate and are presented in combination with the highest ranking recognition candidate. Prediction candidates are thereby identifiable with the recognition candidate with which they are associated and selection of a prediction candidate and recognition candidate may be performed in single selection input.

Claims (42)

1. A user interface presented by a computing device having a processor, a memory, and a handwriting input device, the user interface comprising:

an input window associated with the handwriting input device and configured to one or more of receive a handwriting input and toggle a handwriting input panel for receipt of a handwriting input;

a candidate window that includes a recognition display state and a prediction display state,

the candidate window in the recognition display state presenting one or more recognition candidates and one or more combination candidates that include a first recognition candidate from the one or more recognition candidates followed by a prediction candidate, the prediction candidate being determined based on the first recognition candidate and one or more of a user's input history and a lexicon of phrases, and

the candidate window in the prediction display state presenting one or more second prediction candidates associated with a selected one of the recognition candidates and combination candidates; and

an edit field that displays a text string that includes one or more of the recognition candidates, the prediction candidates, and second prediction candidates.

2. The user interface of claim 1 , wherein the recognition display state is presented after receipt of the handwriting input and prior to receipt of a selection of the selected one of the recognition candidates and combination candidates and the prediction display state is presented after receipt of the selection.

3. The user interface of claim 2 , wherein when in the recognition display state the edit field displays the first recognition candidate as determined text.

4. The user interface of claim 2 , wherein when in the prediction display state the edit field displays the text string as committed text.

5. The user interface of claim 1 , further comprising:

an expanded-candidate-window toggle that when selected toggles a presentation of an expanded candidate window that is able to present the one or more recognition candidates, the one or more combination candidates, and one or more additional combination candidates that are not presented in the candidate window.

6. The user interface of claim 1 , wherein the one or more recognition candidates are presented in a ranked order based on a correlation between the handwriting input and the recognition candidate.

7. The user interface of claim 1 , wherein the one or more combination candidates are presented in a ranked order based at least in part on a user's input history.

8. The user interface of claim 7 , wherein the input history includes a measure of a frequency of usage of a combination candidate and a measure of a length of time since a last usage of the combination candidate.

9. A mobile device configured to present a user interface for presenting recognition and prediction candidates associated with a received handwriting input, the mobile device comprising:

a processor;

a memory; and

a display component with an associated touch interface, the display component being configured to present a user interface that includes

a candidate window, the candidate window displaying a plurality of recognition candidates that are identified by a recognition engine executed by the processor and based on a handwriting input received via the touch interface, the candidate window also displaying a plurality of combination candidates that include a first recognition candidate of the plurality of recognition candidates followed by a respective prediction candidate, one or more of the respective prediction candidates being determined base at least in part on phrases previously input to the mobile device, and

an edit field that displays the first recognition candidate as determined text.

10. The mobile device of claim 9 , wherein the plurality of recognition candidates are presented by the display component in the candidate window in a ranked order based on a correlation value determined by the recognition engine between the handwriting input and the recognition candidate.

11. The mobile device of claim 9 , wherein the plurality of combination candidates are presented by the display component in the candidate window in a ranked order base at least in part on a frequency of use and a measure of a length of time since a last use of the combination candidates.

12. The mobile device of claim 9 , wherein when a selection of a second recognition candidate of the plurality of recognition candidates or a selection of a first combination candidate of the plurality of combination candidates is received via the touch interface the candidate window displays one or more second prediction candidates that are determined to be associated with the second recognition candidate or the first combination candidate based at least in part on phrases previously input to the mobile device.

13. The mobile device of claim 12 , wherein the edit field displays the second recognition candidate or the first combination candidate as committed text.

14. One or more computer-readable storage media having computer-executable instructions embodied thereon that, when executed, perform a method of presenting prediction candidates based on a recognized handwriting input, the method comprising:

receiving a handwriting input from a handwriting input device coupled to a computing device having a processor and a memory;

executing, by the computing device, a recognition engine to identify a recognition candidate based on the handwriting input;

determining a prediction candidate associated with the recognition candidate; and

presenting the recognition candidate and the prediction candidate, the recognition candidate being presented singularly and as a combination candidate that includes the recognition candidate followed by the prediction candidate.

15. The computer-readable storage media of claim 14 , wherein the method further comprises:

receiving a selection of one of the recognition candidate or the combination candidate;

displaying the one of the recognition candidate or the combination candidate in an edit field as committed text;

identifying a second prediction candidate that is associated with the one of the recognition candidate or the combination candidate; and

presenting the second prediction candidate.

16. The computer-readable storage media of claim 15 , wherein the method further comprises:

receiving a selection of the second prediction candidate;

appending the second prediction candidate to a text string that includes the one of the recognition candidate or the combination candidate; and

displaying the text string with the second prediction candidate in the edit field.

17. The computer-readable storage media of claim 14 , wherein the prediction candidate is a history-based-prediction candidate associated with the recognition candidate based on a previous input.

18. The computer-readable storage media of claim 14 , wherein the prediction candidate is a next-word prediction that is determined based on a lexicon of known phrases and word groupings.

19. The computer-readable storage media of claim 14 , wherein the handwriting input device is a touch interface and the computing device is a mobile device.

20. The computer-readable storage media of claim 14 , wherein the prediction candidate includes more than one words, phrases, or symbols.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034544/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2011
From: DAI, JUAN; ZHOU, YI; LI, MINGQIN; CHEN, LIANG
To: MICROSOFT CORPORATION
Reel/Frame 026838/0401 →
Priority Claims (1)
WO PCT/CN2011/074407 · May 20, 2011 · international
Continuity (1)
Related Publication 20120293423A1 · Nov 22, 2012