IP Library Granted Patent US 10,656,829
Granted Patent B2
US 10,656,829 · App. 16/377,076 · Granted May 19, 2020

Progress display of handwriting input

Inventors: Franz Josef Och (Palo Alto, CA); Thomas Deselaers (Zurich, CH); Daniel Martin Keysers (Stallikon, CH); Henry Allan Rowley (Sunnyvale, CA)
Assignee: Google LLC
G06F3/04883G06K9/00402G06K9/00979G06K9/033
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,656,829
App. No.
16/377,076
Granted
May 19, 2020
Kind
B2
Abstract

A computer-implemented method includes: receiving, at a user device, user input corresponding to handwritten text to be recognized using a recognition engine; and receiving, at the user device, a representation of the handwritten text. The representation includes the handwritten text parsed into individual handwritten characters. The method further includes: displaying, on a display of the user device, the handwritten characters using a first indicator; receiving, at the user device, an identification of a text character recognized as one of the handwritten characters; displaying, on the display, the text character; and adjusting, at the user device, the one of the handwritten characters from being displayed using the first indicator to using a second indicator in response to the received identification. The first and second indicators are different.

Claims (59)

1. A computer-implemented method comprising:

receiving, at a user device, user input corresponding to initial handwritten text to be recognized using a recognition engine;

receiving, at the user device, a representation of the initial handwritten text, the representation of the initial handwritten text including the initial handwritten text parsed into individual handwritten characters;

displaying, in a first portion of a display of the user device, the handwritten characters;

receiving, at the user device, a second user input corresponding to additional handwritten text to be recognized using the recognition engine;

receiving, at the user device, a representation of the additional handwritten text, the representation of the additional handwritten text including the additional handwritten text parsed into individual handwritten characters;

determining that an identification of one or more handwritten characters of the initial handwritten text has not been received; and

changing a size of the handwritten characters displayed in the first portion of the display of the user device in response to receiving the second user input and determining that the identification of one or more handwritten characters of the initial handwritten text has not been received.

2. The method of claim 1 further comprising:

receiving, at the user device, an identification of a handwritten character of the initial handwritten text;

displaying, in a second portion of the display of the user device, the one or more handwritten characters of the initial handwritten text;

receiving at the user device, an identification of a handwritten character of the additional handwritten text; and

displaying, in the second portion of the display of the user device, the one or more handwritten characters of the additional handwritten text.

3. The method of claim 2 , further comprising:

receiving, at the user device, a second identification of a second handwritten character of the initial handwritten text;

determining, at the user device, a possible stem for the initial handwritten text based on the handwritten character and the second handwritten character; and

displaying, in the second portion of the display of the user device, the possible stem.

4. The method of claim 3 , further comprising:

receiving, at the user device, user input indicating a selection of the possible stem;

determining, at the user device, a possible word for the initial handwritten text based on the possible stem; and

displaying, in the second portion of the display of the user device, the possible word in response to the receipt of the user input indicating the selection of the possible stem.

5. The method of claim 3 , further comprising removing at least one of the handwritten characters from the first portion of the display of the user device only after the at least one handwritten characters from the first portion of the display are displayed in the second portion of the display of the user device.

6. The method of claim 3 , wherein:

receiving a representation of handwritten text comprises generating, at the user device, the representation of the handwritten text; or

receiving an identification of a handwritten character comprises generating, at the user device, the identification.

7. The method of claim 2 , further comprising displaying, on the display, a progress bar indicative of an amount of the initial handwritten text or the additional handwritten text that has been recognized by the recognition engine.

8. The method of claim 7 , further comprising displaying, on the display, a percentage corresponding to the amount.

9. The method of claim 1 , wherein the display is a touch display and the user input is received via the touch display.

10. A computing device, comprising:

a display;

at least one processor coupled to the display; and

a non-transitory computer-readable storage medium storing executable computer program code, the at least one processor configured to execute the executable computer program code to perform operations including:

receiving, at a user device, user input corresponding to initial handwritten text to be recognized using a recognition engine;

receiving, at the user device, a representation of the initial handwritten text, the representation of the initial handwritten text including the initial handwritten text parsed into individual handwritten characters;

displaying, in a first portion of a display of the user device, the handwritten characters;

receiving, at the user device, a second user input corresponding to additional handwritten text to be recognized using the recognition engine;

receiving, at the user device, a representation of the additional handwritten text, the representation of the additional handwritten text including the additional handwritten text parsed into individual handwritten characters;

determining that an identification of one or more handwritten characters of the initial handwritten text has not been received; and

changing a size of the handwritten characters displayed in the first portion of the display of the user device in response to receiving the second user input and determining that the identification of one or more handwritten characters of the initial handwritten text has not been received.

11. The method of claim 10 further comprising:

receiving, at the user device, an identification of a handwritten character of the initial handwritten text;

displaying, in a second portion of the display of the user device, the one or more handwritten characters of the initial handwritten text;

receiving at the user device, an identification of a handwritten character of the additional handwritten text; and

displaying, in the second portion of the display of the user device, the one or more handwritten characters of the additional handwritten text.

12. The method of claim 11 , further comprising:

receiving, at the user device, a second identification of a second handwritten character of the initial handwritten text;

determining, at the user device, a possible stem for the initial handwritten text based on the handwritten character and the second handwritten character; and

displaying, in the second portion of the display of the user device, the possible stem.

13. The method of claim 12 , further comprising:

receiving, at the user device, user input indicating a selection of the possible stem;

determining, at the user device, a possible word for the initial handwritten text based on the possible stem; and

displaying, in the second portion of the display of the user device, the possible word in response to the receipt of the user input indicating the selection of the possible stem.

14. The method of claim 12 , further comprising removing at least one of the handwritten characters from the first portion of the display of the user device only after the at least one handwritten characters from the first portion of the display are displayed in the second portion of the display of the user device.

15. The method of claim 12 , wherein:

receiving a representation of handwritten text comprises generating, at the user device, the representation of the handwritten text; or

receiving an identification of a handwritten character comprises generating, at the user device, the identification.

16. The method of claim 11 , further comprising displaying, on the display, a progress bar indicative of an amount of the initial handwritten text or the additional handwritten text that has been recognized by the recognition engine.

17. The method of claim 16 , further comprising displaying, on the display, a percentage corresponding to the amount.

18. The method of claim 10 , wherein the display is a touch display and the user input is received via the touch display.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE INVENTOR LEGAL NAME DANIEL M. KEYSERS TO DANIEL MARTIN KEYSERS PREVIOUSLY RECORDED ON REEL 048842 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 6, 2019
From: OCH, FRANZ JOSEF; DESELAERS, THOMAS; KEYSERS, DANIEL MARTIN; ROWLEY, HENRY ALLAN
To: GOOGLE INC.
Reel/Frame 050942/0189 →
CHANGE OF NAME Recorded Apr 10, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 050160/0260 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2019
From: OCH, FRANZ JOSEF; DESELAERS, THOMAS; KEYSERS, DANIEL M.; ROWLEY, HENRY ALLAN
To: GOOGLE INC.
Reel/Frame 048842/0001 →
Continuity (2)
Continuation 13626963 · Sep 26, 2012
Related Publication 20190235749A1 · Aug 1, 2019