IP Library Granted Patent US 11,106,905
Granted Patent B2
US 11,106,905 · App. 16/120,774 · Granted Aug 31, 2021

Multi-character text input system with audio feedback and word completion

Inventors: Jonas Morwing (Lund, SE); Christer Friberg (Lund, SE); Jakob Sternby (Lund, SE); Jonas Andersson (Malmo, SE)
Assignee: Cerence Operating Company
G06K9/00409G06F3/167G06F40/205G06F40/289G06K9/222G10L13/08G06K9/00402
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,106,905
App. No.
16/120,774
Granted
Aug 31, 2021
Kind
B2
Abstract

A system for inputting and processing handwritten, multi-character text may comprise a handwriting recognition subsystem, a word completion subsystem, and an audio feedback system. The handwriting recognition system may be configured to capture a series of handwritten characters formed by a user and to convert the handwritten characters into a set of candidate partial text strings. The word completion subsystem may be configured to identify if a candidate partial text string constitutes a word segment and if so, generate one or both of (i) at least one clarifying word and (ii) at least one clarifying phrase that includes the clarifying word. The word segment may be an arbitrary string and not correspond to a valid complete word in a language associated with the system. The audio feedback subsystem may be configured to produce an audio representation of the word segment(s), the clarifying word(s), and the clarifying phrase(s).

Claims (27)

1. A multi-character text input system, said multi-character text input system comprising a handwriting-recognition subsystem, a word-completion subsystem, and an audio-feedback subsystem,

wherein said handwriting-recognition subsystem is configured to capture a series of handwritten characters that are formed by a user and to convert said handwritten characters into a set of candidate partial text strings,

wherein the word-completion subsystem is configured to determine that said candidate partial text string constitutes a word segment that does not correspond to a valid word in a language associated with the handwriting recognition subsystem and to generate, based on the word segment, a clarifying phrase that is a clarifying conjunctive phrase that comprises a clarifying word and the word segment,

wherein the audio-feedback subsystem is configured to produce an audio representation of the clarifying phrase.

2. The system of claim 1 , wherein the word-completion subsystem utilizes at least one contextual-information input to generate the element.

3. The system of claim 2 , wherein the contextual-information input comprises field information.

4. The system of claim 2 , wherein the contextual-information input comprises relational information.

5. The system of claim 2 , wherein the contextual-information input comprises time-of-day information.

6. The system of claim 2 , wherein the contextual-information input comprises location-based information.

7. The system of claim 1 , wherein the audio-feedback subsystem comprises a sound-producing component configured to convey the audio representation to the user.

8. The system of claim 1 , wherein the at least one clarifying words are constituents of a list of words based on the word segment, the list of words having been ordered according to a likelihood of correctness.

9. The system of claim 8 , wherein the likelihood of correctness is determined based on at least one contextual: information input.

10. The system of claim 1 , wherein the clarifying phrase associates the word segment with a clarifying word.

11. The system of claim 10 , wherein the conjunctive phrase is three words or fewer.

12. The system of claim 1 , wherein the audio-feedback subsystem is configured to render the audio representation of the word segment as a discernable pronunciation.

13. The system of claim 1 , wherein said word-completion subsystem is configured to generate, based on said word segment, a pair of clarifying words.

14. A computer-implemented method of receiving and responding to multi-character text input, said method comprising:

causing a handwriting-recognition subsystem to carry out capturing a series of handwritten characters formed by a user and

causing a processor that is operatively coupled with a memory having computer-code instructions stored thereon to execute the steps of

converting the handwritten characters into a set of candidate partial text strings,

for each candidate partial text string of the set of candidate partial text strings, determining that the candidate partial text string constitutes a word segment that does not correspond to a valid word in a language associated with the handwriting recognition subsystem,

generating, based on the word segment, at least one clarifying phrase that is a clarifying conjunctive phrase and comprises the clarifying word and the word segment, and

producing an audio representation of the clarifying phrase.

15. The computer-implemented method of claim 14 , further comprising utilizing at least one contextual information input to generate the element.

16. The computer-implemented method of claim 14 , further comprising conveying the audio representation to the user through a sound-producing component.

17. The computer-implemented method of claim 14 , further comprising rendering the audio representation of word segment as a discernable pronunciation.

18. A non-transitory computer-readable medium with computer code instruction stored thereon, wherein the computer code instructions, when executed by a processor, cause an apparatus to convert handwritten characters written by a user into a set of candidate partial text strings, for each candidate partial text string of the set of candidate partial text strings, determine that the candidate partial text string constitutes a word segment that does not correspond to a valid word in a language associated with the handwriting recognition subsystem, generate, based on the word segment, a clarifying phrase that is a clarifying conjunctive phrase and includes a clarifying word and the word segment and, produce an audio representation of the clarifying phrase.

Assignments (6)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2020
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 052114/0001 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2018
From: MORWING, JONAS; FRIBERG, CHRISTER; STERNBY, JAKOB; ANDERSSON, JONAS
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 047020/0367 →