IP Library Granted Patent US 9,111,139
Granted Patent B2
US 9,111,139 · App. 14/300,157 · Granted Aug 18, 2015

Method and apparatus for on-top writing

Inventors: Lars Jonas Morwing (Malmö, SE); Jonas Andersson (Malmö, SE)
Assignee: NUANCE COMMUNICATIONS INC.
G06K9/00402G06F3/0237G06F3/0354G06F3/04883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,111,139
App. No.
14/300,157
Granted
Aug 18, 2015
Kind
B2
Abstract

A handwriting recognition apparatus facilitates user entry of strokes one on top of another. The apparatus, which includes a processor and a display integrated with a touch sensitive screen, receives a series of strokes via the screen. Each stroke is defined by contact, trace, and lift occurrences. Each stroke appears on the display until occurrence of a prescribed event, and then disappears. The apparatus accumulates strokes into a buffer and interprets all accumulated strokes collectively against a character database and optionally a linguistic database, to identify multiple candidate strings that could be represented by the accumulated strokes. The apparatus displays candidate strings for user selection after all strokes have faded, or after receiving a user submitted delimiter, or after a given delay has elapsed following user entry of the latest stroke. Alternatively, candidate strings are displayed after each stroke without waiting for timeout or explicit delimiter.

Claims (64)

1. A handwriting recognition apparatus, comprising:

a processor programmed to perform operations comprising:

receiving a series of multiple strokes via a touch sensitive screen, each stroke defined by a contact, trace, and lift of a stylus, finger, or other member;

presenting each stroke on a display until occurrence of a prescribed event after which the displayed stroke disappears;

accumulating strokes into a buffer and interpreting all accumulated strokes collectively to identify multiple candidate strings that could potentially be represented by the accumulated strokes by:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing each stroke input with a character database to produce multiple character candidates and a character distance for each candidate; and

concatenating said character candidates in different combinations to produce complete candidate strings, each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked and ordered list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes are ranked lower.

2. The apparatus of claim 1 , further comprising:

for each alternative configuration, comparing stroke input with the character database to produce multiple character q candidates and a character distance for each candidate, wherein q is a positive integer greater than or equal to two.

3. The apparatus of claim 1 , further comprising:

operating the display to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis:

(1) only after all strokes have disappeared,

(2) only after receiving a predefined user submitted delimiter,

(3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

4. The apparatus claim 1 , further comprising:

said character database representing predefined character shape data;

providing a linguistic database representing predefined character strings;

said accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes:

the character database alone, the character database and the linguistic database.

5. The apparatus of claim 1 , where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood.

6. The apparatus of claim 1 , where the prescribed event comprises expiration of a prescribed time period.

7. The apparatus of claim 6 , responsive to user entry of multiple strokes within a length of time less than or equal to the prescribed time period, concurrently presenting all of the strokes in various stages of fading.

8. The apparatus of claim 6 , where the predetermined delay is different than the prescribed time period.

9. The apparatus of claim 1 , where the operation of presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears comprises:

making an area where the touch screen received the stroke visually distinct; and

after a prescribed time period from entry of the stroke, fading and eventually removing the visually distinct area.

10. The apparatus of claim 1 , where the prescribed event comprises user entry of a prescribed number of subsequent strokes.

11. The apparatus of claim 1 , where the operation of presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears comprises:

responsive to user entry of a new stroke, incrementally fading each currently displayed stroke by a predetermined amount.

12. The apparatus of claim 1 , where the received strokes form multiple characters and at least some of the characters substantially overlap each other.

13. A handwriting recognition method, comprising:

providing a processor programmed to perform operations comprising:

receiving a series of multiple strokes via a touch sensitive screen, each stroke defined by a contact, trace, and lift of a stylus, finger, or other member;

presenting each stroke on a display until occurrence of a prescribed event after which the displayed stroke disappears;

accumulating strokes into a buffer and interpreting all accumulated strokes collectively to identify multiple candidate strings that could potentially be represented by the accumulated strokes by:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing each stroke input with a character database to produce multiple character candidates and a character distance for each candidate; and

concatenating said character candidates in different combinations to produce complete candidate strings, each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked and ordered list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes are ranked lower.

14. The method of claim 13 , further comprising:

for each alternative configuration, comparing stroke input with the character database to produce multiple character q candidates and a character distance for each candidate, wherein q is a positive integer greater than or equal to two.

15. The method of claim 13 , further comprising:

operating the display to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis:

(1) only after all strokes have disappeared,

(2) only after receiving a predefined user submitted delimiter,

(3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

16. The method claim 13 , further comprising:

with said character database representing predefined character shape data;

providing a linguistic database representing predefined character strings;

said accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes:

the character database alone, the character database and the linguistic database.

17. The method of claim 13 , where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood.

18. The method of claim 13 , where the prescribed event comprises expiration of a prescribed time period.

19. The method of claim 18 , responsive to user entry of multiple strokes within a length of time less than or equal to the prescribed time period, concurrently presenting all of the strokes in various stages of fading.

20. The method of claim 18 , where the predetermined delay is different than the prescribed time period.

21. The method of claim 13 , where the operation of presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears comprises:

making an area where the touch screen received the stroke visually distinct; and

after a prescribed time period from entry of the stroke, fading and eventually removing the visually distinct area.

22. The method of claim 13 , where the prescribed event comprises user entry of a prescribed number of subsequent strokes.

23. The method of claim 13 , where the operation of presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears comprises:

responsive to user entry of a new stroke, incrementally fading each currently displayed stroke by a predetermined amount.

24. The method of claim 13 , where the received strokes form multiple characters and at least some of the characters substantially overlap each other.

Assignments (7)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
Continuity (3)
Continuation 13651177 · Oct 12, 2012
Continuation 12779853 · May 13, 2010
Related Publication 20140285460A1 · Sep 25, 2014