IP Library Granted Patent US 8,310,461
Granted Patent B2
US 8,310,461 · App. 12/779,853 · Granted Nov 13, 2012

Method and apparatus for on-top writing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,310,461
App. No.
12/779,853
Granted
Nov 13, 2012
Kind
B2
Abstract

A handwriting recognition apparatus facilitates user entry of strokes one on top of another. The apparatus, which includes a processor and a display integrated with a touch sensitive screen, receives a series of strokes via the screen. Each stroke is defined by contact, trace, and lift occurrences. Each stroke appears on the display until occurrence of a prescribed event, and then disappears. The apparatus accumulates strokes into a buffer and interprets all accumulated strokes collectively against a character database and optionally a linguistic database, to identify multiple candidate strings that could be represented by the accumulated strokes. The apparatus displays candidate strings for user selection after all strokes have faded, or after receiving a user submitted delimiter, or after a given delay has elapsed following user entry of the latest stroke. Alternatively, candidate strings are displayed after each stroke without waiting for timeout or explicit delimiter.

Claims (77)

1. A handwriting recognition apparatus, comprising:

an electrically driven display integrated with a touch sensitive screen; machine-readable storage containing any of:

a character database representing predefined character shape data, the character database and a linguistic database representing predefined character strings; and

a processor coupled to the display and storage, the processor programmed to perform operations comprising:

receiving a series of multiple strokes via the touch sensitive screen, each stroke defined by a contact, trace, and lift of a stylus or finger or other member;

presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears;

accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes: the character database alone, the character database and the linguistic database, where the operation of interpreting all accumulated strokes comprises:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing stroke input with the character database to produce multiple character candidates and a character distance for each candidate;

concatenating said character candidates in different combinations to produce complete candidate strings each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness according to said linguistic database such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes or absent from the linguistic database are ranked lower, where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood;

the operations further comprising:

operating the display to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis: (1) only after all strokes have disappeared, (2) only after receiving a predefined user submitted delimiter, (3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

2. A handwriting recognition apparatus, comprising:

first means for displaying graphics and text;

integrated with the first means, second means for receiving touch input;

third means for storing digital data including any of:

a character database representing predefined character shape data,

the character database and a linguistic database representing predefined character strings; and

fourth means for processing digital data including performing operations comprising:

receiving a series of multiple strokes via the second means, each stroke defined by a contact, trace, and lift of a stylus or finger or other member;

presenting each stroke on the first means until occurrence of a prescribed event after which the displayed stroke disappears;

accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes: the character database alone, the character database and the linguistic database, where the operation of interpreting all accumulated strokes comprises:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing stroke input with the character database to produce multiple character candidates and a character distance for each candidate;

concatenating said character candidates in different combinations to produce complete candidate strings each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness according to said linguistic database such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes or absent from the linguistic database are ranked lower, where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood;

the operations further comprising:

operating the first means to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis: (1) only after all strokes have disappeared, (2) only after receiving a predefined user submitted delimiter, (3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

3. A method for operating a handwriting recognition apparatus that includes an electrically driven display integrated with a touch sensitive screen, a machine-readable storage containing a character database representing predefined character shape data or the character database and a linguistic database representing predefined character strings, and a processor coupled to the display and storage, the operations comprising:

receiving a series of multiple strokes via the touch sensitive screen, each stroke defined by a contact, trace, and lift of a stylus or finger or other member;

presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears;

accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes: the character database alone, the character database and the linguistic database, where the operation of interpreting all accumulated strokes comprises:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing stroke input with the character database to produce multiple character candidates and a character distance for each candidate;

concatenating said character candidates in different combinations to produce complete candidate strings each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness according to said linguistic database such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes or absent from the linguistic database are ranked lower, where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood;

the operations further comprising:

operating the display to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis: (1) only after all strokes have disappeared, (2) only after receiving a predefined user submitted delimiter, (3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

4. A method for operating a handwriting recognition apparatus that includes an electrically driven display integrated with a touch sensitive screen, a machine-readable storage containing a character database representing predefined character shape data or the character database and a linguistic database representing predefined character strings, and a processor coupled to the display and storage, the operations comprising:

a step for receiving a series of multiple strokes via the touch sensitive screen, each stroke defined by a contact, trace, and lift of a stylus or finger or other member;

a step for presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears;

a step for accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes: the character database alone, the character database and the linguistic database, where the operation of interpreting all accumulated strokes comprises:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing stroke input with the character database to produce multiple character candidates and a character distance for each candidate;

concatenating said character candidates in different combinations to produce complete candidate strings each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness according to said linguistic database such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes or absent from the linguistic database are ranked lower, where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood;

the operations further comprising:

a step for operating the display to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis: (1) only after all strokes have disappeared, (2) only after receiving a predefined user submitted delimiter, (3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

5. A computer readable storage medium having stored thereon a non-transitory program of machine-readable instructions executable by a digital processing apparatus to perform operations to manage a handwriting recognition apparatus that includes an electrically driven display integrated with a touch sensitive screen, a machine-readable storage containing a character database representing predefined character shape data or the character database and a linguistic database representing predefined character strings, and a processor coupled to the display and storage, the operations comprising:

receiving a series of multiple strokes via the touch sensitive screen, each stroke defined by a contact, trace, and lift of a stylus or finger or other member; presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears;

accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes: the character database alone, the character database and the linguistic database, where the operation of interpreting all accumulated strokes comprises:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing stroke input with the character database to produce multiple character candidates and a character distance for each candidate;

concatenating said character candidates in different combinations to produce complete candidate strings each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness according to said linguistic database such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes or absent from the linguistic database are ranked lower, where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood;

the operations further comprising:

operating the display to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis: (1) only after all strokes have disappeared, (2) only after receiving a predefined user submitted delimiter, (3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

6. Circuitry of multiple interconnected electrically conductive elements configured to perform operations to manage a handwriting recognition apparatus that includes an electrically driven display integrated with a touch sensitive screen, a machine-readable storage containing a character database representing predefined character shape data or the character database and a linguistic database representing predefined character strings, and a processor coupled to the display and storage, the operations comprising:

receiving a series of multiple strokes via the touch sensitive screen, each stroke defined by a contact, trace, and lift of a stylus or finger or other member;

presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears;

accumulating strokes into a buffer and interpreting all accumulated strokes collectively against one of the following to identify multiple candidate strings that could potentially be represented by the accumulated strokes: the character database alone, the character database and the linguistic database, where the operation of interpreting all accumulated strokes comprises:

combining input strokes in different ways to produce alternative configurations;

for each alternative configuration, comparing stroke input with the character database to produce multiple character candidates and a character distance for each candidate;

concatenating said character candidates in different combinations to produce complete candidate strings each comprising a potential representation of user-intended strokes from start to end; and

producing a ranked list of the complete candidate strings according to a score of each candidate string, where scores are produced by weighing the distances of the concatenated characters and string likeliness according to said linguistic database such that strings that are more likely to represent the accumulated strokes are ranked higher and strings that are less likely to represent the accumulated strokes or absent from the linguistic database are ranked lower, where said ranking is dependent upon string length such that long strings that have a given linguistic likelihood are promoted more than short strings of the given linguistic likelihood;

the operations further comprising:

operating the display to present candidate strings for user selection, the candidate strings being displayed upon one of the following basis: (1) only after all strokes have disappeared, (2) only after receiving a predefined user submitted delimiter, (3) only after a predetermined delay has elapsed following user entry of a most recent stroke.

7. The invention of any of claim 1 or 2 or 3 or 4 or 5 or 6 , where the prescribed event comprises expiration of a prescribed time period.

8. The invention of claim 7 , responsive to user entry of multiple strokes within a length of time less than or equal to the prescribed time period, concurrently presenting all of the strokes in various stages of fading.

9. The invention of claim 7 , where the predetermined delay is different than the prescribed time period.

10. The invention of any of claim 1 or 2 or 3 or 4 or 5 or 6 , where the operation of presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears comprises: making an area where the touch screen received the stroke visually distinct; and

after a prescribed time period from entry of the stroke, fading and eventually removing the visually distinct area.

11. The invention of any of claim 1 or 2 or 3 or 4 or 5 or 6 , where the prescribed event comprises user entry of a prescribed number of subsequent strokes.

12. The invention of any of claim 1 or 2 or 3 or 4 or 5 or 6 , where the operation of presenting each stroke on the display until occurrence of a prescribed event after which the displayed stroke disappears comprises:

responsive to user entry of a new stroke, incrementally fading each currently displayed stroke by a predetermined amount.

13. The invention of any of claim 1 or 2 or 3 or 4 or 5 or 6 , where the received strokes form multiple characters and at least some of the characters substantially overlap each other.

Assignments (8)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2010
From: MORWING, JONAS; ANDERSSON, JONAS
To: NUANCE COMMUNICATIONS INC.
Reel/Frame 024881/0332 →