IP Library Granted Patent US 9,898,452
Granted Patent B2
US 9,898,452 · App. 14/885,111 · Granted Feb 20, 2018

Annotation data generation and overlay for enhancing readability on electronic book image stream service

Inventors: Debbie A. Anglin (Austin, TX); Li Ge (Austin, TX); Su Liu (Austin, TX); Shunguo Yan (Austin, TX)
Assignee: International Business Machines Corporation
G06F17/241G06F17/242G06F17/2785G06K9/4671
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,898,452
App. No.
14/885,111
Granted
Feb 20, 2018
Kind
B2
Abstract

Provided are techniques for receiving a scanned image corresponding to a page; analyzing the scanned image to identify a set of characters (Ci) and corresponding positions (Pi) of each character of Ci on the page; applying natural language processing (NPL) and an analytic analysis algorithm to determine a semantic analysis relationship of phrases formed by Ci to determine meanings for the phrases; generating a plurality of annotations (Ai) indicating the determined meanings of the phrases, wherein each annotation is assigned a corresponding position (Qi) on the page based upon the Pi of the corresponding characters on the page; and storing, in a non-transitory computer-readable medium, the scanned image in conjunction with the plurality of annotations and the corresponding Qi.

Claims (38)

1. An apparatus, comprising:

a processor;

a computer-readable storage device coupled to the processor; and

instructions, stored on the computer-readable storage device and executed on the processor, for performing a method, the method comprising:

receiving a scanned image corresponding to a page of text;

analyzing the scanned image to identify a set of characters (Ci) and corresponding positions (Pi) of each character of Ci on the page;

applying natural language processing (NPL) and an analytic analysis algorithm to determine a semantic analysis relationship of phrases formed within Ci and to determine meanings for the phrases;

generating annotation data for each phrase based upon the meanings;

generating a plurality of annotations (Ai), each Ai corresponding to a corresponding phrase and the corresponding phrase's annotation data, wherein each annotation of Ai is assigned a corresponding position Qi on the page based upon the Pi of the corresponding characters on the page;

storing, in a non-transitory computer-readable medium, the scanned image in conjunction with the plurality of annotations, annotation data and the corresponding Qi; and

displaying the scanned page in conjunction with the annotations, wherein each annotation is displayed at the corresponding position.

2. The apparatus of claim 1 , the method further comprising:

generating an overlay comprising the plurality of annotations, each annotation at the corresponding Qi; and

transmitting, to a display device for display on the display device, the scanned image and the overlay.

3. The apparatus of claim 1 , the displaying comprising:

superimposing the plurality of annotations on the scanned image, each annotation at the corresponding Qi, to produce a modified scanned image; and

transmitting, to a display device for display on the display device, the modified scanned image.

4. The apparatus of claim 1 , wherein the annotations are punctuation corresponding to textual content of the scanned image.

5. The apparatus of claim 1 , wherein the annotation data is reference notes corresponding to the phrases.

6. The apparatus of claim 1 , wherein each characters of Ci represents a letter.

7. The apparatus of claim 1 , wherein each character of Ci represents a word.

8. A computer programming product for the production of annotated images, comprising a non-transitory computer-readable storage medium having program code embodied therewith, the program code executable by a plurality of processors to perform a method comprising:

receiving a scanned image corresponding to a page of text;

analyzing the scanned image to identify a set of characters (Ci) and corresponding positions (Pi) of each character of Ci on the page;

applying natural language processing (NPL) and an analytic analysis algorithm to determine a semantic analysis relationship of phrases formed within Ci and to determine meanings for the phrases;

generating annotation data for each phrase based upon the meanings;

generating a plurality of annotations (Ai), each Ai corresponding to a corresponding phrase and the corresponding phrase's annotation data, wherein each annotation of Ai is assigned a corresponding position Qi on the page based upon the Pi of the corresponding characters on the page;

storing, in a non-transitory computer-readable medium, the scanned image in conjunction with the plurality of annotations, annotation data and the corresponding Qi; and

displaying the scanned page in conjunction with the annotations, wherein each annotation is displayed at the corresponding position.

9. The computer programming product of claim 8 , the method further comprising:

generating an overlay comprising the plurality of annotations, each annotation at the corresponding Qi; and

transmitting, to a display device for display on the display device, the scanned image and the overlay.

10. The computer programming product of claim 8 , the displaying comprising:

superimposing the plurality of annotations on the scanned image, each annotation at the corresponding Qi, to produce a modified scanned image; and

transmitting, to a display device for display on the display device, the modified scanned image.

11. The computer programming product of claim 8 , wherein the annotations are punctuation corresponding to textual content of the scanned image.

12. The computer programming product of claim 8 , wherein the annotation data is reference notes corresponding to the phrases.

13. The computer programming product of claim 8 , wherein each characters of Ci represents a letter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2015
From: ANGLIN, DEBBIE A.; GE, LI; LIU, SU; YAN, SHUNGUO
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 036809/0595 →
Continuity (1)
Related Publication 20170109334A1 · Apr 20, 2017