IP Library Granted Patent US 8,588,528
Granted Patent B2
US 8,588,528 · App. 12/820,620 · Granted Nov 19, 2013

Systems and methods for displaying scanned images with overlaid text

Inventors: Peter Chapman (Bedford, MA); Paul Albrecht (Bedford, MA)
Assignee: K-NFB Reading Technology, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,588,528
App. No.
12/820,620
Granted
Nov 19, 2013
Kind
B2
Abstract

Disclosed are techniques and systems to provide a scanned image in which a portion of the image is overlaid with OCR generated text corresponding to the text of the original scanned document.

Claims (81)

1. A computer-implemented method, comprising:

receiving, by a computer, a file that includes a representation of a scanned image of a document;

determining by the computer one or more portions of the scanned image of the document that are one or more regions of probable text by performing, by the computer, optical character recognition (OCR) on the image file to generate a text file that includes recognized (OCR) text associated with words included in the scanned image of the document;

determining by the computer one or more properties of the words in the scanned image, with the one or more properties including at least a font style and font size;

formatting by the computer the recognized text to match the determined font style and font size of the words in the scanned image; and

displaying the document on a display of a computing device, with one or more portions of the document having words in the scanned image being overlaid with optical character recognized text having the formatted font style and font size, and an transparency between about 25% and 75%, where both the words in the scanned image in the one or more portions of the document and the optical character recognized are viewed simultaneously with differences between words in the scanned image text in the one or more regions of probable text and the overlaid optical character recognized text identified, and with remaining one or more portions of the document displayed from the file that includes the representation of the scanned image of the document.

2. The computer-implemented method of claim 1 further comprises:

providing the optical character recognized text as opaque subsequent to the words being overlaid such that only the optical character recognized text and not the text of the scanned image is viewed; and

overlaying the optical character recognized text as opaque text-based portions to obscure the one or more portions of the scanned image of the document.

3. The computer-implemented method of claim 1 , further comprising:

determining a location of a word in the scanned image; and

aligning the OCR text of the word with the determined location in the scanned image in the display of the document.

4. The computer-implemented method of claim 1 , further comprising:

determining a color of a word in the scanned image; and

formatting the OCR text of the word to match the determined color of the word.

5. The computer-implemented method of claim 1 , further comprising:

determining a color of a background surrounding a word in the scanned image; and

formatting the OCR text of the word to include a background color to match the determined color of the background surrounding the word.

6. The computer-implemented method of claim 1 , further comprising:

determining a color of a word in the scanned image;

formatting the OCR text of the word to match the determined color of the word;

determining a color of a background surrounding a word in the scanned image; and

formatting the OCR text of the word to include a background color to match the determined color of the background surrounding the word.

7. The computer-implemented method of claim 1 , further comprising:

identifying the text-based portions of the scanned image associated with text on the document;

identifying the image-based portions of the scanned image associated with images on the document.

8. A computer program product tangibly embodied in a computer readable hardware storage device, the computer program product comprising instructions to cause a processor to:

receive a file that includes a representation of a scanned image of a document;

perform optical character recognition (OCR) on the image file to generate a text file that includes recognized (OCR) text associated with words included in the image of the document;

determine one or more properties of the words in the scanned image, with the one or more properties including at least a font style and font size;

format the recognized text to match the determined font style and font size of the words in the scanned image; and

display the document on a display of a computing device with one or more portions of the document having words in the scanned image being overlaid with optical character recognized text having an transparency between about 25% and 75%, where both the words in the scanned image in the one or more portions of the document and the optical character recognized text are viewed simultaneously with differences between words in the scanned image in the one or more regions of probable text and the overlaid optical character recognized text identified, and with remaining one or more portions of the document displayed from the file that includes the representation of the scanned image of the document.

9. The computer program product of claim 8 further comprise instructions to:

provide the optical character recognized text as opaque subsequent to the words being overlaid such that only the optical character recognized text and not the text of the original scanned image is viewed; and

overlay the optical character recognized text as opaque text-based portions to obscure the scanned image of the document.

10. The computer program product of claim 8 , further comprising instructions to:

determine a location of a word in the scanned image; and

align the OCR text of the word with the determined location in the scanned image in the display of the document.

11. The computer program product of claim 8 , further comprising instructions to:

determine a color of a word in the scanned image; and

format the OCR text of the word to match the determined color of the word.

12. The computer program product of claim 8 , further comprising instructions to:

determine a color of a background surrounding a word in the scanned image; and

format the OCR text of the word to include a background color to match the determined color of the background surrounding the word.

13. The computer program product of claim 8 , further comprising instructions to:

determine a color of a word in the scanned image;

format the OCR text of the word to match the determined color of the word;

determine a color of a background surrounding a word in the scanned image; and

format the OCR text of the word to include a background color to match the determined color of the background surrounding the word.

14. The computer program product of claim 8 , further comprising instructions to:

identify the text-based portions of the scanned image associated with text on the document;

identify the image-based portions of the scanned image associated with images on the document.

15. A system, comprising:

a processor for executing instructions;

memory coupled to the processor for storing instructions; and

a computer hardware storage device storing a computer program product, the computer program product comprising instructions to cause the processor to:

receive a file that includes a representation of a scanned image of a document;

perform optical character recognition (OCR) on the image file to generate a text file that includes recognized (OCR) text associated with words included in the image of the document;

determine one or more properties of the words in the scanned image, with the one or more properties including at least a font style and font size;

format the recognized text to match the determined font style and font size of the words in the scanned image; and

display the document on a display of a computing device with one or more portions of the document having words in the scanned image being overlaid with optical character recognized text having an transparency between about 25% and 75%, where both the words in the scanned image in the one or more portions of the document and the optical character recognized text are viewed simultaneously with differences between words in the scanned image in the one or more regions of probable text and the overlaid optical character recognized text identified and with remaining one or more portions of the document displayed from the file that includes the representation of the scanned image of the document.

16. The system of claim 15 further configured to:

provide the optical character recognized text as opaque subsequent to the words being overlaid such that only the optical character recognized text and not the text of the original scanned image is viewed;

overlay the optical character recognized text as opaque text-based portions to obscure the scanned image of the document.

17. The system of claim 15 , wherein the instructions to display are further configured to:

determine a location of a word in the scanned image; and

align the OCR text of the word with the determined location in the scanned image in the display of the document.

18. The system of claim 15 , wherein the instructions to display are further configured to:

determine a color of a word in the scanned image; and

format the OCR text of the word to match the determined color of the word.

19. The system of claim 15 , further comprising instructions to:

determine a color of a background surrounding a word in the scanned image; and

format the OCR text of the word to include a background color to match the determined color of the background surrounding the word.

20. The system of claim 15 , wherein the instructions to display are further configured to:

determine a color of a word in the scanned image;

format the OCR text of the word to match the determined color of the word;

determine a color of a background surrounding a word in the scanned image; and

format the OCR text of the word to include a background color to match the determined color of the background surrounding the word.

21. The system of claim 15 , wherein the instructions to display are further configured to:

identify the text-based portions of the scanned image associated with text on the document; and

identify the image-based portions of the scanned image associated with images on the document.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2021
From: EM ACQUISITION CORP., INC.
To: T PLAY HOLDINGS LLC
Reel/Frame 055896/0481 →
RELEASE OF SECURITY INTEREST Recorded Sep 17, 2015
From: FISH & RICHARDSON P.C.
To: DIMENSIONAL STACK ASSETS LLC
Reel/Frame 036629/0762 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2015
From: DIMENSIONAL STACK ASSETS, LLC
To: EM ACQUISITION CORP., INC.
Reel/Frame 036593/0328 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2015
From: K-NFB READING TECHNOLOGY, INC.
To: DIMENSIONAL STACK ASSETS LLC
Reel/Frame 035546/0205 →
LIEN Recorded Dec 30, 2014
From: K-NFB HOLDING TECHNOLOGY, IMC.
To: FISH & RICHARDSON P.C.
Reel/Frame 034599/0860 →
CHANGE OF NAME Recorded Mar 21, 2013
From: K-NFB READING TECHNOLOGY, INC.
To: K-NFB HOLDING TECHNOLOGY, INC.
Reel/Frame 030058/0669 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2013
From: K-NFB HOLDING TECHNOLOGY, INC.
To: K-NFB READING TECHNOLOGY, INC.
Reel/Frame 030059/0351 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2010
From: CHAPMAN, PETER; ALBRECHT, PAUL
To: K-NFB READING TECHNOLOGY, INC.
Reel/Frame 024966/0353 →
Continuity (2)
Provisional Application 61219448 · Jun 23, 2009
Related Publication 20100329555A1 · Dec 30, 2010