IP Library Granted Patent US 7,574,050
Granted Patent B2
US 7,574,050 · App. 10/795,976 · Granted Aug 11, 2009

Image page search for arbitrary textual information

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,574,050
App. No.
10/795,976
Granted
Aug 11, 2009
Kind
B2
Abstract

The approach of the present invention is called optical word recognition (OWR). The present invention advantageously uses techniques to search for arbitrary textual information contained in imaged documents. The result is a significant advance in high-speed search for textual information within imaged documents. The optical apparatus includes a generating unit for synthetically generating textual patterns as signal templates. The optical apparatus has a compensating unit for compensating, if necessary, for visual differences between the synthetically generated textual patterns and images being compared against the synthetically generated images. The optical apparatus has a comparing unit for comparing compensated images against images in a database.

Claims (80)

1. A method of automatically identifying a pattern on a page, comprising:

a computer performing the following:

synthetically generating textual patterns as signal templates;

generating a compensated image, compensating, if necessary, for visual differences between the synthetically generated textual patterns and images being compared against the synthetically generated patterns; and comparing compensated images against images in a database; and

identifying a pattern on a page based upon the comparison;

wherein compensating an image includes reducing resolution, inverting and mirroring a page image in the database; and

wherein comparing compensated images against images in a database includes:

performing a Fast Fourier Transform (FFT) on the compensated image, moving the compensated image from the spatial to frequency domain;

performing an FFT on a search target image;

multiplying the FFT on the image to be searched by the FFT of the search target image to produce a correlation plane;

performing an inverse FFT of the correlation plane, converting the correlation plane from the frequency domain to a spatial specification to produce a similarity matrix for search pattern locations within the target image; and

applying a threshold to the similarity matrix to extract location of matches above the threshold.

2. The method of claim 1 , comprising outputting a signal against a synthetically generated image.

3. The method of claim 1 , wherein said compensating step accommodates for visual differences between font typefaces and different font sizes.

4. The method of claim 1 , further comprising deleting a duplicate scanned first page.

5. The method of claim 1 , further comprising identifying pages as duplicates and assessing the duplicates for quality and deleting lower quality page of the duplicates.

6. The method of claim 5 , comprising performing a connected element analysis to identify speckle and blocks of solid color.

7. The method of claim 1 , wherein said compensating step can accommodate visual differences between different typefaces, different font sizes and distortions introduced in subsequent printing, handling and/or scanning of the page.

8. The method of claim 1 , wherein said compensating step can accommodate visual differences occurring from producing a graphic image.

9. The method of claim 1 , comprising creating a database of metadata to use in synthetically generating patterns.

10. The method of claim 1 , comprising creating a target to search for using a search word specified using numeric characters in the search word.

11. The method of claim 10 , wherein compensations include small enlargements or reductions in search pattern size or visual distortions.

12. A computer readable medium, comprising:

a first sequence of instructions which, when executed by said processor, causes said processor to:

synthetically generate textual patterns as signal templates;

a second sequence of instructions which when executed by said processor, causes said processor to compensate, if necessary, for visual differences between the synthetically generated textual patterns and images being compared against the synthetically generated images; and

a third set of instructions, which when executed by said processor, causes said processor to compare compensated images against images in a database;

wherein compensating includes reducing resolution, inverting and mirroring a page image in the database; and

wherein comparing compensated images against images in a database includes:

performing a Fast Fourier Transform (FFT) on the compensated image, moving the compensated image from the spatial to frequency domain;

performing an FFT on a search target image;

multiplying the FFT of the image to be searched by the FFT of the search target image to produce a correlation plane;

performing an inverse FFT of the correlation plane, converting the correlation plane from the frequency domain to a spatial specification to produce a similarity matrix for search pattern location within the target image; and

applying a threshold to the similarity matrix to extract location of matches above the threshold.

13. An optical apparatus, configured to automatically identify a pattern on a page, comprising:

a generating unit for synthetically generating textual patterns as signal templates;

a compensating unit for compensating, if necessary, for visual differences between the synthetically generated textual patterns and images being compared against the synthetically generated images; and

a comparing unit for comparing compensated images against images in a database

wherein compensating includes reducing resolution, inverting and mirroring a page image in the database; and

wherein comparing compensated images against images in a database includes:

performing a Fast Fourier Transform (FFT) on the compensated image, moving the compensated image from the spatial to frequency domain;

performing an FFT on a search target image;

multiplying the FFT of the image to be searched by the FFT of the search target image to produce a correlation plane;

performing an inverse FFT of the correlation plane, converting the correlation plane from the frequency domain to a spatial specification to produce a similarity matrix for search pattern locations within the target image; and

applying a threshold to the similarity matrix to extract location of matches above the threshold.

14. A computer-readable medium configured to automatically identify a pattern on a page, having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions which, when executed by a processor, cause said processor to perform the steps of:

synthetically generating textual patterns as signal templates;

compensating, if necessary, for visual differences between the synthetically generated textual patterns and images being compared against the synthetically generated images; and

comparing compensated images against images in a database;

wherein compensating includes reducing resolution, inverting and mirroring a page image in the database; and

wherein comparing compensated images against images in a database includes:

performing a Fast Fourier Transform (FFT) on the compensated image, moving the compensated image from the spatial to frequency domain;

performing an FFT on a search target image;

multiplying the FFT of the image to be searched by the FFT of the search target image to produce a correlation plane;

performing an inverse FFT of the correlation plane, converting the correlation plane from the frequency domain to a spatial specification to produce a similarity matrix for search pattern locations within the target image; and

applying a threshold to the similarity matrix to extract location of matches above the threshold.

15. A computer system for automatically identifying a pattern on a page, said computer system comprising a processor and a memory coupled to said processor; the memory having stored therein sequences of instructions, which, when executed by said processor to perform the steps of:

synthetically generating textual patterns as signal templates;

compensating, if necessary, for visual differences between the synthetically generated textual patterns and images being compared against the synthetically generated images; and

comparing compensated images against images in a database;

wherein compensating includes reducing resolution, inverting and mirroring a page image in the database; and

wherein comparing compensated images against images in a database includes:

performing a Fast Fourier Transform (FFT) on the compensated image, moving the compensated image from the spatial to frequency domain;

performing an FFT on a search target image;

multiplying the FFT of the image to be searched by the FFT of the search target image to produce a correlation plane;

performing an inverse FFT of the correlation plane, converting the correlation plane from the frequency domain to a spatial specification to produce a similarity matrix for search pattern locations within the target image; and

applying a threshold to the similarity matrix to extract location of matches above the threshold.

16. A method of automatically identifying a pattern on a page, comprising:

a computer performing the following:

synthetically generating textual patterns as signal templates;

generating a compensated image, compensating, if necessary, for visual differences between the synthetically generated textual patterns and image being compared against the synthetically generated images; and

comparing compensated images against images in a database;

wherein said compensating includes reducing resolution, inverting and mirroring a page image in the database;

wherein compensating includes reducing resolution, inverting and mirroring a page image in the database; and

wherein comparing compensated images against images in a database includes:

performing a Fast Fourier Transform (FFT) on the compensated image, moving the compensated image from the spatial to frequency domain;

performing an FFT on a search target image;

multiplying the FFT of the image to be searched by the FFT of the search target image to produce a correlation plane;

performing an inverse FFT of the correlation plane, converting the correlation plane from the frequency domain to a spatial specification to produce a similarity matrix for search pattern location within the target image; and

applying a threshold to the similarity matrix to extract location of matches above the threshold.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2010
From: NORTHROP GRUMMAN INFORMATION TECHNOLOGY, INC.
To: NORTHROP GRUMMAN SYSTEMS CORPORATION
Reel/Frame 023915/0539 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2009
From: NORTHROP GRUMMAN CORPORATION
To: NORTHROP GRUMMAN INFORMATION TECHNOLOGY, INC.
Reel/Frame 023574/0761 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2004
From: LADWIG, MICHAEL; STALCUP, BRUCE W.; BROWER, JAMES
To: NORTHROP GRUMMAN CORPORATION
Reel/Frame 015068/0289 →