IP Library Granted Patent US 10,552,702
Granted Patent B2
US 10,552,702 · App. 15/854,327 · Granted Feb 4, 2020

Method and system for optical character recognition of series of images

Inventors: Aleksey Ivanovich Kalyuzhny (Moscow region, RU); Aleksey Yevgenyevich Lebedev (Orenburg, DE)
Assignee: ABBYY PRODUCTION LLC
G06K9/325G06K9/00449G06K9/00483G06K9/4604G06K9/6218G06K9/6267G06T3/40G06K2209/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,552,702
App. No.
15/854,327
Granted
Feb 4, 2020
Kind
B2
Abstract

Systems and methods for performing OCR of a series of images depicting text symbols. An example method comprises: receiving, by a processing device, a current image of a series of images of an original document, wherein the current image at least partially overlaps with a previous image of the series of images; performing optical symbol recognition (OCR) of the current image to produce an OCR text and a corresponding text layout; associating, using a coordinate transformation, at least part of the OCR text with a first cluster of a plurality of clusters of symbol sequences, wherein the OCR text is produced by processing the current image and wherein the symbol sequences are produced by processing one or more previously received images of the series of images; identifying a first median string representing the first cluster of symbol sequences based on a first subset of images of the series of images; identifying a first template field of a document template corresponding to the first cluster based on the first median string representing the first cluster and the text layout of the current image; analyzing the symbol sequences from the first cluster to identify suitable symbol sequences, wherein the suitable symbol sequences satisfy first parameters of the first template field; identifying, for the first cluster, a second-level median string representing the cluster of symbol sequences based on a plurality of the suitable symbol sequences; producing, using the second-level median string, a resulting OCR text representing at least a portion of the first template field of the original document.

Claims (68)

1. A method, comprising:

receiving, by a processing device, a current image of a series of images of an original document, wherein the current image at least partially overlaps with a previous image of the series of images;

performing optical character recognition (OCR) of the current image to produce an OCR text and a corresponding text layout;

associating, using a coordinate transformation, at least part of the OCR text with a first cluster of a plurality of clusters of symbol sequences, wherein the OCR text is produced by processing the current image and wherein the symbol sequences are produced by processing one or more previously received images of the series of images;

identifying a first median string representing the first cluster of symbol sequences based on a first subset of images of the series of images;

identifying a first template field of a document template corresponding to the first cluster based on the first median string representing the first cluster and the text layout of the current image;

analyzing the symbol sequences from the first cluster to identify suitable symbol sequences, wherein the suitable symbol sequences satisfy first parameters of the first template field;

identifying, for the first cluster, a second-level median string representing the cluster of symbol sequences based on a plurality of the suitable symbol sequences; and

producing, using the second-level median string, a resulting OCR text representing at least a portion of the first template field of the original document.

2. The method of claim 1 further comprising:

normalizing one or more symbol sequences from the first cluster to conform these symbol sequences to the first parameters of the first template field;

identifying, for the first cluster, the second-level median string representing the cluster of symbol sequences based on a plurality of the normalized symbol sequences.

3. The method of claim 2 wherein normalizing comprises:

identifying one or more unconforming symbols in the symbol sequence, wherein the unconforming symbol is a symbol that does not satisfy first parameters of the first template field;

replace the unconforming symbols in the symbol sequence with blank spaces.

4. The method of claim 1 wherein analyzing the symbol sequences from the first cluster to identify suitable symbol sequences comprises:

filtering the symbol sequences from the first cluster to filter out “garbage” symbol sequences.

5. The method of claim 1 , wherein the second-level median string is a constrained median string, satisfying second parameters of the first template field.

6. The method of claim 1 , further comprising:

determining that the second-level median string cannot be identified;

identifying, for the cluster, a third median string representing the cluster of symbol sequences based on a second subset of images of the series of images different from the first subset of images.

7. The method of claim 6 wherein the second subset of the series of images comprises the first subset of the series of images.

8. The method of claim 1 further comprising:

identifying the document template corresponding the original document based at least on the text layout, produced by the OCR, and the identified first median string.

9. The method of claim 8 wherein the document template is selected from a set of document templates.

10. The method of claim 8 further comprising:

determining that the document template for the original document cannot be identified with a satisfactory confidence level;

identifying a fourth median string representing the cluster of symbol sequences based on a third subset of images of the series of images different from the first subset of images.

11. A system, comprising:

a memory;

a processing device, coupled to the memory, the processing device configured to:

receive, by a processing device, a current image of a series of images of an original document, wherein the current image at least partially overlaps with a previous image of the series of images;

perform optical character recognition (OCR) of the current image to produce an OCR text and a corresponding text layout;

associate, using a coordinate transformation, at least part of the OCR text with a first cluster of a plurality of clusters of symbol sequences, wherein the OCR text is produced by processing the current image and wherein the symbol sequences are produced by processing one or more previously received images of the series of images;

identify a first median string representing the first cluster of symbol sequences based on a first subset of images of the series of images;

identify a first template field of a document template corresponding to the first cluster based on the first median string representing the first cluster and the text layout of the current image;

analyze the symbol sequences from the first cluster to identify suitable symbol sequences, wherein the suitable symbol sequences satisfy first parameters of the first template field;

identify, for the first cluster, a second-level median string representing the cluster of symbol sequences based on a plurality of the suitable symbol sequences; and

produce, using the second-level median string, a resulting OCR text representing at least a portion of the first template field of the original document.

12. The system of claim 11 further comprising:

normalizing one or more symbol sequences from the first cluster to conform these symbol sequences to the first parameters of the first template field;

identifying, for the first cluster, the second-level median string representing the cluster of symbol sequences based on a plurality of the normalized symbol sequences.

13. The system of claim 12 wherein normalizing comprises:

identifying one or more unconforming symbols in the symbol sequence, wherein the unconforming symbol is a symbol that does not satisfy first parameters of the first template field;

replace the unconforming symbols in the symbol sequence with blank spaces.

14. The system of claim 11 wherein analyzing the symbol sequences from the first cluster to identify suitable symbol sequences comprises:

filtering the symbol sequences from the first cluster to filter out “garbage” symbol sequences.

15. The system of claim 11 , wherein the second-level median string is a constrained median string, satisfying second parameters of the first template field.

16. The system of claim 11 , further comprising:

determining that the second-level median string cannot be identified;

identifying, for the cluster, a third median string representing the cluster of symbol sequences based on a second subset of images of the series of images different from the first subset of images.

17. The system of claim 11 further comprising:

identifying the document template corresponding the original document based at least on the text layout, produced by the OCR and the identified first median string.

18. The system of claim 17 further comprising:

determining that the document template for the original document cannot be identified with a satisfactory confidence level;

identifying a fourth median string representing the cluster of symbol sequences based on a third subset of images of the series of images different from the first subset of images.

19. A computer-readable non-transitory storage medium comprising executable instructions that, when executed by a processing device, cause the processing device to:

receive, by a processing device, a current image of a series of images of an original document, wherein the current image at least partially overlaps with a previous image of the series of images;

performed optical character recognition (OCR) of the current image to produce an OCR text and a corresponding text layout;

associate, using a coordinate transformation, at least part of the OCR text with a first cluster of a plurality of clusters of symbol sequences, wherein the OCR text is produced by processing the current image and wherein the symbol sequences are produced by processing one or more previously received images of the series of images;

identify a first median string representing the first cluster of symbol sequences based on a first subset of images of the series of images;

identify a first template field of a document template corresponding to the first cluster based on the first median string representing the first cluster and the text layout of the current image;

analyze the symbol sequences from the first cluster to identify suitable symbol sequences, wherein the suitable symbol sequences satisfy first parameters of the first template field;

identify, for the first cluster, a second-level median string representing the cluster of symbol sequences based on a plurality of the suitable symbol sequences; and

produce, using the second-level median string, a resulting OCR text representing at least a portion of the first template field of the original document.

20. The system of claim 19 further comprising:

normalizing one or more symbol sequences from the first cluster to conform these symbol sequences to the first parameters of the first template field;

identifying, for the first cluster, the second-level median string representing the cluster of symbol sequences based on a plurality of the normalized symbol sequences.

Assignments (4)
SECURITY INTEREST Recorded Aug 14, 2023
From: ABBYY INC.; ABBYY USA SOFTWARE HOUSE INC.; ABBYY DEVELOPMENT INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 064730/0964 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 25, 2022
From: ABBYY PRODUCTION LLC
To: ABBYY DEVELOPMENT INC.
Reel/Frame 059249/0873 →
MERGER Recorded Jan 24, 2019
From: ABBYY DEVELOPMENT LLC
To: ABBYY PRODUCTION LLC
Reel/Frame 048129/0558 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2017
From: KALYUZHNY, ALEKSEY IVANOVICH; LEBEDEV, ALEKSEY YEVGENYEVICH
To: ABBYY DEVELOPMENT LLC
Reel/Frame 044486/0025 →
Priority Claims (1)
RU 2017144602 · Dec 19, 2017 · national
Continuity (1)
Related Publication 20190188511A1 · Jun 20, 2019