IP Library Granted Patent US 12,046,016
Granted Patent B2
US 12,046,016 · App. 17/546,652 · Granted Jul 23, 2024

Division of images into separate color layers

Inventors: Vadim Mikhonov (Astrakhan, RU); Ivan Zagaynov (Dolgoprudniy, RU)
Assignee: ABBYY Development Inc.
G06V10/56G06V10/26G06V10/28G06V10/457G06V10/763G06V30/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,046,016
App. No.
17/546,652
Granted
Jul 23, 2024
Kind
B2
Abstract

A method of the disclosure includes receiving, by a processing device, a document image, dividing the document image into a plurality of patches and determining, for each patch, whether the patch is monochromatic or polychromatic. It further includes clusterizing a plurality of monochromatic patches into a plurality of clusters within a color space, wherein each cluster corresponds to a color layer of a plurality of color layers of the document image, and segmenting each polychromatic patch into a corresponding plurality of monochromatic segments. The method also includes, for each polychromatic patch, associating each monochromatic segment of the corresponding plurality of monochromatic segments with a cluster of the plurality of clusters, and utilizing the plurality of clusters for performing an information extraction task on the document image.

Claims (48)

1. A method comprising:

receiving, by one or more processors, a document image;

detecting a plurality of connected components in the document image;

dividing the document image into a plurality of patches, wherein a first patch of the plurality of patches encompasses a first connected component of the plurality of connected components, wherein the first patch is contained within a second patch of the plurality of patches, and wherein the second patch encompasses a second connected component of the plurality of connected components;

determining, for each patch, whether the patch is monochromatic or polychromatic;

clustering monochromatic patches of the plurality of patches into a plurality of clusters within a color space, wherein the plurality of clusters comprises a predefined number of clusters, and wherein each cluster corresponds to a color layer of a plurality of color layers of the document image;

segmenting each polychromatic patch of the plurality of patches into a corresponding plurality of monochromatic segments;

for each polychromatic patch, associating each monochromatic segment of the corresponding plurality of monochromatic segments with a cluster of the plurality of clusters; and

utilizing the plurality of clusters for performing an information extraction task on the document image.

2. The method of claim 1 , further comprising adjusting one or more properties of the document image and binarizing the document image.

3. The method of claim 1 , further comprising collecting statistical data for each patch of the plurality of patches, wherein the statistical data for each patch comprises at least one of a number of pixels, a centroid in the color space, a measure of dispersion, and a measure of skewness.

4. The method of claim 1 , wherein clustering the monochromatic patches into the plurality of clusters comprises performing an iterative clustering process.

5. The method of claim 1 , wherein each monochromatic segment of the plurality of monochromatic segments corresponds to a respective color layer of the plurality of color layers.

6. The method of claim 1 , wherein performing the information extraction task comprises extracting information from each color layer of the document image and combining the information from each color layer in the document image.

7. A system comprising:

a memory; and

a processor coupled to the memory, the processor configured to:

receive a document image;

detect a plurality of connected components in the document image;

divide the document image into a plurality of patches, wherein a first patch of the plurality of patches encompasses a first connected component of the plurality of connected components, wherein the first patch is contained within a second patch of the plurality of patches, and wherein the second patch encompasses a second connected component of the plurality of connected components;

determine, for each patch, whether the patch is monochromatic or polychromatic;

clusterize monochromatic patches of the plurality of patches into a plurality of clusters within a color space, wherein the plurality of clusters comprises a predefined number of clusters, and wherein each cluster corresponds to a color layer of a plurality of color layers of the document image;

segment each polychromatic patch of the plurality of patches into a corresponding plurality of monochromatic segments;

for each polychromatic patch, associate each monochromatic segment of the corresponding plurality of monochromatic segments with a cluster of the plurality of clusters; and

utilize the plurality of clusters for performing an information extraction task on the document image.

8. The system of claim 7 , wherein the processor is further configured to adjusting one or more properties of the document image comprises and binarize the document image.

9. The system of claim 7 , wherein the processor is further configured to collect statistical data for each patch of the plurality of patches, and wherein the statistical data for each patch comprises at least one of a number of pixels, a centroid in the color space, a measure of dispersion, and a measure of skewness.

10. The system of claim 7 , wherein clustering the monochromatic patches into the plurality of clusters comprises performing an iterative clustering process.

11. The system of claim 7 , wherein each monochromatic segment of the plurality of monochromatic segments corresponds to a respective color layer of the plurality of color layers.

12. The system of claim 7 , wherein performing the information extraction task comprises extracting information from each color layer of the document image and combining the information from each color layer in the document image.

13. A non-transitory machine-readable storage medium including instructions that, when accessed by a processing device, cause the processing device to:

receive a document image;

detect a plurality of connected components in the document image;

divide the document image into a plurality of patches, wherein a first patch of the plurality of patches encompasses a first connected component of the plurality of connected components, wherein the first patch is contained within a second patch of the plurality of patches, and wherein the second patch encompasses a second connected component of the plurality of connected components;

determine, for each patch, whether the patch is monochromatic or polychromatic;

clusterize monochromatic patches of the plurality of patches into a plurality of clusters within a color space, wherein the plurality of clusters comprises a predefined number of clusters, and wherein each cluster corresponds to a color layer of a plurality of color layers of the document image;

segment each polychromatic patch of the plurality of patches into a corresponding plurality of monochromatic segments;

for each polychromatic patch, associate each monochromatic segment of the corresponding plurality of monochromatic segments with a cluster of the plurality of clusters; and

utilize the plurality of clusters for performing an information extraction task on the document image.

14. The non-transitory machine-readable storage medium of claim 13 , wherein the instructions further cause the processing device to collect statistical data for each patch of the plurality of patches, and wherein the statistical data for each patch comprises at least one of a number of pixels, a centroid in the color space, a measure of dispersion, and a measure of skewness.

15. The non-transitory machine-readable storage medium of claim 13 , wherein clustering the monochromatic patches into the plurality of clusters comprises performing an iterative clustering process.

16. The non-transitory machine-readable storage medium of claim 13 , wherein each monochromatic segment of the plurality of monochromatic segments corresponds to a respective color layer of the plurality of color layers.

17. The non-transitory machine-readable storage medium of claim 13 , wherein performing the information extraction task comprises extracting information from each color layer of the document image and combining the information from each color layer in the document image.

18. The method of claim 1 , further comprising:

identifying a first cluster of the plurality of clusters and a second cluster of the plurality of clusters, wherein a distance between a first centroid of the first cluster and a second centroid of the second cluster is a smallest distance between respective centroids of any pair of clusters of the plurality of clusters; and

merging the first cluster and the second cluster.

19. The method of claim 1 , further comprising:

performing pairwise merging of clusters of the plurality of clusters until a pre-determined threshold criterion is met.

Assignments (2)
SECURITY INTEREST Recorded Aug 14, 2023
From: ABBYY INC.; ABBYY USA SOFTWARE HOUSE INC.; ABBYY DEVELOPMENT INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 064730/0964 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2021
From: MIKHONOV, VADIM; ZAGAYNOV, IVAN
To: ABBYY DEVELOPMENT INC.
Reel/Frame 058368/0024 →
Priority Claims (1)
RU RU2021136357 · Dec 9, 2021 · national
Continuity (1)
Related Publication 20230186592A1 · Jun 15, 2023