IP Library Granted Patent US 10,607,101
Granted Patent B1
US 10,607,101 · App. 15/839,133 · Granted Mar 31, 2020

System and method for patterned artifact removal for bitonal images

Inventor: Jay Wagner (Yukon, OK)
Assignee: Revenue Management Solutions, LLC
G06K9/40G06K9/00456G06T7/0002G06K2209/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,101
App. No.
15/839,133
Granted
Mar 31, 2020
Kind
B1
Abstract

Images in bitonal formats often include watermarks, stamps, or other patterns and artifacts. These patterned artifacts may be represented as a series of geometric points, dots, and/or dashes in the general shape of the original pattern. These patterned artifacts make other processes such as optical character recognition (OCR) difficult or impossible when items or pixels of interest are also found within the pattern of such artifact(s). Current patterned artifact removal solutions use methods of erosion to minimize the unwanted patterned artifact. However, such methods also erode the pixels/items of interest which, in turn, cause failures in other processes, such as OCR, that are desired to be carried out on or with the image.

Claims (84)

1. A method for removing a patterned artifact from an initial bitonal image, the method being performed by one or more processors and comprising:

identifying the patterned artifact in the initial bitonal image,

wherein the identifying the patterned artifact step includes:

generating a modified image by applying an erosion algorithm based on stroke width of the initial image;

marking noise locations of the modified image; and

defining, in the modified image, an artifact boundary and thereby identify the patterned artifact;

removing the patterned artifact to create a new bitonal image with the patterned artifact substantially removed; and

identifying text in the new bitonal image; and

cleaning the new bitonal image to remove one or more remaining portions of the patterned artifact and thereby create a second new bitonal image.

2. The method of claim 1 , wherein the removing the patterned artifact step includes:

applying one or more filters in the artifact boundary defined from the identifying the patterned artifact step;

dilating the identified patterned artifact; and

removing areas having a size larger than areas marked as noise from the marking step of the identifying the patterned artifact step and thereby creating the new bitonal image with the patterned artifact substantially removed.

3. The method of claim 2 , wherein the step of identifying text in the new bitonal image includes:

identifying text in the new bitonal image;

rank reducing the identified text to create one or more potential blocks of text;

a first removing of one or more remaining portions of the patterned artifact through applying a binary AND operation on the identified text from the identifying text in the new bitonal image step with the one or more potential blocks of text from the rank reducing step to create a first intermediate bitonal image of the new bitonal image;

dilating the first intermediate bitonal image; and

comparing the dilated first intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step thereby further removing the one or more remaining portion of the patterned artifact and creating a second intermediate bitonal image of the new bitonal image.

4. The method of claim 3 , wherein the cleaning the new bitonal image step includes:

cleaning the second intermediate bitonal image by applying a binary AND operation on the second intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step and thereby create the second new bitonal image.

5. A method for removing a patterned artifact from an initial bitonal image, the method being performed by one or more processors and comprising:

(a) identifying the patterned artifact in the initial bitonal image, wherein the identifying the patterned artifact step includes:

generating a modified image by applying an erosion algorithm based on stroke width of the initial image; and

defining, in the modified image, an artifact boundary and thereby identify the patterned artifact; and

(b) removing the patterned artifact to create a new bitonal image with the patterned artifact substantially removed.

6. The method of claim 5 further comprising the steps of:

(c) identifying text in the new bitonal image; and

(d) cleaning the new bitonal image to remove one or more remaining portions of the patterned artifact and thereby create a second new bitonal image.

7. The method of claim 6 , wherein the step of identifying text in the new bitonal image includes:

identifying text in the new bitonal image;

rank reducing the identified text to create one or more potential blocks of text;

a first removing of one or more remaining portions of the patterned artifact through applying a binary AND operation on the identified text from the identifying text in the new bitonal image step with the one or more potential blocks of text from the rank reducing step to create a first intermediate bitonal image of the new bitonal image;

dilating the first intermediate bitonal image; and

comparing the dilated first intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step thereby further removing the one or more remaining portion of the patterned artifact and creating a second intermediate bitonal image of the new bitonal image.

8. The method of claim 7 , wherein the cleaning the new bitonal image step includes:

cleaning the second intermediate bitonal image by applying a binary AND operation on the second intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step and thereby create the second new bitonal image.

9. The method of claim 5 , wherein the identifying the patterned artifact step further includes:

before defining the artifact boundary, marking noise locations of the modified image.

10. The method of claim 9 , wherein the removing the patterned artifact step includes:

applying one or more filters in the artifact boundary defined from the identifying the patterned artifact step;

dilating the identified patterned artifact; and

removing areas having a size larger than areas marked as noise from the marking step of the identifying the patterned artifact step and thereby creating the new bitonal image with the patterned artifact substantially removed.

11. A non-transitory computer-readable storage media having stored thereon a plurality of computer-executable instructions for removing a patterned artifact from an initial bitonal image which, when executed by a processor, cause the processor to:

identify the patterned artifact in the initial bitonal image, wherein the identification of the patterned artifact in the bitonal image includes generating a modified image by applying an erosion algorithm based on stroke width of the initial image; and defining, in the modified image, an artifact boundary and thereby identify the patterned artifact;

remove the patterned artifact to create a new bitonal image with the patterned artifact substantially removed; and

clean the new bitonal image to remove one or more remaining portions of the patterned artifact and thereby create a second new bitonal image.

12. The non-transitory computer-readable storage media of claim 11 , wherein the plurality of computer-executable instructions for removing a patterned artifact from an initial bitonal image which, when executed by a processor, further cause the processor to:

prior to cleaning the new bitonal image, identify text in the new bitonal image.

13. The non-transitory computer-readable storage media of claim 12 , wherein the identification of text in the new bitonal image includes:

identifying text in the new bitonal image;

rank reducing the identified text to create one or more potential blocks of text;

a first removing of one or more remaining portions of the patterned artifact through applying a binary AND operation on the identified text from the identifying text in the new bitonal image step with the one or more potential blocks of text from the rank reducing step to create a first intermediate bitonal image of the new bitonal image;

dilating the first intermediate bitonal image; and

comparing the dilated first intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step thereby further removing the one or more remaining portion of the patterned artifact and creating a second intermediate bitonal image of the new bitonal image.

14. The non-transitory computer-readable storage media of claim 13 , wherein the cleaning the new bitonal image includes:

cleaning the second intermediate bitonal image by applying a binary AND operation on the second intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step and thereby create the second new bitonal image.

15. The non-transitory computer-readable storage media of claim 11 , wherein the removal of the patterned artifact to create a new bitonal image with the patterned artifact substantially removed includes:

applying one or more filters in the artifact boundary;

dilating the identified patterned artifact; and

removing areas having a size larger than areas marked as noise from the marking step of the identifying the patterned artifact step and thereby creating the new bitonal image with the patterned artifact substantially removed.

16. A system comprising:

a processor; and

a computer-readable storage media operably connected to said processor, said computer-readable storage media including instructions that when executed by said processor, cause performance of said processor to remove a patterned artifact from an initial bitonal image by performing operations including:

identify the patterned artifact in said initial bitonal image,

wherein the operation of identify the patterned artifact in said initial bitonal image includes:

generating a modified image by applying an erosion algorithm based on stroke width of the initial image;

marking noise locations of the modified image; and

defining, in the modified image, an artifact boundary and thereby identify the patterned artifact;

remove the patterned artifact to create a new bitonal image with the patterned artifact substantially removed;

identify text in the new bitonal image; and

clean the new bitonal image to remove one or more remaining portion of the patterned artifact and thereby create a second new bitonal image.

17. The system of claim 16 , wherein the operation of remove the patterned artifact to create a new bitonal image with the patterned artifact substantially removed includes:

applying one or more filters in the artifact boundary defined from the identifying the patterned artifact step;

dilating the identified patterned artifact; and

removing areas having a size larger than areas marked as noise from the marking step of the identifying the patterned artifact step and thereby creating the new bitonal image with the patterned artifact substantially removed.

18. The system of claim 16 , wherein the operation of identify text in the new bitonal image includes:

identifying text in the new bitonal image;

rank reducing the identified text to create one or more potential blocks of text;

a first removing of one or more remaining portions of the patterned artifact through applying a binary AND operation on the identified text from the identifying text in the new bitonal image step with the one or more potential blocks of text from the rank reducing step to create a first intermediate bitonal image of the new bitonal image;

dilating the first intermediate bitonal image; and

comparing the dilated first intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step thereby further removing the one or more remaining portion of the patterned artifact and creating a second intermediate bitonal image of the new bitonal image.

19. The system of claim 18 , wherein the operation of clean the new bitonal image to remove one or more remaining portion of the patterned artifact and thereby create a second new bitonal image includes:

cleaning the second intermediate bitonal image by applying a binary AND operation on the second intermediate bitonal image with the initial bitonal image within the artifact boundary defined from the identifying the patterned artifact step and thereby create the second new bitonal image.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Dec 20, 2021
From: MANULIFE INVESTMENT MANAGEMENT PRIVATE EQUITY AND CREDIT (US) LLC, FORMERLY KNOWN AS HANCOCK CAPITAL MANAGEMENT, LLC, AS AGENT
To: REVENUE MANAGEMENT SOLUTIONS, LLC
Reel/Frame 058429/0380 →
SECURITY INTEREST Recorded Dec 16, 2021
From: REVENUE MANAGEMENT SOLUTIONS, LLC
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 058405/0043 →
RELEASE OF SECURITY INTEREST Recorded Jun 20, 2019
From: COMMERCE BANK
To: REVENUE MANAGEMENT SOLUTIONS, LLC
Reel/Frame 049539/0011 →
SECURITY INTEREST Recorded Jun 19, 2019
From: REVENUE MANAGEMENT SOLUTIONS, LLC
To: HANCOCK CAPITAL MANAGEMENT, LLC, AS AGENT
Reel/Frame 049521/0914 →
SECURITY INTEREST Recorded Nov 9, 2018
From: REVENUE MANAGEMENT SOLUTIONS, LLC
To: COMMERCE BANK
Reel/Frame 047465/0090 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2017
From: WAGNER, JAY
To: REVENUE MANAGEMENT SOLUTIONS, LLC
Reel/Frame 044370/0394 →
Continuity (1)
Provisional Application 62434208 · Dec 14, 2016