IP Library Granted Patent US 9,002,066
Granted Patent B2
US 9,002,066 · App. 13/887,541 · Granted Apr 7, 2015

Methods, systems and processor-readable media for designing a license plate overlay decal having infrared annotation marks

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,002,066
App. No.
13/887,541
Granted
Apr 7, 2015
Kind
B2
Abstract

Methods, systems and processor-readable media for providing a license plate overlay decal with an infrared readable annotation mark for an optical character recognition and segmentation. The annotation mark with respect to character image of a license plate can be designed by training an ALPR engine to improve automatic license plate recognition performance. A plate overlay decal can be rendered with the annotation mark and attached to a license plate. The annotation mark can also be directly placed on the license plate when the license plate is rendered. The annotation mark is visible when illuminated by an infrared light and the license plate appears normal in visible light. The annotation mark enables an ALPR imaging system to obtain more information for each character and utilize the information to improve conclusion accuracy.

Claims (48)

1. A method for designing a license plate overlay decal, said method comprising:

providing an infrared readable annotation mark with respect to a character image associated with a license plate via training of an automatic license plate recognition engine to improve automatic license plate recognition performance; and

rendering a plate overlay decal with said infrared readable annotation mark wherein said infrared readable annotation mark is visible when illuminated by infrared light and said license plate appears normal in visible light.

2. The method of claim 1 further comprising attaching said plate overlay decal with said infrared readable annotation mark to said license plate.

3. The method of claim 1 further comprising directly placing said plate overlay decal with said infrared readable annotation mark on said license plate when said license plate is rendered.

4. The method of claim 1 further comprising:

training and testing said automatic license plate recognition engine utilizing said character image and thereafter generate a confusion matrix in order to determine a close character sibling;

defining said infrared readable annotation mark with respect to said close-character sibling and retraining said automatic license plate recognition engine utilizing said character image including said infrared readable annotation mark; and

enhancing accuracy of said automatic license plate recognition engine by said infrared readable annotation mark so that said infrared readable annotation mark fits in an automatic license plate recognition training paradigm without special processing at run time.

5. The method of claim 1 wherein said character image comprises at least one of the following types of character images:

a labeled ground truth character image; and/or

a synthetic character image with modeled image noise imposed on said image.

6. The method of claim 1 further comprising:

iterating a synthetic plate generation and synthetic noise generation process to optimize said infrared readable annotation mark resulting in a low off-diagonal term in said confusion matrix; and

achieving a high level of automatic license plate recognition performance utilizing said synthetic character image with said modeled image noise.

7. The method of claim 1 wherein said infrared readable annotation mark enables an optical character recognition module to differentiate said close character sibling under a poor imaging condition.

8. The method of claim 1 further comprising determining a boundary of said license plate character and a cut point utilizing said infrared readable annotation mark such that each character is coherently cropped out of said license plate image to improve character segmentation accuracy.

9. The method of claim 1 further comprising clearly identifying a logo on said license plate utilizing said infrared readable annotation mark to significantly improve said character segmentation accuracy.

10. The method of claim 1 further comprising:

determining a presence of said overlay decal based on presence of said infrared readable annotation mark; and

issuing a warning by an electronic tolling system upon entry and/or exit of a toll roadway if a user has not attached said overlay decal.

11. A system for designing a license plate overlay decal, said system comprising:

a processor;

a data bus coupled to said processor; and

a computer-usable medium embodying computer program code, said computer-usable medium being coupled to said data bus, said computer program code comprising instructions executable by said processor and configured for:

providing an infrared readable annotation mark with respect to a character image associated with a license plate via training of an automatic license plate recognition engine to improve automatic license plate recognition performance; and

rendering a plate overlay decal with said infrared readable annotation mark wherein said infrared readable annotation mark is visible when illuminated by infrared light and said license plate appears normal in visible light.

12. The system of claim 11 wherein said instructions are further configured for attaching said plate overlay decal with said infrared readable annotation mark to said license plate.

13. The system of claim 11 wherein said plate overlay decal is directly placed with said infrared readable annotation mark on said license plate when said license plate is rendered.

14. The system of claim 11 wherein said instructions are further configured for:

training and testing said automatic license plate recognition engine utilizing said character image and thereafter generate a confusion matrix in order to determine a close character sibling;

defining said infrared readable annotation mark with respect to said close-character sibling and retraining said automatic license plate recognition engine utilizing said character image including said infrared readable annotation mark; and

enhancing accuracy of said automatic license plate recognition engine by said infrared readable annotation mark so that said infrared readable annotation mark fits in an automatic license plate recognition training paradigm without special processing at run time.

15. The system of claim 11 wherein said character image comprises at least one of the following types of character images:

a labeled ground truth character image; and/or

a synthetic character image with modeled image noise imposed on said image.

16. The system of claim 11 wherein said instructions are further configured for:

iterating a synthetic plate generation and synthetic noise generation process to optimize said infrared readable annotation mark resulting in a low off-diagonal term in said confusion matrix; and

achieving a high level of automatic license plate recognition performance utilizing said synthetic character image with said modeled image noise.

17. The system of claim 11 wherein said infrared readable annotation mark enables an optical character recognition module to differentiate said close character sibling under a poor imaging condition.

18. The system of claim 11 wherein said instructions are further configured for determining a boundary of said license plate character and a cut point utilizing said infrared readable annotation mark such that each character is coherently cropped out of said license plate image to improve character segmentation accuracy.

19. A processor-readable medium storing computer code representing instructions to cause a process for designing a license plate overlay decal, said computer code further comprising code to:

provide an infrared readable annotation mark with respect to a character image associated with a license plate via training of an automatic license plate recognition engine to improve automatic license plate recognition performance; and

render a plate overlay decal with said infrared readable annotation mark wherein said infrared readable annotation mark is visible when illuminated by infrared light and said license plate appears normal in visible light.

20. The processor-readable medium of claim 19 wherein said code further comprises code to:

train and test said automatic license plate recognition engine utilizing said character image and thereafter generate a confusion matrix in order to determine a close define sibling;

defining said infrared readable annotation mark with respect to said close-character sibling and retraining said automatic license plate recognition engine utilizing said character image including said infrared readable annotation mark; and

enhance accuracy of said automatic license plate recognition engine by said infrared readable annotation mark so that said infrared readable annotation mark fits in an automatic license plate recognition training paradigm without special processing at run time.

Assignments (4)
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: U.S. BANK, NATIONAL ASSOCIATION
Reel/Frame 057969/0445 →
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057970/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2017
From: XEROX CORPORATION
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 041542/0022 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2013
From: KOZITSKY, VLADIMIR; PAUL, PETER; BURRY, AARON MICHAEL
To: XEROX CORPORATION
Reel/Frame 030353/0979 →