IP Library Granted Patent US 10,489,668
Granted Patent B2
US 10,489,668 · App. 15/695,475 · Granted Nov 26, 2019

Method for the recognition of raised characters, corresponding computer program and device

Inventors: Pierre Quentin (Enghien les Bains, FR); Remi Geraud (Paris, FR)
Assignee: INGENICO GROUP
G06K9/18G06K7/10861G06K9/00201G06K9/00214G06K9/4661G06Q30/0601G06F17/5086G06K2209/01G06Q40/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,489,668
App. No.
15/695,475
Granted
Nov 26, 2019
Kind
B2
Abstract

A method of character recognition is implemented by an electronic device to recognize, in an image representing an object comprising at least one raised character, called a basic image, at least one raised character of the basic image. The method includes: a phase of processing at least one image, the phase including at least one implementation of a Phong reflection module and delivering at least one identification image; and a phase of identifying characters as a function of the basic image and the at least one identification image.

Claims (104)

1. A method of character recognition implemented by an electronic device, wherein the method comprises:

recognizing, in an image representing an object comprising at least one raised character, called a basic image, at least one raised character of said basic image, wherein recognizing comprises:

a phase of processing at least one image, said phase comprising at least one implementation of a Phong reflection model and delivering at least one identification image, comprising generating by the Phong reflection model, preliminarily or on request, model images of raised characters in a plurality of pre-determined lighting conditions delivering a plurality of sets of reference images;

a phase of identifying characters as a function of the basic image and said at least one identification image, comprising:

comparing at least certain portions of the basic image with at least certain of the reference images, delivering a list of selected reference images, called a list of identification images, that correspond to the characters in the basic image; and

recognizing characters in the basic image using the list of identification images,

wherein said phase of processing said at least one image comprises building a normal map, representing normals of dots on at least one zone of the basic image delivering said identification image and wherein building comprises:

identifying a flat zone on said basic image;

determining a lighting condition from a light intensity of a pixel or a group of pixels on the flat zone;

computing normals of said dots of said at least one zone according to the determined lighting condition.

2. The method according to claim 1 , wherein the raised characters are situated on a bank card in said basic image.

3. The method according to claim 2 , wherein the method comprises a phase of preliminary processing of an image of the bank card captured by a camera, delivering said basic image.

4. The method according to claim 3 , wherein said phase of preliminary processing comprises:

detecting edges of the bank card, delivering an intermediate image;

selecting lines in the intermediate image;

computing intersections of the lines, delivering four corners of the bank card; and

converting the intermediate image, so that the four corners coincide with four corners of a rectangle, delivering said basic image.

5. The method according to claim 1 , wherein the determining and the computing use the following equation according to the Phong illumination model:

I

P

=

k

a

i

a

+

m

(

k

d

(

L

^

m

·

N

^

)

i

m

,

d

+

k

s

(

R

^

m

·

V

^

)

α

i

m

,

s

)

where:

k a ∈[0, 1] is a constant related to the ambient component;

k d ∈[0, 1] is a constant related to the scattered component;

k s ∈[0,1] is a constant related to specular component;

α>>1 is a constant related to the brilliance of the material;

m is the number of light sources;

I p represents a total reflected intensity at a given point;

{circumflex over (L)} is a director vector of light;

{circumflex over (N)} is a director vector of the surface normal;

{circumflex over (R)} is a director vector of the direction in which light would be reflected on a mirror, {circumflex over (R)}=2({circumflex over (L)}·{circumflex over (N)}){circumflex over (N)}−{circumflex over (L)}.

6. The method according to claim 1 , wherein said phase of identifying said characters comprises:

sub-dividing said normal map, delivering a list of sections of said normal map, each section corresponding to a character in said at least one zone;

building a list of current vectors from said list of sections, each current vector representing a section;

comparing said current vectors with a list of model vectors preliminarily built on the basis of normal mappings of the known characters, each model vector corresponding to a known character;

determining a list of current characters corresponding to said list of current vectors.

7. The method according to claim 6 , wherein said current vector and said model vectors have m×n dimensions, each of said normal maps of the known characters having a size of m×n pixels.

8. The method according to claim 6 , wherein said at least one zone comprises a zone of a card number of a bank card and in that said list of current characters comprises said card number of said bank card.

9. The method according to claim 8 , wherein the method comprises verifying said card number of said bank card according to Luhn's formula.

10. An electronic device for recognizing raised characters in a basic image, wherein the device comprises:

a processing unit; and

a non-transitory computer-readable medium comprising program code instructions stored thereon, which when executed by the processing unit configure the processing unit to perform acts comprising:

a phase of processing at least one image, said phase comprising at least one implementation of a Phong reflection model and delivering at least one identification image, comprising generating by the Phong reflection model, preliminarily or on request, model images of raised characters in a plurality of pre-determined lighting conditions delivering a plurality of sets of reference images;

a phase of identifying characters as a function of the basic image and said at least one identification image, comprising:

comparing at least certain portions of the basic image with at least certain of the reference images, delivering a list of selected reference images, called a list of identification images, that correspond to the characters in the basic image; and

recognizing characters in the basic image using the list of identification images,

wherein said phase of processing said at least one image comprises building a normal map, representing normals of dots on at least one zone of the basic image delivering said identification image and wherein building comprises:

identifying a flat zone on said basic image;

determining a lighting condition from a light intensity of a pixel or a group of pixels on the flat zone;

computing normals of said dots of said at least one zone according to the determined lighting condition.

11. A non-transitory computer-readable medium comprising a computer program product stored thereon, comprising program code instructions to implement a method of recognizing, in an image representing an object comprising at least one raised character, called a basic image, at least one raised character of said basic image, when said program is executed on a computer, wherein the method comprises:

a phase of processing at least one image, said phase comprising at least one implementation of a Phong reflection model and delivering at least one identification image, comprising generating by the Phong reflection model, preliminarily or on request, model images of raised characters in a plurality of pre-determined lighting conditions delivering a plurality of sets of reference images;

a phase of identifying characters as a function of the basic image and said at least one identification image, comprising:

comparing at least certain portions of the basic image with at least certain of the reference images, delivering a list of selected reference images, called a list of identification images, that correspond to the characters in the basic image; and

recognizing characters in the basic image using the list of identification images,

wherein said phase of processing said at least one image comprises building a normal map, representing normals of dots on at least one zone of the basic image delivering said identification image and wherein building comprises:

identifying a flat zone on said basic image;

determining a lighting condition from a light intensity of a pixel or a group of pixels on the flat zone;

computing normals of said dots of said at least one zone according to the determined lighting condition.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2021
From: INGENICO GROUP
To: BANKS AND ACQUIRERS INTERNATIONAL HOLDING
Reel/Frame 058173/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2018
From: QUENTIN, PIERRE; GERAUD, REMI
To: INGENICO GROUP
Reel/Frame 044523/0196 →
Priority Claims (1)
FR 16 58228 · Sep 5, 2016 · national
Continuity (1)
Related Publication 20180068196A1 · Mar 8, 2018
Cited By (3)
US 12,374,078 US 12,488,211 US 12,711,794