IP Library Granted Patent US 10,262,398
Granted Patent B2
US 10,262,398 · App. 15/080,176 · Granted Apr 16, 2019

Method for correcting an image of at least one object presented at a distance in front of an imaging device and illuminated by a lighting system and an image pickup system for implementing said method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,262,398
App. No.
15/080,176
Granted
Apr 16, 2019
Kind
B2
Abstract

An image correction method includes: estimating a 3D model of an object as when an imaging device takes an image of the object; calculating the light intensity of each point of a simulated image as it would be taken by the imaging device, using the estimated 3D model of the object, a model of illumination of the object illuminated by a lighting system that illuminates the object, a model of reflection on a surface of the object, and a model of the imaging device, to obtain a simulated image of the object; and correcting the taken image by modifying the light intensity of each point on the taken image or on at least one area of interest of the taken image, according to the light intensity of the corresponding point in the simulated image or the respective light intensities of points adjacent to the corresponding point in the simulated image.

Claims (33)

1. A method for correcting an image taken by an imaging device of an object presented at a distance in front of said imaging device, said object being illuminated by means of a lighting system, wherein the method comprises the following steps:

estimating, from at least one image taken by a 3D image pickup apparatus, a 3D model of the object as it is at the time said imaging device takes said image,

calculating the light intensity of each point of a simulated image as it would be taken by the imaging device, using said thus estimated 3D model of the object, a model of the illumination of the object illuminated by said lighting system, a model of reflection on a surface of the object and a model of said imaging device, in order to obtain a simulated image of said object, and

determining points on the simulated image for which the light intensity is above a maximum threshold,

determining points on the simulated image for which the light intensity is below a minimum threshold, the minimum threshold being different from the maximum threshold,

correcting the image taken by said imaging device, comprising modifying the light intensity of each point on the image actually taken by the imaging device or on at least one area of interest of the image actually taken by the imaging device, according to the light intensity of the corresponding point in the simulated image or the respective light intensities of points adjacent to said corresponding point in the simulated image, the correcting including:

calculating, for each point of the image or of at least one area of the image taken by said imaging device, a correction factor that is a decreasing function of the light intensity of the corresponding point in the simulated image of said object, and

modifying the light intensity of each point of the image or of at least one area of the image actually taken by said imaging device in proportion to said correction factor,

said correcting not being performed for the points on the image taken by the imaging device corresponding to the points on the simulated image thus determined.

2. The method for correcting an image according to claim 1 , further comprising:

determining points on the simulated image for which the light intensity is above a maximum threshold,

determining points on the simulated image for which the light intensity is below a minimum threshold,

said correction step not being performed for the points on the image taken by the imaging device corresponding to the points on the simulated image thus determined.

3. The method for correcting an image according to claim 2 , further comprising:

creating a mask corresponding to the points thus determined at the determination steps so that subsequent image processings of the corrected image do not take into account the corresponding points on said corrected image.

4. The method for correcting an image according to claim 1 , wherein said step of determining said 3D model uses a stereoscopic method involving pairs of views taken by said 3D image pickup system, said 3D image pickup system comprising either of two cameras taking respectively the views of each pair simultaneously, or a camera taking the views of each pair at two different times.

5. The method for correcting an image according to claim 4 , wherein one or other or both of the two cameras of said 3D image pickup system constitutes said imaging device.

6. An image pickup system for delivering a corrected image of an image taken by an imaging device of an object presented at a distance in front of said imaging device, said object being illuminated by a lighting system, wherein the image pickup system comprises circuitry adapted for:

estimating, from at least one image taken by a 3D image pickup apparatus, a 3D model of the object as it is at the time said imaging device takes an image,

executing an image-simulation comprising calculating the light intensity of each point on a simulated image as it would be taken by the imaging device, using said 3D model estimated, a model of the illumination of the object by said lighting system, a model of reflection on a surface of an object and a model of said imaging device, in order to obtain a simulated image of said object, and

determining points on the simulated image for which the light intensity is above a maximum threshold,

determining points on the simulated image for which the light intensity is below a minimum threshold, the minimum threshold being different from the maximum threshold,

correcting the image taken by said imaging device in order to modify the light intensity of each point on the image actually taken by the imaging device or on at least one area of interest of the image actually taken by the imaging device, according to the light intensity of the corresponding point in the simulated image or the respective light intensities of points adjacent to said corresponding point in the simulated image, the correcting comprising:

calculating, for each point on the image or on at least one area of the image taken by said imaging device, a correction factor that is a decreasing function of the light intensity of the corresponding point in the simulated image of the said object, and

modifying the light intensity of each point on the image or at least one area of the image actually taken by said imaging device in proportion to said correction factor,

said correcting not being performed for the points on the image taken by the imaging device corresponding to the points on the simulated image thus determined.

7. The image pickup system according to claim 6 , wherein the circuitry comprised in the image pickup system is further adapted for:

determining points on the simulated image for which the light intensity is above a maximum threshold,

determining points on the simulated image for which the light intensity is below a minimum threshold,

the correcting of the image taken by said imaging device not taking into account the points on the image taken by the imaging device corresponding to the thus determined points of the simulated image.

8. The image pickup system according to claim 7 , wherein the circuitry of the image pickup system is further adapted for:

creating a mask corresponding to the thus determined points of the simulated image, said mask being designed so that processings of images subsequent to the corrected image do not take into account the corresponding points on said corrected image.

9. A non-transitory storage medium that stores a computer program comprising instructions for the implementation, by a central unit of an image pickup system, of a method according to claim 1 , when said program is executed by said central unit.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER REPLACING 10158873 WITH 10185873 PREVIOUSLY RECORDED ON REEL 71930 FRAME 625. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Apr 1, 2026
From: IDEMIA IDENTITY & SECURITY FRANCE
To: IDEMIA PUBLIC SECURITY FRANCE
Reel/Frame 075530/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2025
From: IDEMIA IDENTITY & SECURITY FRANCE
To: IDEMIA PUBLIC SECURITY FRANCE
Reel/Frame 071930/0625 →
CHANGE OF NAME Recorded Jun 19, 2024
From: MORPHO
To: IDEMIA IDENTITY AND SECURITY FRANCE
Reel/Frame 067766/0785 →
CHANGE OF NAME Recorded Feb 21, 2019
From: MORPHO
To: SAFRAN IDENTITY & SECURITY
Reel/Frame 048390/0401 →
CHANGE OF NAME Recorded Feb 21, 2019
From: SAFRAN IDENTITY AND SECURITY; IDEMIA IDENTITY & SECURITY
To: IDEMIA IDENTITY & SECURITY
Reel/Frame 048390/0406 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2016
From: ROUH, ALAIN; BEAUDET, JEAN; DURA, JEREMY; ROSTAING, LAURENT
To: MORPHO
Reel/Frame 039041/0988 →