Image capturing apparatus and image processing method
An image capturing apparatus that can capture a visible light image and an infrared light image of the same object, the image capturing apparatus comprises a detection unit configured to detect a predetermined object in the visible light image, an extraction unit configured to extract feature information of a specific portion in the object detected in the infrared light image by the detection unit, and an estimation unit configured to estimate unique information of the predetermined object using the feature information extracted by the extraction unit.
1. An image capturing apparatus that can capture a visible light image and an infrared light image of the same object, the image capturing apparatus comprising:
a detection unit configured to detect a face of a person as a predetermined object and a light-shielding portion covering the face in the visible light image;
an extraction unit configured to extract luminance information of a specific portion covered by the light-shielding portion in the face of the person detected in the infrared light image by the detection unit; and
an estimation unit configured to estimate unique information of the face of the person using the luminance information extracted by the extraction unit;
wherein
the extraction unit extracts luminance information of a pupil, an iris and a sclera of an eye included in the face of the person covered by the light-shielding portion, and
the estimation unit estimates an iris color as the unique information from a relationship between the luminance information of the pupil, the iris and the sclera.
2. The apparatus according to claim 1 , further comprising:
a composition unit configured to combine the iris color estimated by the estimation unit with an eye region of the face of the person in the visible light image.
3. The apparatus according to claim 1 , wherein
the extraction unit extracts the luminance information of the pupil of the eye included in the face of the person, and
the estimation unit estimates the iris color from a relationship between the luminance information of the pupil and the sclera and a relationship between the luminance information of the pupil and the iris.
4. The apparatus according to claim 3 , wherein
the estimation unit estimates the iris color of the eye included in the face of the person or a race, based on a ratio of luminance information of the iris to luminance information of the sclera.
5. The apparatus according to claim 4 , wherein
the estimation unit estimates the iris color of the eye included in the face of the person or the race, based on a ratio of a difference between the luminance information of the iris and the pupil to a difference between the luminance information of the sclera and the pupil.
6. The apparatus according to claim 1 , further comprising:
a storage unit configured to store a table or metadata indicating a relationship between luminance information of the iris and the iris color or race,
wherein the estimation unit determines the iris color or the race based on the luminance information of the iris stored in the storage unit.
7. The apparatus according to claim 1 , further comprising:
a first image capturing unit configured to capture the visible light image, and a second image capturing unit configured to capture the infrared light image.
8. An image processing method of an apparatus that can capture a visible light image and an infrared light image of the same object, the method comprising:
detecting a face of a person as a predetermined object and a light-shielding portion covering the face in the visible light image;
extracting luminance information of a specific portion covered by the light-shielding portion in the face of the person detected in the infrared light image; and
estimating unique information of the face of the person using the extracted luminance information;
wherein
the extracting step extracts luminance information of a pupil, an iris and a sclera of an eye included in the face of the person covered by the light-shielding portion, and
the estimating step estimates an iris color as the unique information from a relationship between the luminance information of the pupil, the iris and the sclera.
9. A non-transitory computer-readable storage medium storing a program for causing a computer to execute an image processing method of an apparatus that can capture a visible light image and an infrared light image of the same object, the method comprising:
detecting a face of a person as a predetermined object and a light-shielding portion covering the face in the visible light image;
extracting luminance information of a specific portion covered by the light-shielding portion in the face of the person detected in the infrared light image; and
estimating unique information of the face of the person using the extracted luminance information;
wherein
the extracting step extracts luminance information of a pupil, an iris and a sclera of an eye included in the face of the person covered by the light-shielding portion, and
the estimating step estimates an iris color as the unique information from a relationship between the luminance information of the pupil, the iris and the sclera.