Spoof-resistant facial recognition through illumination and imaging engineering
Disclosed herein systems and methods of performing spoof resistant object recognition. In certain embodiments, a system for object recognition includes: an illumination device configured to illuminate an object; a sensor device, wherein the sensor device receives illumination light reflected off the object which includes polarization information; a processor; memory including programming executable by the processor to: calculate the polarization information from the illumination light; use the polarization information to determine whether the object is a real 3D object. It has been discovered that polarization information may be utilized to determine whether an object is a 3D object or a flat (2D) object. Thus, the polarization information may be utilized to differentiate from an image of a 3D object and a photograph of an object.
1 . A system for object recognition comprising:
an illumination device configured to illuminate an object; wherein the illumination device comprises an LED or VCSEL array; wherein the illumination device further comprises sunlight;
a sensor device, wherein the sensor device receives illumination light reflected off the object which includes polarization information;
an ambient light sensor configured to determine the amount of sunlight;
a processor; and
memory including programming executable by the processor to:
calculate the polarization information from the illumination light; and
use the polarization information to determine whether the object is a real 3D object;
alter the amount of light outputted by the LED or VCSEL array based on the amount of sunlight.
2 . The system of claim 1 , wherein the sensor device and/or the illumination device comprise one or more metasurface optical elements.
3 . The system of claim 1 , wherein the memory further includes programming that is configured to use the polarization information to determine whether the object is a real 3D object or whether the object is a picture of an object, a mask of a 3D object, or a video of a 3D object.
4 . The system of claim 1 , wherein the polarization information includes at least one selected from the group consisting of: an S 1 polarization, an S 2 polarization, an S 3 polarization, a degree of polarization (DoP), and an azimuth.
5 . The system of claim 4 , wherein the S 1 polarization, the S 2 polarization, the S 3 polarization is defined as:
S 0 =I;
S 1 =Ip cos 2ψ cos 2χ;
S 2 =Ip sin 2ψ cos 2χ; and
S 3 =Ip sin 2χ,
wherein the S 0 polarization corresponds to an original monochromic image.
6 . The system of claim 5 , wherein the DoP is calculated by
D
oP
=
S
1
2
+
S
2
2
+
S
3
2
S
0
.
7 . The system of claim 1 , wherein the memory further includes programming executable by the processor to compare an original optical image of the object to a subsequent optical image of the object to perform object recognition.
8 . The system of claim 7 , wherein the original optical image and the subsequent optical image are 2D near infrared images.
9 . The system of claim 7 , wherein the original optical image and the subsequent optical image are polarization images.
10 . The system of claim 7 , wherein the memory further includes programming executable by the processor to determine whether portions of the original optical image and/or the subsequent optical image are not real, wherein comparing the original optical image to the subsequent optical image of the object is not performed on the portions of the original optical image and/or the subsequent optical image determined to be not real.
11 . The system of claim 10 , wherein the portions of the original optical image and/or the subsequent optical image that are not real are of a mask, sunglasses, and/or a beard.
12 . The system of claim 7 , wherein determining whether portions of the original optical image and/or the subsequent optical image are not real is performed based on the polarization information from the illumination light.
13 . The system of claim 1 , wherein the object comprises a face.
14 . The system of claim 1 , wherein the memory further includes programming that is configured to perform an object detection algorithm.
15 . The system of claim 14 , wherein the memory further includes programming that is configured to utilize the results from the object detection algorithm to separate out object pixels from non-object pixels.
16 . The system of claim 15 , wherein the sensor device further receives an initial image and a subsequent image, and wherein the memory further includes programming that is configured to compare the initial image with the subsequent image to determine whether the initial image and the subsequent image are substantially the same.
17 . The system of claim 16 , wherein comparing the initial image with the subsequent image is only performed on the object pixels of the subsequent image.
18 . The system of claim 1 , further comprising a bandpass filter configured to pass a certain wavelength of light from the sunlight.