Fingerprint authentication device, display device including the same, and method of authenticating fingerprint

1. A fingerprint authentication device comprising:

a sensor unit configured to output a sensing signal by sensing a fingerprint;

an image processing unit configured to generate a fingerprint image based on the sensing signal;

a storage unit configured to store a template including an enrolled image;

a learning unit configured to generate a first pseudo image and add the first pseudo image to the template; and

an authentication unit configured to compare the fingerprint image generated by the image processing unit with the template, and configured to output a comparison result,

wherein a signal-to-noise ratio of the first pseudo image is smaller than that of the enrolled image,

wherein the learning unit is configured to convert the enrolled image into the first pseudo image by using a first image conversion model,

wherein the image processing unit is configured to generate a first fingerprint image in a fingerprint enrollment period, and is configured to generate a second fingerprint image in a fingerprint authentication period,

wherein the enrolled image includes at least a portion of the first fingerprint image,

wherein the first pseudo image is different from the second fingerprint image,

wherein the learning unit is configured to set the first image conversion model through learning of fingerprint images for learning, which are provided from outside of the fingerprint authentication device,

wherein the fingerprint images for learning include high-quality fingerprint images of which signal-to-noise ratios are within a reference quality range and low-quality fingerprint images of which signal-to-noise ratios are out of the reference quality range with respect to a plurality of objects,

wherein the image processing unit is configured to generate a third fingerprint image corresponding to the second fingerprint image while changing a driving condition of the sensor unit in the fingerprint authentication period, the second fingerprint image and the third fingerprint image obtained from a substantially same fingerprint,

wherein a signal-to noise ratio of the third fingerprint image is smaller than that of the second fingerprint image, and

wherein the storage unit is configured to store the second fingerprint image and the third fingerprint image based on the comparison result of the authentication unit.

2. The fingerprint authentication device of claim 1 , wherein the sensor unit includes a photo sensor to configured to sense light reflected by the fingerprint,

wherein the image processing unit is configured to generate the second fingerprint image by receiving the reflected light for a first exposure time through the sensor unit, and

wherein the image processing unit is configured to generate the third fingerprint image by receiving the reflected light for a second exposure time through the sensor unit.

3. The fingerprint authentication device of claim 2 , wherein the second exposure time is shorter than the first exposure time.

4. The fingerprint authentication device of claim 1 , wherein the sensor unit includes an ultrasonic sensor configured to sense an ultrasonic wave reflected by the fingerprint,

wherein the image processing unit is configured to generate the second fingerprint image by emitting an ultrasonic wave having a first frequency through the sensor unit, and

wherein the image processing unit is configured to generate the third fingerprint image by emitting an ultrasonic wave having a second frequency through the sensor unit.

5. The fingerprint authentication device of claim 4 , wherein the second frequency is lower than the first frequency.

6. The fingerprint authentication device of claim 1 , wherein the learning unit is configured to set a second image conversion model by learning of the second fingerprint image and the third fingerprint image, is configured to convert the first fingerprint image into a second pseudo image by using the second image conversion model, and is configured to add the second pseudo image to the template.

7. The fingerprint authentication device of claim 1 , wherein the learning unit is configured to update the first image conversion model by additionally learning of the second fingerprint image and the third fingerprint image, is configured to convert the first fingerprint image into a third pseudo image by using the updated first fingerprint image model, and is configured to add the third pseudo image to the template.

8. The fingerprint authentication device of claim 1 ,

wherein the image processing unit is configured to generate a converted fingerprint image by increasing a signal-to-noise ratio of the fingerprint image, by reversely using the first image conversion model, and

wherein the authentication unit is configured to compare the converted fingerprint image with the template.

9. The fingerprint authentication device of claim 8 , wherein the authentication unit is configured to compare the converted fingerprint image with the template based on a first comparison result obtained by comparing the fingerprint image with the template, and is configured to output a second comparison result.

10. A fingerprint authentication device comprising:

a sensor unit configured to output a sensing signal by sensing a fingerprint;

an image processing unit configured to generate a fingerprint image based on the sensing signal;

a storage unit configured to store a template including an enrolled image; and

a learning unit configured to generate a first pseudo image and add the first pseudo image to the template,

wherein a signal-to-noise ratio of the first pseudo image is smaller than that of the enrolled image,

wherein the learning unit is configured to convert the enrolled image into the first pseudo image by using a first image conversion model,

wherein the image processing unit is configured to generate a first fingerprint image in a fingerprint enrollment period, and is configured to generate a second fingerprint image in a fingerprint authentication period,

wherein the enrolled image includes at least a portion of the first fingerprint image,

wherein the first pseudo image is different from the second fingerprint image,

wherein the image processing unit is configured to further generates a third fingerprint image corresponding to the second fingerprint image while changing a driving condition of the sensor unit in the fingerprint authentication period, the second fingerprint image and the third fingerprint image obtained from a substantially same fingerprint,

wherein the learning unit is configured to set or update the first image conversion model by learning of at least one of the first and second fingerprint images and the third fingerprint image, and

wherein a signal-to-noise ratio of the third fingerprint image is smaller than that of the second fingerprint image.

11. The fingerprint authentication device of claim 10 , wherein the sensor unit includes a photo sensor configured to sense light reflected by the fingerprint,

wherein the image processing unit is configured to generate the second fingerprint image by receiving the reflected light for a first exposure time through the sensor unit, and

wherein the image processing unit is configured to generate the third fingerprint image by receiving the reflected light for a second exposure time through the sensor unit.

12. The fingerprint authentication device of claim 10 , wherein the sensor unit includes an ultrasonic sensor configured to sense an ultrasonic wave reflected by the fingerprint,

wherein the image processing unit is configured to generate the second fingerprint image by emitting an ultrasonic wave having a first frequency through the sensor unit, and

wherein the image processing unit is configured to generate the third fingerprint image by emitting an ultrasonic wave having a second frequency through the sensor unit.

13. A method of authenticating a fingerprint, the method comprising the steps of:

generating a first fingerprint image of a first object through a sensor unit;

adding, to a template, an enrolled image including at least a portion of the first fingerprint image;

generating a pseudo image based on the enrolled image;

adding the pseudo image to the template;

generating a second fingerprint image through the sensor unit; and

comparing the second fingerprint image with the template and outputting a comparison result,

wherein a signal-to-noise ratio of the pseudo image is smaller than that of the enrolled image,

wherein the step of generating of the second fingerprint image includes the step of generating a third fingerprint image corresponding to the second fingerprint image while changing a driving condition of the sensor unit, the second fingerprint image and the third fingerprint image obtained from a substantially same object, and

wherein a signal-to-noise ratio of the third fingerprint image is lower than that of the second fingerprint image.

14. The method of claim 13 , wherein the step of generating of the pseudo image includes the steps of:

setting a first image conversion model through learning of a fingerprint; and

converting the enrolled image into the pseudo image by using the first image conversion model, and

wherein the enrolled images include high-quality fingerprint images of which signal-to-noise ratios are within a reference quality range and low-quality fingerprint images of which signal-to-noise ratios are out of the reference quality range, with respect to a plurality of objects.

15. The method of claim 13 , further comprising the steps of:

storing the second fingerprint image and the third fingerprint image based on the comparison result;

setting a second image conversion model by learning of the second fingerprint image and the third fingerprint image;

converting the enrolled image into a second pseudo image by using the second image conversion model; and

adding the second pseudo image to the template.

16. The method of claim 15 , wherein the sensor unit includes a photo sensor configured to sense light reflected by a fingerprint, and

wherein the step of generating of the third fingerprint image includes the steps of:

generating the second fingerprint image by receiving the reflected light for a first exposure time through the sensor unit; and

generating the third fingerprint image by receiving the reflected light for a second exposure time through the sensor unit.

17. The method of claim 15 , wherein the sensor unit includes an ultrasonic sensor configured to sense an ultrasonic wave reflected by a fingerprint, and

wherein the step of generating of the third fingerprint image includes the steps of:

generating the second fingerprint image by emitting an ultrasonic wave having a first frequency through the sensor unit; and

generating the third fingerprint image by emitting an ultrasonic wave having a second frequency through the sensor unit.

18. The method of claim 13 , further comprising the steps of:

generating a converted fingerprint image by increasing a signal-to-noise ratio of the second fingerprint image, using an image conversion model based on the first comparison result; and

comparing the converted fingerprint image with the template and outputting a second comparison result.

19. A method of authenticating a fingerprint, the method comprising the steps of:

generating a first fingerprint image of a first object through a sensor unit;

adding, to a template, an enrolled image including at least a portion of the first fingerprint image;

generating a pseudo image based on the enrolled image;

adding the pseudo image to the template;

setting a first image conversion model through learning of fingerprint images;

generating fingerprint images having different signal-to-noise ratios with respect to a first object while changing a driving condition of the sensor unit; and

updating the first image conversion model by learning of the fingerprint images,

wherein a signal-to-noise ratio of the pseudo image is smaller than that of the enrolled image.