IP Library Granted Patent US 11,354,544
Granted Patent B2
US 11,354,544 · App. 17/362,213 · Granted Jun 7, 2022

Fingerprint image processing methods and apparatuses

Inventors: Kai Zhu (Hangzhou, CN); Jianxu Zheng (Hangzhou, CN)
Assignee: Alipay (Hangzhou) Information Technology Co., Ltd.
G06K9/6262G06K9/6256G06N5/04G06N20/00G06T5/001G06V40/13G06V40/1365
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,544
App. No.
17/362,213
Granted
Jun 7, 2022
Kind
B2
Abstract

Methods, systems, and apparatus for operations for processing fingerprint images. An example system includes obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object; inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model; obtaining as output a target fingerprint trace image from the fingerprint image processing model; and using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold.

Claims (122)

1. A computer-implemented method for processing fingerprint images, comprising:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein inputting the original fingerprint trace image to the pre-trained fingerprint image processing model comprises:

mirror-flipping the original fingerprint trace image to generate a mirror-flipped fingerprint trace image;

inputting the mirror-flipped fingerprint trace image to the fingerprint image processing model; and

restoring texture information of a fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model, or reducing a value of color difference between the fingerprint trace in the original fingerprint trace image and the target object by adjusting a color value of the fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model.

2. A computer-implemented method for processing fingerprint images, comprising:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein inputting the original fingerprint trace image to the pre-trained fingerprint image processing model comprises:

inputting the original fingerprint trace image to the fingerprint image processing model;

mirror-flipping the original fingerprint trace image by using the fingerprint image processing model to generate the mirror-flipped fingerprint trace image; and

restoring texture information of the fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model, or reducing a value of color difference between the fingerprint trace in the original fingerprint trace image and the target object by adjusting a color value of the fingerprint trace in the mirror-flipped fingerprint trace image.

3. A computer-implemented method for processing fingerprint images, comprising:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein before inputting the original fingerprint trace image to the pre-trained fingerprint image processing model, the method further comprises:

obtaining a plurality of fingerprint trace images corresponding to the plurality of different fingers;

mirror-flipping the plurality of fingerprint trace images to generate the set of fingerprint trace image samples corresponding to the plurality of different fingers;

obtaining the set of real fingerprint image samples corresponding to the plurality of different fingers by using a fingerprint sensor; and

training the fingerprint image processing model by using the set of fingerprint trace image samples and the set of real fingerprint image samples corresponding to the plurality of different fingers.

4. The computer-implemented method according to claim 3 , wherein before inputting the original fingerprint trace image to the pre-trained fingerprint image processing model, the method further comprises:

inputting a fingerprint trace image sample from the set of fingerprint trace image samples to the fingerprint image processing model for processing;

obtaining as output a processed fingerprint trace image sample from the fingerprint image processing model;

determining a matching result based on matching a fingerprint in the processed fingerprint trace image sample with a real fingerprint that corresponds to a same finger; and

optimizing the fingerprint image processing model based on the matching result.

5. The computer-implemented method according to claim 1 , wherein obtaining the original fingerprint trace image of the fingerprint trace left by the user on the target object comprises:

scanning a surface region on the target object that has the fingerprint trace by using an image scanning device.

6. The computer-implemented method according to claim 1 , wherein the fingerprint image processing model is a self-attention generative adversarial network (SAGAN) model.

7. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations for processing fingerprint images, wherein the operations comprise:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein inputting the original fingerprint trace image to the pre-trained fingerprint image processing model comprises:

mirror-flipping the original fingerprint trace image to generate a mirror-flipped fingerprint trace image;

inputting the mirror-flipped fingerprint trace image to the fingerprint image processing model; and

restoring texture information of a fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model, or reducing a value of color difference between the fingerprint trace in the original fingerprint trace image and the target object by adjusting a color value of the fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model.

8. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations for processing fingerprint images, wherein the operations comprise:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein inputting the original fingerprint trace image to the pre-trained fingerprint image processing model comprises:

inputting the original fingerprint trace image to the fingerprint image processing model;

mirror-flipping the original fingerprint trace image by using the fingerprint image processing model to generate the mirror-flipped fingerprint trace image; and

restoring texture information of the fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model, or reducing a value of color difference between the fingerprint trace in the original fingerprint trace image and the target object by adjusting a color value of the fingerprint trace in the mirror-flipped fingerprint trace image.

9. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations for processing fingerprint images, wherein the operations comprise:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein before inputting the original fingerprint trace image to the pre-trained fingerprint image processing model, the operations further comprise:

obtaining a plurality of fingerprint trace images corresponding to the plurality of different fingers;

mirror-flipping the plurality of fingerprint trace images to generate the set of fingerprint trace image samples corresponding to the plurality of different fingers;

obtaining the set of real fingerprint image samples corresponding to the plurality of different fingers by using a fingerprint sensor; and

training the fingerprint image processing model by using the set of fingerprint trace image samples and the set of real fingerprint image samples corresponding to the plurality of different fingers.

10. The non-transitory, computer-readable medium according to claim 9 , wherein before inputting the original fingerprint trace image to the pre-trained fingerprint image processing model, the operations further comprise:

inputting a fingerprint trace image sample from the set of fingerprint trace image samples to the fingerprint image processing model for processing;

obtaining as output a processed fingerprint trace image sample from the fingerprint image processing model;

determining a matching result based on matching a fingerprint in the processed fingerprint trace image sample with a real fingerprint that corresponds to a same finger; and

optimizing the fingerprint image processing model based on the matching result.

11. The non-transitory, computer-readable medium according to claim 7 , wherein obtaining the original fingerprint trace image of the fingerprint trace left by the user on the target object comprises:

scanning a surface region on the target object that has the fingerprint trace by using an image scanning device.

12. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform operations for processing fingerprint images, wherein the operations comprise:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein inputting the original fingerprint trace image to the pre-trained fingerprint image processing model comprises:

mirror-flipping the original fingerprint trace image to generate a mirror-flipped fingerprint trace image;

inputting the mirror-flipped fingerprint trace image to the fingerprint image processing model; and

restoring texture information of a fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model, or reducing a value of color difference between the fingerprint trace in the original fingerprint trace image and the target object by adjusting a color value of the fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model.

13. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform operations for processing fingerprint images, wherein the operations comprise:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein inputting the original fingerprint trace image to the pre-trained fingerprint image processing model comprises:

inputting the original fingerprint trace image to the fingerprint image processing model;

mirror-flipping the original fingerprint trace image by using the fingerprint image processing model to generate the mirror-flipped fingerprint trace image; and

restoring texture information of the fingerprint trace in the mirror-flipped fingerprint trace image by using the fingerprint image processing model, or reducing a value of color difference between the fingerprint trace in the original fingerprint trace image and the target object by adjusting a color value of the fingerprint trace in the mirror-flipped fingerprint trace image.

14. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform operations for processing fingerprint images, wherein the operations comprise:

obtaining an original fingerprint trace image of a fingerprint trace left by a user on a target object;

inputting the original fingerprint trace image to a pre-trained fingerprint image processing model that is configured to process the original fingerprint trace image in accordance with pre-trained parameters of the pre-trained fingerprint image processing model;

obtaining as output a target fingerprint trace image from the fingerprint image processing model; and

using the target fingerprint trace image as a test fingerprint image for performing a test on a fingerprint recognition device, wherein

the fingerprint image processing model is obtained through training based on a set of fingerprint trace image samples and a set of real fingerprint image samples corresponding to a plurality of different fingers, and a degree of matching between a fingerprint in the target fingerprint trace image and a real fingerprint that corresponds to a same finger is greater than or equal to a predetermined threshold;

wherein before inputting the original fingerprint trace image to the pre-trained fingerprint image processing model, the operations further comprise:

obtaining a plurality of fingerprint trace images corresponding to the plurality of different fingers;

mirror-flipping the plurality of fingerprint trace images to generate the set of fingerprint trace image samples corresponding to the plurality of different fingers;

obtaining the set of real fingerprint image samples corresponding to the plurality of different fingers by using a fingerprint sensor; and

training the fingerprint image processing model by using the set of fingerprint trace image samples and the set of real fingerprint image samples corresponding to the plurality of different fingers.

15. The computer-implemented system according to claim 14 , wherein before inputting the original fingerprint trace image to the pre-trained fingerprint image processing model, the operations further comprise:

inputting a fingerprint trace image sample from the set of fingerprint trace image samples to the fingerprint image processing model for processing;

obtaining as output a processed fingerprint trace image sample from the fingerprint image processing model;

determining a matching result based on matching a fingerprint in the processed fingerprint trace image sample with a real fingerprint that corresponds to a same finger; and

optimizing the fingerprint image processing model based on the matching result.

16. The computer-implemented system according to claim 12 , wherein obtaining the original fingerprint trace image of the fingerprint trace left by the user on the target object comprises:

scanning a surface region on the target object that has the fingerprint trace by using an image scanning device.

17. The computer-implemented system according to claim 12 , wherein the fingerprint image processing model is a self-attention generative adversarial network (SAGAN) model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2022
From: ZHU, KAI
To: ALIPAY (HANGZHOU) INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 059661/0313 →
EMPLOYEE AGREEMENT Recorded Apr 21, 2022
From: ZHENG, JIANXU
To: ALIPAY (HANGZHOU) INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 059746/0321 →
Priority Claims (1)
CN 202010670691.1 · Jul 13, 2020 · national
Continuity (1)
Related Publication 20220012541A1 · Jan 13, 2022