IP Library › Granted Patent US 11,048,914
Granted Patent B2
US 11,048,914 · App. 16/451,208 · Granted Jun 29, 2021

Face anti-counterfeiting detection methods and systems, electronic devices, programs and media

Inventors: Liwei Wu (Beijing, CN); Tianpeng Bao (Beijing, CN); Meng Yu (Beijing, CN); Yinghui Che (Beijing, CN); Chenxu Zhao (Beijing, CN)
Assignee: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD
G06K9/00268G06K9/00288G06K9/66
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,048,914
App. No.
16/451,208
Granted
Jun 29, 2021
Kind
B2
Abstract

Face anti-counterfeiting detection methods and systems, electronic devices, and computer storage media include: obtaining an image or video to be detected containing a face; extracting a feature of the image or video to be detected, and detecting whether the extracted feature contains counterfeited face clue information; and determining whether the face passes the face anti-counterfeiting detection according to a detection result.

Claims (57)

1. A face anti-counterfeiting detection method, comprising:

obtaining an image or video to be detected containing a face;

extracting a feature of the image or video to be detected, and detecting whether the extracted feature contains counterfeited face clue information, wherein the counterfeited face clue information comprises counterfeited clue information of an imaging media, and the counterfeited clue information of the imaging media further a screen edge, screen reflection, and a screen Moiré pattern of a display device; and

determining whether the face passes the face anti-counterfeiting detection according to a detection result.

2. The method according to claim 1 , wherein the extracted feature comprises one or more of the following: a local binary pattern feature, a histogram of sparse coding feature, a panorama feature, a face map feature, and a face detail map feature; or

wherein the counterfeited face clue information has human eye observability under a visible light condition; or

wherein the counterfeited face clue information further comprises at least one of the following: counterfeited clue information of an imaging medium, or clue information of a real counterfeited face; and

wherein the counterfeited clue information of the imaging medium comprises at least one of: edge information, reflection information, or material information of the imaging medium; or

wherein the clue information of the real counterfeited face comprises at least one of: the characteristics of a masked face, the characteristics of a model face, or the characteristics of a sculpture face.

3. The method according to claim 1 , wherein the extracting a feature of the image or video to be detected, and detecting whether the extracted feature contains counterfeited face clue information comprise:

inputting the image or video to be detected to a neural network, and outputting, by the neural network, a detection result for indicating whether the image or video to be detected contains at least one piece of counterfeited face clue information, wherein the neural network is pre-trained based on a training image set containing the counterfeited face clue information.

4. The method according to claim 3 , wherein the training image set comprises a plurality of facial images serving as positive samples for training and a plurality of images serving as negative samples for training;

the training image set containing the counterfeited face clue information is obtained by the following operations:

obtaining the plurality of facial images serving as positive samples for training; and

performing image processing for simulating the counterfeited face clue information on at least a part of the obtained at least one facial image to generate at least one image serving as a negative sample for training.

5. The method according to claim 1 , wherein the obtaining an image or video to be detected containing a face comprises:

obtaining, by a visible light camera of a terminal device, the image or video to be detected containing a face.

6. The method according to claim 3 , wherein the neural network comprises a first neural network located in the terminal device;

the determining whether the face passes the face anti-counterfeiting detection according to a detection result comprises: determining, by the terminal device, whether the face passes the face anti-counterfeiting detection according to a detection result output by the first neural network.

7. The method according to claim 1 , wherein the obtaining an image or video to be detected containing a face comprises:

receiving, by a server, the image or video to be detected containing a face sent by the terminal device.

8. The method according to claim 3 , wherein the neural network comprises a second neural network located in the server, wherein the determining whether the image or video to be detected passes the face anti-counterfeiting detection according to a detection result comprises: determining, by the server, whether the face passes the face anti-counterfeiting detection according to a detection result output by the second neural network, and returning to the terminal device a determination result about whether the face passes the face anti-counterfeiting detection.

9. The method according to claim 8 , wherein the neural network further comprises a first neural network located in the terminal device, and a size of the first neural network is less than a size of the second neural network;

the method further comprises:

inputting a video containing a face obtained by the terminal device to the first neural network, and outputting, by the first neural network, a detection result for indicating whether the video containing a face contains at least one piece of counterfeited face clue information; and

in response to the detection result indicating that the video containing a face does not contain the counterfeited face clue information, selecting a partial video or image from the video containing a face as the image or video to be detected to be sent to the server.

10. The method according to claim 9 , wherein the selecting a partial video or image from the video containing a face as the image or video to be detected to be sent to the server comprises:

obtaining a status of a network currently used by the terminal device; and at least one of the following operations:

if the status of the network currently used by the terminal device satisfies a first preset condition, selecting a partial video from the video obtained by the terminal device as the video to be detected to be sent to the server; or

if the status of the network currently used by the terminal device does not satisfy the first preset condition, but the status of the network currently used by the terminal device satisfies a second preset condition, selecting at least one image that satisfies a preset standard from the video obtained by the terminal device as the image to be detected to be sent to the server.

11. The method according to claim 10 , wherein when selecting a partial video from the video obtained by the terminal device as the video to be detected to be sent to the server, inputting the video to be detected to the second neural network, and outputting, by the second neural network, a detection result for indicating whether the video to be detected contains at least one piece of counterfeited face clue information, comprising:

selecting, by the server, at least one image from the video to be detected as the image to be detected to be input to the second neural network, and outputting, by the second neural network, a detection result for indicating whether the image to be detected contains at least one piece of counterfeited face clue information.

12. The method according to claim 9 , wherein in response to the detection result indicates that the video containing a face contains at least one piece of counterfeited face clue information, the determining whether the face passes the face anti-counterfeiting detection according to a detection result comprises: determining, by the terminal device, that the face fails to pass the face anti-counterfeiting detection according to the detection result output by the first neural network.

13. The method according to claim 9 , further comprising: returning, by the server, the detection result output by the second neural network to the terminal device;

the determining whether the face passes the face anti-counterfeiting detection according to a detection result comprises: determining, by the terminal device, whether the face passes the face anti-counterfeiting detection according to the detection result output by the second neural network.

14. The method according to claim 9 , wherein the determining whether the face passes the face anti-counterfeiting detection according to a detection result comprises: determining, by the server, whether the face passes the face anti-counterfeiting detection according to the detection result output by the second neural network, and sending to the terminal device a determination result about whether the face passes the face anti-counterfeiting detection.

15. The method according to claim 3 , further comprising:

performing, by the neural network, living body detection on the video obtained by the terminal device; and

in response to passing the living body detection by the video obtained by the terminal device, executing the face anti-counterfeiting detection method according to claim 3 .

16. The method according to claim 15 , the performing, by the neural network, living body detection on the video obtained by the terminal device comprises: performing, by the first neural network, the living body detection on the video obtained by the terminal device;

the in response to passing the living body detection by the video obtained by the terminal device, executing the face anti-counterfeiting detection method according to claim 3 comprises:

in response to passing the living body detection by the video obtained by the terminal device, executing the operations of inputting the video obtained by the terminal device to the first neural network, and extracting, by the first neural network, a feature of the video obtained by the terminal device and detecting whether the extracted feature contains counterfeited face clue information; or

in response to passing the living body detection by the video obtained by the terminal device, selecting a partial video or image from the video obtained by the terminal device as the image or video to be detected, and executing the operations of inputting the image or video to be detected to a neural network, and outputting, by the neural network, a detection result for indicating whether the image or video to be detected contains at least one piece of counterfeited face clue information.

17. The method according to claim 15 , wherein the performing, by the neural network, living body detection on the video obtained by the terminal device comprises:

performing, by the neural network, validity detection of a required action on the video obtained by the terminal device; and

at least in response to that a validity detection result indicates the required action satisfies a preset condition, determining that the video obtained by the terminal device passes the living body detection.

18. The method according to claim 17 , wherein the required action comprises at least one of the following: blink, open mouth, shut up, smile, nod up, nod down, turn left, turn right, tilt left, tilt right, head down, or head up, wherein the required action is a preset required action or a randomly selected required action.

19. An electronic device, comprising:

memory configured to store executable instructions; and

a processor configured to communicate with the memory to execute the executable instructions so as to perform:

obtaining an image or video to be detected containing a face;

extracting a feature of the image or video to be detected, and detecting whether the extracted feature contains counterfeited face clue information, wherein the counterfeited face clue information comprises counterfeited clue information of an imaging media, and the counterfeited clue information of the imaging media comprises a screen edge, screen reflection, and a screen Moiré pattern of a display device; and

determining whether the face passes the face anti-counterfeiting detection according to a detection result.

20. A non-transitory computer-readable storage medium configured to store computer-readable instructions, wherein execution of the instructions by the processor causes the processor to perform:

obtaining an image or video to be detected containing a face;

extracting a feature of the image or video to be detected, and detecting whether the extracted feature contains counterfeited face clue information, wherein the counterfeited face clue information comprises counterfeited clue information of an imaging media, and the counterfeited clue information of the imaging media comprises a screen edge, screen reflection, and a screen Moiré pattern of a display device; and

determining whether the face passes the face anti-counterfeiting detection according to a detection result.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2019
From: WU, LIWEI; BAO, TIANPENG; YU, MENG; CHE, YINGHUI; ZHAO, CHENXU
To: BEIJING SENSETIME TECHNOLOGY DEVELOPMENT CO., LTD
Reel/Frame 050740/0008 →
Priority Claims (2)
CN 201710157715.1 · Mar 16, 2017 · national
CN 201711251762.9 · Dec 1, 2017 · national
Continuity (2)
Continuation PCTCN2018079247 · Mar 16, 2018
Related Publication 20190318156A1 · Oct 17, 2019