IP Library Granted Patent US 12,198,361
Granted Patent B2
US 12,198,361 · App. 17/321,479 · Granted Jan 14, 2025

Anti-spoofing 3D face reconstruction using infrared structure light

Inventors: Yue Tian (Princeton, NJ); Ting Wang (West Windsor, NJ); Shengtao Sun (Glassboro, NJ)
Assignee: NEC Corporation
G06T7/521G02B26/0833G02B27/0927G06N3/04G06V40/166G06T2207/10048G06T2207/20084G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,198,361
App. No.
17/321,479
Granted
Jan 14, 2025
Kind
B2
Abstract

Aspects of the present disclosure describe systems, methods, and structures for anti-spoofing 3D face reconstruction using infrared structured light that advantageously reconstructs 3D face structures for facial recognition and detect face surface material(s) such that human skin may be effectively distinguished from artifacts thereby providing additional security for facial recognition including immunity from 2D/3D print attacks including face masks and special make-ups.

Claims (7)

1. An anti-spoofing 3D face reconstruction system comprising:

a structured light generator including an infrared laser light source configured to generate infrared light at 980 nm and a light pattern generator configured to generate different structured patterns of the generated infrared light, the light pattern generator including a digital multimirror device (DMD) configured to generate a plurality of structured light patterns from received light;

a light beam expander interposed between the infrared laser light source and light pattern generator, the light beam expander configured to expand a beam of infrared light generated by the light generator;

a camera configured to detect and digitally image the different structured patterns after they are reflected from an object comprising a face;

a second light beam expander consisting of a double concave lens interposed between the structured light generator and the face, the second light beam expander configured to further expand a structured IR light beam to a proper light spot area for the face; and

an image processor configured to generate a 3D surface reconstruction of the face from the digital images of the reflected structured patterns and simultaneously detect a surface material of the face;

wherein the image processor reconstructs the 3D surface of the face including any distortion of the structured light patterns by triangulation, determines the surface material by comparing a strength of the reflected structured patterns of infrared (IR) light with a baseline strength of human skin, detects abnormal areas by a convolutional neural network (CNN) as part of the surface material detection, and marks or highlights the detected abnormal areas as non-skin segments/areas on the reconstructed 3D surface.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2024
From: NEC LABORATORIES AMERICA, INC.
To: NEC CORPORATION
Reel/Frame 069540/0269 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2021
From: TIAN, YUE; WANG, TING; SUN, SHENGTAO
To: NEC LABORATORIES AMERICA, INC.
Reel/Frame 056253/0925 →
Continuity (2)
Provisional Application 63026351 · May 18, 2020
Related Publication 20210358149A1 · Nov 18, 2021
References Cited (11)
US 11982805B2 · Hwangbo · 2024 [cited by examiner]
US 20150339471A1 · Bennett · 2015 [cited by examiner]
US 20170249501A1 · Van Der Sijde · 2017 [cited by examiner]
US 20170257770A1 · Derakhshani · 2017 [cited by examiner]
US 20180307895A1 · Chu · 2018 [cited by examiner]
US 20180343401A1 · Campbell · 2018 [cited by examiner]
US 20190166348A1 · Kempf · 2019 [cited by examiner]
US 20190213309A1 · Morestin · 2019 [cited by examiner]
US 20210262787A1 · Hirose · 2021 [cited by examiner]
Şengür, Abdulkadir, et al. “Deep feature extraction for face liveness detection.” 2018 International Conference on Artificial Intelligence and Data Processing (IDAP). Ieee, 2018. (Year: 2018). [cited by examiner]
Kim, Yoonsik, Insung Hwang, and Nam Ik Cho. “Convolutional neural networks and training strategies for skin detection.” 2017 IEEE international conference on image processing (ICIP). IEEE, 2017. (Year: 2017). [cited by examiner]