IP Library › Granted Patent US 12,321,431
Granted Patent B2
US 12,321,431 · App. 17/929,991 · Granted Jun 3, 2025

Face authentication anti-spoofing using ultrasound

Inventors: Octavio Ponce Madrigal (Mountain View, CA); Anton Heistser (Munich, DE); Patrick M. Amihood (Palo Alto, CA)
Assignee: Google LLC
G06F21/32G06T7/20G06T7/70G06V10/25G06V10/443G06V10/761G06V40/161G06V40/45G06T2207/10132G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,321,431
App. No.
17/929,991
Granted
Jun 3, 2025
Kind
B2
Abstract

Techniques and apparatuses are described that implement face authentication anti-spoofing using ultrasound. In particular, a face-authentication system uses ultrasound to distinguish between a real human face and a presentation attack that uses instruments to present a version of a human face. The face-authentication system includes or communicates with an ultrasonic sensor, which can detect a presentation attack and notify the face-authentication system. In general, the ultrasonic sensor analyzes characteristics of a presented object and determines whether the object represents a human face or a presentation attack instrument. In this way, the ultrasonic sensor can prevent unauthorized actors from using the presentation attack to gain access to a user's account or information.

Claims (73)

1. A method performed by an ultrasonic sensor, the method comprising:

transmitting an ultrasonic transmit signal;

receiving an ultrasonic receive signal, the ultrasonic receive signal comprising a version of the ultrasonic transmit signal that is reflected by an object;

generating range-profile data based on the ultrasonic receive signal, the range-profile data comprising amplitude information across a range dimension and a time dimension;

generating normalized range-profile data by normalizing the amplitude information within the range-profile data based on a determined distance to the object;

determining a feature associated with the amplitude information of the normalized range-profile data within a region-of-interest that is associated with a location of the object;

detecting a presentation attack based on a comparison of the determined feature to a threshold, the presentation attack attempting to spoof a face-authentication system, the object associated with the presentation attack; and

preventing the face-authentication system from authenticating the presentation attack.

2. The method of claim 1 , wherein:

the determining of the feature comprises detecting a peak amplitude within the region-of-interest of the range-profile data; and

the detecting the presentation attack comprises:

comparing the peak amplitude to the threshold; and

responsive to the peak amplitude being above the threshold, detecting the presentation attack.

3. The method of claim 2 , further comprising:

transmitting another ultrasonic transmit signal;

receiving another ultrasonic receive signal, the other ultrasonic receive signal comprising a version of the other ultrasonic transmit signal that is reflected by a human face;

generating other range-profile data based on the other ultrasonic receive signal, the other range-profile data comprising amplitude associated with the other ultrasonic receive signal;

detecting another peak amplitude within another region-of-interest of the other range-profile data, the other region-of-interest associated with a location of the human face;

comparing the other peak amplitude to the threshold; and

responsive to the other peak amplitude being less than the threshold, enabling the face-authentication system to authenticate the human face.

4. The method of claim 1 , wherein:

the determining of the feature comprises determining a distribution of energy over the region-of-interest; and

the detecting the presentation attack comprises detecting the presentation attack responsive to the distribution of energy being greater than the threshold.

5. The method of claim 1 , further comprising:

determining the location of the object,

wherein the region-of-interest includes the location of the object.

6. The method of claim 5 , further comprising:

accepting sensor data from a sensor,

wherein the determining the location of the object comprises determining the location of the object based on the sensor data.

7. The method of claim 6 , wherein the sensor comprises:

a phase-difference sensor of a camera; or

a radio-frequency sensor.

8. The method of claim 5 , further comprising:

prior to determining the feature, filtering the range-profile data to extract the amplitude information associated with the region-of-interest.

9. The method of claim 1 , wherein the transmitting of the ultrasonic transmit signal comprises generating the ultrasonic transmit signal having a bandwidth that results in a range resolution of the range-profile data being less than approximately 7 centimeters.

10. The method of claim 1 , wherein the normalizing of the amplitude information further comprises normalizing the amplitude information based on a cross-coupling factor.

11. The method of claim 1 , wherein the normalizing of the amplitude information further comprises normalizing the amplitude information based on a constant-false-alarm-rate signal-to-noise ratio.

12. The method of claim 1 , further comprising:

accepting motion data from an inertial measurement unit, the motion data representing motion of the ultrasonic sensor; and

compensating for the motion of the ultrasonic sensor by modifying the range-profile data based on the motion data.

13. The method of claim 1 , further comprising:

accepting motion data from an inertial measurement unit; and

determining that the ultrasonic sensor is substantially stationary based on the motion data,

wherein the transmitting the ultrasonic transmit signal comprises transmitting the ultrasonic transmit signal responsive to determining that the ultrasonic sensor is substantially stationary.

14. An apparatus comprising an ultrasonic sensor configured to:

transmit an ultrasonic transmit signal;

receive an ultrasonic receive signal, the ultrasonic receive signal comprising a version of the ultrasonic transmit signal that is reflected by an object;

generate range-profile data based on the ultrasonic receive signal, the range-profile data comprising amplitude information across a range dimension and a time dimension;

generate normalized range-profile data by normalizing the amplitude information within the range-profile data based on a determined distance to the object;

determine a feature associated with the amplitude information of the normalized range-profile data within a region-of-interest that is associated with a location of the object;

detect a presentation attack based on a comparison of the determined feature to a threshold, the presentation attack attempting to spoof a face-authentication system, the object associated with the presentation attack; and

prevent the face-authentication system from authenticating the presentation attack.

15. The apparatus of claim 14 , wherein the ultrasonic sensor is configured to:

detect a peak amplitude within the region-of-interest of the range-profile data;

compare the peak amplitude to the threshold; and

detect the presentation attack responsive to the peak amplitude being above the threshold.

16. The apparatus of claim 14 , wherein the ultrasonic sensor is configured to:

determine a distribution of energy over the region-of-interest; and

detect the presentation attack responsive to the distribution of energy being greater than the threshold.

17. The apparatus of claim 14 , wherein the ultrasonic sensor is configured to generate the ultrasonic transmit signal having a bandwidth that results in a range resolution of the range-profile data being less than approximately 7 centimeters.

18. The apparatus of claim 14 , wherein the ultrasonic sensor is further configured to normalize the amplitude information within the range-profile data based a cross-coupling factor or a constant-false-alarm-rate signal-to-noise ratio.

19. A non-transitory computer-readable medium comprising instructions which, when executed by a processor, cause an ultrasonic sensor to:

transmit an ultrasonic transmit signal;

receive an ultrasonic receive signal, the ultrasonic receive signal comprising a version of the ultrasonic transmit signal that is reflected by an object;

generate range-profile data based on the ultrasonic receive signal, the range-profile data comprising amplitude information across a range dimension and a time dimension;

generate normalized range-profile data by normalizing the amplitude information within the range-profile data based on a determined distance to the object;

determine a feature associated with the amplitude information of the normalized range-profile data within a region-of-interest that is associated with a location of the object;

detect a presentation attack based on a comparison of the determined feature to a threshold, the presentation attack attempting to spoof a face-authentication system, the object associated with the presentation attack; and

prevent the face-authentication system from authenticating the presentation attack.

20. The computer-readable medium of claim 19 , wherein the instructions cause the ultrasonic sensor to:

detect a peak amplitude within the region-of-interest of the range-profile data;

compare the peak amplitude to the threshold; and

detect the presentation attack responsive to the peak amplitude being above the threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2022
From: MADRIGAL, OCTAVIO PONCE; HEISTSER, ANTON; AMIHOOD, PATRICK M.
To: GOOGLE LLC
Reel/Frame 061001/0052 →
Continuity (2)
Continuation PCTUS2021056601 · Oct 26, 2021
Related Publication 20230126062A1 · Apr 27, 2023
References Cited (39)
US 3522764A · Biber et al. · 1970 [cited by applicant]
US 5729604A · Van Schyndel · 1998 [cited by applicant]
US 6104808A · Alameh et al. · 2000 [cited by applicant]
US 6542436B1 · Myllyla · 2003 [cited by applicant]
US 7801315B2 · Watanabe et al. · 2010 [cited by applicant]
US 9665784B2 · Derakhshani et al. · 2017 [cited by applicant]
US 10108871B2 · Derakhshani et al. · 2018 [cited by applicant]
US 10262188B2 · Agassy et al. · 2019 [cited by applicant]
US 10311219B2 · Bakish · 2019 [cited by applicant]
US 20160371555A1 · Derakhshani et al. · 2016 [cited by applicant]
US 20190065875A1 · Sheikh Faridul · 2019 [cited by examiner]
US 20190138828A1 · Hogan · 2019 [cited by applicant]
US 20190258841A1 · Rasmussen · 2019 [cited by examiner]
US 20200066132A1 · Kleinbeck · 2020 [cited by applicant]
US 20200201968A1 · Danielsen et al. · 2020 [cited by applicant]
US 20200300970A1 · Nguyen et al. · 2020 [cited by applicant]
US 20200319301A1 · Qiu et al. · 2020 [cited by applicant]
US 20220222466A1 · Hassani et al. · 2022 [cited by applicant]
US 20230125564A1 · Madrigal et al. · 2023 [cited by applicant]
US 20230129068A1 · Madrigal et al. · 2023 [cited by applicant]
EP 3447684 · 2019 [cited by applicant]
WO 2019089432 · 2019 [cited by applicant]
WO 2023075751 · 2023 [cited by applicant]
WO 2023075753 · 2023 [cited by applicant]
WO 2023075754 · 2023 [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2021/056622, Jul. 8, 2022, 14 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2021/056631, Jul. 11, 2022, 14 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2021/056601, Jul. 11, 2022, 15 pages. [cited by applicant]
Chen, et al., “EchoFace: Acousito Sensor-Based Media Attack Detection for Face Authentication”, Mar. 2020, pp. 2152-2159. [cited by applicant]
Lai, et al., “A Smart Spoofing Face Detector by Display Features Analysis”, Jul. 2016, 15 pages. [cited by applicant]
Ming, et al., “A Survey on Anti-Spoofing Methods for Face Recognition with RGB Cameras of Generic Consumer Devices”, Oct. 8, 2020, 53 pages [cited by applicant]
Pinto, et al., “Video-Based Face Spoofing Detection through Visual Rhythm Analysis”, Aug. 2012, 8 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2021/056622, Apr. 30, 2024, 10 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2021/056631, Apr. 30, 2024, 10 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2021/056601, Apr. 30, 2024, 11 pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 17/930,016, Nov. 13, 2024, 37 pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 17/930,026, Nov. 18, 2024, 13 pages. [cited by applicant]
Park, Jae-Hyun, “Anomaly detection from the signal of low-cost laser device without the false alarm and the missing”, IEEE Sensors Journal. Mar. 26, 2018; 18(1 0):4275-85., May 18, 2018, 11 pages. [cited by applicant]
“Foreign Office Action”, EP Application No. 21811189.6, Mar. 28, 2025, 4 pages. [cited by applicant]
Cited By (1)
US 12,387,528