IP Library Granted Patent US 12,651,049
Granted Patent B2
US 12,651,049 · App. 18/319,200 · Granted Jun 9, 2026

Spoof detection using localized illumination for biometric authentication systems

Inventors: Firas Sammoura (Dublin, CA); James Brooks Miller (Sunnyvale, CA)
Assignee: Google LLC
G06F21/32G06V10/141G06V10/70G06V40/1318G06V40/1394G06F3/04186G06F3/0446G06F2203/04104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,651,049
App. No.
18/319,200
Granted
Jun 9, 2026
Kind
B2
Abstract

This document describes a biometric authentication system including a biometric authentication manager is configured to receive user input at a touch-sensitive display, determine a shape of the user input, and alter a luminosity and/or color of one or more portions of a region of the touch-sensitive display. Through such a technique, the biometric authentication manager can implement spatially, temporally, and/or chromatically variable illumination patterns to produce a fingerprint reflection, receive the fingerprint reflection, and then analyze the fingerprint reflection for authenticity and/or for liveness characteristics effective to detection spoof fingerprints.

Claims (41)

1 . A method comprising:

receiving a fingertip touch input from a user, the fingertip touch input in contact with a touch-sensitive display;

determining, responsive to receiving the fingertip touch input, an irregularly-shaped contact area of the fingertip touch input in contact with the touch-sensitive display, the determining the irregularly-shaped contact area of the contact with the touch-sensitive display including:

receiving a raw heatmap; and

determining, based on the raw heatmap, a location of the irregularly-shaped contact area;

altering, responsive to determining the irregularly-shaped contact area of the contact, a color of light emitted by one or more portions of the touch-sensitive display within the irregularly-shaped contact area;

receiving a fingerprint reflection of the fingertip touch input, the fingerprint reflection being a reflection from the fingertip touch input caused by the altered color of light emitted from the one or more portions of the touch-sensitive display at the irregularly-shaped contact area; and

determining, based on the received fingerprint reflection, that the fingerprint reflection of the fingerprint touch input indicates a live, human finger.

2 . The method as described in claim 1 , further comprising, prior to determining the irregularly-shaped contact area or prior to altering the color of light, determining that a resource of a computing device associated with the touch-sensitive display is locked from access.

3 . The method as described in claim 2 , wherein the resource of the computing device associated with the touch-sensitive display is a resource requiring authentication prior to the access, the resource requiring authentication being a computer program, an internet-enabled account, or a peripheral device.

4 . The method as described in claim 3 , further comprising, responsive to determining that the received fingerprint reflection of the fingerprint touch input indicates a live, human finger and is authorized to access the resource of the computing device, unlocking the resource of the computing device.

5 . The method as described in claim 1 , further comprising, responsive to determining that the received fingerprint reflection of the fingerprint touch input indicates a live, human finger and is not authorized to access the resource of the computing device, denying access to the resource of the computing device.

6 . The method as described in claim 1 , further comprising, responsive to determining the irregularly-shaped contact area of the contact, altering a luminosity of light emitted by the one or more portions of the touch-sensitive display within the irregularly-shaped contact area.

7 . The method as described in claim 1 , wherein altering a color of light emitted by one or more portions of the touch-sensitive display within the irregularly-shaped contact area is sufficient to generate colored light.

8 . The method as described in claim 1 , wherein altering a color of light emitted by one or more portions of the touch-sensitive display within the irregularly-shaped contact area is sufficient to generate electromagnetic waves at frequency greater than 700 nanometers.

9 . The method as described in claim 1 , wherein altering the color of light is effective to amplify characteristics of the fingertip touch input in the fingerprint reflection.

10 . The method as described in claim 1 , wherein determining that the fingerprint reflection of the fingerprint touch input indicates a live, human finger is based on a machine-learned model trained to reject spoof fingers if the fingerprint reflection exhibits optical characteristics dissimilar to optical characteristics of live, human fingers.

11 . The method of claim 1 , wherein determining the irregularly-shaped contact area further includes calculation of a line drawing algorithm based on the raw heatmap.

12 . The method of claim 1 , wherein altering the color of light emitted by one or more portions of the touch-sensitive display within the irregularly-shaped contact area alters the color at an offset from a contour of the irregularly-shaped contact area.

13 . The method of claim 12 , where in the offset is determined based on at least one of an ambient light of an environment in which the touch-sensitive display resides, an amount of potential light leakage from the touch-sensitive display, a current brightness setting of the touch-sensitive display, a determined curvature of the user input, or a size of the irregularly-shaped contact area.

14 . An electronic device comprising:

an electronic visual display;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:

receiving a fingertip touch input from a user, the fingertip touch input in contact with a touch-sensitive display;

determining, responsive to receiving the fingertip touch input, an irregularly-shaped contact area of the fingertip touch input in contact with the touch-sensitive display, the determining the irregularly-shaped contact area of the contact with the touch-sensitive display including:

receiving a raw heatmap; and

determining, based on the raw heatmap, a location of the irregularly-shaped contact area;

altering, responsive to determining the irregularly-shaped contact area of the contact, a color of light emitted by one or more portions of the touch-sensitive display within the irregularly-shaped contact area;

receiving a fingerprint reflection of the fingertip touch input, the fingerprint reflection being a reflection from the fingertip touch input caused by the altered color of light emitted from the one or more portions of the touch-sensitive display within the irregularly-shaped contact area; and

determining, based on the received fingerprint reflection, that the fingerprint reflection of the fingerprint touch input indicates a live, human finger.

15 . The electronic device as described in claim 14 , wherein the one or more programs further comprise instructions for:

prior to determining the irregularly-shaped contact area or prior to altering the color of light, determining that a resource of a computing device associated with the touch-sensitive display is locked from access.

16 . The electronic device as described in claim 15 , where in the one or more programs further comprise instructions for:

responsive to determining that the received fingerprint reflection of the fingerprint touch input indicates a live, human finger and is authorized to access the resource of the computing device, unlocking the resource of the computing device; or

responsive to determining that the received fingerprint reflection of the fingerprint touch input indicates a live, human finger and is not authorized to access the resource of the computing device, denying access to the resource of the computing device.

17 . The electronic device as described in claim 14 , wherein the one or more programs further comprise instructions for:

responsive to determining an irregularly-shaped contact area of the contact, altering a luminosity of light emitted by the one or more portions of the touch-sensitive display within the irregularly-shaped contact area.

18 . The electronic device of claim 14 , wherein determining the irregularly-shaped contact area further includes calculation of a line drawing algorithm based on the raw heatmap.

19 . The electronic device of claim 14 , wherein altering the color of light emitted by one or more portions of the touch-sensitive display within the irregularly-shaped contact area alters the color at an offset from a contour of the irregularly-shaped contact area.

20 . The electronic device of claim 19 , wherein the offset is determined based on at least one of an ambient light of an environment in which the electronic device resides, an amount of potential light leakage from the touch-sensitive display, a current brightness setting of the touch-sensitive display, a determined curvature of the user input, or a size of the irregularly-shaped contact area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2023
From: SAMMOURA, FIRAS; MILLER, JAMES BROOKS
To: GOOGLE LLC
Reel/Frame 063686/0614 →
Continuity (2)
Continuation PCTUS2022072601 · May 26, 2022
Related Publication 20230385393A1 · Nov 30, 2023
References Cited (49)
US 12008836B2 · Kim et al. · 2024 [cited by applicant]
US 20130088671A1 · Drzaic et al. · 2013 [cited by applicant]
US 20130342519A1 · Kim et al. · 2013 [cited by applicant]
US 20160063933A1 · Kobayashi et al. · 2016 [cited by applicant]
US 20160337570A1 · Tan et al. · 2016 [cited by applicant]
US 20170116932A1 · Musgrave et al. · 2017 [cited by applicant]
US 20170168463A1 · Hong et al. · 2017 [cited by applicant]
US 20170200054A1 · Du et al. · 2017 [cited by applicant]
US 20180012006A1 · Suh et al. · 2018 [cited by applicant]
US 20180018501A1 · Mather et al. · 2018 [cited by applicant]
US 20180040301A1 · Bae et al. · 2018 [cited by applicant]
US 20180165508A1 · Othman et al. · 2018 [cited by applicant]
US 20180300526A1 · Cho et al. · 2018 [cited by applicant]
US 20190057660A1 · Lee et al. · 2019 [cited by applicant]
US 20190197944A1 · Kim et al. · 2019 [cited by applicant]
US 20190228740A1 · Aflatooni et al. · 2019 [cited by applicant]
US 20190303639A1 · He et al. · 2019 [cited by applicant]
US 20190303642A1 · He et al. · 2019 [cited by applicant]
US 20200050818A1 · He et al. · 2020 [cited by applicant]
US 20200117933A1 · Chang et al. · 2020 [cited by applicant]
US 20200273427A1 · Wang · 2020 [cited by applicant]
US 20200327348A1 · Kim · 2020 [cited by applicant]
US 20210209327A1 · Wu et al. · 2021 [cited by applicant]
US 20210248350A1 · Chang et al. · 2021 [cited by applicant]
US 20210264181A1 · Park et al. · 2021 [cited by applicant]
US 20210271851A1 · Chou et al. · 2021 [cited by applicant]
US 20210333928A1 · Wu et al. · 2021 [cited by applicant]
US 20220050506A1 · Gehlen et al. · 2022 [cited by applicant]
US 20220058254A1 · Park et al. · 2022 [cited by applicant]
US 20230274573A1 · Kim et al. · 2023 [cited by applicant]
CN 111241890 · 2020 [cited by applicant]
WO 2021257108 · 2021 [cited by applicant]
WO 2024229035 · 2024 [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2022/072601, Jan. 16, 2023, 12 pages. [cited by applicant]
Choi, et al., “Expediting Fingerprint Authentication by Compensating for Display Luminance Latency”, Technical Disclosure Commons, https://www.tdcommons.org/dpubs_series/4686, Oct. 29, 2021, 11 pages. [cited by applicant]
Chugh, et al., “Fingerprint Spoof Detection: Temporal Analysis of Image Sequence”, Dec. 17, 2019, 8 pages. [cited by applicant]
Ghiani, et al., “Fingerprint liveness detection using Binarized Statistical Image Features”, Oct. 2013, 6 pages. [cited by applicant]
Li-Fong, et al., “A Circular Flexible Amoled Display with a 1-mm Slim Border”, May 25, 2016, pp. 847-850. [cited by applicant]
Lih, et al., “A True Circular 1.39 Inch Amoled for Wearable Application”, May 2016, pp. 566-569. [cited by applicant]
Lombardi, et al., “Adaptive User Interface for a Camera Aperture within an Active Display Area”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2719, Nov. 25, 2019, 12 pages. [cited by applicant]
Ojala, et al., “Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns”, Jul. 2002, pp. 971-987. [cited by applicant]
Sammoura, et al., “Fingerprint-Matching Algorithm Using Polar Shapelets”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2471, Sep. 10, 2019, 17 pages. [cited by applicant]
Sammoura, et al., “Safeguarding Biometric Authentication Systems from Fingerprint Spoof Attacks”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2769, Dec. 16, 2019, 13 pages. [cited by applicant]
Sammoura, et al., “Spoof Detection for Fingerprint Sensors”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2648, Nov. 5, 2019, 12 pages. [cited by applicant]
Skanda, “Xiaomi Mi 9 to Feature an Improved In-screen Fingerprint Sensor”, https://www.gizchina.com/2019/02/17/mi-9-fingerprint-improved-fingerprint/, Feb. 17, 2019, 10 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2024/027072, Jul. 23, 2024, 12 pages. [cited by applicant]
“Notice of Allowance”, U.S. Appl. No. 18/313,138, filed Mar. 12, 2024, 7 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2022/072601, Nov. 7, 2024, 8 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2024/027072, Nov. 11, 2024, 7 pages. [cited by applicant]