IP Library Granted Patent US 12,367,821
Granted Patent B2
US 12,367,821 · App. 18/494,398 · Granted Jul 22, 2025

Expediting fingerprint authentication via variable refresh rate control and display luminance compensation

Inventors: Jyothi Karri (San Jose, CA); Chien-Hui Wen (Cupertino, CA)
Assignee: Google LLC
G09G3/3225G06F3/041G06V40/1318G06V40/1365G09G2320/0626G09G2340/0435G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,821
App. No.
18/494,398
Granted
Jul 22, 2025
Kind
B2
Abstract

This document describes systems and techniques directed at expediting fingerprint authentication via variable refresh rate control and display luminance compensation. In aspects, a computing device having an under-display fingerprint sensor (UDFPS) and a touch-sensitive display includes a biometric authentication manager. Upon detecting at least one finger at or near the touch-sensitive display, the biometric authentication manager implements variable display refresh rates and selectively adjusts luminance settings for a high-luminance region of the touch-sensitive display for predetermined intervals. In so doing, at least one finger can be well-illuminated during UDFPS image capturing, facilitating UDFPS sensing and expediting fingerprint authentication.

Claims (26)

1. A computing device comprising:

an under-display fingerprint sensor;

a display comprising:

a pixel array including rows of pixel circuits, each of the pixel circuits comprising one or more light-emitting diodes;

a data-line driver operably coupled to each of the pixel circuits, the data-line driver configured to selectively supply data-line signals to one or more of the pixel circuits, the data-line signals comprising voltage data effective to cause one or more pixel circuits to illuminate light at varying luminosities; and

an emission control-line driver operably coupled to each of the pixel circuits, the emission control-line driver configured to:

supply, in an alternating fashion, a low emission-control signal and a high emission-control signal to each of the pixel circuits effective to implement a refresh rate for the display; and

a processor configured to:

detect at least one finger at or near the display of the computing device;

determine, responsive to the detection of the at least one finger, a target luminance of a region of the display and a target frequency at which the emission control-line driver supplies the low emission-control signal and the high emission-control signal;

direct, based on the determination, (i) the emission control-line driver to adjust the frequency at which the low emission-control signal and the high emission-control signal are supplied at one or more of the pixel circuits to the target frequency and (ii) the data-line driver to adjust the voltage data for one or more pixel circuits within the region of the display, the direction sufficient to cause an increase in luminosity of the one or more pixel circuits within the region of the display; and

instruct the under-display fingerprint sensor to capture one or more images of the at least one finger, the frequency adjustment of the emission control-line driver and the voltage data adjustment effective to facilitate fingerprint image capturing.

2. The computing device of claim 1 , wherein the target frequency comprises a frequency less than or equal to 15 hertz.

3. The computing device of claim 1 , wherein the direction to adjust the frequency and the voltage data occur during a first interval, the first interval lasting for at least a duration equal to an exposure time for the under-display fingerprint sensor.

4. The computing device of claim 3 , wherein the processor is further configured to:

direct, in response the capture of one or more images, (i) the emission control-line driver to increase the frequency at which the low emission-control signal and the high emission-control signal are supplied at one or more of the pixel circuits to a second target frequency and (ii) the data-line driver to adjust the voltage data for one or more pixel circuits within the region of the display, the direction sufficient to maintain a luminosity of the one or more pixel circuits within the region of the display; and

instruct the under-display fingerprint sensor to capture one or more additional images of the at least one finger.

5. The computing device of claim 4 , wherein the direction to increase the frequency and adjust the voltage data occur during a second interval, the second interval lasting for at least a duration equal to an exposure time for the under-display fingerprint sensor.

6. The computing device of claim 3 , wherein the direction to adjust the frequency and the voltage data comprises luminance settings targeting a lower pixel luminance than previous luminance settings during the first interval.

7. The computing device of claim 1 , wherein the direction to adjust the frequency and the voltage data comprises luminance settings targeting a pixel luminance greater than 100% of a pre-coded pixel luminance setting in a display driver integrated circuit.

8. The computing device of claim 1 , wherein the at least one finger is provided at the region of the display.

9. The computing device of claim 1 , wherein the processor is further configured to:

authenticate, responsive to the capture of one or more images, a user based on analysis of a fingerprint of the at least one finger represented in the one or more images.

10. The computing device of claim 9 , wherein the processor is further configured to:

provide, in accordance with a positive authentication of the user, access to one or more resources on the computing device.

11. The computing device of claim 1 , wherein the display is a touch-sensitive display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2023
From: KARRI, JYOTHI; WEN, CHIEN-HUI
To: GOOGLE LLC
Reel/Frame 065375/0609 →
Continuity (2)
Provisional Application 63381498 · Oct 28, 2022
Related Publication 20240062718A1 · Feb 22, 2024
References Cited (146)
US 9697758B2 · Watanabe et al. · 2017 [cited by applicant]
US 10021226B2 · Gagne-Keats et al. · 2018 [cited by applicant]
US 10068551B1 · Choi et al. · 2018 [cited by applicant]
US 10440839B2 · Cheng · 2019 [cited by applicant]
US 10510317B2 · Spence et al. · 2019 [cited by applicant]
US 10742788B2 · Shin et al. · 2020 [cited by applicant]
US 10838452B2 · Siddiqui et al. · 2020 [cited by applicant]
US 10890954B2 · Evans et al. · 2021 [cited by applicant]
US 10997914B1 · Hwang et al. · 2021 [cited by applicant]
US 11163970B1 · Sammoura et al. · 2021 [cited by applicant]
US 11403984B2 · Jung et al. · 2022 [cited by applicant]
US 12008836B2 · Kim et al. · 2024 [cited by applicant]
US 20060093928A1 · Hung et al. · 2006 [cited by applicant]
US 20070070272A1 · Gettemy et al. · 2007 [cited by applicant]
US 20080062102A1 · Ichiraku et al. · 2008 [cited by applicant]
US 20080123032A1 · Taniguchi et al. · 2008 [cited by applicant]
US 20100053853A1 · Allore et al. · 2010 [cited by applicant]
US 20110175852A1 · Goertz et al. · 2011 [cited by applicant]
US 20130088671A1 · Drzaic et al. · 2013 [cited by applicant]
US 20130135272A1 · Park · 2013 [cited by applicant]
US 20130342519A1 · Kim et al. · 2013 [cited by applicant]
US 20140118985A1 · Hassember · 2014 [cited by applicant]
US 20140240911A1 · Cole et al. · 2014 [cited by applicant]
US 20140265822A1 · Drzaic et al. · 2014 [cited by applicant]
US 20140267370A1 · Albrecht et al. · 2014 [cited by applicant]
US 20140267448A1 · Albrecht et al. · 2014 [cited by applicant]
US 20150070826A1 · Montevirgen et al. · 2015 [cited by applicant]
US 20150138434A1 · Chuang et al. · 2015 [cited by applicant]
US 20150287352A1 · Watanabe et al. · 2015 [cited by applicant]
US 20150301417A1 · Park et al. · 2015 [cited by applicant]
US 20150331292A1 · Yang et al. · 2015 [cited by applicant]
US 20160063933A1 · Kobayashi et al. · 2016 [cited by applicant]
US 20160078838A1 · Huang et al. · 2016 [cited by applicant]
US 20160078846A1 · Liu et al. · 2016 [cited by applicant]
US 20160227654A1 · Kim et al. · 2016 [cited by applicant]
US 20160337570A1 · Tan et al. · 2016 [cited by applicant]
US 20170092196A1 · Gupta et al. · 2017 [cited by applicant]
US 20170116932A1 · Musgrave et al. · 2017 [cited by applicant]
US 20170168463A1 · Hong et al. · 2017 [cited by applicant]
US 20170200054A1 · Du et al. · 2017 [cited by applicant]
US 20170322357A1 · De Jong et al. · 2017 [cited by applicant]
US 20180012006A1 · Suh et al. · 2018 [cited by applicant]
US 20180018501A1 · Mather et al. · 2018 [cited by applicant]
US 20180040301A1 · Bae et al. · 2018 [cited by applicant]
US 20180075798A1 · Nho et al. · 2018 [cited by applicant]
US 20180137332A1 · Andersen et al. · 2018 [cited by applicant]
US 20180151109A1 · Shim et al. · 2018 [cited by applicant]
US 20180165508A1 · Othman et al. · 2018 [cited by applicant]
US 20180260602A1 · He et al. · 2018 [cited by applicant]
US 20180285619A1 · Kim et al. · 2018 [cited by applicant]
US 20180300526A1 · Cho et al. · 2018 [cited by applicant]
US 20180301080A1 · Shigeta et al. · 2018 [cited by applicant]
US 20180350313A1 · Nambi et al. · 2018 [cited by applicant]
US 20190057660A1 · Lee · 2019 [cited by examiner]
US 20190197944A1 · Kim et al. · 2019 [cited by applicant]
US 20190228740A1 · Aflatooni et al. · 2019 [cited by applicant]
US 20190303639A1 · He et al. · 2019 [cited by applicant]
US 20190303642A1 · He et al. · 2019 [cited by applicant]
US 20200035202A1 · Aflatooni et al. · 2020 [cited by applicant]
US 20200050818A1 · He et al. · 2020 [cited by applicant]
US 20200117933A1 · Chang et al. · 2020 [cited by applicant]
US 20200273427A1 · Wang · 2020 [cited by applicant]
US 20200327348A1 · Kim · 2020 [cited by applicant]
US 20200403186A1 · Choi et al. · 2020 [cited by applicant]
US 20210005158A1 · Huang et al. · 2021 [cited by applicant]
US 20210056281A1 · Shih et al. · 2021 [cited by applicant]
US 20210201731A1 · Ranjan et al. · 2021 [cited by applicant]
US 20210209327A1 · Wu et al. · 2021 [cited by applicant]
US 20210232791A1 · Wang · 2021 [cited by applicant]
US 20210248350A1 · Chang et al. · 2021 [cited by applicant]
US 20210264181A1 · Park et al. · 2021 [cited by applicant]
US 20210271851A1 · Chou et al. · 2021 [cited by applicant]
US 20210333928A1 · Wu et al. · 2021 [cited by applicant]
US 20210335325A1 · Her et al. · 2021 [cited by applicant]
US 20210408140A1 · Han et al. · 2021 [cited by applicant]
US 20220043488A1 · Lombardi et al. · 2022 [cited by applicant]
US 20220050506A1 · Gehlen et al. · 2022 [cited by applicant]
US 20220058254A1 · Park et al. · 2022 [cited by applicant]
US 20220130308A1 · Jung et al. · 2022 [cited by applicant]
US 20220148536A1 · Choi · 2022 [cited by applicant]
US 20220165083A1 · Lin et al. · 2022 [cited by applicant]
US 20220270550A1 · Choi et al. · 2022 [cited by applicant]
US 20220391086A1 · Westerman · 2022 [cited by applicant]
US 20230154411A1 · Lee · 2023 [cited by examiner]
US 20230222950A1 · Zhang · 2023 [cited by applicant]
US 20230274573A1 · Kim et al. · 2023 [cited by applicant]
US 20230274678A1 · Wen et al. · 2023 [cited by applicant]
US 20230306912A1 · Wen et al. · 2023 [cited by applicant]
US 20230343267A1 · Wen · 2023 [cited by applicant]
US 20240029684A1 · Sun et al. · 2024 [cited by applicant]
US 20240105142A1 · Jeon et al. · 2024 [cited by applicant]
US 20240161548A1 · Kim et al. · 2024 [cited by applicant]
US 20240193985A1 · Sammoura et al. · 2024 [cited by applicant]
US 20240264740A1 · Zou et al. · 2024 [cited by applicant]
US 20240298509A1 · Gong et al. · 2024 [cited by applicant]
CN 103488364A · 2014 [cited by applicant]
CN 110310596A · 2019 [cited by applicant]
CN 111241890 · 2020 [cited by applicant]
CN 111477135 · 2020 [cited by applicant]
CN 112288661A · 2021 [cited by applicant]
CN 112331145 · 2021 [cited by applicant]
CN 113053306 · 2021 [cited by applicant]
CN 114187867 · 2022 [cited by applicant]
CN 115035851A · 2022 [cited by applicant]
CN 117351895A · 2024 [cited by applicant]
KR 20160080768 · 2016 [cited by applicant]
KR 102279278 · 2021 [cited by applicant]
TW 202318385A · 2023 [cited by applicant]
TW 202404343A · 2024 [cited by applicant]
WO 2015188595A1 · 2015 [cited by applicant]
WO 2020192051A1 · 2020 [cited by applicant]
WO 2022046025 · 2022 [cited by applicant]
WO 2022105484 · 2022 [cited by applicant]
“Foreign Office Action”, IN Application No. 202247031876, Aug. 7, 2023, 7 pages. [cited by applicant]
“Foreign Office Action”, JP Application No. 2022-536640, Sep. 5, 2023, 4 pages. [cited by applicant]
“International Preliminary Report on Patentability”, Application No. PCT/US2020/047670, Feb. 28, 2023, 10 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2022/072601, Jan. 16, 2023, 12 pages. [cited by applicant]
“International Search Report and Written Opinion”, Application No. PCT/US2020/047670, May 12, 2021, 13 pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 17/507,293, filed Feb. 17, 2023, 7 pages. [cited by applicant]
“Non-Final Office Action”, U.S. Appl. No. 17/586,386, filed Oct. 24, 2022, 5 pages. [cited by applicant]
Choi, et al., “Disabling Transitions When Encoded Intensity is Low”, Application No. PCT/US2021/070522, filed May 10, 2021, 46 pages. [cited by applicant]
Choi, et al., “Light-Guiding Structure For Under-Display Sensor Modules”, Technical Disclosure Commons; https://www.tdcommons.org/dpubs_series/3527, Aug. 17, 2020, 8 pages. [cited by applicant]
Chugh, et al., “Fingerprint Spoof Detection: Temporal Analysis of Image Sequence”, Dec. 17, 2019, 8 pages. [cited by applicant]
Ghiani, et al., “Fingerprint liveness detection using Binarized Statistical Image Features”, Oct. 2013, 6 pages. [cited by applicant]
Karri, et al., “User Interface Mitigation of Display Artifacts During Transitions between Display Clock Speeds”, Technical Disclosure Commons, https://www.tdcommons.org/dpubs_series/5427, Nov. 4, 2022, 7 pages. [cited by applicant]
Li-Fong, et al., “A Circular Flexible Amoled Display with a 1-mm Slim Border”, May 25, 2016, pp. 847-850. [cited by applicant]
Lih, et al., “A True Circular 1.39 Inch Amoled for Wearable Application”, May 2016, pp. 566-569. [cited by applicant]
Lombardi, et al., “Adaptive User Interface for a Camera Aperture within an Active Display Area”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2719, Nov. 25, 2019, 12 pages. [cited by applicant]
Ojala, et al., “Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns”, Jul. 2002, pp. 971-987. [cited by applicant]
Sammoura, et al., “Fingerprint-Matching Algorithm Using Polar Shapelets”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2471, Sep. 10, 2019, 17 pages. [cited by applicant]
Sammoura, et al., “Safeguarding Biometric Authentication Systems from Fingerprint Spoof Attacks”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2769, Dec. 16, 2019, 13 pages. [cited by applicant]
Sammoura, et al., “Spoof Detection for Fingerprint Sensors”, Technical Disclosure Commons; Retrieved from https://www.tdcommons.org/dpubs_series/2648, Nov. 5, 2019, 12 pages. [cited by applicant]
Shin, et al., “Dynamic Voltage Scaling of OLED Displays”, Jun. 2011, 6 pages. [cited by applicant]
Skanda, Sai, “Xiaomi Mi 9 to Feature an Improved In-screen Fingerprint Sensor”, https://www.gizchina.com/2019/02/17/mi-9-fingerprint-improved-fingerprint/, Feb. 17, 2019, 10 pages. [cited by applicant]
Yonebayashi, et al., “High refresh rate and low power consumption AMOLED panel using top-gate n-oxide and p-LTPS TFTs”, Mar. 2020, 10 pages. [cited by applicant]
Choi, et al., “Expediting Fingerprint Authentication by Compensating for Display Luminance Latency”, Technical Disclosure Commons, https://www.tdcommons.org/dpubs_series/4686, Oct. 29, 2021, 11 pages. [cited by applicant]
Wen, et al., “Improving Under-Display Fingerprint Authentication Latency by Normalizing Frame Luminance”, Technical Disclosure Commons—https://www.tdcommons.org/dpubs_series/5006, Mar. 24, 2022, 12 pages. [cited by applicant]
“Notice of Allowance”, U.S. Appl. No. 18/313,138, filed Mar. 12, 2024, 7 pages. [cited by applicant]
Lee, et al., “Illumination-Level Adaptive Color Reproduction Method with Lightness Adaptation and Flare Compensation for Mobile Display”, Jan. 2007, 9 pages. [cited by applicant]
Li, et al., “Advanced Prediction Model for Variable Refresh Rate Compensation Compensation”, May 29, 2024, 9 pages. [cited by applicant]
Li, et al., “Smart Mathematical Model for Variable Refresh Rate Prediction Algorithm”, Technical Disclosure Commons, https://www.tdcommons.org/dpubs_series/7047, May 29, 2024, 10 pages. [cited by applicant]
Bai, et al., “On-Pixel Ratio-Based Adjustment of Local High Brightness Control”, Oct. 8, 2024, 13 pages. [cited by applicant]
Eltoft, et al., “Adaptive Maximum Fingerprint Touch-Size Threshold for Reduced Unintended Authentication Attempts and Reduced Spoof Accept Rate”, Technical Disclosure Commons, https://www.tdcommons.org/dpubs_series/7586… [cited by applicant]
“DAC <Basic D/A Converter Configurations> ”, ROHM—retrieved at: https://www.rohm.com/electronics-basics/ad-da-converters/da-converter-configurations—on Jun. 6, 2024, 9 pages. [cited by applicant]
Choi, et al., “Independently Controllable Black Level Voltage in Digital-to-Analog Converter Circuits for AMOLED Driving Circuits”, Technical Disclosure Commons, https://www.tdcommons.org/dpubs_series/7114, Jun. 18, 202… [cited by applicant]
Mienko, et al., “”Ultra-dark“ OLED Panel Combining Polarization and Masking Layers”, Technical Disclosure Commons, https://www.tdcommons.org/dpubs_series/7923, Mar. 18, 2025, 12 pages. [cited by applicant]