IP Library › Granted Patent US 12,243,346
Granted Patent B2
US 12,243,346 · App. 18/489,017 · Granted Mar 4, 2025

Electronic device comprising display-embedded fingerprint sensor and method

Inventor: Jinho Kim (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06V40/1318G06T5/50G06T2207/20224G06V2201/121
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,346
App. No.
18/489,017
Granted
Mar 4, 2025
Kind
B2
Abstract

An electronic device includes: a display panel including a plurality of light-emitting elements and a fingerprint sensing region; a fingerprint sensor disposed below the fingerprint sensing region; and at least one processor electrically connected to the display panel or the fingerprint sensor, and configured to identify an occurrence of an event that causes an operation of receiving a fingerprint through the fingerprint sensor to be executed, obtain a first image of the fingerprint by controlling the display panel such that light-emitting elements disposed in a first light-emitting region within the fingerprint sensing region output light, obtain a second image of the fingerprint by controlling the display panel such that light-emitting elements disposed in a second light-emitting region that does not overlap the first light-emitting region output light, and determine whether the fingerprint is a three-dimensional object, by using the first image and the second image.

Claims (45)

1. An electronic device comprising:

a display panel comprising a plurality of light-emitting elements and a fingerprint sensing region;

a fingerprint sensor disposed below the fingerprint sensing region of the display panel;

memory storing instructions; and

at least one processor,

wherein the instructions, when executed by the at least one processor, cause the electronic device to:

identify an occurrence of an event that causes an operation of receiving a fingerprint through the fingerprint sensor to be executed;

acquire a first image of the fingerprint by controlling the display panel such that light-emitting elements disposed in a first light-emitting region within the fingerprint sensing region among the plurality of light-emitting elements output light;

acquire a second image of the fingerprint by controlling the display panel such that light-emitting elements disposed in a second light-emitting region that does not overlap the first light-emitting region among the plurality of light-emitting elements output light; and

determine whether the fingerprint is a three-dimensional object by using the first image and the second image,

wherein the instructions, when executed by the at least one processor, cause the electronic device to determine that the fingerprint is the three-dimensional object when a phase of a first portion among the first image is different from a phase of a second portion among the second image, and

wherein the first portion of the first image and the second portion of the second image correspond to a same portion of the fingerprint.

2. The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to determine whether the fingerprint is the three-dimensional object based on a subtraction component of the first image from the second image.

3. The electronic device of claim 1 , wherein, based on determination that the fingerprint is the three-dimensional object, the instructions, when executed by the at least one processor, cause the electronic device to perform biometric authentication by using a fingerprint image that is acquired based on the first image and the second image.

4. The electronic device of claim 1 , wherein the light outputted from the first light-emitting region is discharged through a first light output region and an overlapping region which correspond to a surface of the display panel, and the light outputted from the second light-emitting region is discharged through a second light output region that is distinguished from the first light output region, and the overlapping region,

wherein the second light output region and the overlapping region correspond to the surface of the display panel.

5. The electronic device of claim 4 , wherein the first image comprises a first sensing region corresponding to the first light output region, a second sensing region corresponding to the overlapping region, and a third sensing region corresponding to the second light output region.

6. The electronic device of claim 5 , wherein the instructions, when executed by the at least one processor, cause the electronic device to filter a noise of the second image based on image data included in the third sensing region of the first image.

7. The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:

acquire a third image of the fingerprint by controlling light-emitting elements disposed in a third light-emitting region that is distinguished from the first light-emitting region to output light, in response to an occurrence of another event that causes the operation of receiving the fingerprint to be executed after the occurrence of the event; and

acquire a fourth image of the fingerprint by controlling light-emitting elements disposed in a fourth light-emitting region that is distinguished from the second light-emitting region and does not overlap the third light-emitting region to output light.

8. The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:

determine whether the event is a first event of a high security level in response to identifying the occurrence of the event;

when the event is the first event of the high security level, acquire the first image and the second image in sequence by activating the first light-emitting region and the second light-emitting region in sequence, determine whether the fingerprint is the three-dimensional object by using the first image and the second image, and, when the fingerprint is the three-dimensional object, perform biometric authentication by using an image of the fingerprint that is acquired by using the first image and the second image,

wherein the event corresponds to a higher security level than a pre-set security level, the instructions, when executed by the at least one processor, cause the electronic device to determines that the event is the first event of the high security level.

9. The electronic device of claim 8 , wherein, when the event is a second event of a low security level, the at least one processor is configured to acquire the image of the fingerprint by controlling light-emitting elements corresponding to the fingerprint sensing region to emit light,

wherein the event corresponds to a lower security level than the pre-set security level, the instructions, when executed by the at least one processor, cause the electronic device to determines that the event is the second event of the low security level.

10. The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to control the display panel to output light having a same luminance through the first light-emitting region and the second light-emitting region.

11. An operating method of an electronic device comprising a display panel comprising a plurality of light-emitting elements and a fingerprint sensing region, and a fingerprint sensor, the operating method comprising:

identifying an occurrence of an event that causes an operation of receiving a fingerprint through the fingerprint sensor to be executed;

acquiring a first image of the fingerprint by controlling the display panel such that light-emitting elements disposed in a first light-emitting region within the fingerprint sensing region among the plurality of light-emitting elements output light;

acquiring a second image of the fingerprint by controlling the display panel such that light-emitting elements disposed in a second light-emitting region that does not overlap the first light-emitting region among the plurality of light-emitting elements output light;

determining whether the fingerprint is a three-dimensional object by using the first image and the second image; and

determining that the fingerprint is the three-dimensional object when a phase of a first portion among the first image is different from a phase of a second portion among the second image, and

wherein the first portion of the first image and the second portion of the second image correspond to a same portion of the fingerprint.

12. The method of claim 11 , wherein the determining whether the fingerprint is the three-dimensional object comprises determining whether the fingerprint is the three-dimensional object based on a subtraction component of the first image from the second image.

13. The method of claim 11 , further comprising:

based on determination that the fingerprint is the three-dimensional object, performing biometric authentication by using an image of the fingerprint that is acquired based on the first image and the second image.

14. The method of claim 11 , wherein acquiring the first image of the fingerprint by controlling the display panel comprises discharging the light outputted by the light-emitting elements disposed in the first light-emitting region through a first light output region and an overlapping region which correspond to a surface of the display panel, and

acquiring the second image of the fingerprint by controlling the display panel comprises discharging the light outputted by the light-emitting elements disposed in the second light-emitting region through a second light output region that is distinguished from the first light output region, and the overlapping region,

wherein the second light output region and the overlapping region correspond to the surface of the display panel.

15. The method of claim 11 , further comprising:

acquiring a third image of the fingerprint by controlling light-emitting elements disposed in a third light-emitting region that is distinguished from the first light-emitting region to output light, in response to an occurrence of another event that causes the operation of receiving the fingerprint to be executed after the occurrence of the event; and

acquiring a fourth image of the fingerprint by controlling light-emitting elements disposed in a fourth light-emitting region that is distinguished from the second light-emitting region and does not overlap the third light-emitting region to output light.

16. The electronic device of claim 2 , wherein the instructions, when executed by the at least one processor, cause the electronic device to determines that the fingerprint is the three-dimensional object when the subtraction component includes a phase difference in a predetermined area, of which value is not zero.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2023
From: KIM, JINHO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 065274/0107 →
Priority Claims (1)
KR 10-2021-0062216 · May 13, 2021 · national
Continuity (2)
Continuation PCTKR2022006935 · May 13, 2022
Related Publication 20240046695A1 · Feb 8, 2024
References Cited (24)
US 20080253620A1 · Hashimoto · 2008 [cited by applicant]
US 20170220840A1 · Wickboldt et al. · 2017 [cited by applicant]
US 20170270342A1 · He et al. · 2017 [cited by applicant]
US 20170323141A1 · Lee et al. · 2017 [cited by applicant]
US 20180260602A1 · He et al. · 2018 [cited by applicant]
US 20190303639A1 · He et al. · 2019 [cited by applicant]
US 20200380238A1 · Zeng et al. · 2020 [cited by applicant]
US 20200387687A1 · Chung · 2020 [cited by examiner]
US 20210004562A1 · Chiang · 2021 [cited by examiner]
US 20210064839A1 · Lee et al. · 2021 [cited by applicant]
US 20210319207A1 · Zhong et al. · 2021 [cited by applicant]
US 20210334568A1 · Hall · 2021 [cited by examiner]
CN 110520863A · 2019 [cited by applicant]
CN 110945524A · 2020 [cited by applicant]
CN 111523523A · 2020 [cited by applicant]
CN 111837131A · 2020 [cited by applicant]
CN 211698979U · 2020 [cited by applicant]
JP 4389957B2 · 2009 [cited by applicant]
JP 6924767B2 · 2021 [cited by applicant]
KR 20170125556A · 2017 [cited by applicant]
KR 101924916B1 · 2018 [cited by applicant]
KR 20210025752A · 2021 [cited by applicant]
WO WO2018171174A1 · 2018 [cited by examiner]
International Search Report mailed Aug. 29, 2022 for PCT/KR2022/006935. [cited by applicant]