IP Library › Granted Patent US 12,287,859
Granted Patent B2
US 12,287,859 · App. 17/720,565 · Granted Apr 29, 2025

Biometric liveness authentication method and electronic device

Inventors: Juwoan Yoo (Gyeonggi-do, KR); Wonsuk Jang (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F21/32G06V10/141G06V40/172G06V40/18G06V40/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,287,859
App. No.
17/720,565
Granted
Apr 29, 2025
Kind
B2
Abstract

Certain embodiments of the disclosure disclose a method and a device, the device including a display, a camera module disposed under the display, at least one light source disposed to correspond to the camera module, a memory, and a processor operatively connected to the display, the camera module, the light source, and/or the memory. The processor may be configured to drive the camera module and the at least one light source in response to a request for biometric authentication, acquire a face image from the camera module, analyze the face image produced at least in part by light emitted from the driven at least one light source, and perform the biometric authentication based on the analysis result. Other embodiments are possible.

Claims (67)

1. An electronic device comprising:

a display for visually providing information to a user;

a camera module disposed under the display;

at least one light source disposed to correspond to the camera module;

a memory storing instruction; and

a processor, wherein the instructions, when executed by the processor, cause the electronic device to:

drive the camera module and the at least one light source in response to a request for biometric authentication,

acquire a face image including an eye image from the camera module,

determine whether the acquired face image corresponds to a face image stored including an eye image in the memory,

determine whether a number of rays reflected by an eye identified from the eye image in the acquired face image corresponds to a number of the driven at least one light source, and

perform a function related to the biometric authentication based on determining that the acquired face image including the eye image corresponds to the face image stored in the memory and a number of rays reflected by an eye identified from the eye image in the acquired face image corresponds to a number of the driven at least one light source.

2. The electronic device of claim 1 , wherein the at least one light source further comprises:

a first light source disposed at a first distance from the camera module; and

a second light source disposed at a second distance from the camera module,

wherein the first distance is shorter than the second distance.

3. The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to:

determine whether a red-eye effect is identified from the eye image included in the acquired face image when the first light source is driven, and

determine whether a specular highlight is identified from the eye image included in the acquired face image when the second light source is driven.

4. The electronic device of claim 3 , wherein the instructions, when executed by the processor, cause the electronic device to:

determine whether a size of a reflected ray identified from the eye image is larger than a predetermined reference value when the first light source is driven,

determine biometric verification to be successful when the size of the reflected ray is larger than the predetermined reference value, and

determine biometric verification to be unsuccessful when the reflected ray is absent from the eye image or when the size of the reflected ray is smaller than the predetermined reference value.

5. The electronic device of claim 3 , wherein the instructions, when executed by the processor, cause the electronic device to:

determine whether a size of a reflected ray identified from the eye image appears smaller than a predetermined reference value when the second light source is driven,

determine biometric verification to be successful when the size of the reflected ray is smaller than the predetermined reference value, and

determine biometric verification to be unsuccessful when the reflected ray is absent from the eye image or when the size of the reflected ray is larger than the predetermined reference value.

6. The electronic device of claim 2 , further comprising a third light source disposed at the second distance from the camera module,

wherein the instructions, when executed by the processor, cause the electronic device to:

drive one of the second light source or the third light source to acquire a first face image,

determine whether one reflected ray is identified from an eye image included in the first face image,

when one reflected ray is identified from the eye image included in the first face image, drive the second light source and the third light source to acquire a second face image,

determine whether two reflected rays are identified from an eye image included in the second face image,

determine biometric verification to be successful when two reflected rays are identified from the eye image included in the second face image, and

determine biometric verification to be unsuccessful when reflected rays are absent from the eye image included in the second face image or when more or less than two reflected rays are identified from the eye image included in the second face image.

7. The electronic device of claim 1 , wherein the at least one light source is configured to be an infrared ray (IR) light-emitting diode (LED).

8. The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to determine, based on a security level of the biometric authentication, a number of times biometric liveness is to be determined based on the light emitted from the driven at least one light source.

9. A method for operating an electronic device, the method comprising:

driving a camera module, disposed under a display of the electronic device, and at least one light source, disposed to correspond to the camera module, in response to a request for biometric authentication;

acquiring a face image including an eye image from the camera module;

determining whether the acquired face image corresponds to a face image including an eye image stored in a memory of the electronic device,

determining whether a number of rays reflected by an eye identified from the eye image in the acquired face image corresponds to a number of the driven at least one light source; and

performing a function related to the biometric authentication based on determining that the acquired face image including the eye image corresponds to the face image stored in the memory and a number of rays reflected by an eye identified from the eye image in the acquired face image corresponds to a number of the driven at least one light source.

10. The method of claim 9 , wherein the at least one light source further comprises:

a first light source disposed at a first distance from the camera module; and

a second light source disposed at a second distance from the camera module,

wherein the first distance is shorter than the second distance.

11. The method of claim 10 , wherein the determining further comprises:

determining whether a red-eye effect is identified from the eye image included in the acquired face image when the first light source is driven; or

determining whether a specular highlight is identified from the eye image included in the acquired face image when the second light source is driven.

12. The method of claim 11 , further comprising:

determining whether a size of a reflected ray identified from the eye image is larger than a predetermined reference value when the first light source is driven;

determining biometric verification to be successful when the size of the reflected ray is larger than the predetermined reference value; and

determining biometric verification to be unsuccessful when the reflected ray is absent from the eye image or when the size of the reflected ray is smaller than the predetermined reference value.

13. The method of claim 10 , further comprising:

determining whether a size of a reflected ray identified from the eye image included in the acquired face image appears smaller than a predetermined reference value when the second light source is driven;

determining biometric verification to be successful when the size of the reflected ray is smaller than the predetermined reference value; and

determining biometric verification to be unsuccessful when the reflected ray is absent from the eye image or when the size of the reflected ray is larger than the predetermined reference value.

14. The method of claim 10 , wherein the electronic device further comprises a third light source disposed at the second distance from the camera module, and

wherein the method further comprises:

driving one of the second light source or the third light source to acquire a first face image;

determining whether one reflected ray is identified from an eye image included in the first face image;

when one reflected ray is identified from the eye image included in the first face image, driving the second light source and the third light source to acquire a second face image;

determining whether two reflected rays are identified from an eye image included in the second face image;

determining biometric verification to be successful when two reflected rays are identified from the eye image included in the second face image; and

determining biometric verification to be unsuccessful when reflected rays are absent from the eye image included in the second face image or when more or less than two reflected rays are identified from the eye image included in the second face image.

15. The method of claim 9 , wherein the at least one light source is configured to be an infrared ray (IR) light-emitting diode (LED).

16. The method of claim 9 , further comprising determining, based on a security level of the biometric authentication, a number of times biometric liveness is to be determined based on the light emitted from the driven at least one light source.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2022
From: YOO, JUWOAN; JANG, WONSUK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 059598/0270 →
Priority Claims (1)
KR 10-2021-0079335 · Jun 18, 2021 · national
Continuity (2)
Continuation PCTKR2022004854 · Apr 5, 2022
Related Publication 20220405365A1 · Dec 22, 2022
References Cited (28)
US 6760467B1 · Min et al. · 2004 [cited by applicant]
US 8411909B1 · Zhao et al. · 2013 [cited by applicant]
US 9672341B2 · Danikhno et al. · 2017 [cited by applicant]
US 10380418B2 · Agrawal · 2019 [cited by examiner]
US 10762367B2 · Ackerman et al. · 2020 [cited by applicant]
US 11080516B1 · Joshi · 2021 [cited by examiner]
US 11200436B2 · Ebihara · 2021 [cited by applicant]
US 20020010307A1 · Schwab · 2002 [cited by applicant]
US 20070120879A1 · Kanade et al. · 2007 [cited by applicant]
US 20090016574A1 · Tsukahara · 2009 [cited by applicant]
US 20110211056A1 · Publicover et al. · 2011 [cited by applicant]
US 20140169642A1 · Law et al. · 2014 [cited by applicant]
US 20160019420A1 · Feng et al. · 2016 [cited by applicant]
US 20160117544A1 · Hoyos et al. · 2016 [cited by applicant]
US 20170061210A1 · Ollila · 2017 [cited by examiner]
US 20180034812A1 · Rahman · 2018 [cited by applicant]
US 20190205680A1 · Miu · 2019 [cited by examiner]
US 20200226237A1 · He et al. · 2020 [cited by applicant]
US 20210158509A1 · Kwak et al. · 2021 [cited by applicant]
EP 3724815 · 2020 [cited by applicant]
KR 20070120879A1 · 2007 [cited by applicant]
KR 1020130058665A · 2013 [cited by applicant]
KR 1020190130435A · 2019 [cited by applicant]
KR 1020210062381A · 2021 [cited by applicant]
Translation of KR102210062381A (Year: 2021). [cited by examiner]
Translation of Kr 1020130058665A (Year: 2013). [cited by examiner]
International Search Report dated Jun. 28, 2022. [cited by applicant]
Extended European Search Report dated Sep. 26, 2024. [cited by applicant]