IP Library Granted Patent US 12,626,536
Granted Patent B2
US 12,626,536 · App. 18/030,137 · Granted May 12, 2026

Liveness detection apparatus, control method, and computer-readable medium

Inventors: Takamichi Miyamoto (Tokyo, JP); Koichi Takahashi (Tokyo, JP)
Assignee: NEC Corporation
G06V40/45G06T7/70G06V10/60G06V40/161G06V40/167G06V40/172G06V40/67G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,626,536
App. No.
18/030,137
Granted
May 12, 2026
Kind
B2
Abstract

A liveness detection apparatus ( 2000 ) causes a display apparatus ( 20 ) to display a plurality of screens ( 30 ). At least one of the plurality of screens ( 30 ) has a plurality of regions ( 32 ). At least two of the plurality of regions ( 32 ) include different indications. The liveness detection apparatus ( 2000 ) acquires a plurality of captured images ( 40 ). The captured image ( 40 ) is generated by capturing an image of a target object ( 50 ) with a camera ( 10 ) while the screen ( 30 ) is displayed. The liveness detection apparatus ( 2000 ) determines whether or not the target object ( 50 ) is a living body by using the plurality of captured images ( 40 ).

Claims (50)

1 . A non-transitory computer-readable medium storing a program executed by a computer, the program causing the computer to execute:

causing a display apparatus to display a guide related to a direction of a line of sight and a guide related to a face direction, wherein the guides prompt to swing the face left and right while continuously viewing a same place;

acquiring captured images generated by capturing a target with a camera a plurality of times;

determining whether or not a posture of the target is a posture suitable for liveness detection by using the captured images;

causing the display apparatus to display a guide prompting to take an appropriate posture in a case where the posture of the target is not a posture suitable for liveness detection;

computing a difference between the face direction and a line-of-sight direction for each of the captured images by using an image of a face of the target captured in each of the captured images; and

determining whether or not the target is a living body based on the computed difference,

wherein the program causes the computer to execute:

determining whether or not a posture of the face and a posture of a torso of the target satisfy a predetermined condition by using an image of the face and the torso of the target that are captured in the captured images; and

causing the display apparatus to display a guide prompting to take an appropriate posture in a case where the predetermined condition is not satisfied.

2 . The non-transitory computer-readable medium according to claim 1 , wherein the program causes the computer to execute:

determining whether or not a face direction of the target on a vertical plane is within a predetermined range by using the image of the face of the target that is captured in the captured images; and

causing the display apparatus to display a guide prompting to take an appropriate posture in a case where the face direction of the target on the vertical plane is not within the predetermined range.

3 . The non-transitory computer-readable medium according to claim 2 , wherein different guides are displayed for a case where the target takes a motion of swinging the face and a case where the target does not take the motion of swinging the face.

4 . The non-transitory computer-readable medium according to claim 1 , the program causes the computer to execute: determining, for a terminal in which the display apparatus is installed, whether or not a magnitude of an inclination on a vertical plane is equal to or less than a predetermined threshold; and causing the display apparatus to display a guide prompting to set a pose of the terminal to an appropriate pose in a case where the magnitude of the inclination is not equal to or less than the predetermined threshold.

5 . A liveness detection apparatus comprising:

at least one memory storing instructions; and

at least one processor that is configured to execute the instructions to:

causes a display apparatus to display a guide related to a direction of a line of sight and a guide related to a face direction, wherein the guides prompt to swing the face left and right while continuously viewing a same place;

acquire captured images generated by capturing a target with a camera a plurality of times;

determine whether or not a posture of the target is a posture suitable for liveness detection by using the captured images;

cause the display apparatus to display a guide prompting to take an appropriate posture in a case where the posture of the target is not a posture suitable for liveness detection;

compute a difference between the face direction and a line-of-sight direction for each of the captured images by using an image of a face of the target captured in each of the captured images; and

determine whether or not the target is a living body based on the computed difference,

wherein the at least one processor is configured to execute the instructions further to:

determine whether or not a posture of the face and a posture of a torso of the target satisfy a predetermined condition by using an image of the face and the torso of the target that are captured in the captured images; and

cause the display apparatus to display a guide prompting to take an appropriate posture in a case where the predetermined condition is not satisfied.

6 . A control method to be executed by a computer, the control method comprising:

causing a display apparatus to display a guide related to a direction of a line of sight and a guide related to a face direction, wherein the guides prompt to swing the face left and right while continuously viewing a same place;

acquiring captured images generated by capturing a target with a camera a plurality of times;

determining whether or not a posture of the target is a posture suitable for liveness detection by using the captured images;

causing the display apparatus to display a guide prompting to take an appropriate posture in a case where the posture of the target is not a posture suitable for liveness detection;

computing a difference between the face direction and a line-of-sight direction for each of the captured images by using an image of a face of the target captured in each of the captured images; and

determining whether or not the target is a living body based on the computed difference,

wherein the control method further comprises:

determining whether or not a posture of the face and a posture of a torso of the target satisfy a predetermined condition by using an image of the face and the torso of the target that are captured in the captured images; and

causing the display apparatus to display a guide prompting to take an appropriate posture in a case where the predetermined condition is not satisfied.

7 . The liveness detection apparatus according to claim 5 , wherein the at least one processor is configured to execute the instructions further to:

determine whether or not a face direction of the target on a vertical plane is within a predetermined range by using the image of the face of the target that is captured in the captured images; and

cause the display apparatus to display a guide prompting to take an appropriate posture in a case where the face direction of the target on the vertical plane is not within the predetermined range.

8 . The liveness detection apparatus according to claim 7 , wherein different guides are displayed for a case where the target takes a motion of swinging the face and a case where the target does not take the motion of swinging the face.

9 . The liveness detection apparatus according to claim 5 , wherein the at least one processor is configured to execute the instructions further to:

determine, for a terminal in which the display apparatus is installed, whether or not a magnitude of an inclination on a vertical plane is equal to or less than a predetermined threshold; and

cause the display apparatus to display a guide prompting to set a pose of the terminal to an appropriate pose in a case where the magnitude of the inclination is not equal to or less than the predetermined threshold.

10 . The control method according to claim 6 , further comprising:

determining whether or not a face direction of the target on a vertical plane is within a predetermined range by using the image of the face of the target that is captured in the captured images; and

causing the display apparatus to display a guide prompting to take an appropriate posture in a case where the face direction of the target on the vertical plane is not within the predetermined range.

11 . The control method according to claim 10 , wherein different guides are displayed for a case where the target takes a motion of swinging the face and a case where the target does not take the motion of swinging the face.

12 . The control method according to claim 6 , further comprising: determining, for a terminal in which the display apparatus is installed, whether or not a magnitude of an inclination on a vertical plane is equal to or less than a predetermined threshold; and

causing the display apparatus to display a guide prompting to set a pose of the terminal to an appropriate pose in a case where the magnitude of the inclination is not equal to or less than the predetermined threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2023
From: MIYAMOTO, TAKAMICHI; TAKAHASHI, KOICHI
To: NEC CORPORATION
Reel/Frame 063217/0154 →
Priority Claims (1)
WO PCT/JP2020/038329 · Oct 9, 2020 · international
Continuity (1)
Related Publication 20230368580A1 · Nov 16, 2023
References Cited (25)
US 6870529B1 · Davis · 2005 [cited by applicant]
US 10735959B2 · Lecun et al. · 2020 [cited by applicant]
US 20070071321A1 · Ota · 2007 [cited by applicant]
US 20070159309A1 · Ito · 2007 [cited by examiner]
US 20130016129A1 · Gossweiler, III et al. · 2013 [cited by applicant]
US 20130069924A1 · Robinson et al. · 2013 [cited by applicant]
US 20150334292A1 · Tartz et al. · 2015 [cited by applicant]
US 20170228586A1 · Morishita · 2017 [cited by examiner]
US 20180173980A1 · Fan · 2018 [cited by examiner]
US 20210027081A1 · Zhang · 2021 [cited by examiner]
US 20210073518A1 · Kumar · 2021 [cited by examiner]
US 20210174068A1 · Kao · 2021 [cited by examiner]
EP 1770596A1 · 2007 [cited by applicant]
JP 2003178306A · 2003 [cited by applicant]
JP 2008015800A · 2008 [cited by applicant]
JP 2016032193A · 2016 [cited by applicant]
JP 2017518691A · 2017 [cited by applicant]
WO 2015075957A1 · 2015 [cited by applicant]
WO 2016059786A1 · 2016 [cited by applicant]
JP Office Communication for JP Application No. 2022-555262, mailed on Dec. 12, 2023 with English Translation. [cited by applicant]
Extended European Search Report for European Patent Application No. 20956780.9, dated on Nov. 7, 2023. [cited by applicant]
International Search Report for PCT Application No. PCT/JP2021/015746, mailed on Jul. 13, 2021. [cited by applicant]
JP Office Action for JP Application No. 2024-001748, mailed on Nov. 12, 2024 with English Translation. [cited by applicant]
Narishige Abe et al., “A Study for Eye Movement Authentication Technique using Sliding Windows”, 2015 Symposium on Cryptography and Information Security, SCIS2015 [CD-ROM], the collection of 2015 Symposium on Cryptograp… [cited by applicant]
US Office Action for U.S. Appl. No. 18/030,197, mailed on May 14, 2025. [cited by applicant]