IP Library › Granted Patent US 12,629,021
Granted Patent B2
US 12,629,021 · App. 17/794,006 · Granted May 19, 2026

Information processing system, information processing method, and storage medium for eye gaze based liveness detection

Inventors: Arun Chandrasekaran (Sacramento, CA); Kris Ranganath (Sacramento, CA); Vinoth Babu Amirthalingam (Sacramento, CA)
Assignee: NEC CORPORATION
A61B3/113A61B3/145G06V40/197G06V40/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,629,021
App. No.
17/794,006
Granted
May 19, 2026
Kind
B2
Abstract

An apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to: obtain a plurality of images, each of the plurality of images including an eye of a subject; obtain a plurality of gaze angles, each of the plurality of gaze angles corresponding to the eye of the user; and detect liveness of the subject based on the plurality of gaze angles.

Claims (25)

1 . An apparatus comprising:

a memory storing one or more instructions; and

a processor configured to execute the one or more instructions to:

obtain a plurality of images, which are subsequent frames in a moving image captured by a camera, each of the plurality of images including an eye of a subject;

obtain a plurality of gaze angles, each of the plurality of gaze angles corresponding to the eye of the subject;

calculate a moving average of the plurality of gaze angles;

identify a pattern of movement of the plurality of gaze angles; and

detect liveness of the subject in a case in which the moving average of the plurality of gaze angles for a specified number of frames out of the frames coincides with a moving average of the moving pattern of the position of the moving object on the display screen corresponding to the specified number of frames within a particular threshold value.

2 . The apparatus of claim 1 , wherein the plurality of gaze angles are determined based on angle of the eye with respect to a reference point.

3 . The apparatus of claim 1 , wherein the processor is further configured to:

display the moving object on the display screen to prompt the subject to follow the moving object;

compare a moving pattern of the gaze angles with a pattern of the moving object; and

detect the liveness of the subject based on a result of the comparison between the pattern of movement of the plurality of gaze angles and the pattern of the moving object.

4 . A method comprising:

obtaining a plurality of images, which are subsequent frames in a moving image captured by a camera, each of the plurality of images including an eye of a subject;

obtaining a plurality of gaze angles, each of the plurality of gaze angles corresponding to the eye of the subject;

calculating a moving average of the plurality of gaze angles;

identifying a pattern of movement of the plurality of gaze angles; and

detecting liveness of the subject in a case in which the moving average of the plurality of gaze angles for a specified number of frames out of the frames coincides with a moving average of the moving pattern of the position of the moving object on the display screen corresponding to the specified number of frames within a particular threshold value.

5 . A non-transitory storage medium storing a program which causes a computer to execute:

obtaining a plurality of images, which are subsequent frames in a moving image captured by a camera, each of the plurality of images including an eye of a subject;

obtaining a plurality of gaze angles, each of the plurality of gaze angles corresponding to the eye of the subject;

calculating a moving average of the plurality of gaze angles;

identifying a pattern of movement of the plurality of gaze angles; and

detecting liveness of the subject in a case in which the moving average of the plurality of gaze angles for a specified number of frames out of the frames coincides with a moving average of the moving pattern of the position of the moving object on the display screen corresponding to the specified number of frames within a particular threshold value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2023
From: CHANDRASEKARAN, ARUN; RANGANATH, KRIS; AMIRTHALINGAM, VINOTH BABU
To: NEC CORPORATION
Reel/Frame 062672/0560 →
Continuity (2)
Provisional Application 62966341 · Jan 27, 2020
Related Publication 20230033687A1 · Feb 2, 2023
References Cited (11)
US 20070263908A1 · Tsukahara · 2007 [cited by applicant]
US 20100096300A1 · Otto et al. · 2010 [cited by applicant]
US 20160019410A1 · Komogortsev · 2016 [cited by applicant]
US 20190392145A1 · Komogortsev · 2019 [cited by examiner]
JP 2017142859A · 2017 [cited by applicant]
WO 2016168814A1 · 2016 [cited by applicant]
WO 2019023032A1 · 2019 [cited by applicant]
International Search Report for PCT Application No. PCT/JP2021/002734, mailed on Apr. 20, 2021. [cited by applicant]
Written opinion for PCT Application No. PCT/JP2021/002734, mailed on Apr. 20, 2021. [cited by applicant]
Tetsuya Yonezawa et al., “Development of an Eye Gaze Interface System and Improvement of Cursor Control Function”, Proceedings of the International Conference on Signal Processing and Multimedia Applications, 2008, XP09… [cited by applicant]
Communication dated Jun. 1, 2023 issued by the European Patent Office in counterpart European Application No. 21746929.5. [cited by applicant]