IP Library › Granted Patent US 12,511,940
Granted Patent B2
US 12,511,940 · App. 17/639,115 · Granted Dec 30, 2025

Information processing apparatus, information processing method, and recording medium

Inventor: Kazuyuki Sakurai (Tokyo, JP)
Assignee: NEC CORPORATION
G06V40/40G06V40/193
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,511,940
App. No.
17/639,115
Granted
Dec 30, 2025
Kind
B2
Abstract

An information processing apparatus ( 2 ) includes an acquisition unit ( 211 ) configured to acquire a person image (IMG) including an eye area (EA) of a target person, and a determination unit ( 212 ) configured to determine that the target person impersonates another person in the case where an aperture (AP) enclosing at least a part of an eye of the target person is present in the person image.

Claims (32)

1 . An information processing apparatus comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to:

acquire a person image including an eye area of a target person with eyes closed;

perform, by the at least one processor, edge extraction processing on the person image to generate an edge image;

extract, from the edge image, an edge enclosing at least a part of an eye of the target person included in the eye area, an edge of an upper eyelid of the target person and an edge of a lower eyelid of the target person, while the eye of the target person is closed;

determine, in response to simultaneously detecting the edge enclosing the at least the part of the eye of the target person and both the edge of upper eyelid and the edge of lower eyelid while the eye of the target person is closed, a determination of whether the target person impersonates another person; and

output the result indicating that the target person impersonates another person,

wherein the at least one processor is further configured to determine whether or not an accessory having an aperture enclosing the at least the part of the eye of the target person is in the person image, and if it is determined the person is wearing an accessory having an aperture enclosing the at least the part of the eye, the target person impersonates another person.

2 . The information processing apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to acquire the person image from a plurality of person images that are captured continuously in time, and

wherein the plurality of person images includes the eye area of the target person.

3 . The information processing apparatus according to claim 1 , wherein the edge enclosing at least the part of the eye of the target person is the edge of an aperture formed in the accessory worn by the target person.

4 . An information processing method comprising:

acquiring, by at least one processor, a person image including an eye area of a target person with eyes closed;

performing, by the at least one processor, edge extraction processing on the person image to generate an edge image;

extract, from the edge image, an edge enclosing at least a part of an eye of the target person included in the eye area, an edge of an upper eyelid of the target person and an edge of a lower eyelid of the target person, while the eye of the target person is closed;

determining, by the at least one processor, in response to simultaneously detecting the edge enclosing the at least the part of the eye of the target person and both the edge of upper eyelid and the edge of lower eyelid while the eye of the target person is closed, a determination of whether the target person impersonates another person; and

output the result indicating that the target person impersonates another person,

wherein information processing method further comprises determining, by the at least one processor, whether or not an accessory having an aperture enclosing the at least the part of the eye of the target person is in the person image, and if it is determined the person is wearing an accessory having an aperture enclosing the at least the part of the eye, the target person impersonates another person.

5 . The information processing method according to claim 4 , the information processing method further comprising:

acquiring the person image from a plurality of person images that are captured continuously in time,

wherein the plurality of person images includes the eye area of the target person.

6 . A non-transitory recording medium storing a computer program, which when executed, causes a computer to execute an information processing method comprising:

acquiring, by at least one processor, a person image including an eye area of a target person with eyes closed;

performing, by the at least one processor, edge extraction processing on the person image to generate an edge image;

extract, from the edge image, an edge enclosing at least a part of an eye of the target person included in the eye area, an edge of an upper eyelid of the target person and an edge of a lower eyelid of the target person, while the eye of the target person is closed;

determining, by the at least one processor, in response to simultaneously detecting the edge enclosing the at least the part of the eye of the target person and both the edge of upper eyelid and the edge of lower eyelid while the eye of the target person is closed, a determination of whether the target person impersonates another person; and

output the result indicating that the target person impersonates another person,

wherein information processing method further comprises determining, by the at least one processor, whether or not an accessory having an aperture enclosing the at least the part of the eye of the target person is in the person image, and if it is determined the person is wearing an accessory having an aperture enclosing the at least the part of the eye, the target person impersonates another person.

7 . The non-transitory recording medium according to claim 6 , the information processing method further comprising:

acquiring the person image from a plurality of person images that are captured continuously in time,

wherein the plurality of person images includes the eye area of the target person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2022
From: SAKURAI, KAZUYUKI
To: NEC CORPORATION
Reel/Frame 059118/0874 →
Continuity (1)
Related Publication 20240037994A1 · Feb 1, 2024
References Cited (47)
US 10817722B1 · Raguin · 2020 [cited by examiner]
US 20090003709A1 · Kaneda · 2009 [cited by examiner]
US 20180053044A1 · Su et al. · 2018 [cited by applicant]
US 20180060648A1 · Yoo et al. · 2018 [cited by applicant]
US 20190005318A1 · Su et al. · 2019 [cited by applicant]
US 20190012533A1 · Su et al. · 2019 [cited by applicant]
US 20190012534A1 · Su et al. · 2019 [cited by applicant]
US 20190034708A1 · Yoo et al. · 2019 [cited by applicant]
US 20190071095A1 · Hashimoto · 2019 [cited by examiner]
US 20190320890A1 · Tahara · 2019 [cited by examiner]
US 20200143156A1 · Su et al. · 2020 [cited by applicant]
US 20200349372A1 · Lee et al. · 2020 [cited by applicant]
US 20200410215A1 · Yoo et al. · 2020 [cited by applicant]
US 20210209387A1 · Nikitidis et al. · 2021 [cited by applicant]
US 20210248401A1 · Timoshenko · 2021 [cited by examiner]
US 20210334526A1 · Su et al. · 2021 [cited by applicant]
US 20220245968A1 · Lee · 2022 [cited by examiner]
US 20220277596A1 · Li · 2022 [cited by examiner]
US 20230091381A1 · Vemulapalli · 2023 [cited by examiner]
CN 109543635A · 2019 [cited by applicant]
CN 111353404A · 2020 [cited by applicant]
JP 06309457A · 1994 [cited by applicant]
JP 2004178402A · 2004 [cited by applicant]
JP 2006330936A · 2006 [cited by applicant]
JP 2010097619A · 2010 [cited by applicant]
JP 2010286959A · 2010 [cited by applicant]
JP 2015041307A · 2015 [cited by applicant]
JP 2018032391A · 2018 [cited by applicant]
JP 2018169943A · 2018 [cited by applicant]
JP 2019139433A · 2019 [cited by applicant]
JP 2020181305A · 2020 [cited by applicant]
JP 2020184331A · 2020 [cited by applicant]
WO 2016147272A1 · 2016 [cited by applicant]
Saied, Marwa, Ayman Elshenawy, and Mohamed M. Ezz. “A Novel Approach for Improving Dynamic Biometric Authentication and Verification of Human Using Eye Blinking Movement.” Wireless Personal Communications 115.1 (2020): … [cited by examiner]
Manjani, Ishan, et al. “Detecting silicone mask-based presentation attack via deep dictionary learning.” IEEE Transactions on Information Forensics and Security 12.7 (2017): 1713-1723. (Year: 2017). [cited by examiner]
Wang L, Ding X, Fang C, Liu C, Wang K. Eye blink detection based on eye contour extraction. InImage Processing: Algorithms and Systems VII Feb. 10, 2009 (vol. 7245, pp. 222-228). SPIE. (Year: 2009). [cited by examiner]
He, Chaoxiang, et al. “Mysticmask: Adversarial mask for impersonation attack against face recognition systems.” 2024 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 2024. (Year: 2024). [cited by examiner]
Taha, Noor Al-Huda, Taha Mohammed Hassan, and Mohammed Akram Younis. “Face spoofing detection using deep CNN.” Turkish J. Comput. Math. Educ.(TURCOMAT) 12.13 (2021): 4363-4373. (Year: 2021). [cited by examiner]
Kim, Ki Wan, Hyung Gil Hong, Gi Pyo Nam, and Kang Ryoung Park. “A study of deep CNN-based classification of open and closed eyes using a visible light camera sensor.” Sensors 17, No. 7 (2017): 1534. (Year: 2017). [cited by examiner]
Al-Waisy, Alaa S., et al. “A fast and accurate iris localization technique for healthcare security system.” 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communicati… [cited by examiner]
Wang, Liting, et al. “Eye blink detection based on eye contour extraction.” Image Processing: Algorithms and Systems VII. vol. 7245. SPIE, 2009. (Year: 2009). [cited by examiner]
Al-Rashid, Ali. “A Three Steps Eye-Liveness Validation System.” 2019 International Conference on Cyber Security for Emerging Technologies (CSET). IEEE, 2019. (Year: 2019). [cited by examiner]
Luo, Shiqing, et al. “Oculock: Exploring human visual system for authentication in virtual reality head-mounted display.” 2020 Network and Distributed System Security Symposium (NDSS). 2020. (Year: 2020). [cited by examiner]
Extended European Search Report for EP Application No. 21934851.3, dated on Mar. 5, 2024. [cited by applicant]
JP Office Action for JP Application No. 2024-063815, mailed on Jan. 28, 2025 with English Translation. [cited by applicant]
Takuya Kira et al., “Bio-distrinction of e-Learning student using blink detection”, the 72nd (Heisei 22(2010)) national conference lecture collected papers (2) Artificial intelligence, cognitive science, Japan, Informat… [cited by applicant]
JP Official Communication for JP Application No. 2024-063815, mailed on Apr. 8, 2025 with English Translation. [cited by applicant]