IP Library › Granted Patent US 12,731,434
Granted Patent B2
US 12,731,434 · App. 18/293,652 · Granted Sep 8, 2026

Event detection system, event detection method, and non-transitory computer readable medium

Inventors: Jianquan Liu (Tokyo, JP); Noboru Yoshida (Tokyo, JP); Ryo Kawai (Tokyo, JP); Uiko Morimoto (Tokyo, JP); Hirotaka Gochou (Tokyo, JP)
Assignee: NEC CORPORATION
G06V40/20G06V10/75G06V20/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,731,434
App. No.
18/293,652
Granted
Sep 8, 2026
Kind
B2
Abstract

An event detection system ( 10 ) includes: a calculation unit ( 16 ) that calculates a degree of similarity between at least a part of skeletal information extracted from a captured image in which a user who is visiting an ATM is captured and at least a part of registration skeletal information, the registration skeletal information being extracted from a registration image showing a phone call action of a person and being registered in an action database; and a determination unit ( 17 ) that determines that an event related to the ATM has been detected when the degree of similarity is equal to or greater than a predetermined threshold. Thus, a problematic event at an ATM can be easily detected while protecting privacy.

Claims (28)

1 . An event detection system comprising:

at least one memory storing instructions; and

at least one processor configured to execute the instructions to:

in response to detection of a predetermined operation signal sent to an Automatic Teller Machine (ATM), extract skeletal information from a captured image in which a user who is visiting the ATM is captured;

calculate a plurality of degrees of similarity between at least a part of the skeletal information and at least a part of registration skeletal information, the registration skeletal information being extracted from a registration image showing a phone call action of a person visiting and operating the ATM and being registered in an action database; and

determine that an event related to the ATM has been detected in case that at least one of the calculated similarities is equal to or greater than a predetermined threshold.

2 . The event detection system according to claim 1 , wherein the at least one processor configured to execute the instructions to:

acquire the captured image; and

extract the skeletal information about at least a part of a body of the user based on the captured image.

3 . The event detection system according to claim 1 , wherein the registration image shows an action of the person talking on a phone and performing an input operation in the ATM.

4 . The event detection system according to claim 1 , wherein in case that at least one of the calculated similarities is equal to or greater than a predetermined threshold and it is determined that the user has a predetermined attribute, the at least one processor configured to execute the instructions to determine that the event has been detected.

5 . The event detection system according to claim 4 , wherein the at least one processor configured to execute the instructions to acquire an attribute of the user based on information read by the ATM.

6 . The event detection system according to claim 1 , wherein in case that at least one of the calculated similarities is equal to or greater than a predetermined threshold and a predetermined operation signal sent to the ATM has been detected, the at least one processor configured to execute the instructions to determine that the event has been detected.

7 . The event detection system according to claim 1 , wherein the at least one processor configured to execute the instructions to learn a plurality of degrees of similarity calculation parameter by using the skeletal information and a result of the determination of the event,

wherein the at least one processor configured to execute the instructions to calculate the plurality of degrees of similarity by using the plurality of degrees of similarity calculation parameter.

8 . The event detection system according to claim 1 , the at least one processor configured to execute the instructions to register skeletal information extracted from the registration image in the action database as registration skeletal information.

9 . The event detection system according to claim 8 , wherein when it is determined that the user has a predetermined attribute, the at least one processor configured to execute the instructions to ask a management apparatus whether to register the skeletal information extracted from the captured image in the action database.

10 . The event detection system according to claim 1 , wherein the skeletal information includes a plurality of key points detected from a body.

11 . The event detection system according to claim 10 , wherein the skeletal information includes a plurality of bones indicating links between the key points, at least one of the plurality of bones being detected from the body.

12 . The event detection system according to claim 1 , wherein the skeletal informationskeleton-information is extracted from an upper body.

13 . An event detection method comprising:

in response to detection of a predetermined operation signal sent to an Automatic Teller Machine (ATM), extracting skeletal information from a captured image in which a user who is visiting the ATM is captured;

calculating a plurality of degrees of similarity between at least a part of the skeletal information is captured and at least a part of registration skeletal information, the registration skeletal information being extracted from a registration image showing a phone call action of a person visiting an operating the ATM and being registered in an action database; and

determining that an event related to the ATM has been detected in case that at least one of the calculated similarities is equal to or greater than a predetermined threshold.

14 . A non-transitory computer readable medium storing a program for causing a computer to execute:

extracting processing for, in response to detection of a predetermined operation signal sent to an Automatic Teller Machine (ATM), extracting skeletal information from a captured image in which a user who is visiting the ATM is captured;

calculation processing for calculating a plurality of degrees of similarity between at least a part of the skeletal information and at least a part of registration skeletal information, the registration skeletal information being extracted from a registration image showing a phone call action of a person visiting and operating the ATM and being registered in an action database; and

determination processing for determining that an event related to the ATM has been detected in case that at least one of the calculated similarities is equal to or greater than a predetermined threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2024
From: LIU, JIANQUAN; YOSHIDA, NOBORU; KAWAI, RYO; MORIMOTO, UIKO; GOCHOU, HIROTAKA
To: NEC CORPORATION
Reel/Frame 066305/0023 →
Continuity (1)
Related Publication 20240338976A1 · Oct 10, 2024
References Cited (25)
US 10956971B2 · Mendez · 2021 [cited by examiner]
US 11086594B2 · Lapidot · 2021 [cited by examiner]
US 11328535B1 · Guo · 2022 [cited by examiner]
US 11361536B2 · Chakravarty · 2022 [cited by examiner]
US 11435845B2 · Rosenbaum · 2022 [cited by examiner]
US 11557122B2 · Toyoda · 2023 [cited by examiner]
US 11676362B2 · Namioka · 2023 [cited by examiner]
US 11749038B2 · Neill · 2023 [cited by examiner]
US 11869209B1 · McCracken, Jr. · 2024 [cited by examiner]
US 11900707B2 · Kameda · 2024 [cited by examiner]
US 20120170728A1 · Wengrovitz · 2012 [cited by examiner]
US 20150189355A1 · Korbecki · 2015 [cited by examiner]
US 20200160670A1 · Zalewski et al. · 2020 [cited by applicant]
JP 2003115088A · 2003 [cited by applicant]
JP 2005004256A · 2005 [cited by applicant]
JP 2010218392A · 2010 [cited by applicant]
JP 2010262408A · 2010 [cited by applicant]
JP 2018010332A · 2018 [cited by applicant]
JP 2018190012A · 2018 [cited by applicant]
JP 2020135747A · 2020 [cited by applicant]
WO 2020003477A1 · 2020 [cited by applicant]
JP Office Communication for JP Application No. 2023-542039, mailed on May 13, 2025 with English Translation. [cited by applicant]
International Search Report for PCT Application No. PCT/JP2021/029903, mailed on Sep. 14, 2021. [cited by applicant]
Fujishima et al., “Investigation of a phone call detection method using skeleton information with a Kinect”, Proceedings of FIT2017 16th Forum on Information Science and Technology 3rd Volume, Sep. 5, 2017, pp. 371-372. [cited by applicant]
TW Office Action for TW Application No. 111126067, issued on Aug. 1, 2024 with English Translation. [cited by applicant]