IP Library › Granted Patent US 11,688,256
Granted Patent B2
US 11,688,256 · App. 17/743,647 · Granted Jun 27, 2023

Security system, security method, and non-transitory computer readable medium

Inventors: Kaoru Uchida (Tokyo, JP); Nobuyuki Yamashita (Tokyo, JP)
Assignee: NEC CORPORATION
G08B13/19608G06T7/20G06V20/52G08B13/19613G08B13/19645G06V40/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,688,256
App. No.
17/743,647
Granted
Jun 27, 2023
Kind
B2
Abstract

A security system ( 10 ) includes an image information acquisition unit ( 11 ) that acquires input image information on an image taken of a person in a store, a tracking unit ( 12 ) that tracks an action of a hand of the person based on the input image information, and a suspicious action detection unit ( 13 ) that detects a suspicious action of the person based on the tracked action of the hand. A security system, a security method, and a security program capable of accurately detecting a suspicious action are thereby provided.

Claims (50)

1. A security system, comprising:

a memory storing instructions; and

one or more processors coupled to the memory, wherein the one or more processors are configured to execute the instructions to:

acquire input image information of a product shelf in a store and a person in front of the product shelf taken from above the product shelf;

detect a bone structure of the person based on the input image information;

track the bone structure of the person;

detect an action of a hand of the person based on the bone structure, the person being a store staff involved in the business of the store or a customer who visits the store;

determine a suspicious action based on the action of the hand and based on whether the person is the store staff or the customer; and

output alert information based on the determined suspicious action.

2. The security system according to claim 1 , wherein the one or more processors are further configured to execute the instructions to track an action of putting the product in a place other than a predetermined place, and wherein the predetermined place is a shopping basket or a cart.

3. The security system according to claim 2 , wherein the one or more processors are further configured to execute the instructions to track the action of putting the product in a pocket of clothes worn by the person.

4. The security system according to claim 1 , wherein the one or more processors are further configured to execute the instructions to:

record the suspicious action; and

output the recorded suspicious action.

5. The security system according to claim 1 , wherein the one or more processors are further configured to execute the instructions to:

set a level of the suspicious action according to content of the suspicious action; and

output the suspicious action corresponding to a new level higher than a predetermined level.

6. A security method comprising:

acquiring input image information of a product shelf in a store and a person in front of the product shelf taken from above the product shelf;

detecting a bone structure of the person based on the input image information;

tracking the bone structure of the person;

detecting an action of a hand of the person based on the bone structure, the person being a store staff involved in the business of the store or a customer who visits the store;

determining a suspicious action based on the action of the hand and based on whether the person is the store staff or the customer; and

outputting alert information based on the determined suspicious action.

7. The security method according to claim 6 , wherein tracking the bone structure of the person comprises tracking an action of putting the product in a place other than a predetermined place, wherein the predetermined place is a shopping basket or a cart.

8. The security method according to claim 6 , wherein tracking the bone structure of the person comprises tracking an action of putting money in a pocket of clothes worn by the person.

9. The security method according to claim 6 , further comprising:

recording the suspicious action; and

outputting the recorded suspicious action.

10. The security method according to claim 6 , further comprising:

setting a level of the suspicious action according to content of the suspicious action; and

outputting the suspicious action corresponding to a new level higher than a predetermined level.

11. A non-transitory computer readable medium storing a security program causing a computer to perform a security method, the method comprising:

acquiring input image information of a product shelf and a person in front of the product shelf in a store taken from above the product shelf;

detecting a bone structure of the person based on the input image information;

tracking the bone structure of the person;

detecting an action of a hand of the person based on the bone structure, the person being a store staff involved in the business of the store or a customer who visits the store;

determining a suspicious action based on the action of the hand and based on whether the person is the store staff or the customer; and

outputting alert information based on the determined suspicious action.

12. The non-transitory computer readable medium according to claim 11 , wherein tracking the bone structure of the person comprises tracking an action of putting the product in a place other than a predetermined place, wherein the predetermined is a shopping basket or a cart.

13. The non-transitory computer readable medium according to claim 11 , wherein tracking the bone structure of the person comprises tracking an action of putting money in a pocket of clothes worn by the person.

14. The non-transitory computer readable medium according to claim 11 , wherein the security program causes the computer to further perform:

recording the suspicious action; and

outputting the recorded suspicious action.

15. The non-transitory computer readable medium according to claim 11 , wherein the security program causes the computer to further perform:

setting a level of the suspicious action according to content of the suspicious action; and

outputting the suspicious action corresponding to a new level higher than a predetermined level.

16. The security system according to claim 1 , wherein the one or more processors are further configured to execute the instructions to output a warning information based on a state in the store before determining the suspicious action.

17. The security method according to claim 6 , wherein outputting a warning information based on a state in the store occurs before determining the suspicious action.

18. The non-transitory computer readable medium according to claim 11 , wherein the security program causes the computer to further perform outputting a warning information based on a state in the store before determining the suspicious action.

Priority Claims (1)
JP 2013-185130 · Sep 6, 2013 · national
Continuity (3)
Continuation 16126818 · Sep 10, 2018
Continuation 14916702
Related Publication 20220270455A1 · Aug 25, 2022