IP Library › Granted Patent US 11,348,371
Granted Patent B2
US 11,348,371 · App. 16/483,078 · Granted May 31, 2022

Person detection system

Inventor: Ryuta Niino (Tokyo, JP)
Assignee: NEC CORPORATION
G06V40/20G06V20/53G06V40/10G08B21/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,348,371
App. No.
16/483,078
Granted
May 31, 2022
Kind
B2
Abstract

A person detection system of the present invention includes: a person extraction unit that extracts person information from image information; a group determination unit that extracts behavior information from the image information and determines a group; a first person identification unit that identifies a first person from the image information, based on the person information and the behavior information; a second person identification unit that identifies a second person belonging to a same group as the first person from the image information, based on the person information of a person identified as the first person and the group information; and a position identification unit that identifies a position of the first person and a position of the second person, based on position information of the security cameras used for taking the image information based on which the first person and the second person have been identified, respectively.

Claims (45)

1. A person detection system comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute instructions to:

extract person information representing a person from image information taken with a security camera;

extract behavior information representing behavior of the person from the image information and, based on the behavior information, determine a group composed of a plurality of persons and register group information including the person information;

identify a first person from the image information taken with the security camera, based on the extracted person information and the extracted behavior information;

identify a second person belonging to a same group as the identified first person from the image information taken with the security camera, based on the extracted person information of the person identified as the first person and the group information;

identify a position of the first person and a position of the second person, based on position information of the security camera used for taking the image information based on from which the first person and the second person have been identified;

identify a third person as a parent from the group information, based on different person information of a different person extracted from different image information taken with a different camera;

identify a fourth person belonging to a same group as the identified third person and who is a child of the parent identified as the third person, from the image information taken within the camera, based on the different person information of the different person identified as the third person and the group information, and based on the extracted person information; and

identify a position of the fourth person, based on the position information of the security camera used for taking the image information from which the fourth person has been identified.

2. The person detection system according to claim 1 , wherein the instructions are executed to:

extract feature information representing an external feature of the person as the person information; and

identify a lost child as the first person based on the feature information.

3. The person detection system according to claim 2 , wherein the child is a first child,

and wherein the instructions are executed to identify a second child acting alone as the lost child who is the first person, based on the behavior information and the feature information.

4. The person detection system according to claim 2 , wherein the parent is a first parent,

and wherein the instructions are executed to identify the second person as a second parent of the lost child identified as the first person, based on the feature information.

5. The person detection system according to claim 1 , wherein the instructions are executed to update and register the group information based on the behavior information extracted from the image information.

6. A person detection method comprising:

extracting person information representing a person from image information taken with a security camera;

extracting behavior information representing behavior of the person from the image information and, based on the behavior information, determine a group composed of a plurality of persons and register group information including the person information;

identifying a first person from the image information taken with the security camera, based on the extracted person information and the extracted behavior information;

identifying a second person belonging to a same group as the identified first person from the image information taken with the security camera, based on the extracted person information of the person identified as the first person and the group information;

identifying a position of the first person and a position of the second person, based on position information of the security camera used for taking the image information from which the first person and the second person have been identified;

identifying a third person as a parent from the group information, based on different person information of a different person extracted from different image information taken with a different camera;

identifying a fourth person belonging to a same group as the identified third person and who is a child of the parent identified as the third person, from the image information taken within the camera, based on the different person information of the different person identified as the third person and the group information, and based on the extracted person information; and

identifying a position of the fourth person, based on the position information of the security camera used for taking the image information from which the fourth person has been identified.

7. The person detection method according to claim 6 , wherein:

in extracting the person information, feature information representing an external feature of the person is extracted as the person information; and

in identifying the first person, a lost child is identified as the first person based on the feature information.

8. The person detection method according to claim 7 , wherein the child is a first child,

and wherein in identifying the first person, a second child acting alone is identified as the lost child who is the first person, based on the behavior information and the feature information.

9. The person detection method according to claim 7 , wherein the parent is a first parent,

and wherein in identifying the second person, the second person is identified as a second parent of the lost child identified as the first person, based on the feature information.

10. The person detection method according to claim 6 , wherein in registering the group information, the group information is updated and registered based on the behavior information extracted from the image information.

11. A non-transitory computer-readable storage medium for storing a computer program comprising instructions for causing an information processing device to:

extract person information representing a person from image information taken with a security camera;

extract behavior information representing behavior of the person from the image information and, based on the behavior information, determine a group composed of a plurality of persons and register group information including the person information;

identify a first person from the image information taken with the security camera, based on the extracted person information and the extracted behavior information;

identify a second person belonging to a same group as the identified first person from the image information taken with the security camera, based on the extracted person information of the person identified as the first person and the group information;

identify a position of the first person and a position of the second person, based on position information of the security camera used for taking the image information from which the first person and the second person have been identified;

identify a third person as a parent from the group information, based on different person information of a different person extracted from different image information taken with a different camera;

identify a fourth person belonging to a same group as the identified third person and who is a child of the parent identified as the third person, from the image information taken within the camera, based on the different person information of the different person identified as the third person and the group information, and based on the extracted person information; and

identify a position of the fourth person, based on the position information of the security camera used for taking the image information from which the fourth person has been identified.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2019
From: NIINO, RYUTA
To: NEC CORPORATION
Reel/Frame 049939/0229 →
Priority Claims (1)
JP JP2017-023894 · Feb 13, 2017 · national
Continuity (1)
Related Publication 20210279450A1 · Sep 9, 2021
Cited By (1)
US 12,361,716