IP Library Granted Patent US 9,183,432
Granted Patent B2
US 9,183,432 · App. 14/270,531 · Granted Nov 10, 2015

People counting device and people trajectory analysis device

Inventors: So Sasatani (Tokyo, JP); Yoshikuni Mae (Tokyo, JP); Ryou Yumiba (Tokyo, JP)
Assignee: Hitachi Industry & Control Solutions, Ltd.
G06K9/00369G06K9/00778G06T7/0042G06T2207/30196G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,183,432
App. No.
14/270,531
Granted
Nov 10, 2015
Kind
B2
Abstract

The people counting device includes an image acquisition unit to acquire an image from an imaging device, a head coordinate detection unit to detect a head coordinate of a target person from the image, a foot coordinate estimation unit to estimate a foot coordinate of the target person from the detected head coordinate, an individual region detection unit to perform region segmentation of the image and to give an attribute to each of regions, a foot coordinate correction unit to determine whether the target person overlaps another person based on the given attribute and to correct the foot coordinate of the target person estimated by the foot coordinate estimation unit when the persons are determined to overlap each other, a foot coordinate region inside/outside determination unit to determine whether the foot coordinate exists in a detection region set in the image, and a people counting unit to count foot coordinates.

Claims (33)

1. A people counting device comprising:

an image acquisition unit configured to acquire an image from an imaging device;

a head coordinate detection unit configured to detect a head coordinate of a target person from the image;

a foot coordinate estimation unit configured to estimate a foot coordinate of the target person from the detected head coordinate;

an individual region detection unit configured to perform region segmentation of the image and to give an attribute to each of regions;

a foot coordinate correction unit configured to determine whether the target person overlaps another person based on the given attribute and to correct the foot coordinate of the target person estimated by the foot coordinate estimation unit when the persons are determined to overlap each other;

a foot coordinate region inside/outside determination unit configured to determine whether the foot coordinate exists in a detection region set in the image; and

a people counting unit configured to count foot coordinates determined to exist in the detection region by the foot coordinate region inside/outside determination unit.

2. The people counting device according to claim 1 , wherein the individual region detection unit gives a stationary attribute indicating a stationary state and a transient attribute indicating a moving state based on a time change in brightness value on the image when the region segmentation of the image is performed.

3. The people counting device according to claim 1 , wherein the foot coordinate correction unit corrects the foot coordinate of the target person based on the head coordinate of the target person and an average height.

4. The people counting device according to claim 1 , wherein the foot coordinate correction unit determines whether a distribution of the regions of the respective attributes is abnormal, and deletes the head coordinate detected by the head coordinate detection unit when the distribution is determined to be abnormal.

5. The people counting device according to claim 1 , wherein the foot coordinate correction unit determines whether a head exists from a distribution of the regions of the respective attributes, and newly adds a head coordinate when determines that the head exists.

6. The people counting device according to claim 1 , wherein

when the target person is determined not to overlap another person, the foot coordinate correction unit stores the detected head coordinate and the foot coordinate and tracks the person in continuous frames, and

when the target person is determined to overlap another person, the foot coordinate correction unit corrects based on the stored head coordinate and the foot coordinate.

7. The people counting device according to claim 1 , wherein

the imaging device photographs an elevator hall, and

the people counting unit counts the number of persons in the elevator hall.

8. The people counting device according to claim′ 1 , wherein

the imaging device photographs an inside of a store, and

the people counting unit counts the number of persons in the store.

9. A people trajectory analysis device comprising:

an image acquisition unit configured to acquire an image from an imaging device;

a head coordinate detection unit configured to detect a head coordinate of a target person from the image acquired by the image acquisition unit;

a foot coordinate estimation unit configured to estimate a foot coordinate of the target person from the detected head coordinate;

an individual region detection unit configured to perform region segmentation of the image and to give an attribute to each of regions;

a foot coordinate correction unit configured to determine whether the target person overlaps another person based on the attribute and to correct the foot coordinate of the target person estimated by the foot coordinate estimation unit when the persons are determined to overlap each other;

a trajectory detection unit configured to store the foot coordinate for each frame and to detect a trajectory of the target person based on the stored foot coordinate; and

a trajectory analysis unit configured to analyze an action pattern of the target person from the trajectory of the target person.

10. The people trajectory analysis device according to claim 9 , wherein

the imaging device photographs an elevator hall, and

the trajectory analysis unit detects existence of a person staying in a specified range and measures a waiting time of the detected person.

11. The people trajectory analysis device according to claim 9 , wherein the trajectory analysis unit detects existence of persons acting in groups, counts the number of the detected persons for each of the groups, and acquires the number of the groups in the image and the number of the persons in each of the groups.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 5, 2014
From: HITACHI, LTD.
To: HITACHI INDUSTRY & CONTROL SOLUTIONS, LTD.
Reel/Frame 034109/0447 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2014
From: SASATANI, SO; MAE, YOSHIKUNI; YUMIBA, RYOU
To: HITACHI, LTD.
Reel/Frame 032828/0740 →
Priority Claims (1)
JP 2013-108154 · May 22, 2013 · national
Continuity (1)
Related Publication 20140348382A1 · Nov 27, 2014