IP Library Granted Patent US 10,602,080
Granted Patent B2
US 10,602,080 · App. 15/040,687 · Granted Mar 24, 2020

Flow line analysis system and flow line analysis method

Inventors: Shinpei Hagisu (Fukuoka, JP); Tetsuo Tayama (Fukuoka, JP); Hidetoshi Kinoshita (Fukuoka, JP); Koji Yano (Kanagawa, JP); Manabu Nakamura (Fukuoka, JP); Takae Oguchi (Fukuoka, JP); Hideaki Takahashi (Fukuoka, JP)
Assignee: Panasonic I-PRO Sensing Solutions Co., Ltd.
H04N5/272G06F21/60G06F21/6254G06K9/00342G06K9/00711G06K9/00778H04N7/181H04N7/183G06K2009/00738G06T2207/10016G06T2207/20221G06T2207/30196G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,602,080
App. No.
15/040,687
Granted
Mar 24, 2020
Kind
B2
Abstract

A camera device generates a captured image, extracts flow line information relating to a staying position or a passing position of a moving object, and transmits the generated captured image and the extracted flow line information of the moving object to a server device for each predetermined transmission period. The server device generates a flow line analysis image in which the flow line information of the moving object is superimposed on the captured image and displays the generated flow line analysis image on a displayer. Furthermore, the server device switches a first flow line analysis image in a first predetermined period to a second flow line analysis image in a second predetermined period according to an operation of changing the period, and displays the resulting flow line analysis image.

Claims (59)

1. A flow line analysis system to which a camera device and a server device are connected,

wherein the camera device, in operation,

generates captured images, and

extracts flow line information relating to a staying position of a moving person or where a moving person passes,

wherein the server device, in operation,

downloads, from a plurality of camera devices including the camera device, the generated captured images and the extracted flow line information of the moving person,

displays an acquisition menu including selections of camera device identifiers and target period durations,

receives, from a user via the acquisition menu, a selection of a camera device identifier of the camera device and a target period having a target period duration,

in response to receiving the selection of the camera device identifier of the camera device and the target period,

generates, for the target period, flow line analysis images in which the flow line information of the moving person is superimposed on the captured images, the flow line analysis image providing an indication of a number of moving persons passing a position in the captured image,

displays a first flow line analysis image on the display, the first flow line analysis image being associated with a first time instance in the target period, and

displays, on the display, a selection of a plurality of image leap commands respectively associated with a plurality of predefined second time instances, a first set of the plurality of predefined second time instances temporally preceding the first time instance and a second set of the plurality of predefined second time instances temporally succeeding the first time instance,

receives, from the user via the displayed selection of the plurality of image leap commands, a selection of a predefined second time instance of the plurality of predefined second time instances, and

when the selected predefined second time instance is within the target period, displays a second flow line analysis image generated for the selected predefined second time instance.

2. A flow line analysis system to which a camera device and a server device are connected,

wherein the camera device, in operation,

generates a background image of a captured image,

extracts flow line information relating to a staying position of a moving person or where a moving person passes, and

wherein the server device, in operation,

downloads, from the camera device, the generated background image and the extracted flow line information of the moving person,

displays an acquisition menu including selections of camera device identifiers and target period durations,

receives, from a user via the acquisition menu, a selection of a camera device identifier of the camera device and a target period having a target period duration,

in response to receiving the selection of the camera device identifier of the camera device and the target period,

generates, for the target period, a flow line analysis images in which the flow line information of the moving person is superimposed on the background image, the flow line analysis image providing an indication of a number of moving persons passing a position in the captured image, and

displays a first flow line analysis image on the display, the first flow line analysis image being associated with a first time instance in the target period, and

displays, on the display, a selection of a plurality of image leap commands respectively associated with a plurality of predefined second time instances, a first set of the plurality of predefined second time instances temporally preceding the first time instance and a second set of the plurality of predefined second time instances temporally succeeding the first time instance,

receives, from the user via the displayed selection of the plurality of image leap commands, a selection of a predefined second time instance of the plurality of predefined second time instances, and

when the selected predefined second time instance is within the target period, displays a second flow line analysis image generated for the selected predefined second time instance.

3. The system of claim 1 ,

wherein the camera device repeatedly generates the captured image.

4. The system of claim 1 ,

wherein the camera device,

generates a captured image,

extracts first flow line information relating to a staying position of a moving person and second flow line information relating to where a moving person passes, and

transmits the generated captured image and the extracted first flow line information and the second flow line information to the server device for each predetermined transmission period, and

wherein, according to a setting, the server device displays a first flow line analysis image in which the first flow line information is superimposed on the captured image or a second flow line analysis image in which the second flow line information is superimposed on the captured image.

5. The system of claim 1 ,

wherein the server device,

displays a time line bar that arbitrarily sets a period of the flow line analysis image in which the flow line information is superimposed on the captured image, and

displays the flow line analysis image in the period arbitrarily set on the time line bar.

6. The system of claim 5 ,

wherein the server device displays the time line bar on a screen same as the screen on which the flow line analysis image is displayed.

7. The system of claim 5 ,

wherein the time line bar indicates the presence or absence of the captured image from the camera device and the flow line information for each predetermined period.

8. A flow line analysis method in a flow line analysis system to which a camera device and a server device are connected, the flow line analysis method comprising:

generating captured images, and

extracting flow line information relating to a staying position of a moving person or where a moving person passes, and

causing the server device to:

display an acquisition menu including selections of camera device identifiers and target period durations,

receive, from a user via the acquisition menu, a selection of a camera device identifier of the camera device and a target period having a target period duration,

in response to receiving the selection of the camera device identifier of the camera device and the target period, retrieve, from the camera device, the generated captured images and the extracted flow line information of the moving person,

generate, for the target period, flow line analysis images in which the flow line information of the moving person is superimposed on the captured images, the flow line analysis image providing an indication of a number of moving persons passing a position in the captured image,

display a first flow line analysis image on the display, the first flow line analysis image being associated with a first time instance in the target period,

display, on the display, a selection of a plurality of image leap commands respectively associated with a plurality of predefined second time instances, a first set of the plurality of predefined second time instances temporally preceding the first time instance and a second set of the plurality of predefined second time instances temporally succeeding the first time instance,

receive, from the user via the displayed selection of the plurality of image leap commands, a selection of a predefined second time instance of the plurality of predefined second time instances,

when the selected predefined second time instance is within the target period, display a second flow line analysis image generated for the selected predefined second time instance.

9. The flow line analysis system of claim 1 , wherein the server device, in operation, displays a field, selection of the field initiating the operation of changing the timing of the target period.

10. The flow line analysis system of claim 2 , wherein the server device, in operation, displays a field, selection of the field initiating the operation of changing the timing of the target period.

11. The flow line analysis method of claim 8 , further comprising causing the server device to display a field which upon selection initiates the operation of changing the timing of the target period.

Assignments (8)
CHANGE OF NAME Recorded Mar 16, 2023
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 063101/0966 →
CHANGE OF ADDRESS Recorded Mar 16, 2023
From: I-PRO CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 063102/0075 →
CHANGE OF NAME Recorded Dec 31, 2020
From: PSP HOLDINGS CO., LTD
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 054883/0234 →
MERGER Recorded Dec 31, 2020
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: PSP HOLDINGS CO., LTD
Reel/Frame 054883/0201 →
CHANGE OF ADDRESS Recorded Dec 31, 2020
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 054883/0248 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTED DATE PREVIOUSLY RECORDED AT REEL: 051249 FRAME: 0136. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 13, 2020
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 051580/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2019
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 051249/0136 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2016
From: HAGISU, SHINPEI; TAYAMA, TETSUO; KINOSHITA, HIDETOSHI; YANO, KOJI; NAKAMURA, MANABU; OGUCHI, TAKAE; TAKAHASHI, HIDEAKI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 037914/0839 →
Priority Claims (1)
JP 2015-085454 · Apr 17, 2015 · national
Continuity (1)
Related Publication 20160309096A1 · Oct 20, 2016