IP Library Granted Patent US 11,281,914
Granted Patent B2
US 11,281,914 · App. 16/875,498 · Granted Mar 22, 2022

Vehicle monitoring system and vehicle monitoring method

Inventors: Yuma Kobayashi (Fukuoka, JP); Hiromichi Sotodate (Kanagawa, JP); Akihiro Nawata (Fukuoka, JP); Toshimasa Funaki (Saga, JP); Yuji Arima (Fukuoka, JP); Hideaki Takahashi (Fukuoka, JP); Jyouji Wada (Fukuoka, JP); Hideaki Yamada (Fukuoka, JP); Akito Omata (Fukuoka, JP)
Assignee: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
G06K9/00771G06K9/00255G06K9/4652G06K2209/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,281,914
App. No.
16/875,498
Granted
Mar 22, 2022
Kind
B2
Abstract

A vehicle monitoring system includes at least one camera, and a server that is communicably connected to the camera and a client terminal. The camera captures a license plate and an occupant's face of a vehicle entering an angle of view of the camera, and transmits a captured video to the server. The server acquires an analysis result of the license plate, analysis results of a type and a color of the vehicle, an analysis result of the occupant's face, and an analysis result of the number of occupants based on the captured video, and accumulates the acquired analysis results as analysis results of the captured video, and sends the analysis result to the client terminal in correlation with a snapshot of the captured video.

Claims (63)

1. A vehicle monitoring system comprising:

at least one camera; and

a server that is communicably connected to a client terminal,

wherein the camera

captures a video including a license plate of a vehicle and an occupant's face in the vehicle, the vehicle entering an angle of view of the camera, and

transmits, to the server, the captured video having the license plate and the occupant's face for performing collation, and

wherein the server

acquires a collation result of the license plate after collating the license plate of the vehicle against a pre-stored number collation list,

acquires a collation result of the occupant's face after collating the occupant's face against a pre-stored face collation list,

acquires analysis results of a type and a color of the vehicle, and

acquires an analysis result of a number of occupants present in the vehicle based on the captured video,

stores, in a memory, the acquired analysis results and the collation results of the captured video, and

sends, to the client terminal, the collation result of the license plate, the analysis results of the type and the color of the vehicle, the collation result of the occupant's face, the analysis result of the number of occupants, and a corresponding snapshot of the captured video;

wherein the server acquires the collation result of the occupant's face, acquires the analysis results of the type and the color of the vehicle, and acquires the analysis result of the number of occupants present in the vehicle, only in response to a match indicated in the collation results of the license elate information.

2. The vehicle monitoring system according to claim 1 ,

wherein the server

includes a database storing the number collation list, in which a license plate of an investigation target vehicle is registered, and collates whether or not license plate information of the vehicle captured in the video is registered in the number collation list in a case where the license plate information of the vehicle that is input as a retrieval condition is received from the client terminal, and

extracts a face image of an occupant of the vehicle, the type and the color of the vehicle, and the number of occupants corresponding to the license plate information based on a match in the collation result of the license plate information and the analysis result of the captured video, and displays the extracted results on the client terminal.

3. The vehicle monitoring system according to claim 2 ,

wherein the server extracts a face image of each of a driver and a passenger of the vehicle, and displays the face image of each of the driver and the passenger on the client terminal.

4. The vehicle monitoring system according to claim 2 ,

wherein the server stores, in the database, the face collation list in which a face image and person information of an investigation target person are registered, and displays person information of the occupant of the vehicle corresponding to the face image on the client terminal in a popup form according to the collation result indicating that the face image of the occupant of the vehicle corresponding to the license plate information of the vehicle is registered in the face collation list.

5. The vehicle monitoring system according to claim 1 ,

wherein the server

includes a database storing the face collation list in which a face image and person information of an investigation target person are registered, and collates whether or not the face image of the occupant captured in the video is registered in the face collation list in a case where the face image of the occupant is input as a retrieval condition is received from the client terminal, and

extracts license plate information of the vehicle, the type and the color of the vehicle, and the number of occupants corresponding to the face image of the occupant based on a match in the collation result of the face image of the occupant and an analysis result of the captured video, and displays the extracted results on the client terminal.

6. The vehicle monitoring system according to claim 5 ,

wherein the server collates whether or not a face image of a passenger of the vehicle corresponding to the face image is registered in the face collation list, and displays the collation result on the client terminal along with the license plate of the vehicle, the type and the color of the vehicle, and the number of occupants.

7. The vehicle monitoring system according to claim 1 ,

wherein the server

includes a database storing the number collation list in which a license plate of an investigation target vehicle is registered, and collates whether or not a detection result of the license plate of the vehicle captured in the video is registered in the number collation list, and

analyzes the occupant's face and the number of occupants based on the captured video in a case where the detection result of the license plate of the vehicle is registered in the number collation list, or analysis results of the type and the color of the vehicle satisfy a predetermined condition.

8. The vehicle monitoring system according to claim 1 ,

wherein the camera

includes a database storing the number collation list in which a license plate of an investigation target vehicle is registered, and collates whether or not a detection result of the license plate of the vehicle captured in the video is registered in the number collation list, and

wherein the server

receives a notification of the collation result of the license plate from the camera, and analyzes the type and the color of the vehicle based on the captured video,

analyzes the occupant's face and the number of occupants based on the captured video in a case where the detection result of the license plate of the vehicle is registered in the number collation list, or analysis results of the type and the color of the vehicle satisfy a predetermined condition.

9. The vehicle monitoring system according to claim 1 ,

wherein the camera

includes a database storing the number collation list in which a license plate of an investigation target vehicle is registered, and collates whether or not a detection result of the license plate of the vehicle captured in the video is registered in the number collation list,

analyzes the type and the color of the vehicle based on the captured video,

analyzes the occupant's face and the number of occupants based on the captured video in a case where the detection result of the license plate of the vehicle is registered in the number collation list, or analysis results of the type and the color of the vehicle satisfy a predetermined condition, and

transmits, to the server, the collation result of the license plate, the analysis results of the type and the color of the vehicle, the collation result of the occupant's face, and the analysis result of the number of occupants.

10. The vehicle monitoring system according to claim 1 ,

wherein the camera

detects the license plate of the vehicle based on the captured video, and sends a license plate image obtained by cutting out the license plate of the vehicle to the server, and

detects the occupant's face of the vehicle based on the captured video, and sends the face image of the occupant obtained by cutting out the occupant's face to the server, and

wherein the server

includes a database storing the number collation list in which a license plate of an investigation target vehicle is registered, and collates whether or not the license plate image of the vehicle captured in the video is registered in the number collation list and analyzes the type and the color of the vehicle and the number of occupants based on the captured video in response to reception of the license plate image, and

analyzes the occupant's face based on the captured video in response to reception of the face image.

11. A vehicle monitoring method performed by a vehicle monitoring system including at least one camera, and a server that is communicably connected to a client terminal, the vehicle monitoring method comprising:

by the camera,

capturing a video including a license plate of a vehicle and an occupant's face in the vehicle, the vehicle entering an angle of view of the camera, and

transmitting, to the server, the captured video having the license plate and the occupant's face for performing collation; and

by the server

acquiring a collation result of the license plate after collating the license plate of the vehicle against a pre-stored number collation list,

acquiring a collation result of the occupant's face after collating the occupant's face against a pre-stored face collation list,

acquiring analysis results of a type and a color of the vehicle, and

acquiring an analysis result of a number of occupants present in the vehicle based on the captured video,

storing the acquired analysis results and the collation results the captured video, and

sending, to the client terminal, the collation result of the license plate, the analysis results of the type and the color of the vehicle, the collation result of the occupant's face, the analysis result of the number of occupants, and a corresponding snapshot of the captured video;

wherein the acquiring of the collation result of the occupant's face, the acquiring of the analysis results of the type and the color of the vehicle, and the acquiring of the analysis result of the number of occupants present in the vehicle, only in response to a match indicated in the collation results of the license olate information.

Assignments (3)
ADDRESS CHANGE Recorded Feb 13, 2023
From: I-PRO CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 062800/0446 →
CHANGE OF NAME Recorded Feb 10, 2023
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 062660/0052 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2020
From: KOBAYASHI, YUMA; SOTODATE, HIROMICHI; NAWATA, AKIHIRO; FUNAKI, TOSHIMASA; ARIMA, YUJI; TAKAHASHI, HIDEAKI; WADA, JYOUJI; YAMADA, HIDEAKI; OMATA, AKITO
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 052675/0957 →
Priority Claims (1)
JP JP2019-094825 · May 20, 2019 · national
Continuity (1)
Related Publication 20200372258A1 · Nov 26, 2020