IP Library Granted Patent US 11,704,930
Granted Patent B2
US 11,704,930 · App. 17/666,128 · Granted Jul 18, 2023

Vehicle monitoring system and vehicle monitoring method

Inventors: Yuma Kobayashi (Fukuoka, JP); Hiromichi Sotodate (Kanagawa, JP); Akihiro Nawata (Fukuoka, JP); Toshimasa Funaki (Saga, JP); Yuji Arima (Fukuoka, JP); Hideaki Takahashi (Fukuoka, JP); Jyouji Wada (Fukuoka, JP); Hideaki Yamada (Fukuoka, JP); Akito Omata (Fukuoka, JP)
Assignee: I-PRO CO., LTD.
G06V40/16G06V20/52G06V20/593G06V40/166G06V20/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,704,930
App. No.
17/666,128
Granted
Jul 18, 2023
Kind
B2
Abstract

A vehicle monitoring system includes at least one camera, and a server that is communicably connected to the camera and a client terminal. The camera captures an occupant's face of a vehicle entering an angle of view of the camera, and transmits a captured video to the server. The server acquires an analysis results of an attribute of the vehicle, an analysis result of the occupant's face, and an analysis result of the number of occupants based on the captured video, and accumulates the acquired analysis results as analysis results of the captured video, and sends the analysis result to the client terminal in correlation with a snapshot of the captured video.

Claims (61)

1. A vehicle monitoring system comprising:

at least one camera; and

a server that is communicably connected to a client terminal,

wherein the camera

for each of a plurality of vehicles, captures a video including an occupant's face in a vehicle, the vehicle entering an angle of view of the camera, and

transmits, to the server, the captured video having the occupant's face for performing collation,

wherein the server

acquires an attribute of the vehicle included in the captured video,

compares the acquired attribute of the vehicle against a target attribute of an investigation target vehicle,

identifies the vehicle as a target vehicle when the attribute of the vehicle matches with the target attribute,

acquires, for the identified target vehicle, a collation result of the occupant's face after collating the occupant's face against a pre-stored face collation list, and

acquires, for the identified target vehicle, an analysis result of a number of occupants present in the target vehicle based on the captured video,

stores, in a memory, the acquired attribute of the vehicle, the identified target vehicle, the acquired analysis result and the collation result, and

sends, to the client terminal, the acquired attribute of the vehicle, the identified target vehicle, the collation result of the occupant's face, the analysis result of the number of occupants, and a corresponding snapshot of the captured video, and wherein the server

acquires the collation result of the occupant's face, only in response to a match indicated between the attribute of the vehicle with the target attribute.

2. The vehicle monitoring system according to claim 1 ,

wherein the server

extracts a face image of the occupant of the target vehicle, and the number of occupants in the target vehicle included in the captured video based on a match of the attribute between the vehicle included in the captured video and the target attribute, and displays the extracted results on the client terminal.

3. The vehicle monitoring system according to claim 2 ,

wherein the server extracts a face image of each of a driver and a passenger of the vehicle, and displays the face image of each of the driver and the passenger on the client terminal.

4. The vehicle monitoring system according to claim 2 ,

wherein the server

stores, in the database, the face collation list in which a face image and person information of an investigation target person are registered, and

displays person information of the occupant of the vehicle corresponding to the face image on the client terminal in a popup form according to the collation result indicating that the face image of the occupant of the vehicle corresponds to the face image of the investigation target person.

5. The vehicle monitoring system according to claim 1 ,

wherein the server

includes a database storing the face collation list in which a face image and person information of an investigation target person are registered, and collates whether or not the face image of the occupant captured in the video is registered in the face collation list in a case where the face image of the occupant is input as a retrieval condition is received from the client terminal, and

extracts the number of occupants corresponding to the face image of the occupant based on a match in the collation result of the face image of the occupant and an analysis result of the captured video, and displays the extracted results on the client terminal.

6. The vehicle monitoring system according to claim 5 ,

wherein the server collates whether or not a face image of a passenger of the vehicle corresponding to the face image is registered in the face collation list, and displays the collation result on the client terminal along with the attribute of the vehicle, and the number of occupants.

7. The vehicle monitoring system according to claim 1 ,

wherein the server

analyzes the occupant's face and the number of occupants based on the captured video in a case where analysis results of the attribute of the vehicle satisfy a predetermined condition.

8. The vehicle monitoring system according to claim 1 ,

wherein the camera

analyzes the attribute of the vehicle based on the captured video,

analyzes the occupant's face and the number of occupants based on the captured video in a case where the analysis results of the attribute of the vehicle satisfy a predetermined condition, and

transmits, to the server, an analysis results of the attribute of the vehicle, the collation result of the occupant's face, and the analysis result of the number of occupants.

9. The vehicle monitoring system according to claim 1 ,

wherein the camera

detects the occupant's face of the vehicle based on the captured video, and sends the face image of the occupant obtained by cutting out the occupant's face to the server, and

wherein the server

analyzes the number of occupants based on the captured video in response to a match between the attribute of the vehicle and the target attribute, and

analyzes the occupant's face based on the captured video in response to reception of the face image.

10. The vehicle monitoring system according to claim 1 ,

wherein the attribute is a color.

11. The vehicle monitoring system according to claim 1 ,

wherein the attribute is a vehicle type.

12. A vehicle monitoring method performed by a vehicle monitoring system including at least one camera, and a server that is communicably connected to a client terminal, the vehicle monitoring method comprising:

by the camera,

for each of a plurality of vehicles, capturing a video including an occupant's face in a vehicle, the vehicle entering an angle of view of the camera, and

transmitting, to the server, the captured video having the occupant's face for performing collation; and

by the server

acquiring an attribute of the vehicle included in the captured video,

comparing the acquired attribute of the vehicle against a target attribute of an investigation target vehicle,

identifying the vehicle as a target vehicle when the attribute of the vehicle matches with the target attribute,

acquiring, for the identified target vehicle, a collation result of the occupant's face after collating the occupant's face against a pre-stored face collation list,

acquiring, for the identified target vehicle, an analysis result of a number of occupants present in the target vehicle based on the captured video,

storing the acquired attribute of the vehicle, the identified target vehicle, the acquired analysis result and the collation result, and

sending, to the client terminal, the acquired attribute of the vehicle, the identified target vehicle, the collation result of the occupant's face, the analysis result of the number of occupants, and a corresponding snapshot of the captured video, and

wherein the acquiring of the collation result of the occupant's face is performed only in response to a match indicated between the attribute of the vehicle with the target attribute.

Assignments (3)
ADDRESS CHANGE Recorded Nov 1, 2022
From: I-PRO CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 061828/0350 →
CHANGE OF NAME Recorded Oct 31, 2022
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 061824/0261 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: KOBAYASHI, YUMA; SOTODATE, HIROMICHI; NAWATA, AKIHIRO; FUNAKI, TOSHIMASA; ARIMA, YUJI; TAKAHASHI, HIDEAKI; WADA, JYOUJI; YAMADA, HIDEAKI; OMATA, AKITO
To: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
Reel/Frame 058913/0413 →