IP Library Granted Patent US 11,869,347
Granted Patent B2
US 11,869,347 · App. 17/044,619 · Granted Jan 9, 2024

Traffic monitoring system and traffic monitoring method

Inventors: Yoji Yokoyama (Kanagawa, JP); Makoto Yasugi (Tokyo, JP)
Assignee: PANASONIC HOLDINGS CORPORATION
G08G1/01G01S13/867G01S13/91G06T11/60G08G1/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,869,347
App. No.
17/044,619
Granted
Jan 9, 2024
Kind
B2
Abstract

The traffic monitoring system is provided with: a camera which captures an image of a monitoring area including a road and generates image data; a millimeter-wave radar which scans a scanning area included in the monitoring area and generates millimeter-wave data; and an information processing server which is connected to the camera and the millimeter-wave radar and acquires the image data and the millimeter-wave data. The information processing server is provided with: a data synchronization unit which synchronizes the image data with the millimeter-wave data so that the difference between a timing at which the image data is generated and a timing at which the millimeter-wave data is generated is equal to or smaller than a certain value; and a screen generation unit which associates the image data and the millimeter wave, which have been synchronized, with each other and generates a monitoring screen that indicates the road conditions.

Claims (34)

1. A traffic monitoring system, comprising:

a camera that captures a monitoring area including a road, and generates image data;

a millimeter-wave radar that scans a scanning area included in the monitoring area, and generates millimeter-wave data; and

an information processing server that is connected to the camera and the millimeter-wave radar, and acquires the image data and the millimeter-wave data, wherein

the information processing server includes:

a data synchronizer that synchronizes the image data and the millimeter-wave data such that a difference between a first timing at which the image data is generated and a second timing at which the millimeter-wave data is generated is equal to or smaller than a certain value; and

a screen generator that associates the image data and the millimeter-wave data which have been synchronized, with each other, and generates a monitoring screen that indicates a condition of the road,

the screen generator determines a retention condition of an object in the scanning area based on the millimeter-wave data, and superimposes information indicating the retention condition on the image data,

the information indicating the retention condition is color information in accordance with a detection frequency of the object, and

the screen generator superimposes the color information on the image data while making the color information transparent on the image data.

2. The traffic monitoring system according to claim 1 , further comprising:

a data accumulator that accumulates the image data and the millimeter-wave data which have been synchronized by the data synchronizer, wherein

the screen generator generates the monitoring screen by using the image data and the millimeter-wave data accumulated in the data accumulator, the image data being past image data, the millimeter-wave data being past millimeter-wave data.

3. The traffic monitoring system according to claim 1 , wherein

the screen generator performs conversion such that millimeter-wave data corresponding to the scanning area corresponds to the monitoring area.

4. A traffic monitoring method, comprising:

acquiring image data from a camera, the image data being generated by capturing a monitoring area including a road;

acquiring millimeter-wave data from a millimeter-wave radar, the millimeter-wave data being generated by scanning a scanning area included in the monitoring area;

synchronizing the image data and the millimeter-wave data such that a difference between a first timing at which the image data is generated and a second timing at which the millimeter-wave data is generated is equal to or smaller than a certain value;

associating the image data and the millimeter-wave data which have been synchronized, with each other, and generating a monitoring screen that indicates a condition of the road;

determining a retention condition of an object in the scanning area based on the millimeter-wave data; and

superimposing information indicating the retention condition on the image data,

wherein the information indicating the retention condition is color information in accordance with a detection frequency of the object, and

the color information is superimposed on the image data while making the color information transparent on the image data.

5. A traffic monitoring system, comprising:

a camera that captures a monitoring area including a road, and generates image data;

a millimeter-wave radar that scans a scanning area included in the monitoring area, and generates millimeter-wave data; and

an information processing server that is connected to the camera and the millimeter-wave radar, and acquires the image data and the millimeter-wave data, wherein

the information processing server:

synchronizes the image data and the millimeter-wave data such that a difference between a first timing at which the image data is generated and a second timing at which the millimeter-wave data is generated is equal to or smaller than a certain value;

associates the image data and the millimeter-wave data which have been synchronized, with each other, and generates a monitoring screen that indicates a condition of the road; and

determines a retention condition of an object in the scanning area based on the millimeter-wave data, and superimposes information indicating the retention condition on the image data,

the information indicating the retention condition is color information in accordance with a detection frequency of the object, and

the information processing server superimposes the color information on the image data while making the color information transparent on the image data.

Assignments (2)
CHANGE OF NAME Recorded May 9, 2022
From: PANASONIC CORPORATION
To: PANASONIC HOLDINGS CORPORATION
Reel/Frame 059909/0607 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2021
From: YOKOYAMA, YOJI; YASUGI, MAKOTO
To: PANASONIC CORPORATION
Reel/Frame 056222/0535 →