IP Library › Granted Patent US 11,366,477
Granted Patent B2
US 11,366,477 · App. 16/475,576 · Granted Jun 21, 2022

Information processing device, information processing method, and computer readable medium

Inventors: Takefumi Hasegawa (Tokyo, JP); Masahiro Abukawa (Tokyo, JP); Shu Murayama (Tokyo, JP); Yohei Miki (Tokyo, JP); Michinori Yoshida (Tokyo, JP); Kentaro Ishikawa (Tokyo, JP)
Assignee: Mitsubishi Electric Corporation
G05D1/0214G05D1/0246G05D1/0297G06V20/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,366,477
App. No.
16/475,576
Granted
Jun 21, 2022
Kind
B2
Abstract

A first image-data acquisition unit ( 101 ) acquires a plurality of pieces of image data in which different areas in a facility in which an autonomous driving vehicle conducts autonomous traveling are shown. A priority setting unit ( 102 ) analyzes a status shown in each of the plurality of pieces of image data and sets a priority to each image data. A first image-data display unit ( 103 ) decides a display mode at a time of displaying the plurality of pieces of image data according to the priority set by the priority setting unit ( 102 ).

Claims (26)

1. An information processing device for monitoring autonomous driving vehicles conducting automatic parking in a parking facility, the device comprising:

processing circuitry

to acquire, from sensors positioned in the parking facility, a plurality of pieces of image data in which different areas in the parking facility in which an autonomous driving vehicle conducts autonomous traveling are shown;

to analyze a status shown in each of the plurality of pieces of image data and to set a priority to each of the plurality of pieces of image data;

to combine the plurality of pieces of image data to generate a bird's-eye view;

to display the bird's-eye view with a highlight for portions of the bird's-eye view in which pieces of the acquired image data having a set priority that matches a predetermined condition is reflected; and

instructs stopping or altering of a traveling of a monitored autonomous driving vehicle.

2. The information processing device according to claim 1 , wherein the processing circuitry analyzes a status shown in each image data, estimates a degree of danger in an area that is shown in each image data, and sets a priority to each image data based on an estimated degree of danger.

3. The information processing device according to claim 2 , wherein the processing circuitry

acquires a plurality of pieces of image data in which different areas in a facility in which one or more autonomous driving vehicles conduct autonomous driving and one or more pedestrians walk are shown, and

analyzes a status of an autonomous driving vehicle and a status of a pedestrian as a status shown in each image data, and estimates a degree of danger in an area that is shown in each image data.

4. The information processing device according to claim 1 , wherein the processing circuitry acquires a plurality of pieces of image data generated by a plurality of sensor devices installed in a plurality of autonomous traveling vehicles that are present in the facility.

5. The information processing device according to claim 1 , wherein the processing circuitry instructs stopping of traveling of the autonomous driving vehicle.

6. The information processing device according to claim 1 , wherein the processing circuitry designates a traveling route and instructs traveling of the autonomous driving vehicle along the traveling route.

7. The information processing device according to claim 1 , wherein the processing circuitry instructs, when there are a plurality of autonomous driving vehicles in the facility, stopping of traveling of the plurality of autonomous driving vehicles.

8. An information processing method monitoring autonomous driving vehicles conducting automatic parking in a parking facility, the method comprising:

acquiring, from sensors positioned in the parking facility, a plurality of pieces of image data in which different areas in the parking facility in which an autonomous driving vehicle conducts autonomous driving are shown;

analyzing a status shown in each of the plurality of pieces of image data and setting a priority to each of the plurality of pieces of image data;

combining the plurality of pieces of image data to generate a bird's-eye view;

displaying the bird's-eye view with highlighting for portions of the bird's-eye view in which pieces of the acquire image data having a set priority that matches a predetermined condition is reflected; and

instructing stopping or altering of traveling of a monitored autonomous driving vehicle.

9. A non-transitory computer readable medium storing an information processing program for monitoring autonomous driving vehicles conducting automatic parking in a parking facility, the information processing program causing a computer to execute:

an image-data acquiring process of acquiring, from sensors positioned in the parking facility, a plurality of pieces of image data in which different areas in the parking facility in which an autonomous driving vehicle conducts autonomous driving are shown;

a priority setting process of analyzing a status shown in each of the plurality of pieces of image data and setting a priority to each of the plurality of pieces of image data;

a display control process of combining the plurality of pieces of image data to generate a bird's-eye view, and displaying the bird's-eye view with highlighting for portions of the bird's-eye view in which pieces of the acquired image data having a set priority that matches a predetermined condition is reflected; and

an instruction process of stopping or altering traveling of a monitored autonomous driving vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2019
From: HASEGAWA, TAKEFUMI; ABUKAWA, MASAHIRO; MURAYAMA, SHU; MIKI, YOHEI; YOSHIDA, MICHINORI; ISHIKAWA, KENTARO
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 049661/0560 →
Continuity (1)
Related Publication 20210173400A1 · Jun 10, 2021
Cited By (2)
US 12,198,550 US 12,624,957