IP Library Granted Patent US 11,636,762
Granted Patent B2
US 11,636,762 · App. 16/933,152 · Granted Apr 25, 2023

Image display device

Inventors: Hojung Jung (Susono, JP); Hiromitsu Urano (Numazu, JP); Sho Otaki (Yokohama, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
G08G1/096855G05D1/0038G08G1/09626H04N5/272B60W60/0025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,636,762
App. No.
16/933,152
Granted
Apr 25, 2023
Kind
B2
Abstract

An image display device includes: an external sensor data acquisition unit acquired external sensor data detected at a first time point; an internal sensor data acquisition unit acquired internal sensor data detected at the first time point; a determination unit determined a position of the vehicle at a second time point that is a future time point after a predetermined time has elapsed from the first time point, based on the internal sensor data at the first time point; and a display control unit displayed a monitoring image indicating surroundings of the vehicle on the display unit based on the external sensor data at the first time point, wherein, the display control unit superimposes an object indicating the position of the vehicle at the second time point at the position on the monitoring image corresponding to the position of the vehicle at the second time point.

Claims (21)

1. An image display device connected to a display device that displays information to a remote operator that remotely instructs a vehicle, comprising:

a processor configured to:

acquire external sensor data detected at a first time point by an external sensor that detects information on an external environment of the vehicle from the vehicle;

acquire internal sensor data detected at the first time point by an internal sensor that detects a travel state of the vehicle from the vehicle;

determine a position of the vehicle at a second time point that is a future time point after a predetermined time has elapsed from the first time point, based on the internal sensor data at the first time point;

display a monitoring image indicating surroundings of the vehicle on the display device based on the external sensor data at the first time point;

superimpose an object indicating the position of the vehicle at the second time point at a position on the monitoring image corresponding to the position of the vehicle at the second time point,

calculate a delay time of communication with the vehicle;

determine an acceptable range of the position of the vehicle at the second time point based on the delay time; and

superimpose an object indicating the acceptable range at a position on the monitoring image corresponding to the acceptable range.

2. The image display device according to claim 1 ,

wherein the processor is configured to superimpose the object indicating the acceptable range at the position on the monitoring image corresponding to the acceptable range when a degree of delay is equal to or greater than a threshold value, and the degree of delay is defined based on at least one of an absolute value of the delay time and a variance value within a predetermined time and indicating that the delay increases as a value increases.

3. The image display device according to claim 2 , wherein:

the object indicating the position of the vehicle at the second time point is a guideline object,

the object indicating the acceptable range is an object extending in a line width direction of the guideline object, and

the processor is configured to increase a length of the object indicating the acceptable range in the line width direction as the degree of delay increases.

4. The image display device according to claim 1 ,

wherein the processor is configured to:

detect another vehicle existing around the vehicle based on the external sensor data at the first time point,

determine a position of the other vehicle at the second time point, and

superimpose an object indicating the position of the other vehicle at the second time point at a position on the monitoring image corresponding to the position of the other vehicle at the second time point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2020
From: JUNG, HOJUNG; URANO, HIROMITSU; OTAKI, SHO
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 053253/0385 →
Priority Claims (1)
JP JP2019-135626 · Jul 23, 2019 · national
Continuity (1)
Related Publication 20210027625A1 · Jan 28, 2021