IP Library Granted Patent US 11,468,692
Granted Patent B2
US 11,468,692 · App. 16/600,687 · Granted Oct 11, 2022

Control device, vehicle, image display system, and image display method

Inventors: Takuro Yanagi (Toyota, JP); Maki Tamura (Nisshin, JP); Mutsumi Matsuura (Okazaki, JP); Toshihiko Inoue (Toyota, JP); Naoki Yamamuro (Nagoya, JP); Takashi Hayashi (Aichi-gun, JP); Takahiro Shiga (Chiryu, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
G06V20/597B60R1/00G01C21/265H04N5/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,468,692
App. No.
16/600,687
Granted
Oct 11, 2022
Kind
B2
Abstract

A control device includes a controller. The controller detects, as an event, that a target present outside a vehicle has been overlooked by a driver of the vehicle during. The controller controls the outputting of a target image, which is an image including the target overlooked in the detected event, toward the driver.

Claims (32)

1. A control device comprising:

a controller configured to:

detect, as an event, that a target present outside a vehicle has been overlooked by a driver of the vehicle during driving, the event being detected in response to a determination that a driver of the vehicle looks at a side glass of the vehicle away from objects from which the driver was previously viewing, the detection of the event further includes the controller being configured to:

acquire an image of a driver,

determine, from the acquired image, that the driver looks at the side glass to perform a double take of the objects after the driver has viewed the objects for a predetermined period of time,

acquire, after the driver looks at the side glass after viewing the objects for the predetermined period of time, biological information of the driver,

determine, from the biological information, that the driver has an increase in one of a (i) heart rate, (ii) blood pressure, and (iii) breathing rate, and

control outputting of a target image toward the driver, the target image

including the target overlooked in the detected event,

wherein the determination of the performance of the double take of the objects is based on a determination of a line of sight of the driver from the acquired image.

2. The control device according to claim 1 , wherein the controller is further configured to control an output unit provided in the vehicle and having a display function such that the target image is displayed toward the driver.

3. The control device according to claim 1 , further comprising a communication unit having a communication function, wherein the controller controls the communication unit such that the target image is transmitted to a terminal device of the driver.

4. The control device according to claim 1 , wherein the target image is an image captured from the vehicle.

5. The control device according to claim 4 , wherein the target image is an image captured from the vehicle before the event is detected by the controller.

6. The control device according to claim 1 , wherein the acquired image of the driver is captured in the vehicle.

7. The control device according to claim 1 , wherein the controller is further configured to detect the event based on an input operation of the driver performed in the vehicle.

8. A vehicle comprising:

an imaging unit configured to capture a target image; and

the control device according to claim 1 .

9. The vehicle according to claim 8 , further comprising an output unit configured to display the target image toward the driver.

10. An image display system comprising:

the control device according to claim 1 ; and

a terminal device configured to receive the target image from the control device and display the target image toward the driver.

11. An image display method comprising:

detecting, as an event by a control device, that a target present outside a vehicle has been overlooked by a driver of the vehicle during driving, the event being detected in response to a determination that a driver of the vehicle looks at a side glass of the vehicle away from objects from which the driver was previously viewing, detecting the event further including:

acquiring an image of a driver,

determining, from the acquired image, that the driver looks at the side glass to perform a double take of the objects after the driver has viewed the objects for a predetermined period of time,

acquiring, after the driver looks at the side glass after viewing the objects for the predetermined period of time, biological information of the driver, and

determining, from the biological information, that the driver has an increase in one of a (i) heart rate, (ii) blood pressure, and (iii) breathing rate;

capturing a target image, which is an image including the target overlooked in the event detected by the control device by an imaging unit of the vehicle; and

displaying the target image captured by the imaging unit toward the driver by one of an output unit of the vehicle and a terminal device,

wherein the determination of the performance of the double take of the objects is based on a determination of a line of sight of the driver from the acquired image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2019
From: YANAGI, TAKURO; TAMURA, MAKI; MATSUURA, MUTSUMI; INOUE, TOSHIHIKO; YAMAMURO, NAOKI; HAYASHI, TAKASHI; SHIGA, TAKAHIRO
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 050702/0421 →
Priority Claims (1)
JP JP2018-240111 · Dec 21, 2018 · national
Continuity (1)
Related Publication 20200202150A1 · Jun 25, 2020