IP Library Granted Patent US 12,558,961
Granted Patent B2
US 12,558,961 · App. 18/629,136 · Granted Feb 24, 2026

Display device, display method, and display program of a vehicle surroundings image

Inventors: Takashi Ota (Tokyo, JP); Takahiko Kuwabara (Yokohama, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
B60K35/80B60K35/28B60W40/08B60W50/14B60W60/001G06V20/597B60W2040/0818B60W2050/146B60W2420/403B60W2540/223B60W2540/229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,558,961
App. No.
18/629,136
Granted
Feb 24, 2026
Kind
B2
Abstract

A display device includes: a steering non-holding recognition unit configured to recognize a steering non-holding state in which a driver of the vehicle does not hold steady a steering wheel of the vehicle based on detection result of a steering sensor of the vehicle; and a display control unit configured to display the vehicle surroundings image on the display unit based on detection result of an external sensor of the vehicle. The display control unit reduces visibility of the vehicle surroundings image in the display unit when the steering non-holding state continues for a predetermined first period or longer, compared to visibility of the vehicle surroundings image when the steering non-holding state does not continue for the first period or longer, during execution of autonomous driving control in which the driver is required to visually confirm a surrounding environment.

Claims (19)

1 . A display device configured to display a vehicle surroundings image representing a surrounding situation of a vehicle on an in-vehicle display unit, the display device comprising an electronic control unit configured to:

recognize a steering non-holding state in which a driver of the vehicle does not hold a steering wheel of the vehicle based on detection result of a steering sensor of the vehicle;

display the vehicle surroundings image on the in-vehicle display unit based on detection result of an external sensor of the vehicle; and

reduce visibility of the vehicle surroundings image in the in-vehicle display unit by changing a line type of the vehicle surroundings image, lightening a color of the vehicle surroundings image, or increasing a transparency of the vehicle surroundings image when the steering non-holding state continues for a predetermined first period or longer, compared to visibility of the vehicle surroundings image when the steering non-holding state does not continue for the first period or longer, during execution of autonomous driving control in which the driver is required to visually confirm a surrounding environment.

2 . The display device according to claim 1 , wherein the electronic control unit is further configured to:

recognize a neglect of a visual environment confirmation of the driver based on an image captured by a driver monitor camera that images the driver; and

reduce visibility of the vehicle surroundings image in the in-vehicle display unit when the neglect of a visual environment confirmation continues for a predetermined second period or longer, compared to visibility of the vehicle surroundings image when the neglect of a visual environment confirmation does not continue for the second period or longer, during execution of autonomous driving control in which the driver is required to visually confirm the surrounding environment.

3 . The display device according to claim 1 , wherein the electronic control unit is further configured to:

recognize a state of reduced alertness of the driver when an arousal level of the driver is less than or equal to a predetermined threshold value, based on an image captured by a driver monitor camera that images the driver; and

reduce visibility of the vehicle surroundings image in the in-vehicle display unit when the state of reduced alertness continues for a predetermined third period or longer, compared to visibility of the vehicle surroundings image when the state of reduced alertness does not continue for the third period or longer, during execution of autonomous driving control in which the driver is required to visually confirm the surrounding environment.

4 . The display device according to claim 1 , wherein reducing visibility of the vehicle surroundings image comprises changing the line type from solid lines to dashed lines.

5 . A display method of displaying a vehicle surroundings image representing a surrounding situation of a vehicle on an in-vehicle display unit, the display method comprising:

a step of recognizing a steering non-holding state in which a driver of the vehicle does not hold a steering wheel of the vehicle based on detection result of a steering sensor of the vehicle, and

a step of displaying the vehicle surroundings image on the in-vehicle display unit based on detection result of an external sensor of the vehicle, wherein

in the step of displaying the vehicle surroundings image on the in-vehicle display unit, visibility of the vehicle surroundings image in the in-vehicle display unit is to be reduced by changing a line type of the vehicle surroundings image, lightening a color of the vehicle surroundings image, or increasing a transparency of the vehicle surroundings image when the steering non-holding state continues for a predetermined first period or longer, compared to visibility of the vehicle surroundings image when the steering non-holding state does not continue for the first period or longer, during execution of autonomous driving control in which the driver is required to visually confirm a surrounding environment.

6 . A non-transitory storage medium storing a display program that causes a computer to function as a display device that displays a vehicle surroundings image representing a surrounding situation of a vehicle on an in-vehicle display unit, the display program causing the computer to:

recognize a steering non-holding state in which a driver of the vehicle does not hold a steering wheel of the vehicle based on detection result of a steering sensor of the vehicle;

display the vehicle surroundings image on the in-vehicle display unit based on a detection result of an external sensor of the vehicle; and

reduce visibility of the vehicle surroundings image in the in-vehicle display unit by changing a line type of the vehicle surroundings image, lightening a color of the vehicle surroundings image, or increasing a transparency of the vehicle surroundings image when the steering non-holding state continues for a predetermined first period or longer, compared to a case where the steering non-holding state does not continue for the first period or longer, during execution of autonomous driving control in which the driver is required to visually confirm a surrounding environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2024
From: OTA, TAKASHI; KUWABARA, TAKAHIKO
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 067079/0417 →
Priority Claims (1)
JP 2023-068675 · Apr 19, 2023 · national
Continuity (1)
Related Publication 20240351440A1 · Oct 24, 2024
References Cited (8)
US 20180154903A1 · Song · 2018 [cited by examiner]
US 20200207366A1 · Kapuria · 2020 [cited by examiner]
US 20220063649A1 · Takabatake · 2022 [cited by examiner]
US 20230182764A1 · Fukui · 2023 [cited by examiner]
JP 2019109590A · 2019 [cited by applicant]
JP 2022039936A · 2022 [cited by applicant]
JP 2022048538A · 2022 [cited by applicant]
Black Tesla, Tesla v8.0 Autopilot—Warning Interval & Autosteer Unavailable, Sep. 24, 2016, Youtube, https://www.youtube.com/watch?v=isZ3fSbE_pg&t=322s (Year: 2016). [cited by examiner]