IP Library › Granted Patent US 12,333,197
Granted Patent B2
US 12,333,197 · App. 17/709,672 · Granted Jun 17, 2025

Adjusting a vehicle display that occludes a view of an operator in response to identifying a risk

Inventors: Hiroshi Yasuda (San Francisco, CA); Manuel Ludwig Kuehner (Mountain View, CA)
Assignee: Toyota Research Institute, Inc.
G06F3/14B60K35/00G06T7/70G06V20/58B60K35/28B60K35/65B60K35/81B60K2360/172B60K2360/741G06T2207/30201G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,197
App. No.
17/709,672
Granted
Jun 17, 2025
Kind
B2
Abstract

System, methods, and other embodiments described herein relate to adjusting a vehicle display that occludes a view of an operator in response to identifying a risk. In one embodiment, a method includes, in response to determining a vehicle is operating in an autonomous mode, displaying content on at least one display within the vehicle that occludes a field-of-view (FOV) of an operator through a window of the vehicle. The method includes analyzing sensor data from at least one sensor of the vehicle to identify a risk associated with a path of the vehicle. The method includes, in response to determining the risk satisfies a risk threshold, adjusting display of the content associated with the display occluding the FOV.

Claims (39)

1. A system, comprising:

one or more processors; and

a memory communicably coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the one or more processors to:

in response to determining a vehicle is operating in an autonomous mode, display content on at least one display within the vehicle that occludes a field-of-view (FOV) of an operator through a window of the vehicle;

analyze sensor data from at least one sensor of the vehicle to identify a risk associated with a path of the vehicle; and

in response to determining the risk satisfies a risk threshold, adjust display of the content associated with the display occluding the FOV by moving a location of the content relative to the FOV of the operator.

2. The system of claim 1 , wherein the instructions to adjust the display of the content include instructions to analyze the sensor data from at least one sensor of the vehicle to identify at least one of eye positions and head positions of the operator;

determine the display of the content occludes the risk from the FOV of the operator, wherein the FOV of the operator depends, at least in part, on the at least one of the eye positions and the head positions of the operator; and

adjust the display of the content to show the risk within the FOV of the operator.

3. The system of claim 1 , wherein the instructions to adjust the display of the content include instructions to increase a transparency of the display relative to the FOV of the operator.

4. The system of claim 1 , wherein the instructions to adjust the display of the content include instructions to locally adapt a transparency of a portion of the display relative to the FOV.

5. The system of claim 1 , wherein the instructions to determine whether the risk satisfies the risk threshold includes instructions to identify a risk that prompts a user action, wherein the user action includes at least observation from the operator and a vehicle takeover maneuver.

6. The system of claim 1 , wherein the instructions to analyze the sensor data include instructions to identify at least one of: a presence of at least one pedestrian, a presence of at least one erratic vehicle, a presence of at least one animal, a level of road congestion, a need for changes in longitudinal and lateral movements of the vehicle, a presence of at least one road obstruction, and a possible collision.

7. The system of claim 1 , wherein the instructions to analyze the sensor data include instructions to determine at least one of: a location and a trajectory of the risk.

8. The system of claim 1 , wherein the window of the vehicle is a windshield.

9. A non-transitory computer-readable medium for including instructions that when executed by one or more processors cause the one or more processors to:

responsive to determining a vehicle is operating in an autonomous mode, display content on at least one display within the vehicle that occludes a field-of-view (FOV) of an operator through a window of the vehicle;

analyze sensor data from at least one sensor of the vehicle to identify a risk associated with a path of the vehicle; and

responsive to determining the risk satisfies a risk threshold, adjust display of the content associated with the display occluding the FOV by moving a location of the content relative to the FOV of the operator.

10. The non-transitory computer-readable medium of claim 9 , wherein the instructions to adjust the display of the content include instructions to:

analyze the sensor data from at least one sensor of the vehicle to identify at least one of eye positions and head positions of the operator;

determine the display of the content occludes the risk from the FOV of the operator, wherein the FOV of the operator depends, at least in part, on the at least one of the eye positions and the head positions of the operator; and

adjust the display of the content to show the risk within the FOV of the operator.

11. The non-transitory computer-readable medium of claim 9 , wherein the instructions to adjust the display of the content include instructions to increase a transparency of the display relative to the FOV of the operator.

12. The non-transitory computer-readable medium of claim 9 , wherein the instructions to adjust the display of the content include instructions to locally adapt a transparency of a portion of the display relative to the FOV.

13. The non-transitory computer-readable medium of claim 9 , wherein the instructions to determine the risk satisfies the risk threshold include instructions to identify a risk that prompts a user action, wherein the user action includes at least observation from the operator and a vehicle takeover maneuver.

14. A method, comprising:

in response to determining a vehicle is operating in an autonomous mode, displaying content on at least one display within the vehicle that occludes a field-of-view (FOV) of an operator through a window of the vehicle;

analyzing sensor data from at least one sensor of the vehicle to identify a risk associated with a path of the vehicle; and

in response to determining the risk satisfies a risk threshold, adjusting display of the content associated with the display occluding the FOV, including moving a location of the content relative to the FOV of the operator.

15. The method of claim 14 , wherein adjusting the display of the content includes:

analyzing the sensor data from at least one sensor of the vehicle to identify at least one of eye positions and head positions of the operator;

determining the display of the content occludes the risk from the FOV of the operator, wherein the FOV of the operator depends, at least in part, on the at least one of the eye positions and the head positions of the operator; and

adjusting the display of the content to show the risk within the FOV of the operator.

16. The method of claim 14 , wherein adjusting the display of the content includes increasing a transparency of the display relative to the FOV of the operator.

17. The method of claim 14 , wherein adjusting the display of the content includes locally adapting a transparency of a portion of the display relative to the FOV.

18. The method of claim 14 , wherein determining the risk satisfies the risk threshold includes identifying a risk that prompts a user action, wherein the user action includes at least observation from the operator and a vehicle takeover maneuver.

19. The method of claim 14 , wherein analyzing the sensor data includes identifying at least one of: a presence of at least one pedestrian, a presence of at least one erratic vehicle, a presence of at least one animal, a level of road congestion, a need for changes in longitudinal and lateral movements of the vehicle, a presence of at least one road obstruction, and a possible collision.

20. The method of claim 14 , wherein analyzing the sensor data includes determining at least one of: a location and a trajectory of the risk.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED ON REEL 71783 FRAME 815. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Jul 29, 2026
From: TOYOTA RESEARCH INSTITUTE, INC.
To: WOVEN BY TOYOTA, INC.
Reel/Frame 076076/0856 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2025
From: TOYOTA RESEARCH INSTITUTE, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 071783/0815 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2022
From: YASUDA, HIROSHI; KUEHNER, MANUEL LUDWIG
To: TOYOTA RESEARCH INSTITUTE, INC.
Reel/Frame 059571/0952 →
Continuity (1)
Related Publication 20230315369A1 · Oct 5, 2023
References Cited (13)
US 9937929B2 · Wulf · 2018 [cited by applicant]
US 10017114B2 · Bongwald · 2018 [cited by applicant]
US 10059175B2 · Cuddihy et al. · 2018 [cited by applicant]
US 10144348B2 · Hergeth · 2018 [cited by applicant]
US 10603988B2 · O'Keefe · 2020 [cited by applicant]
US 20060164219A1 · Knoll · 2006 [cited by applicant]
US 20180141414A1 · Lota · 2018 [cited by applicant]
US 20190324452A1 · Sato et al. · 2019 [cited by applicant]
US 20210318135A1 · Chandupatla · 2021 [cited by examiner]
US 20230017486A1 · Homma · 2023 [cited by examiner]
JP 2021148690A · 2021 [cited by examiner]
WO 2018056981A1 · 2018 [cited by applicant]
WO 2019068412A1 · 2019 [cited by applicant]