IP Library › Granted Patent US 12,311,982
Granted Patent B2
US 12,311,982 · App. 17/339,458 · Granted May 27, 2025

Systems and methods for displaying trajectories for autonomous vehicles

Inventors: Mikio David (Ypsilanti, MI); John C. Rafferty (Dexter, MI)
Assignee: Toyota Motor Engineering & Manufacturing North America, Inc.
B60W60/0051B60K35/00G05B19/042G06V20/58B60K35/23B60K35/28B60K2360/166B60K2360/177B60W2420/403B60W2420/54B60W2540/18B60W2540/221G05B2219/2637G05D1/0214G06V20/59G10L25/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,311,982
App. No.
17/339,458
Granted
May 27, 2025
Kind
B2
Abstract

A vehicle includes a computing device configured to detect an object in an external environment via an external sensor. The computing device determines a trajectory for navigation relative the object based on a trust zone. The trust zone is selected based on a trust parameter. The computing device instructs a display device to render a representation of the object and the trajectory relative the object, and determines whether to modify the trust parameter based on feedback data received in response to navigation.

Claims (39)

1. A vehicle, comprising:

a computing device configured to:

detect an object in an external environment via at least one external sensor,

determine a trajectory for navigation relative the object based on a trust zone selected from a plurality of trust zones, wherein the trust zone is selected based on a trust parameter, the trust parameter including a trust level that is determined based on a plurality of environmental conditions, the plurality of environmental conditions including a vehicle condition, vehicle network connectivity information, a type of roadway, a classification corresponding to a type of vehicle, and a type of artificial light information of the external environment;

instruct a display device to render a representation of the object, the plurality of trust zones, and the trajectory relative the object; and

determine whether to modify the trust parameter based on feedback data received in response to navigation, wherein

the trust parameter is modified based on feedback collected during navigation through the trajectory from at least one internal sensor that includes a pressure sensor configured to measure pressure on a steering wheel of the vehicle,

the feedback data reflects a lack of trustworthiness by the user during navigation in the trust zone,

the lack of trustworthiness is indicated during the navigation through the trajectory in response to the pressure sensor indicating that the pressure is applied during the navigation, and

the computing device is configured to control the vehicle to autonomously navigate in accordance with the trajectory.

2. The vehicle of claim 1 , wherein the computing device is further configured to modify the trust parameter based on feedback collected from a biometric sensor configured to measure biometric information associated with a user.

3. The vehicle of claim 1 , wherein the computing device is further configured to lower the trust parameter based on the feedback data indicating that a user manually controlled the vehicle during the navigation.

4. The vehicle of claim 1 , wherein the trust parameter includes at least a high level of trust and a low level of trust, and wherein the computing device selects the trust zone to be closer to the object when the trust parameter comprises the high level of trust and selects the trust zone to be further from the object when the trust parameter comprises the low level of trust.

5. The vehicle of claim 1 , wherein the display device comprises an augmented reality display device.

6. The vehicle of claim 5 , wherein the augmented reality display device comprises a three-dimensional heads-up display device.

7. A method implemented by a vehicle, the method comprising:

analyzing external sensor data to identify an object;

determining a trajectory for navigation relative to the object based on a trust zone, wherein the trust zone is selected based on a trust parameter, the trust parameter including a trust level that is determined based on a plurality of environmental conditions, the plurality of environmental conditions including a vehicle condition, vehicle network connectivity information, a type of roadway, a classification corresponding to a type of vehicle, and a type of artificial light information of the external environment;

displaying a representation of the object, the plurality of trust zones, and the trajectory relative the object; and

determining whether to modify the trust parameter based on feedback collected in response to navigation, wherein

the trust parameter is modified based on feedback collected during navigation through the trajectory from at least one internal sensor that includes a pressure sensor configured to measure pressure on a steering wheel of the vehicle,

the feedback data reflects a lack of trustworthiness by the user during navigation in the trust zone,

the lack of trustworthiness is indicated during the navigation through the trajectory in response to the pressure sensor indicating that the pressure is applied during the navigation, and

controlling the vehicle to autonomously navigate in accordance with the trajectory.

8. The method of claim 7 , wherein the trust parameter includes at least a high level of trust and a low level of trust, and further comprising selecting the trust zone to be closer to the object when the trust parameter comprises the high level of trust and selects the trust zone to be further from the object when the trust parameter comprises the low level of trust.

9. The method of claim 7 , further comprising analyzing the feedback according to a model that is trained to identify trust levels in navigation of the vehicle.

10. The method of claim 7 , wherein analyzing external sensor data to identify the object further comprises determining at least one of a type of the object, a condition of the object, or a distance of the object relative the vehicle.

11. The method of claim 10 , further comprising displaying at least one of the type of the object, the condition of the object, or the distance of the object relative the vehicle on a display device.

12. A vehicle navigation system comprising:

an electronic control unit configured to:

detect objects in an external environment via at least one external sensor,

determine a trajectory for navigation relative the object based on a trust zone selected from a plurality of trust zones, wherein the trust zone is selected based on a trust parameter stored in a computer readable memory, the trust parameter including a trust level that is determined based on a plurality of environmental conditions, the plurality of environmental conditions including a vehicle condition, vehicle network connectivity information, a type of roadway, a classification corresponding to a type of vehicle, and a type of artificial light information of the external environment;

instruct a display device to render a representation of the object, the plurality of trust zones, and the trajectory relative the object; and

modify the trust parameter in response to comparison of feedback data to a trust model, wherein

the trust parameter is modified based on feedback collected during navigation through the trajectory from at least one internal sensor that includes a pressure sensor configured to measure pressure on a steering wheel of the vehicle,

the feedback data reflects a lack of trustworthiness by the user during navigation in the trust zone,

the lack of trustworthiness is indicated during the navigation through the trajectory in response to the pressure sensor indicating that the pressure is applied during the navigation, and

the electronic control unit is configured to control the vehicle to autonomously navigate in accordance with the trajectory.

13. The vehicle navigation system of claim 12 , wherein the electronic control unit modifies the trust parameter by increasing a trust level when the feedback data indicates a user has increased trust according to the trust model, and modifies the trust parameter by decreasing the trust level when the feedback data indicates the user has decreased trust according to the trust model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2025
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 071832/0410 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2021
From: DAVID, MIKIO; RAFFERTY, JOHN C.
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 056502/0008 →
Continuity (1)
Related Publication 20220388543A1 · Dec 8, 2022
References Cited (21)
US 10083547B1 · Tomatsu · 2018 [cited by applicant]
US 10395433B2 · Tomatsu · 2019 [cited by applicant]
US 20130187771A1 · Rothschild · 2013 [cited by examiner]
US 20170276494A1 · Kusano et al. · 2017 [cited by applicant]
US 20190049957A1 · Healey · 2019 [cited by examiner]
US 20200247429A1 · Tram · 2020 [cited by examiner]
US 20200250969A1 · Wang et al. · 2020 [cited by applicant]
US 20200331459A1 · Szczerba · 2020 [cited by examiner]
US 20200331481A1 · Szczerba · 2020 [cited by examiner]
US 20210078608A1 · Misu · 2021 [cited by examiner]
US 20210276567A1 · Othersen · 2021 [cited by examiner]
US 20220281461A1 · Gentner · 2022 [cited by examiner]
US 20220324490A1 · Akash · 2022 [cited by examiner]
US 20230219586A1 · Giersch · 2023 [cited by examiner]
CN 212125098U · 2020 [cited by applicant]
CN 112455449A · 2021 [cited by applicant]
DE 102017221191A1 · 2019 [cited by applicant]
DE 102018203121A1 · 2019 [cited by applicant]
K. Akash, Wan-Lin Hu, T. Reid and N. Jain, “Dynamic modeling of trust in human-machine interactions,” 2017 American Control Conference (ACC), Seattle, WA, USA, 2017, pp. 1542-1548 (Year: 2017). [cited by examiner]
Augmented Reality Head-Up Displays Point the Way Toward Self-Driving (https://www.forbes.com/sites/dougnewcomb/2015/10/15/augmented-reality-head-up-displays-point-the-way-toward-self-driving/?sh=2998cac27c25) Oct. 15, 2… [cited by applicant]
Here Are the Benefits to Digitally Developing AR HUD (https://www.ansys.com/en-in/blog/digitally-developing-ar-hud) Feb. 14, 2020. [cited by applicant]