IP Library Granted Patent US 11,605,306
Granted Patent B2
US 11,605,306 · App. 16/916,440 · Granted Mar 14, 2023

Systems and methods for driver training during operation of automated vehicle systems

Inventors: Hiromitsu Urano (Numazu, JP); Kentaro Ichikawa (Sunto-gun, JP); Junya Ueno (Susono, JP)
Assignee: Toyota Research Institute, Inc.
G09B9/042G09B9/052G09B19/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,605,306
App. No.
16/916,440
Granted
Mar 14, 2023
Kind
B2
Abstract

System, methods, and other embodiments described herein relate to a training system to train a driver about occurrences of anomalous driving events of automated vehicle systems. In one embodiment, a method includes determining, upon receiving a selection of a vehicle behavior from one or more anomalous driving events and a detected state change signal, whether the vehicle behavior affects one or more entities. The method includes assessing a state of the one or more entities to simulate the vehicle behavior according to a safety standard. The method includes triggering simulation of the vehicle behavior if the state satisfies a threshold. The method includes simulating the vehicle behavior by at least controlling the vehicle to simulate the vehicle behavior during automated driving of the vehicle.

Claims (41)

1. A training system for improving training of a driver of a vehicle about occurrences of anomalous driving events, comprising:

one or more processors;

a memory communicably coupled to the one or more processors and storing:

a determination module including first instructions that when executed by the one or more processors cause the one or more processors to:

determine, upon receiving a vehicle behavior from one or more anomalous driving events and a detected state change signal, whether the vehicle behavior affects one or more entities;

assess a state of the one or more entities to simulate the vehicle behavior according to a safety standard; and

trigger simulation of the vehicle behavior if the state satisfies a threshold; and

an actuator module including second instructions that when executed by the one or more processors cause the one or more processors to simulate the vehicle behavior by at least controlling an actuator to steer the vehicle to perform the vehicle behavior during automated driving of the vehicle.

2. The training system of claim 1 , wherein the simulation of the vehicle behavior further includes braking the vehicle when the vehicle behavior is a sensor module that is unable to detect objects or colors in a driving environment near the vehicle, and

wherein a navigation system module includes third instructions that when executed by the one or more processors cause the one or more processors to prompt the driver that the vehicle is unable to detect the objects or the colors in the driving environment.

3. The training system of claim 1 , wherein the simulation of the vehicle behavior further includes braking the vehicle when the vehicle behavior is an automated driving module identifying vegetation near the vehicle as a person, and

wherein a navigation system module includes third instructions that when executed by the one or more processors cause the one or more processors to prompt the driver that the person is proximate to the vehicle and that the braking was needed to avoid a collision.

4. The training system of claim 1 , wherein the simulation of the vehicle behavior further includes to maintain speed or delay braking of the vehicle when the vehicle behavior is failing to detect another vehicle, failing to detect velocity of the another vehicle, or failing to detect a traffic light state, and

wherein a navigation system module includes third instructions that when executed by the one or more processors cause the one or more processors to prompt the driver that a driving path is clear, driving will continue, or braking is unnecessary.

5. The training system of claim 1 , wherein the simulation of the vehicle behavior terminates when one of the driver takes over driving or the state no longer satisfies the threshold.

6. The training system of claim 1 , wherein the one or more entities is one of the driver and a passenger.

7. The training system of claim 1 , wherein the one or more entities is a pedestrian, another vehicle, or an object proximate to the vehicle.

8. The training system of claim 1 , wherein the one or more anomalous driving events are atypical driving environment scenarios.

9. A non-transitory computer-readable medium for improving training of a driver of a vehicle about occurrences of anomalous driving events and including instructions that when executed by one or more processors cause the one or more processors to:

determine, upon receiving a vehicle behavior from one or more anomalous driving events of a vehicle and a detected state change signal, whether the vehicle behavior affects one or more entities;

assess a state of the one or more entities to simulate the vehicle behavior according to a safety standard;

trigger simulation of the vehicle behavior if the state satisfies a threshold; and

simulate the vehicle behavior by at least controlling an actuator to steer the vehicle to perform the vehicle behavior during automated driving of the vehicle.

10. The non-transitory computer-readable medium of claim 9 , wherein the instructions to simulate the vehicle behavior further include additional instructions to brake the vehicle when the vehicle behavior is a sensor module that is unable to detect objects or colors in a driving environment near the vehicle and to prompt the driver that the vehicle is unable to detect the objects or the colors in the driving environment.

11. The non-transitory computer-readable medium of claim 9 , wherein the instructions to simulate the vehicle behavior further include additional instructions to brake the vehicle when the vehicle behavior is an automated driving module identifying vegetation near the vehicle as a person, and instructions to prompt the driver that the person is proximate to the vehicle and that the braking was needed to avoid a collision.

12. The non-transitory computer-readable medium of claim 9 , wherein the instructions to simulate the vehicle behavior further include additional instructions to maintain speed or delaying braking of the vehicle when the vehicle behavior is failing to detect another vehicle, failing to detect velocity of the another vehicle, or failing to detect a traffic light state and to prompt the driver that a driving path is clear, driving will continue, or braking is unnecessary.

13. The non-transitory computer-readable medium of claim 9 , wherein the instructions to simulate the vehicle behavior further include additional instructions to terminate the simulation by detection of one of the driver taking over driving or detecting when the state no longer satisfies the threshold.

14. A method for improving training of a driver of a vehicle about occurrences of anomalous driving events, the method comprising:

determining, upon receiving a vehicle behavior from one or more anomalous driving events and a detected state change signal, whether the vehicle behavior affects one or more entities;

assessing a state of the one or more entities to simulate the vehicle behavior according to a safety standard;

triggering simulation of the vehicle behavior if the state satisfies a threshold; and

simulating the vehicle behavior by at least controlling an actuator to steer the vehicle to perform the vehicle behavior during automated driving of the vehicle.

15. The method of claim 14 , wherein simulating the vehicle behavior further includes braking the vehicle when the vehicle behavior is a sensor module that is unable to detect objects or colors in a driving environment near the vehicle, and

prompting the driver that the vehicle is unable to detect the objects or the colors in the driving environment.

16. The method of claim 14 , wherein simulating the vehicle behavior further includes braking the vehicle when the vehicle behavior is identifying vegetation near the vehicle as a person, and

prompting the driver that the person is proximate to the vehicle and that the braking was needed to avoid a collision.

17. The method of claim 14 , wherein simulating the vehicle behavior further includes maintaining speed or delaying braking of the vehicle when the vehicle behavior is failing to detect another vehicle, failing to detect velocity of the another vehicle, or failing to detect a traffic light state, and

prompting the driver that a driving path is clear, driving will continue, or braking is unnecessary.

18. The method of claim 14 , wherein simulating the vehicle behavior further includes terminating the simulation by detecting one of the driver taking over driving or detecting when the state no longer satisfies the threshold.

19. The method of claim 14 , wherein the one or more entities is one of the driver and a passenger.

20. The method of claim 14 , wherein the one or more entities is a pedestrian, another vehicle, or an object proximate to the vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2023
From: TOYOTA RESEARCH INSTITUTE, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 063130/0244 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2020
From: URANO, HIROMITSU; ICHIKAWA, KENTARO; UENO, JUNYA
To: TOYOTA RESEARCH INSTITUTE, INC.
Reel/Frame 053117/0769 →
Continuity (1)
Related Publication 20210407313A1 · Dec 30, 2021