IP Library › Granted Patent US 12,646,420
Granted Patent B2
US 12,646,420 · App. 18/232,643 · Granted Jun 2, 2026

Audio cues for driver training

Inventors: Hiroshi Yasuda (San Francisco, CA); Jean Marcel dos Reis Costa (San Jose, CA)
Assignees: Toyota Research Institute, Inc.; Toyota Jidosha Kabushiki Kaisha
G09B19/167G09B5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,646,420
App. No.
18/232,643
Granted
Jun 2, 2026
Kind
B2
Abstract

Systems, methods, and other embodiments described herein relate to training a vehicle driver using audio cues. In one embodiment, a method includes determining a deviation of a vehicle between an actual path of the vehicle and an ideal path. The ideal path defines a position and a velocity of the vehicle to optimize driving time through a current section of a road. The method includes generating an audible cue within the vehicle to indicate to a driver the deviation from the ideal path.

Claims (24)

1 . An audio system comprising:

a processor; and

a memory communicably coupled to the processor and storing instructions that, when executed by the processor, cause the processor to:

determine a deviation of a vehicle between an actual path of the vehicle and an ideal path, wherein the ideal path defines a position and a velocity of the vehicle to optimize driving time through a current section of a road; and

generate an audible cue within the vehicle to indicate to a driver the deviation from the ideal path including selecting the audible cue to mimic a virtual vehicle by one of: i) executing the ideal path using a Doppler effect to convey movement in relation to the vehicle as though the virtual vehicle is emitting the audible cue, ii) driving in proximity to the vehicle to influence the driver to control the vehicle along the ideal path, including approaching from a rear position of the vehicle and accelerating away from the vehicle.

2 . The audio system of claim 1 , wherein the instructions to determine the deviation include instructions to generate the ideal path according to at least a geometry of the road.

3 . The audio system of claim 1 , wherein the actual path indicates a current position of the vehicle on the road and a velocity of the vehicle, and wherein the instructions to determine the deviation include instructions to acquire sensor data about the vehicle in relation to the road and localize the vehicle on the road.

4 . The audio system of claim 1 , wherein the instructions to generate the audible cue include instructions to generate the audible cue by varying a pace of the audible cue according to the deviation.

5 . The audio system of claim 1 , wherein the instructions to generate the audible cue include instructions to generate the audible cue by at least one of modifying a type of sound of the audible cue, modifying an intensity of the audible cue according to the deviation, and varying a number of sounds concurrently playing as part of the audible cue.

6 . The audio system of claim 1 , wherein the road is a racetrack, wherein the instructions to determine the deviation include instructions to determine the position and the velocity of the ideal path at separate points along the racetrack.

7 . A non-transitory computer-readable medium including instructions that, when executed by one or more processors, cause the one or more processors to:

determine a deviation of a vehicle between an actual path of the vehicle and an ideal path, wherein the ideal path defines a position and a velocity of the vehicle to optimize driving time through a current section of a road; and

generate an audible cue within the vehicle to indicate to a driver the deviation from the ideal path including selecting the audible cue to mimic a virtual vehicle by one of: i) executing the ideal path using a Doppler effect to convey movement in relation to the vehicle as though the virtual vehicle is emitting the audible cue, ii) driving in proximity to the vehicle to influence the driver to control the vehicle along the ideal path, including approaching from a rear position of the vehicle and accelerating away from the vehicle.

8 . The non-transitory computer-readable medium of claim 7 ,

wherein the instructions to determine the deviation include instructions to generate the ideal path according to at least a geometry of the road.

9 . The non-transitory computer-readable medium of claim 7 , wherein the actual path indicates a current position of the vehicle on the road and a velocity of the vehicle, and wherein the instructions to determine the deviation include instructions to acquire sensor data about the vehicle in relation to the road and localize the vehicle on the road.

10 . The non-transitory computer-readable medium of claim 7 , wherein the instructions to generate the audible cue include instructions to generate the audible cue by varying a pace of the audible cue according to the deviation.

11 . A method, comprising:

determining a deviation of a vehicle between an actual path of the vehicle and an ideal path, wherein the ideal path defines a position and a velocity of the vehicle to optimize driving time through a current section of a road; and

generating an audible cue within the vehicle to indicate to a driver the deviation from the ideal path including selecting the audible cue to mimic a virtual vehicle by one of: i) executing the ideal path using a Doppler effect to convey movement in relation to the vehicle as though the virtual vehicle is emitting the audible cue, ii) driving in proximity to the vehicle to influence the driver to control the vehicle along the ideal path, including approaching from a rear position of the vehicle and accelerating away from the vehicle.

12 . The method of claim 11 , wherein determining the deviation includes generating the ideal path according to at least a geometry of the road.

13 . The method of claim 11 , wherein the actual path indicates a current position of the vehicle on the road and a velocity of the vehicle, and wherein determining the deviation includes acquiring sensor data about the vehicle in relation to the road and localizing the vehicle on the road.

14 . The method of claim 11 , wherein generating the audible cue includes generating the audible cue by varying a pace of the audible cue according to the deviation.

15 . The method of claim 11 , wherein generating the audible cue includes generating the audible cue by at least one of: modifying a type of sound of the audible cue, modifying an intensity of the audible cue according to the deviation, and varying a number of sounds concurrently playing as part of the audible cue.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2026
From: TOYOTA RESEARCH INSTITUTE, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 075016/0131 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2023
From: YASUDA, HIROSHI; DOS REIS COSTA, JEAN MARCEL
To: TOYOTA RESEARCH INSTITUTE, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 064577/0760 →
Continuity (1)
Related Publication 20250054410A1 · Feb 13, 2025
References Cited (19)
US 5921780A · Myers · 1999 [cited by applicant]
US 6227862B1 · Harkness · 2001 [cited by applicant]
US 7062895B1 · Sperie · 2006 [cited by applicant]
US 7892078B2 · Tipping et al. · 2011 [cited by applicant]
US 8393944B2 · Tipping et al. · 2013 [cited by applicant]
US 9533619B2 · Minikey, Jr. et al. · 2017 [cited by applicant]
US 10713543B1 · Skuin et al. · 2020 [cited by applicant]
US 10786033B2 · Brown et al. · 2020 [cited by applicant]
US 11363402B2 · Claar · 2022 [cited by applicant]
US 11532172B2 · Skuin et al. · 2022 [cited by applicant]
US 20140244265A1 · Ashbrook · 2014 [cited by examiner]
US 20150258996A1 · Victor et al. · 2015 [cited by applicant]
US 20200184849A1 · Spence et al. · 2020 [cited by applicant]
US 20200207272A1 · Matsuo et al. · 2020 [cited by applicant]
US 20210192975A1 · Spence · 2021 [cited by examiner]
US 20210237760A1 · Tucker · 2021 [cited by applicant]
US 20220148317A1 · Herrmann et al. · 2022 [cited by applicant]
US 20220189310A1 · Kendall et al. · 2022 [cited by applicant]
US 20230394989A1 · Hill · 2023 [cited by examiner]