IP Library Granted Patent US 12,475,611
Granted Patent B2
US 12,475,611 · App. 18/526,511 · Granted Nov 18, 2025

Systems and methods for superimposing augmented reality vehicle lights in a vehicle display

Inventors: Benjamin Piya Austin (Saline, MI); Rohit Gupta (Santa Clara, CA); William Patrick Garrett (Plymouth, MI)
Assignees: Toyota Motor Engineering & Manufacturing North America, Inc.; Toyota Jidosha Kabushiki Kaisha
G06T11/00B60R1/24B60R2300/205B60R2300/605G06V20/597
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,611
App. No.
18/526,511
Granted
Nov 18, 2025
Kind
B2
Abstract

Systems, methods, and other embodiments described herein relate to superimposing computer-generated exterior vehicle lights over asynchronous real-world exterior vehicle lights to reduce a sensory overload of a vehicle driver. In one embodiment, a method includes assessing a sensory environment of a vehicle driver. The method also includes determining that the vehicle driver is in a sensory-overloaded state based on 1) a characteristic of the sensory environment, 2) physiological sensor data for the vehicle driver, and 3) driving behavior sensor data. The method also includes superimposing an augmented reality (AR) overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights viewed through an AR display device of the vehicle based on a determination that the vehicle driver is in the sensory-overloaded state.

Claims (63)

1 . A system, comprising:

a processor; and

a memory storing machine-readable instructions that, when executed by the processor, cause the processor to:

assess a sensory environment of a vehicle driver;

determine that the vehicle driver is in a sensory-overloaded state based on:

a characteristic of the sensory environment;

physiological sensor data for the vehicle driver; and

driving behavior sensor data; and

superimpose an augmented reality (AR) overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights viewed through an AR display device of a vehicle based on a determination that the vehicle driver is in the sensory-overloaded state.

2 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the asynchronous real-world exterior vehicle lights comprises machine-readable instructions that, when executed by the processor, cause the processor to:

superimpose a digital vehicle image of a neighboring vehicle over the neighboring vehicle viewed through the AR display device, wherein the digital vehicle image conceals the asynchronous real-world exterior vehicle lights of the neighboring vehicle; and

superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the digital vehicle image.

3 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to synchronize at least one of a turn signal visual indicator or a turn signal audio indicator with the computer-generated synchronized exterior vehicle lights.

4 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to disable at least one of a turn signal visual indicator or a turn signal audio indicator responsive to a generation of the computer-generated synchronized exterior vehicle lights.

5 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to synchronize a turn signal lamp of the vehicle with the computer-generated synchronized exterior vehicle lights.

6 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to assess the sensory environment of the vehicle driver comprises a machine-readable instruction that, when executed by the processor, causes the processor to:

assess an external sensory environment of the vehicle driver; and

assess an in-cabin sensory environment of the vehicle driver.

7 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-readable instruction that, when executed by the processor, causes the processor to assess at least one of biometric data for the vehicle driver or images of the vehicle driver to determine that the vehicle driver is in the sensory-overloaded state.

8 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-readable instruction that, when executed by the processor, causes the processor to assess sensor data indicative of a driver interaction with a vehicle system.

9 . The system of claim 1 , wherein the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-readable instruction that, when executed by the processor, causes the processor to assess environment sensor data indicative of a surrounding environment of the vehicle.

10 . The system of claim 1 , wherein:

the machine-readable instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises a machine-learning instruction that, when executed by the processor, causes the processor to compare the physiological sensor data and the driving behavior sensor data to baseline sensor data; and

the baseline sensor data comprises at least one of:

historical data for the vehicle driver; or

historical data for an additional vehicle driver.

11 . The system of claim 1 , wherein the machine-readable instructions further comprise a machine-readable instruction that, when executed by the processor, causes the processor to produce a notification of a sensory-overloaded vehicle driver to at least one of:

another human vehicle operator;

an autonomous vehicle system; or

an infrastructure element.

12 . A non-transitory machine-readable medium comprising instructions that, when executed by a processor, cause the processor to:

assess a sensory environment of a vehicle driver;

determine that the vehicle driver is in a sensory-overloaded state based on:

a characteristic of the sensory environment;

physiological sensor data for the vehicle driver; and

driving behavior sensor data; and

superimpose an augmented reality (AR) overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights viewed through an AR display device of a vehicle based on a determination that the vehicle driver is in the sensory-overloaded state.

13 . The non-transitory machine-readable medium of claim 12 , wherein the instruction that, when executed by the processor, causes the processor to superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the asynchronous real-world exterior vehicle lights comprises instructions that, when executed by the processor, cause the processor to:

superimpose a digital vehicle image of a neighboring vehicle over the neighboring vehicle viewed through the AR display device, wherein the digital vehicle image conceals the asynchronous real-world exterior vehicle lights of the neighboring vehicle; and

superimpose the AR overlay of computer-generated synchronized exterior vehicle lights over the digital vehicle image.

14 . The non-transitory machine-readable medium of claim 12 , wherein the instructions further comprise an instruction that, when executed by the processor, causes the processor to synchronize at least one of a turn signal visual indicator or a turn signal audio indicator with the computer-generated synchronized exterior vehicle lights.

15 . The non-transitory machine-readable medium of claim 12 , wherein:

the instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises an instruction that, when executed by the processor, causes the processor to compare the physiological sensor data and the driving behavior sensor data to baseline sensor data; and

the baseline sensor data comprises at least one of:

historical data for the vehicle driver; or

historical data for an additional vehicle driver.

16 . The non-transitory machine-readable medium of claim 12 , wherein the instruction that, when executed by the processor, causes the processor to determine that the vehicle driver is in the sensory-overloaded state comprises at least one of:

an instruction that, when executed by the processor, causes the processor to assess sensor data indicative of a driver interaction with a vehicle system; or

an instruction that, when executed by the processor, causes the processor to assess environment sensor data indicative of a surrounding environment of the vehicle.

17 . A method, comprising:

assessing a sensory environment of a vehicle driver;

determining that the vehicle driver is in a sensory-overloaded state based on:

a characteristic of the sensory environment;

physiological sensor data for the vehicle driver; and

driving behavior sensor data; and

superimposing an augmented reality (AR) overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights viewed through an AR display device of a vehicle based on a determination that the vehicle driver is in the sensory-overloaded state.

18 . The method of claim 17 , wherein superimposing the AR overlay of computer-generated synchronized exterior vehicle lights over asynchronous real-world exterior vehicle lights comprises:

superimposing a digital vehicle image of a neighboring vehicle over the neighboring vehicle viewed through the AR display device, wherein the digital vehicle image conceals the asynchronous real-world exterior vehicle lights of the neighboring vehicle; and

superimposing the AR overlay of computer-generated synchronized exterior vehicle lights over the digital vehicle image.

19 . The method of claim 17 , wherein synchronizing at least one of a turn signal visual indicator or a turn signal audio indicator with the computer-generated synchronized exterior vehicle lights.

20 . The method of claim 17 , wherein determining that the vehicle driver is in the sensory-overloaded state comprises at least one of:

assessing sensor data indicative of a driver interaction with a vehicle system; or

assessing environment sensor data indicative of a surrounding environment of the vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2026
From: TOYOTA JIDOSHA KABUSHIKI KAISHA
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 073670/0071 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2023
From: AUSTIN, BENJAMIN PIYA; GUPTA, ROHIT; GARRETT, WILLIAM PATRICK
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 065781/0571 →
Continuity (1)
Related Publication 20250182339A1 · Jun 5, 2025
References Cited (48)
US 9013293B2 · Pimentel · 2015 [cited by applicant]
US 9047703B2 · Beckwith et al. · 2015 [cited by applicant]
US 9662015B2 · Proud et al. · 2017 [cited by applicant]
US 9751534B2 · Fung et al. · 2017 [cited by applicant]
US 9881503B1 · Goldman-Shenhar et al. · 2018 [cited by applicant]
US 10046618B2 · Kirsch et al. · 2018 [cited by applicant]
US 10235882B1 · Aoude et al. · 2019 [cited by applicant]
US 10547988B2 · Oh et al. · 2020 [cited by applicant]
US 10777083B2 · Rau et al. · 2020 [cited by applicant]
US 10850746B2 · Marti et al. · 2020 [cited by applicant]
US 10885785B2 · Xu et al. · 2021 [cited by applicant]
US 10911915B2 · Woo et al. · 2021 [cited by applicant]
US 11021103B2 · Haar et al. · 2021 [cited by applicant]
US 11172492B2 · Zhang et al. · 2021 [cited by applicant]
US 11260791B2 · Leaming et al. · 2022 [cited by applicant]
US 11533586B2 · Balasubramanian et al. · 2022 [cited by applicant]
US 11557234B1 · Eudy · 2023 [cited by examiner]
US 11571969B2 · Domeyer et al. · 2023 [cited by applicant]
US 11699250B1 · McCann · 2023 [cited by examiner]
US 12251994B1 · Balasubramanyan · 2025 [cited by examiner]
US 20050024196A1 · Moore · 2005 [cited by applicant]
US 20050117364A1 · Rennick et al. · 2005 [cited by applicant]
US 20120212320A1 · Oberholtzer · 2012 [cited by applicant]
US 20150077826A1 · Beckman · 2015 [cited by examiner]
US 20170315825A1 · Gordon et al. · 2017 [cited by applicant]
US 20180024359A1 · Yoneyama · 2018 [cited by examiner]
US 20180043756A1 · Kaphengst · 2018 [cited by examiner]
US 20180314066A1 · Bell · 2018 [cited by examiner]
US 20200202535A1 · Lee · 2020 [cited by examiner]
US 20210046822A1 · Kleen et al. · 2021 [cited by applicant]
US 20210287551A1 · Pedersen · 2021 [cited by applicant]
US 20210403039A1 · Horigome et al. · 2021 [cited by applicant]
US 20220256255A1 · Dixit · 2022 [cited by applicant]
US 20220363264A1 · Bilal et al. · 2022 [cited by applicant]
US 20230056390A1 · Balasubramanian et al. · 2023 [cited by applicant]
US 20230186983A1 · Grover et al. · 2023 [cited by applicant]
US 20230194899A1 · Su et al. · 2023 [cited by applicant]
US 20240027760A1 · Beckman · 2024 [cited by examiner]
CN 110466529A · 2019 [cited by applicant]
CN 112277789A · 2021 [cited by applicant]
CN 112566340A · 2021 [cited by applicant]
CN 113771745A · 2021 [cited by applicant]
CN 114132328A · 2022 [cited by applicant]
CN 115363529A · 2022 [cited by applicant]
DE 102013002875A1 · 2014 [cited by applicant]
DE 102017219535A1 · 2019 [cited by applicant]
DE 102021105077A1 · 2022 [cited by applicant]
Jasoren. “How AR works and what it is—Jasoren”, Retrieved from the Internet: <https://jasoren.com/what-augmented-reality-is-and-how-it-works-the-ultimate-tutorial/>, Retrieved Dec. 1, 2023. [cited by applicant]
Cited By (1)
US 12,722,598