IP Library Granted Patent US 12,601,608
Granted Patent B2
US 12,601,608 · App. 18/884,553 · Granted Apr 14, 2026

Route-based activity recommendation using artificial intelligence

Inventors: Imad Zahid (Carrollton, TX); Joshua C. Batie (Frisco, TX)
Assignees: TOYOTA MOTOR NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
G01C21/3679B60K35/28B60K2360/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,601,608
App. No.
18/884,553
Granted
Apr 14, 2026
Kind
B2
Abstract

An example operation includes one or more of storing preferences of an occupant of a vehicle within a database, receiving data from a sign that is within a field of view of the occupant as the vehicle is travelling along a route that includes the sign, generating display content for the sign which includes custom data integrated with the data based on the preferences of the occupant, and displaying the display content on a display device within the vehicle, wherein the displaying comprises aligning the display content with the sign in the field of view of the occupant.

Claims (31)

1 . A method comprising:

storing preferences of an occupant of a vehicle within a database;

receiving data from a sign that is within a field of view of the occupant as the vehicle is travelling along a route that includes the sign, wherein a wireless communication from the sign which comprises sign content to be displayed is received;

generating display content for the sign which includes custom data integrated with the preferences of the occupant, wherein the sign content and the custom data are combined to generate the display content; and

displaying the display content on a display device within the vehicle, wherein the displaying comprises aligning the display content with the sign in the field of view of the occupant.

2 . The method of claim 1 , comprising capturing sensor data of the occupant while viewing the display content and executing an artificial intelligence (AI) model on the sensor data to determine a reaction of the occupant to the display content.

3 . The method of claim 2 , comprising generating additional content based on the reaction of the occupant, detecting a second sign that is within the field of view of the occupant and displaying the additional content on the display device of the vehicle, wherein the displaying of the additional content comprises aligning the additional content with the second sign in the field of view of the occupant.

4 . The method of claim 1 , comprising vibrating at least one of a seat within the vehicle and a steering wheel of the vehicle when the display content is displayed on the display device of the vehicle.

5 . The method of claim 1 , comprising detecting a touch on the display device while displaying the display content on the display device, and in response, generating routing instructions to a location associated with the display content and displaying the routing instructions via a navigation system of the vehicle.

6 . The method of claim 1 , wherein the generating comprises detecting that the sign is within a predetermined distance from the vehicle and the displaying comprises displaying the display content while the sign is within the predetermined distance from the vehicle.

7 . A system, comprising:

a memory; and

at least one processor communicably coupled to the memory, the at least one processor configured to:

store preferences of an occupant of a vehicle within a database,

receive data from a sign that is within a field of view of the occupant as the vehicle travels along a route that includes the sign, wherein a wireless communication from the sign which comprises sign content to be displayed is received;

generate display content for the sign which includes custom data integrated with the preferences of the occupant, wherein the sign content and the custom data are combined to generate the display content; and

display the display content on a display device within the vehicle, wherein the at least one processor aligns the display content with the sign in the field of view of the occupant.

8 . The system of claim 7 , wherein the at least one processor is further configured to capture sensor data of the occupant while the display content is being viewed and execute an artificial intelligence (AI) model on the sensor data to determine a reaction of the occupant to the display content.

9 . The system of claim 8 , wherein the at least one processor is further configured to generate additional content based on the reaction of the occupant, detect a second sign that is within the field of view of the occupant, and display the additional content on the display device of the vehicle, wherein the display of the additional content is aligned with the second sign in the field of view of the occupant.

10 . The system of claim 7 , wherein the at least one processor is further configured to vibrate at least one of a seat within the vehicle and a steering wheel of the vehicle when the display content is displayed on the display device of the vehicle.

11 . The system of claim 7 , wherein the at least one processor is further configured to detect a touch on the display device while the display content is being displayed on the display device, and in response, generate routing instructions to a location associated with the display content and display the routing instructions via a navigation system of the vehicle.

12 . The system of claim 7 , wherein the at least one processor is configured to detect that the sign is within a predetermined distance from the vehicle and the display the display content while the sign is within the predetermined distance from the vehicle.

13 . A non-transitory computer-readable storage medium comprising instructions, that when read by a processor, cause the processor to perform:

storing preferences of an occupant of a vehicle within a database;

receiving data from a sign that is within a field of view of the occupant as the vehicle is travelling along a route that includes the sign, wherein a wireless communication from the sign which comprises sign content to be displayed is received;

generating display content for the sign which includes custom data integrated with the preferences of the occupant, wherein the sign content and the custom data are combined to generate the display content; and

displaying the display content on a display device within the vehicle, wherein the displaying comprises aligning the display content with the sign in the field of view of the occupant.

14 . The non-transitory computer-readable storage medium of claim 13 , wherein the processor is further configured to perform capturing sensor data of the occupant while viewing the display content and executing an artificial intelligence (AI) model on the sensor data to determine a reaction of the occupant to the display content.

15 . The non-transitory computer-readable storage medium of claim 14 , wherein the processor is further configured to perform generating additional content based on the reaction of the occupant, detecting a second sign that is within the field of view of the occupant and displaying the additional content on the display device of the vehicle, wherein the displaying of the additional content comprises aligning the additional content with the second sign in the field of view of the occupant.

16 . The non-transitory computer-readable storage medium of claim 13 , wherein the processor is further configured to perform vibrating at least one of a seat within the vehicle and a steering wheel of the vehicle when the display content is displayed on the display device of the vehicle.

17 . The non-transitory computer-readable storage medium of claim 13 , wherein the processor is further configured to perform detecting a touch on the display device while displaying the display content on the display device, and in response, generating routing instructions to a location associated with the display content and displaying the routing instructions via a navigation system of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2024
From: ZAHID, IMAD; BATIE, JOSHUA C.
To: TOYOTA MOTOR NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 068783/0668 →
Continuity (1)
Related Publication 20260079023A1 · Mar 19, 2026
References Cited (119)
US 6680675B1 · Suzuki · 2004 [cited by applicant]
US 9945679B2 · Bender et al. · 2018 [cited by applicant]
US 10049389B2 · Rider et al. · 2018 [cited by applicant]
US 10166991B1 · Bai et al. · 2019 [cited by applicant]
US 10180333B2 · Jackson et al. · 2019 [cited by applicant]
US 10207716B2 · Liu · 2019 [cited by applicant]
US 10358057B2 · Breed · 2019 [cited by applicant]
US 10525845B2 · Pursifull et al. · 2020 [cited by applicant]
US 10528833B1 · Bhatnagar · 2020 [cited by applicant]
US 10650918B2 · Bastide et al. · 2020 [cited by applicant]
US 10663309B2 · Lin et al. · 2020 [cited by applicant]
US 10801849B2 · Gusikhin · 2020 [cited by applicant]
US 10893010B1 · Argenti et al. · 2021 [cited by applicant]
US 10906554B2 · Smid et al. · 2021 [cited by applicant]
US 10955252B2 · Duale et al. · 2021 [cited by applicant]
US 10957203B1 · Chan et al. · 2021 [cited by applicant]
US 11107281B2 · Hermina Martinez et al. · 2021 [cited by applicant]
US 11155167B2 · Kuehne · 2021 [cited by applicant]
US 11263653B1 · Sumien et al. · 2022 [cited by applicant]
US 11318952B2 · Hotson et al. · 2022 [cited by applicant]
US 11359926B2 · Galan-Oliveras et al. · 2022 [cited by applicant]
US 11359928B2 · Ichinokawa · 2022 [cited by applicant]
US 11371861B2 · Moore et al. · 2022 [cited by applicant]
US 11519746B2 · Müller · 2022 [cited by examiner]
US 11753019B2 · Samarthyam et al. · 2023 [cited by applicant]
US 11774252B2 · Glasgow et al. · 2023 [cited by applicant]
US 11775870B2 · Zhou et al. · 2023 [cited by applicant]
US 11850967B1 · Brannan · 2023 [cited by applicant]
US 11951979B1 · Newman et al. · 2024 [cited by applicant]
US 11978129B2 · Cella · 2024 [cited by applicant]
US 11988741B2 · Somanath et al. · 2024 [cited by applicant]
US 20110238289A1 · Lehmann et al. · 2011 [cited by applicant]
US 20130030645A1 · Divine et al. · 2013 [cited by applicant]
US 20150006278A1 · Di Censo et al. · 2015 [cited by applicant]
US 20170184411A1 · Glasgow et al. · 2017 [cited by applicant]
US 20170370732A1 · Bender et al. · 2017 [cited by applicant]
US 20170371608A1 · Wasserman · 2017 [cited by examiner]
US 20190043088A1 · Garcia · 2019 [cited by examiner]
US 20190122058A1 · Saeki · 2019 [cited by examiner]
US 20190186939A1 · Cox et al. · 2019 [cited by applicant]
US 20190197330A1 · Mahmoud et al. · 2019 [cited by applicant]
US 20190219417A1 · Quint · 2019 [cited by applicant]
US 20190332902A1 · Gallagher et al. · 2019 [cited by applicant]
US 20200116520A1 · Moore · 2020 [cited by examiner]
US 20200124426A1 · Beaurepaire et al. · 2020 [cited by applicant]
US 20200232807A1 · Müller · 2020 [cited by examiner]
US 20200286391A1 · Beaurepaire et al. · 2020 [cited by applicant]
US 20200369271A1 · Jang et al. · 2020 [cited by applicant]
US 20210043301A1 · Goel et al. · 2021 [cited by applicant]
US 20210293565A1 · Reed · 2021 [cited by applicant]
US 20210302185A1 · Zhou et al. · 2021 [cited by applicant]
US 20210318685A1 · Jenkins et al. · 2021 [cited by applicant]
US 20210389147A1 · Kim · 2021 [cited by applicant]
US 20220011132A1 · Jia et al. · 2022 [cited by applicant]
US 20220018672A1 · Woll et al. · 2022 [cited by applicant]
US 20220074758A1 · Sameer · 2022 [cited by applicant]
US 20220136839A1 · Quint et al. · 2022 [cited by applicant]
US 20220155093A1 · Fear · 2022 [cited by examiner]
US 20220169141A1 · Hou et al. · 2022 [cited by applicant]
US 20220176842A1 · Cun et al. · 2022 [cited by applicant]
US 20220252415A1 · Meroux et al. · 2022 [cited by applicant]
US 20220327925A1 · Jackson et al. · 2022 [cited by applicant]
US 20220334247A1 · Chen et al. · 2022 [cited by applicant]
US 20220344957A1 · Fergadiotou et al. · 2022 [cited by applicant]
US 20220355696A1 · Ahtikari · 2022 [cited by applicant]
US 20230040465A1 · Klein et al. · 2023 [cited by applicant]
US 20230058508A1 · Bush et al. · 2023 [cited by applicant]
US 20230128979A1 · Kinsey et al. · 2023 [cited by applicant]
US 20230147000A1 · Heiden et al. · 2023 [cited by applicant]
US 20230171123A1 · You et al. · 2023 [cited by applicant]
US 20230260005A1 · Gunapal et al. · 2023 [cited by applicant]
US 20230332911A1 · Nayak et al. · 2023 [cited by applicant]
US 20230341236A1 · Klein et al. · 2023 [cited by applicant]
US 20230341535A1 · Zhang et al. · 2023 [cited by applicant]
US 20230373335A1 · Brannan · 2023 [cited by applicant]
US 20230393867A1 · Penilla · 2023 [cited by examiner]
US 20230401952A1 · Beaurepaire et al. · 2023 [cited by applicant]
US 20240062555A1 · Xu et al. · 2024 [cited by applicant]
US 20240067216A1 · Gokhale et al. · 2024 [cited by applicant]
US 20240124023A1 · Kumar et al. · 2024 [cited by applicant]
US 20240132060A1 · Newman et al. · 2024 [cited by applicant]
US 20240142969A1 · Cella · 2024 [cited by applicant]
US 20240149671A1 · Choi · 2024 [cited by applicant]
US 20240152873A1 · Yanai · 2024 [cited by applicant]
US 20240174220A1 · Newman et al. · 2024 [cited by applicant]
US 20250289306A1 · Stout · 2025 [cited by examiner]
CN 106985780A · 2017 [cited by applicant]
CN 108347371A · 2018 [cited by applicant]
CN 110382285A · 2019 [cited by applicant]
CN 110758168A · 2020 [cited by applicant]
CN 114545890A · 2022 [cited by applicant]
CN 114662730A · 2022 [cited by applicant]
CN 115731697A · 2023 [cited by applicant]
CN 115892044A · 2023 [cited by applicant]
CN 117916119A · 2024 [cited by applicant]
CN 118609372A · 2024 [cited by applicant]
CN 119091332A · 2024 [cited by applicant]
DE 102022112325A1 · 2023 [cited by applicant]
EP 3822939A1 · 2021 [cited by applicant]
EP 3926588A1 · 2021 [cited by applicant]
JP 2017134251A · 2017 [cited by applicant]
KR 20200128282A · 2020 [cited by applicant]
KR 20210074366A · 2021 [cited by applicant]
KR 102357898B1 · 2022 [cited by applicant]
TW I757024B · 2022 [cited by applicant]
WO 2020173584A1 · 2020 [cited by applicant]
WO 2021191685A2 · 2021 [cited by applicant]
Pitchai et al., “Traffic Sign Recognition using Convolutional Neural Network”, IEEE Xplore, DOI: 10.1109/ICAECC59324.2023.10560073 (Year: 2023). [cited by examiner]
Kerr, “Waymo's robotaxi service set to expand into Los Angeles,” npr, Mar. 14, 2024. [cited by applicant]
Khattak et al., “Quantifying automated vehicle benefits in reducing driving stress: a simulation experiment approach”, frontiers, Aug. 14, 2023. [cited by applicant]
Morris, “Uptime requirements may not cure the epidemic of unreliable public EV charging,” Charged EV Fleet & Infrastructure News, Dec. 20, 2023. [cited by applicant]
SOHAILKHAN2K22, “Benefits of Electric Cars for the Environment,” Eco Vehicles, Jan. 30, 2024. [cited by applicant]
Stjohn, “What's behind the epidemic of unreliable EV chargers?” Canary Media, clean energy journalism for a cooler tomorrow, Dec. 12, 2023. [cited by applicant]
Unknown, “Model 3 Support Videos”, https://www.tesla.com/de_LU/support/model-3-videos, last downloaded Jun. 15, 2024. [cited by applicant]
Unknown, “Tesla's new Autopilot is amazing—but please keep your eyes on the road”, CNN Business, https://edition.cnn.com/2019/04/22/success/tesla-navigate-on-autopilot/index.html, last downloaded Jun. 15, 2024. [cited by applicant]
Unknown, “Toyota Safety Sense 3.0”, Overview, Toyota, Jan. 18, 2023. [cited by applicant]
Unknown, “Toyota Safety SenseTM”, Active Safety Technology, https://www.toyota.com/safety-sense/, downloaded Jun. 4, 2024. [cited by applicant]
Unknown, “What Does Ad Personalization Mean for Publishers?” jeeng.com, May 3, 2022. [cited by applicant]
Walson, “Autonomous Vehicles Break Into Tours and Attractions”, Phocus Wire, Feb. 6, 2023. [cited by applicant]