IP Library Granted Patent US 12,462,194
Granted Patent B2
US 12,462,194 · App. 18/377,273 · Granted Nov 4, 2025

Vehicle occupant behavior monitoring application

Inventors: Imad Zahid (Carrollton, TX); Sumit K. Jha (Frisco, TX); Anil Nagpal (Plano, TX); Joshua C. Batie (Frisco, TX); Nikhil Rajendra (Dallas, TX)
Assignees: TOYOTA MOTOR NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
G06N20/00B60R11/04B60R21/01532B60W40/08B60W50/0097B60W50/14B60W60/0015G01C21/28G01C21/3841G01C21/3874G01C21/3896G06V20/597G08G1/0112G08G1/0116G08G1/0125G08G1/09626G08G1/096716G08G1/096783H04L1/1809H04W64/003H04W76/15B60W2050/009B60W2050/143B60W2050/146B60W2540/043B60W2540/215B60W2540/221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,194
App. No.
18/377,273
Granted
Nov 4, 2025
Kind
B2
Abstract

An example operation includes one or more of monitoring, via a vehicle, a behavior of an occupant of the vehicle, responsive to the behavior being above a threshold, generating via an application of the vehicle, a first suggested action intended for the occupant based on the behavior and an amount the behavior is above the threshold, monitoring, by the vehicle, whether the first suggested action is being performed by the occupant, determining an alternate action is being performed by the occupant, generating a second suggested action based on the alternate action and the first suggested action, and providing a value to an occupant device associated with the occupant responsive to the second action being detected by the transport.

Claims (58)

1 . A method comprising:

monitoring, by a vehicle, a behavior of an occupant of the vehicle;

responsive to the behavior exceeding a threshold, suggesting a first action for the occupant by the vehicle, based on the behavior and an amount the behavior exceeds the threshold;

in response to determining that the occupant is performing an alternate action, which differs from the first action, suggesting a second action by the vehicle for the occupant, based on the alternate action and the first action; and

providing, by the vehicle, a value to a device associated with the occupant responsive to the vehicle detecting a performance of one or more of the first action or the second action by the occupant.

2 . The method of claim 1 , wherein the behavior comprises one or more of:

a vehicle operation action or a limited time-related action.

3 . The method of claim 1 , wherein the first action comprises:

a notification to the occupant to modify one or more of a current or a future vehicle operation action.

4 . The method of claim 1 , comprising:

identifying whether the occupant has performed the first action based on sensor data generated by a movement of the occupant.

5 . The method of claim 1 , comprising:

retrieving a profile associated with the occupant from the device; and

determining a type of value to apply to subsequent occupant compliance actions based on the profile.

6 . The method of claim 5 , comprising:

determining one or more of the first action or the second action have been performed by the occupant; and

providing the value of the type of value to the profile.

7 . The method of claim 5 , comprising:

determining that only the second action has been performed by the occupant; and

providing a partial value of the type of value to the profile.

8 . A vehicle comprising:

a processor that executes instructions stored in a memory to configure the processor to:

monitor a behavior of an occupant of the vehicle;

responsive to the behavior exceeding a threshold, suggest a first action for the occupant, based on the behavior and an amount the behavior exceeds the threshold;

in response to a determination that the occupant is performing an alternate action, which differs from the first action, suggest a second action for the occupant, based on the alternate action and the first action; and

provide a value to a device associated with the occupant responsive to the vehicle detecting a performance of one or more of the first action or the second action by the occupant.

9 . The system of claim 8 , wherein the behavior comprises one or more of:

a vehicle operation action or a limited time-related action.

10 . The system of claim 8 , wherein the first action comprises:

a notification to the occupant to modify one or more of a current or a future vehicle operation action.

11 . The system of claim 8 , wherein the processor is further configured to:

identify whether the occupant has performed the first action based on the sensor data generated by a movement of the occupant.

12 . The system of claim 8 , wherein the processor is further configured to:

retrieve a profile associated with the occupant from the occupant device; and

determine a type of value to apply to subsequent occupant compliance actions based on the profile.

13 . The system of claim 12 , wherein the processor is further configured to:

determine one or more of the first action or the second action have been performed by the occupant; and

provide the value of the type of value to the profile.

14 . The system of claim 12 , wherein the processor is further configured to

determine that only the second action has been performed by the occupant; and

provide a partial value of the type of value to the profile.

15 . A non-transitory computer-readable medium comprising instructions that, when executed by a processor, cause a processor to perform:

monitoring, by a vehicle, a behavior of an occupant of the vehicle;

responsive to the behavior exceeding a threshold, suggesting a first action for the occupant by the vehicle, based on the behavior and an amount the behavior exceeds the threshold;

in response to determining that the occupant is performing an alternate action, which differs from the first action, suggesting a second action by the vehicle for the occupant, based on the alternate action and the first action; and

providing, by the vehicle, a value to a device associated with the occupant responsive to the vehicle detecting a performance of one or more of the first action or the second action by the occupant.

16 . The non-transitory computer-readable medium of claim 15 , wherein the behavior comprises one or more of:

a vehicle operation action or a limited time-related action.

17 . The non-transitory computer-readable medium of claim 15 , wherein the first action comprises:

a notification to the occupant to modify one or more of a current or a future vehicle operation action.

18 . The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the processor to perform:

identifying whether the occupant has performed the first action based on sensor data generated by a movement of the occupant.

19 . The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the processor to perform:

retrieving a profile associated with the occupant from the occupant device; and

determining a type of value to apply to subsequent occupant compliance actions based on the profile.

20 . The non-transitory computer-readable medium of claim 15 , wherein the instructions further cause the processor to perform:

determining one or more of the first action or the second action have been performed by the occupant; and

providing the value of the type of value to the profile.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2026
From: TOYOTA JIDOSHA KABUSHIKI KAISHA
To: TOYOTA MOTOR NORTH AMERICA, INC.
Reel/Frame 075748/0944 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2023
From: ZAHID, IMAD; JHA, SUMIT K.; NAGPAL, ANIL; BATIE, JOSHUA C.
To: TOYOTA MOTOR NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 065142/0068 →
Continuity (2)
Provisional Application 63514512 · Jul 19, 2023
Related Publication 20250026294A1 · Jan 23, 2025
References Cited (189)
US 5082333A · Fukushima et al. · 1992 [cited by applicant]
US 7183932B2 · Bauer · 2007 [cited by applicant]
US 7254482B2 · Kawasaki et al. · 2007 [cited by applicant]
US 7292152B2 · Torkkola et al. · 2007 [cited by applicant]
US 7450603B2 · Nix et al. · 2008 [cited by applicant]
US 7707576B2 · Sun · 2010 [cited by applicant]
US 8301108B2 · Naboulsi · 2012 [cited by applicant]
US 8326258B2 · Chmielewski et al. · 2012 [cited by applicant]
US 8495239B2 · Cohen et al. · 2013 [cited by applicant]
US 8725311B1 · Breed · 2014 [cited by applicant]
US 8972090B2 · Weslati et al. · 2015 [cited by applicant]
US 9075702B2 · Park et al. · 2015 [cited by applicant]
US 9211891B2 · Scofield et al. · 2015 [cited by applicant]
US 9240079B2 · Lambert et al. · 2016 [cited by applicant]
US 9460601B2 · Mimar · 2016 [cited by applicant]
US 9531737B2 · Stählin · 2016 [cited by applicant]
US 9792740B2 · Lambert et al. · 2017 [cited by applicant]
US 9821657B2 · Gan · 2017 [cited by applicant]
US 9849802B2 · Chow et al. · 2017 [cited by applicant]
US 9905057B2 · Stacy · 2018 [cited by applicant]
US 9915950B2 · Hartung et al. · 2018 [cited by applicant]
US 10036646B2 · Schumann et al. · 2018 [cited by applicant]
US 10081317B2 · Naboulsi · 2018 [cited by applicant]
US 10091299B2 · Mian et al. · 2018 [cited by applicant]
US 10104525B1 · Kaiser et al. · 2018 [cited by applicant]
US 10163340B2 · Vandikas et al. · 2018 [cited by applicant]
US 10196071B1 · Rowson et al. · 2019 [cited by applicant]
US 10225348B2 · Wang et al. · 2019 [cited by applicant]
US 10235859B1 · Hiles · 2019 [cited by applicant]
US 10429195B2 · Hashisho · 2019 [cited by applicant]
US 10474794B2 · Patton et al. · 2019 [cited by applicant]
US 10490075B2 · Bai et al. · 2019 [cited by applicant]
US 10532658B2 · Kim et al. · 2020 [cited by applicant]
US 10672200B2 · Wang et al. · 2020 [cited by applicant]
US 10696299B2 · Weldemariam et al. · 2020 [cited by applicant]
US 10741178B2 · Jo et al. · 2020 [cited by applicant]
US 10816978B1 · Schwalb · 2020 [cited by applicant]
US 10829110B2 · Nienhueser et al. · 2020 [cited by applicant]
US 10850616B2 · Koebler et al. · 2020 [cited by applicant]
US 10912509B2 · Alsbou · 2021 [cited by applicant]
US 10976170B2 · Morgan-Brown · 2021 [cited by applicant]
US 11037443B1 · Cui et al. · 2021 [cited by applicant]
US 11047704B2 · Yamamoto · 2021 [cited by applicant]
US 11084494B2 · Hu et al. · 2021 [cited by applicant]
US 11124153B2 · Narumi · 2021 [cited by applicant]
US 11163270B2 · Migneco et al. · 2021 [cited by applicant]
US 11206453B2 · Ramos et al. · 2021 [cited by applicant]
US 11221621B2 · Wengreen et al. · 2022 [cited by applicant]
US 11221622B2 · Schwie et al. · 2022 [cited by applicant]
US 11287270B2 · Xiang et al. · 2022 [cited by applicant]
US 11310626B2 · Mian et al. · 2022 [cited by applicant]
US 11323168B2 · Legg et al. · 2022 [cited by applicant]
US 11388241B1 · Myers, Jr. et al. · 2022 [cited by applicant]
US 11400944B2 · Soltanian et al. · 2022 [cited by applicant]
US 11513523B1 · Schwalb · 2022 [cited by applicant]
US 11526721B1 · O'Malley · 2022 [cited by applicant]
US 11539818B2 · Sabella et al. · 2022 [cited by applicant]
US 11620473B1 · Zhang · 2023 [cited by applicant]
US 11625745B1 · Warden et al. · 2023 [cited by applicant]
US 11667299B2 · Memani et al. · 2023 [cited by applicant]
US 11673570B2 · Chambers et al. · 2023 [cited by applicant]
US 11685409B2 · Kim et al. · 2023 [cited by applicant]
US 11694543B2 · Biala et al. · 2023 [cited by applicant]
US 11697420B2 · Bade et al. · 2023 [cited by applicant]
US 11780458B1 · Hussain et al. · 2023 [cited by applicant]
US 11794676B1 · Benqassmi et al. · 2023 [cited by applicant]
US 11866036B2 · Klingemann et al. · 2024 [cited by applicant]
US 20060069473A1 · Sumcad et al. · 2006 [cited by applicant]
US 20060261933A1 · Deniau et al. · 2006 [cited by applicant]
US 20070054685A1 · Kellum · 2007 [cited by applicant]
US 20080133120A1 · Romanick · 2008 [cited by applicant]
US 20080243558A1 · Gupte · 2008 [cited by applicant]
US 20090319341A1 · Berkobin et al. · 2009 [cited by applicant]
US 20100023201A1 · Kinney et al. · 2010 [cited by applicant]
US 20100070128A1 · Johnson · 2010 [cited by applicant]
US 20110131666A1 · Tanaka · 2011 [cited by applicant]
US 20120101713A1 · Moshchuk · 2012 [cited by examiner]
US 20130167037A1 · Xaio · 2013 [cited by applicant]
US 20130342364A1 · Grimm et al. · 2013 [cited by applicant]
US 20140277896A1 · Lathrop et al. · 2014 [cited by applicant]
US 20140303806A1 · Bai et al. · 2014 [cited by applicant]
US 20140309886A1 · Ricci · 2014 [cited by applicant]
US 20150120135A1 · Lawrenson · 2015 [cited by applicant]
US 20150294547A1 · Ito et al. · 2015 [cited by applicant]
US 20160001781A1 · Fung · 2016 [cited by examiner]
US 20170129496A1 · Li et al. · 2017 [cited by applicant]
US 20170132923A1 · Li et al. · 2017 [cited by applicant]
US 20170262453A1 · Raichelgauz et al. · 2017 [cited by applicant]
US 20170334374A1 · Naboulsi · 2017 [cited by applicant]
US 20170355377A1 · Vijaya Kumar et al. · 2017 [cited by applicant]
US 20180012424A1 · Ricci · 2018 [cited by applicant]
US 20180029612A1 · Tsuyunashi et al. · 2018 [cited by applicant]
US 20180128628A1 · Cheaz et al. · 2018 [cited by applicant]
US 20180146323A1 · Tseng et al. · 2018 [cited by applicant]
US 20180240335A1 · Dong et al. · 2018 [cited by applicant]
US 20180244288A1 · Glaser et al. · 2018 [cited by applicant]
US 20180365998A1 · Shibata et al. · 2018 [cited by applicant]
US 20190028904A1 · Carpenter et al. · 2019 [cited by applicant]
US 20190050718A1 · Tickoo et al. · 2019 [cited by applicant]
US 20190116476A1 · Qiu et al. · 2019 [cited by applicant]
US 20190302766A1 · Mondello et al. · 2019 [cited by applicant]
US 20190377362A1 · Lee · 2019 [cited by applicant]
US 20190392707A1 · McEnroe et al. · 2019 [cited by applicant]
US 20200031371A1 · Soliman · 2020 [cited by applicant]
US 20200117187A1 · Kothari · 2020 [cited by applicant]
US 20200130711A1 · Turek et al. · 2020 [cited by applicant]
US 20200166363A1 · Mcgavran et al. · 2020 [cited by applicant]
US 20200290630A1 · Elwart et al. · 2020 [cited by applicant]
US 20200346663A1 · Park et al. · 2020 [cited by applicant]
US 20200388154A1 · Kim et al. · 2020 [cited by applicant]
US 20210035125A1 · Casey et al. · 2021 [cited by applicant]
US 20210149397A1 · Shin et al. · 2021 [cited by applicant]
US 20210150828A1 · Mezaael et al. · 2021 [cited by applicant]
US 20210297472A1 · Calvert et al. · 2021 [cited by applicant]
US 20210309217A1 · Kim et al. · 2021 [cited by applicant]
US 20210309255A1 · Roesner · 2021 [cited by applicant]
US 20210312725A1 · Milton · 2021 [cited by applicant]
US 20210319691A1 · Merwaday et al. · 2021 [cited by applicant]
US 20210407292A1 · Cui et al. · 2021 [cited by applicant]
US 20220074756A1 · Gewickey et al. · 2022 [cited by applicant]
US 20220129948A1 · Cho et al. · 2022 [cited by applicant]
US 20220163969A1 · Li · 2022 [cited by applicant]
US 20220194433A1 · Nagata et al. · 2022 [cited by applicant]
US 20220234615A1 · Nishino et al. · 2022 [cited by applicant]
US 20220242448A1 · Chen et al. · 2022 [cited by applicant]
US 20220266842A1 · Li et al. · 2022 [cited by applicant]
US 20220289250A1 · Oba · 2022 [cited by applicant]
US 20220297726A1 · Zhang et al. · 2022 [cited by applicant]
US 20220308579A1 · Flores et al. · 2022 [cited by applicant]
US 20220381564A1 · Kitchen et al. · 2022 [cited by applicant]
US 20220408340A1 · Paczkowski et al. · 2022 [cited by applicant]
US 20230020772A1 · Aluvila et al. · 2023 [cited by applicant]
US 20230031709A1 · Yu et al. · 2023 [cited by applicant]
US 20230055974A1 · Arnold et al. · 2023 [cited by applicant]
US 20230058508A1 · Bush et al. · 2023 [cited by applicant]
US 20230063370A1 · Li · 2023 [cited by applicant]
US 20230096556A1 · Lerner et al. · 2023 [cited by applicant]
US 20230140079A1 · Zhu et al. · 2023 [cited by applicant]
US 20230147000A1 · Heiden et al. · 2023 [cited by applicant]
US 20230156055A1 · Apanovitch et al. · 2023 [cited by applicant]
US 20230343223A1 · Obraczka et al. · 2023 [cited by applicant]
US 20230375351A1 · Palanisamy et al. · 2023 [cited by applicant]
US 20240198938A1 · Carlos et al. · 2024 [cited by applicant]
US 20240211797A1 · Pronovost · 2024 [cited by applicant]
US 20240400077A1 · Kondasani et al. · 2024 [cited by applicant]
CA 3026666A1 · 2018 [cited by applicant]
CN 104778056A · 2015 [cited by applicant]
CN 105976609A · 2016 [cited by applicant]
CN 105989712A · 2016 [cited by applicant]
CN 108650656A · 2018 [cited by applicant]
CN 112801351A · 2021 [cited by applicant]
CN 112950939A · 2021 [cited by applicant]
CN 112970285A · 2021 [cited by applicant]
CN 113891823A · 2022 [cited by applicant]
CN 114358240A · 2022 [cited by applicant]
CN 114802059A · 2022 [cited by applicant]
EP 2288521A1 · 2011 [cited by applicant]
EP 2992418A1 · 2016 [cited by applicant]
EP 3269203A1 · 2018 [cited by applicant]
EP 3272613A1 · 2018 [cited by applicant]
EP 3299766A1 · 2018 [cited by applicant]
EP 3374902A1 · 2018 [cited by applicant]
EP 3401786A2 · 2018 [cited by applicant]
EP 3543906A1 · 2019 [cited by applicant]
EP 3629105A1 · 2020 [cited by applicant]
EP 4011740A2 · 2022 [cited by applicant]
WO 2016020151A1 · 2016 [cited by applicant]
US 2023/0031452 A1, 02/2023, Myers, Jr. et al. (withdrawn) [cited by applicant]
International Search Report and Written Opinion issued in the International PCT Application No. PCT/US2024/038905, mailed on Oct. 18, 2024. [cited by applicant]
Bellan, GM aims to build Netflix-sized subscription business by 2030, Oct. 6, 2021, https://techcrunch.com/2021/10/06/gm-aims-to-build-netflix-sized-subscription-business-by-2030/. [cited by applicant]
Bhardwaj, Audi GLOSA (Green Light Optimised Speed Advisory), Jul. 8, 2022, https://gomechanic.in/blog/audi-glosa-green-light-optimised-speed-advisory/. [cited by applicant]
McEachern, Just 25 Percent Of Car Buyers Willing To Pay For Subscription Services, Apr. 21, 2022, https://gmauthority.com/blog/2022/04/just-25-percent-of-car-buyers-willing-to-pay-for-subscription-services/. [cited by applicant]
Palkar, How Uber Uses Machine Learning to Reinvent Transportation?, Nov. 10, 2020, https://palkardurvesh.medium.com/how-uber-uses-machine-learning-to-reinvent-transportation-9412e4a3e4e9. [cited by applicant]
Rechtin, Goodbye MBUX, hello MB.OS. New Mercedes infotainment coming soon ‘Hey Mercedes’ gets smarter, navigation gets more realistic, audio goes full 3D, Mar. 21, 2022, https://www.autoblog.com/2022/03/21/mercedes-mb-o… [cited by applicant]
Smith, Hallucinations Could Blunt ChatGPT's Success OpenAl says the problem's solvable, Yann LeCun says we'll see, Mar. 13, 2023, https://spectrum.ieee.org/ai-hallucination. [cited by applicant]
Smith, The Future of Intelligent Transportation Systems (ITS): Applying Lessons Learned From 30 Years of Innovation, Spring 2022, Issue No. vol. 86 No. 1Publication No. FHWA-HRT-22-003, https://highways.dot.gov/public-r… [cited by applicant]
SOMANYM3s, You can now Watch videos in the browsers [Update: only while in Park], Oct. 26, 2019, https://teslamotorsclub.com/tmc/threads/you-can-now-watch-videos-in-the-browsers-update-only-while-in-park.171461/. [cited by applicant]
Stocksdale, Audi testing bus, school zone vehicle-to-infrastructure system, May 23, 2021, https://www.autoblog.com/2021/05/23/audi-v2x-vehicle-infrastructure-school-bus-zone-warning-system/. [cited by applicant]
Tan, GPT-4 Inherits “Hallucinating” Facts and Reasoning Errors From Earlier GPT Models, Mar. 16, 2023, https://mpost.io/gpt-4-inherits-hallucinating-facts-and-reasoning-errors-from-earlier-gpt-models/. [cited by applicant]
Unknown, Artificial Intelligence (AI) in Automotive Market Size by Component (Software, Hardware, Service), by technology (computer vision, context Awareness, Deep Learning, Machine Learning, Natural Language Processing… [cited by applicant]
Unknown, Automotive Artificial Intelligence (AI) Market Size (By Offering: Software and Hardware; By Process: Signal Recognition, Image Recognition, Voice Recognition, and Data Mining; By Technology: Deep Learning, Mach… [cited by applicant]
Unknown, Cadillac unveils electric Escalade IQ; 200kWh, 450 miles, pricing starting around 130K, Aug. 10, 2023, https://www.greencarcongress.com/2023/08/20230910-escaladeiq.html. [cited by applicant]
Unknown, Comfort and Infotainment Subscriptions: A Scalable Growth Vector for OEMs, intellias, published Mar. 31, 2023, updated Aug. 21, 2023, https://intellias.com/comfort-infotainment-subscriptions/. [cited by applicant]
Unknown, MHI Group to Participate in Vehicle-to-Infrastructure (V21) Demonstration Test Program to Support Autonomous Highway Driving—Groupwide Technologies to Help Achieve Autonomous Driving Society—, Oct. 5, 2022, htt… [cited by applicant]
Unknown, Personal development market size to grow by USD 755.16 million between 2022 and 2027; Growth driven by the rise in cost-effective content development—Technavio, Technavio, Apr. 3, 2023, https://www.prnewswire.c… [cited by applicant]
Unknown, Personal Development Market Size, Share & Trends Analysis Report By Instrument (Books, e-Platforms), By Focus Area (Mental Health, Physical Health), By Region, And Segment Forecasts, 2023-2030, Report ID: GVR-4… [cited by applicant]
Unknown, Research Blog, top 10 Automotive Industry Trends & Innovations in 2024, last downloaded on , https://www.startus-insights.com/innovators-guide/automotive-industry-trends-10-innovations-that-will-impact-automoti… [cited by applicant]
Unknown, The subscription Economy Index, Zuora, Mar. 2023. [cited by applicant]
Weise et al., When A.I. Chatbots Hallucinate, The New York Times, May 1, 2023. [cited by applicant]