IP Library Granted Patent US 12,321,169
Granted Patent B2
US 12,321,169 · App. 18/395,398 · Granted Jun 3, 2025

Optimizing a vehicle operating parameter based in part on a sensed emotional state of a rider

Inventor: Charles Howard Cella (Pembroke, MA)
Assignee: STRONG FORCE TP PORTFOLIO 2022, LLC
G05D1/0022B60W40/08G01C21/3438G01C21/3461G01C21/3469G01C21/3617G05B13/027G05D1/0088G05D1/0212G05D1/0287G05D1/224G05D1/225G05D1/226G05D1/227G05D1/228G05D1/229G05D1/24G05D1/646G05D1/69G05D1/692G05D1/81G06F40/40G06N3/0418G06N3/045G06N3/08G06N3/086G06N20/00G06Q30/0208G06Q50/188G06Q50/40G06V10/764G06V10/82G06V20/56G06V20/59G06V20/597G06V20/64G07C5/006G07C5/008G07C5/02G07C5/08G07C5/0808G07C5/0816G07C5/0866G07C5/0891G10L15/16G10L25/63B60W2040/0881G06N3/02G06Q30/0281G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,321,169
App. No.
18/395,398
Granted
Jun 3, 2025
Kind
B2
Abstract

A system may include a first neural network to detect the state of the rider through expert system-based processing of rider state indicative wearable sensor data of a plurality of wearable physiological condition sensors worn by the rider in the vehicle, the state indicative wearable sensor data indicative of at least one of a first state of the rider and a second state of the rider. A system may include a second neural network to optimize, for at least one of achieving and maintaining a first state of the rider, the operating parameter of the vehicle in response to the detected state of the rider, wherein the second neural network optimizes the operational parameter based on a correlation between a vehicle operating state and a rider state, wherein the optimized operational parameter of the vehicle is determined and adjusted to induce the first state in the rider.

Claims (31)

1. A system for operating a vehicle based on a state of a rider, the system comprising:

an artificial intelligence system for processing a sensory input from a wearable device in the vehicle to determine the state of a rider in the vehicle and optimizing an operating parameter of the vehicle to improve the state of the rider, wherein the wearable device includes at least one of: a heart rate monitor, a skin temperature sensor, or a galvanic skin response sensor, and wherein the artificial intelligence system comprises:

a first neural network to detect the state of the rider through expert system-based processing of rider state indicative wearable sensor data of the wearable device, wherein the rider state indicative wearable sensor data is indicative of a current state of the rider and a predicted future state of the rider; and

a second neural network to optimize the operating parameter of the vehicle in response to the detected state indicative of the current state of the rider, wherein the second neural network optimizes the operating parameter of the vehicle based on a correlation between a vehicle operating state and the current state of the rider, wherein the operating parameter of the vehicle that is optimized affects at least one of: a route of the vehicle, in-vehicle audio content, driving speed of the vehicle, acceleration of the vehicle, deceleration of the vehicle, proximity to objects along the route, proximity to other vehicles along the route, temperature, lighting, seat position, or music volume, and wherein the operating parameter of the vehicle that is optimized is determined and adjusted to induce a desired state of the rider and to prevent the predicted future state of the rider.

2. The system of claim 1 , wherein the first neural network is further configured to classify the current state of the rider into one of a plurality of predefined categories.

3. The system of claim 2 , wherein the predefined categories include at least one of: relaxed, stressed, alert, or fatigued.

4. The system of claim 1 , wherein the predicted future state of the rider is determined based on historical data related to the state of the rider under similar conditions.

5. The system of claim 1 , wherein the operating parameter of the vehicle is adjusted in real-time.

6. The system of claim 1 , wherein the wearable device further includes an eye tracking sensor.

7. The system of claim 1 , wherein the current state of the rider is a relaxed state, and the predicted future state of the rider is a stressed state.

8. The system of claim 7 , wherein the operating parameter of the vehicle is optimized to induce the relaxed state in the rider when the predicted future state of the rider is the stressed state.

9. The system of claim 1 , wherein the artificial intelligence system is further configured to learn and adapt over time based on feedback from the rider.

10. The system of claim 1 , wherein the artificial intelligence system is further configured to process social media data sourced from a plurality of social media sources as indicative of an effect on the state of the rider.

11. The system of claim 10 , wherein the social media data includes at least one of: first posts made by the rider, second posts made by others about the rider, or third posts liked or shared by the rider.

12. A system for operating a vehicle based on a state of a rider, comprising:

an artificial intelligence system for processing a sensory input from a wearable device in the vehicle to determine the state of the rider in the vehicle and optimizing an operating parameter of the vehicle to improve the state of the rider, wherein the artificial intelligence system is configured to execute a genetic algorithm to generate mutations of an initial operating state of the vehicle to determine at least one optimized vehicle operating state, wherein the wearable device includes at least one of: a heart rate monitor, a skin temperature sensor, or a galvanic skin response sensor, and wherein the at least one optimized vehicle operating state is optimized to improve the state of the rider;

wherein the artificial intelligence system comprises:

a first neural network to detect the state of the rider through expert system-based processing of rider state indicative wearable sensor data of the wearable device, wherein the rider state indicative wearable sensor data is indicative of a current state of the rider and a predicted future state of the rider; and

a second neural network to optimize the operating parameter of the vehicle in response to the detected state indicative of the current state of the rider, wherein the second neural network optimizes the operating parameter of the vehicle based on a correlation between a vehicle operating state and the current state of the rider, wherein the operating parameter of the vehicle that is optimized affects at least one of: a route of the vehicle, in-vehicle audio content, driving speed of the vehicle, acceleration of the vehicle, deceleration of the vehicle, proximity to objects along the route, proximity to other vehicles along the route, temperature, lighting, seat position, or music volume, and wherein the operating parameter of the vehicle that is optimized is determined and adjusted to induce a desired state of the rider and to prevent the predicted future state of the rider.

13. The system of claim 12 , wherein the genetic algorithm is further configured to incorporate feedback from rider interactions with a vehicle control interface to refine optimization of the operating parameter of the vehicle.

14. The system of claim 12 , wherein the artificial intelligence system is further configured to provide haptic feedback to the rider through the wearable device based on the at least one optimized vehicle operating parameter of the vehicle.

15. The system of claim 12 , wherein the artificial intelligence system is further configured to interface with a mobile application to allow the rider to provide input regarding an effectiveness of the at least one optimized vehicle operating parameter of the vehicle in improving the state of the rider.

16. A method of operating a vehicle based on a state of a rider in the vehicle, comprising:

processing, using an artificial intelligence system, a sensory input from a wearable device in the vehicle to determine the state of the rider in the vehicle, wherein the wearable device includes at least one of: a heart rate monitor, a skin temperature sensor, or a galvanic skin response sensor, and wherein the processing of the sensory input using the artificial intelligence system involves:

detecting the state of the rider using the artificial intelligence system through expert-system based processing of rider state indicative wearable sensor data of the wearable device, wherein the rider state indicative wearable sensor data is indicative of a current state of the rider and a predicted future state of the rider; and

optimizing, using the artificial intelligence system, an operating parameter of the vehicle in response to the detected state indicative of the current state of the rider, wherein:

the operating parameter of the vehicle is optimized based on a correlation between a vehicle operating state and the current state of the rider,

the operating parameter of the vehicle that is optimized affects at least one of: temperature, lighting, seat position, music volume, or driving speed of the vehicle, and

the operating parameter of the vehicle that is optimized is determined and adjusted to induce a desired state of the rider and to prevent the predicted future state of the rider.

17. The method of claim 16 , wherein the current state of the rider is a relaxed state, and the predicted future state of the rider is a stressed state.

18. The method of claim 17 , wherein the optimizing of the operating parameter of the vehicle induces the relaxed state in the rider when the predicted future state of the rider is the stressed state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2024
From: CELLA, CHARLES HOWARD
To: STRONG FORCE TP PORTFOLIO 2022, LLC
Reel/Frame 066235/0543 →
Continuity (6)
Continuation 17978093 · Oct 31, 2022
Continuation 16887547 · May 29, 2020
Continuation 16694733 · Nov 25, 2019
Continuation PCTUS2019053857 · Sep 30, 2019
Provisional Application 62739335 · Sep 30, 2018
Related Publication 20240142972A1 · May 2, 2024
References Cited (114)
US 5400734A · Doyon · 1995 [cited by applicant]
US 6058352A · Lu et al. · 2000 [cited by applicant]
US 6188945B1 · Graf et al. · 2001 [cited by applicant]
US 6694054B1 · Gardes et al. · 2004 [cited by applicant]
US 9451396B2 · Takatsuji · 2016 [cited by applicant]
US 9493168B1 · Kim et al. · 2016 [cited by applicant]
US 9744363B2 · Grill, Jr. et al. · 2017 [cited by applicant]
US 9849044B1 · Groden et al. · 2017 [cited by applicant]
US 10117109B2 · Madaiah et al. · 2018 [cited by applicant]
US 10122692B2 · Maccarthaigh · 2018 [cited by applicant]
US 10126743B2 · Fukumoto · 2018 [cited by applicant]
US 10152875B2 · Khaligh et al. · 2018 [cited by applicant]
US 10289618B2 · Fink et al. · 2019 [cited by applicant]
US 10346415B1 · Smith et al. · 2019 [cited by applicant]
US 10372130B1 · Kaushansky et al. · 2019 [cited by applicant]
US 10373522B2 · Byron et al. · 2019 [cited by applicant]
US 10387205B2 · Boutnaru · 2019 [cited by applicant]
US 10387417B1 · Hansen et al. · 2019 [cited by applicant]
US 10387429B2 · Smith-Mickelson et al. · 2019 [cited by applicant]
US 10423934B1 · Zanghi et al. · 2019 [cited by applicant]
US 10482333B1 · Kaliouby et al. · 2019 [cited by applicant]
US 10620631B1 · Abeloe · 2020 [cited by applicant]
US 10696306B1 · Benisch et al. · 2020 [cited by applicant]
US 10769525B2 · Redding et al. · 2020 [cited by applicant]
US 10942520B1 · Copeland et al. · 2021 [cited by applicant]
US 20030145647A1 · Ismail et al. · 2003 [cited by applicant]
US 20050143845A1 · Kaji · 2005 [cited by applicant]
US 20090112334A1 · Grichnik et al. · 2009 [cited by applicant]
US 20090112429A1 · Sah et al. · 2009 [cited by applicant]
US 20110213511A1 · Visconti et al. · 2011 [cited by applicant]
US 20120016551A1 · Krause et al. · 2012 [cited by applicant]
US 20120197504A1 · Sujan et al. · 2012 [cited by applicant]
US 20130057671A1 · Levin et al. · 2013 [cited by applicant]
US 20130110666A1 · Aubrey · 2013 [cited by applicant]
US 20130204874A1 · Frey · 2013 [cited by applicant]
US 20140201126A1 · Zadeh et al. · 2014 [cited by applicant]
US 20140309790A1 · Ricci · 2014 [cited by applicant]
US 20140309806A1 · Ricci · 2014 [cited by applicant]
US 20150271557A1 · Tabe · 2015 [cited by applicant]
US 20150298565A1 · Iwamura et al. · 2015 [cited by applicant]
US 20150317990A1 · Fousek et al. · 2015 [cited by applicant]
US 20150344036A1 · Kristinsson et al. · 2015 [cited by applicant]
US 20160035150A1 · Barfield, Jr. et al. · 2016 [cited by applicant]
US 20160098561A1 · Keller et al. · 2016 [cited by applicant]
US 20160161275A1 · Waltermann et al. · 2016 [cited by applicant]
US 20160189056A1 · Mayhew · 2016 [cited by applicant]
US 20160297309A1 · Kim · 2016 [cited by applicant]
US 20160364823A1 · Cao · 2016 [cited by applicant]
US 20170021282A1 · Comploi · 2017 [cited by applicant]
US 20170025983A1 · Sills et al. · 2017 [cited by applicant]
US 20170057507A1 · Gordon et al. · 2017 [cited by applicant]
US 20170089721A1 · Akselrod · 2017 [cited by examiner]
US 20170151956A1 · Boesen · 2017 [cited by applicant]
US 20170299399A1 · Yamaguchi et al. · 2017 [cited by applicant]
US 20170316533A1 · Goldman-Shenhar · 2017 [cited by applicant]
US 20170352267A1 · Tzirkel-Hancock et al. · 2017 [cited by applicant]
US 20180027215A1 · Carlson · 2018 [cited by applicant]
US 20180050686A1 · Alturi et al. · 2018 [cited by applicant]
US 20180053413A1 · Patil et al. · 2018 [cited by applicant]
US 20180082501A1 · Kochar et al. · 2018 [cited by applicant]
US 20180086223A1 · Lindemann et al. · 2018 [cited by applicant]
US 20180101800A1 · Lecue · 2018 [cited by examiner]
US 20180120843A1 · Berntorp et al. · 2018 [cited by applicant]
US 20180137593A1 · Djuric · 2018 [cited by examiner]
US 20180143635A1 · Zijderveld · 2018 [cited by examiner]
US 20180157923A1 · Kaliouby et al. · 2018 [cited by applicant]
US 20180203455A1 · Cronin et al. · 2018 [cited by applicant]
US 20180208211A1 · Chiba · 2018 [cited by applicant]
US 20180238698A1 · Pedersen · 2018 [cited by applicant]
US 20180260414A1 · Gordo Soldevila · 2018 [cited by applicant]
US 20180266834A1 · Cronin · 2018 [cited by examiner]
US 20180303397A1 · Krupat et al. · 2018 [cited by applicant]
US 20180322112A1 · Bellegarda et al. · 2018 [cited by applicant]
US 20180330178A1 · Kaliouby et al. · 2018 [cited by applicant]
US 20190018067A1 · Kong et al. · 2019 [cited by applicant]
US 20190033085A1 · Ogale et al. · 2019 [cited by applicant]
US 20190047584A1 · Donnelly · 2019 [cited by applicant]
US 20190049267A1 · Huang · 2019 [cited by applicant]
US 20190049957A1 · Healey et al. · 2019 [cited by applicant]
US 20190049969A1 · Qawami et al. · 2019 [cited by applicant]
US 20190050714A1 · Nosko et al. · 2019 [cited by applicant]
US 20190051069A1 · Cooley · 2019 [cited by applicant]
US 20190079659A1 · Adenwala et al. · 2019 [cited by applicant]
US 20190101985A1 · Sajda et al. · 2019 [cited by applicant]
US 20190102840A1 · Perl et al. · 2019 [cited by applicant]
US 20190113362A1 · Kline et al. · 2019 [cited by applicant]
US 20190122544A1 · Schlesinger et al. · 2019 [cited by applicant]
US 20190156596A1 · Followell et al. · 2019 [cited by applicant]
US 20190178678A1 · Rahbari-Asr et al. · 2019 [cited by applicant]
US 20190204840A1 · Park et al. · 2019 [cited by applicant]
US 20190225232A1 · Blau · 2019 [cited by applicant]
US 20190226861A1 · Schimik et al. · 2019 [cited by applicant]
US 20190276037A1 · Ito et al. · 2019 [cited by applicant]
US 20190283762A1 · Kaliouby et al. · 2019 [cited by applicant]
US 20190294159A1 · Pedersen et al. · 2019 [cited by applicant]
US 20190311614A1 · Yang et al. · 2019 [cited by applicant]
US 20190319477A1 · Manikfan · 2019 [cited by applicant]
US 20190332902A1 · Gallagher et al. · 2019 [cited by applicant]
US 20190370915A1 · Garden et al. · 2019 [cited by applicant]
US 20210091995A1 · Trim et al. · 2021 [cited by applicant]
US 20210197867A1 · Kirk et al. · 2021 [cited by applicant]
US 20210217510A1 · Chakra · 2021 [cited by examiner]
US 20220005291A1 · Konrardy et al. · 2022 [cited by applicant]
US 20220036122A1 · Higa · 2022 [cited by applicant]
CN 107235045A · 2017 [cited by applicant]
KR 1020150050134A · 2015 [cited by applicant]
WO 2009061687A1 · 2009 [cited by applicant]
WO 2011080321A1 · 2011 [cited by applicant]
WO 2018094375A1 · 2018 [cited by applicant]
Villarejo, et al., “A Stress Sensor Based on Galvanic Skin Response (GSR) Controlled by ZigBee Sensors”, Sensors, 12, 6075-6101, 2012. [cited by applicant]
Author Unknown, “The Difference Between Robotic Process Automation and Artificial Intelligence”, CFB Bots, retrieved from https://medium.com/@cfb_bots, 7 pages, Apr. 20, 2018. [cited by applicant]
Gallego, “Stress Level Assessment with Non-Intrusive Sensors, Doctoral Thesis”, Universidad Carlos III De Madrid, accessed at http://www.tsc.uc3m.es/˜fhernando/ research/ ThesisFHG.pdf on Jun. 21, 2021, Apr. 2018. [cited by applicant]
Yang, Carl, et al., “Did You Enjoy the Ride: Understanding Passenger Experience via Heterogeneous Network Embedding”, 2018 IEEE 34th International Conference on Data Engineering, pp. 1392-1403, 2018. [cited by applicant]
Sekar, M., et al., “Carbon fiber based electrochemical sensor for sweat cortisol measurement”, Scientific Reports, 9:403-403, 2019. [cited by applicant]