IP Library Granted Patent US 12,321,168
Granted Patent B2
US 12,321,168 · App. 18/394,175 · Granted Jun 3, 2025

Transportation system to optimize an operating parameter of a vehicle based on an emotional state of an occupant of the vehicle determined from a sensor to detect a physiological condition of the occupant

Inventor: Charles Howard Cella (Pembroke, MA)
Assignee: STRONG FORCE TP PORTFOLIO 2022, LLC
G05D1/0022B60W40/08G01C21/3438G01C21/3461G01C21/3469G01C21/3617G05B13/027G05D1/0088G05D1/0212G05D1/0287G05D1/224G05D1/225G05D1/226G05D1/227G05D1/228G05D1/229G05D1/24G05D1/646G05D1/69G05D1/692G05D1/81G06F40/40G06N3/0418G06N3/045G06N3/08G06N3/086G06N20/00G06Q30/0208G06Q50/188G06Q50/40G06V10/764G06V10/82G06V20/56G06V20/59G06V20/597G06V20/64G07C5/006G07C5/008G07C5/02G07C5/08G07C5/0808G07C5/0816G07C5/0866G07C5/0891G10L15/16G10L25/63B60W2040/0881G06N3/02G06Q30/0281G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,321,168
App. No.
18/394,175
Granted
Jun 3, 2025
Kind
B2
Abstract

A transportation system to optimize an operating parameter of a vehicle based on a physiological state of an occupant of the vehicle. The transportation system includes a sensor to sense a physiological condition of the occupant and to output data based on the sensed physiological condition. The sensor includes a movement sensor to detect physical actions of the vehicle occupant. The transportation system further includes a real-time control system to receive and process the data to determine an emotional state of the occupant based on the detected physical actions and to optimize, for achieving a favorable emotional state of the occupant, at least one operating parameter of the vehicle in response to the detected emotional state of the occupant.

Claims (38)

1. A transportation system configured to optimize an operating parameter of a vehicle based on a physiological state of an occupant of the vehicle, the transportation system comprising:

a sensor configured to sense a physiological condition of the occupant and to output data based on the sensed physiological condition, the sensor including at least one of:

a physical or mechanical interface, wherein the physical or mechanical interface includes at least one of: a button, a dial, a toggle, a knob, a touch screen, a lever, a handle, a steering system, or a wheel;

an optical interface, wherein the optical interface is configured to detect gestures;

an accelerometer, wherein the accelerometer is configured to detect gestures; or

an IR sensor, wherein the IR sensor is configured to detect gestures; and

a real-time control system configured to receive and to process the data to determine an emotional state of the occupant based on the processed data and to optimize, for achieving a favorable emotional state of the occupant, at least one operating parameter of the vehicle in response to the determined emotional state of the occupant, wherein the at least one operating parameter of the vehicle that is optimized affects dynamics of the vehicle and further affects vehicle entertainment content in the vehicle that is presented to the occupant.

2. The transportation system of claim 1 wherein the data is indicative of at least one of: the emotional state of the occupant is changing, the emotional state of the occupant is stable, a rate of change of the emotional state of the occupant, a direction of change of the emotional state of the occupant, or a polarity of a change of the emotional state of the occupant.

3. The transportation system of claim 1 wherein the data is indicative of at least one of: the emotional state of the occupant is changing to an unfavorable state, or the emotional state of the occupant is changing to a favorable state.

4. The transportation system of claim 1 wherein the dynamics of the vehicle include at least one of; a route of the vehicle, vehicle responsiveness to inputs, a speed of the vehicle, an acceleration of the vehicle, a deceleration of the vehicle, controlled suspension performance of the vehicle, a proximity to objects along the route of the vehicle, or a proximity to other vehicles along the route of the vehicle; and wherein the vehicle entertainment content includes at least one of: in-vehicle audio content, or in-vehicle video content.

5. The transportation system of claim 1 wherein the sensor comprises at least one of: a wearable sensor, an in-vehicle sensor, a rider helmet, or a rider headgear.

6. The transportation system of claim 1 wherein the sensor includes a wearable sensor including at least two of; a watch, a ring, a wrist band, an arm band, an ankle band, a torso band, a skin patch, a head-worn device, eyeglasses, foot wear, a glove, an in-ear device, clothing, headphones, a belt, a finger ring, a thumb ring, a toe ring, or a necklace.

7. The transportation system of claim 6 wherein the real-time control system includes a first neural network configured to detect the emotional state of the occupant through expert system-based processing of occupant emotional state indicative wearable sensor data of a plurality of wearable physiological condition sensors worn by the occupant in the vehicle, the occupant emotional state indicative wearable sensor data being indicative of at least one of: the favorable emotional state of the occupant, or an unfavorable emotional state of the occupant.

8. The transportation system of claim 7 wherein the first neural network learns to classify patterns of the occupant emotional state indicative wearable sensor data and associate the patterns to emotional states and changes thereto from a training data set sourced from at least one of: a stream of data from unstructured data sources, social media sources, wearable devices, the sensor, a rider helmet, a rider headgear, or an occupant voice system.

9. The transportation system of claim 8 wherein the real-time control system further includes a second neural network configured to optimize the at least one operating parameter based on a correlation between a vehicle operating state and the occupant emotional state.

10. The transportation system of claim 1 wherein the vehicle comprises a self-driving vehicle.

11. A method of for optimizing at least one operating parameter of a vehicle based on a physiological state of an occupant of the vehicle, the method comprising:

sensing a physiological condition of the occupant and outputting output data based on the sensed physiological condition, wherein the sensing includes:

detecting, at a sensor, physical actions of the occupant of the vehicle, wherein the sensor includes at least one of:

a physical or mechanical interface, wherein the physical or mechanical interface includes at least one of: a button, a dial, a toggle, a knob, a touch screen, a lever, a handle, a steering system, or a wheel;

an optical interface, wherein the optical interface is configured to detect gestures;

an accelerometer, wherein the accelerometer is configured to detect gestures; or

an IR sensor, wherein the IR sensor is configured to detect gestures;

receiving, at a real-time control system, the data;

processing the data;

determining an emotional state of the occupant based on the processed data; and

optimizing the at least one operating parameter of the vehicle in response to the determined emotional state of the occupant, wherein the optimizing of the at least one operating parameter of the vehicle affects dynamics of the vehicle and further affects vehicle entertainment content that is presented to the occupant.

12. The method of claim 11 wherein the data is indicative of at least one of: the emotional state of the occupant is changing, the emotional state of the occupant is stable, a rate of change of the emotional state of the occupant, a direction of change of the emotional state of the occupant, or a polarity of a change of the emotional state of the occupant.

13. The method of claim 11 wherein the data is indicative of at least one of; the emotional state of the occupant is changing to an unfavorable state, or the emotional state of the occupant is changing to a favorable state.

14. The method of claim 11 wherein the dynamics of the vehicle include at least one of: a route of the vehicle, vehicle responsiveness to inputs, a speed of the vehicle, an acceleration of the vehicle, a deceleration of the vehicle, controlled suspension performance of the vehicle, a proximity to objects along the route of the vehicle, or a proximity to other vehicles along the route of the vehicle; and wherein the vehicle entertainment content includes at least one of: in-vehicle audio content, or in-vehicle video content.

15. The method of claim 11 wherein the sensor comprises at least one of: a wearable sensor, an in-vehicle sensor, a rider helmet, or a rider headgear.

16. The method of claim 11 wherein the sensor includes a wearable sensor including at least two of: a watch, a ring, a wrist band, an arm band, an ankle band, a torso band, a skin patch, a head-worn device, eyeglasses, foot wear, a glove, an in-ear device, clothing, headphones, a belt, a finger ring, a thumb ring, a toe ring, or a necklace.

17. The method of claim 16 wherein the real-time control system includes a first neural network, and wherein the method further comprises:

detecting the emotional state of the occupant through expert system-based processing of occupant emotional state indicative wearable sensor data of a plurality of wearable physiological condition sensors worn by the occupant in the vehicle, the emotional state indicative wearable sensor data being indicative of at least one of: a favorable emotional state of the occupant, or an unfavorable emotional state of the occupant.

18. The method of claim 17 wherein the first neural network learns to classify patterns of the occupant emotional state indicative wearable sensor data and associate the patterns to emotional states and changes thereto from a training data set sourced from at least one of a stream of data from unstructured data sources, social media sources, wearable devices, the sensor, a rider helmet, a rider headgear, or an occupant voice system.

19. The method of claim 18 wherein the real-time control system further includes a second neural network, and wherein the method further comprises:

optimizing, at the second neural network, the at least one operating parameter based on a correlation between a vehicle operating state and the occupant emotional state.

20. The method of claim 11 wherein the vehicle comprises a self-driving vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2024
From: CELLA, CHARLES HOWARD
To: STRONG FORCE TP PORTFOLIO 2022, LLC
Reel/Frame 066235/0543 →
Continuity (5)
Continuation 17976839 · Oct 30, 2022
Continuation 16694770 · Nov 25, 2019
Continuation PCTUS2019053857 · Sep 30, 2019
Provisional Application 62739335 · Sep 30, 2018
Related Publication 20240126256A1 · Apr 18, 2024
References Cited (114)
US 5400734A · Doyon · 1995 [cited by applicant]
US 6058352A · Lu et al. · 2000 [cited by applicant]
US 6188945B1 · Graf et al. · 2001 [cited by applicant]
US 6694054B1 · Gardes et al. · 2004 [cited by applicant]
US 9451396B2 · Takatsuji · 2016 [cited by applicant]
US 9493168B1 · Kim et al. · 2016 [cited by applicant]
US 9744363B2 · Grill, Jr. et al. · 2017 [cited by applicant]
US 9849044B1 · Groden · 2017 [cited by examiner]
US 10117109B2 · Madaiah et al. · 2018 [cited by applicant]
US 10122692B2 · MacCarthaigh · 2018 [cited by applicant]
US 10126743B2 · Fukumoto · 2018 [cited by applicant]
US 10152875B2 · Khaligh et al. · 2018 [cited by applicant]
US 10289618B2 · Fink et al. · 2019 [cited by applicant]
US 10346415B1 · Smith et al. · 2019 [cited by applicant]
US 10372130B1 · Kaushansky et al. · 2019 [cited by applicant]
US 10373522B2 · Byron et al. · 2019 [cited by applicant]
US 10387205B2 · Boutnaru · 2019 [cited by applicant]
US 10387417B1 · Hansen et al. · 2019 [cited by applicant]
US 10387429B2 · Smith-Mickelson et al. · 2019 [cited by applicant]
US 10423934B1 · Zanghi et al. · 2019 [cited by applicant]
US 10482333B1 · El Kaliouby et al. · 2019 [cited by applicant]
US 10620631B1 · Abeloe · 2020 [cited by applicant]
US 10696306B1 · Benisch et al. · 2020 [cited by applicant]
US 10769525B2 · Redding et al. · 2020 [cited by applicant]
US 10942520B1 · Copeland et al. · 2021 [cited by applicant]
US 20030145647A1 · Ismail et al. · 2003 [cited by applicant]
US 20050143845A1 · Kaji · 2005 [cited by applicant]
US 20090112334A1 · Grichnik et al. · 2009 [cited by applicant]
US 20090112429A1 · Sah et al. · 2009 [cited by applicant]
US 20110213511A1 · Visconti et al. · 2011 [cited by applicant]
US 20120016551A1 · Krause et al. · 2012 [cited by applicant]
US 20120197504A1 · Sujan et al. · 2012 [cited by applicant]
US 20130057671A1 · Levin et al. · 2013 [cited by applicant]
US 20130110666A1 · Aubrey · 2013 [cited by examiner]
US 20130204874A1 · Frey · 2013 [cited by applicant]
US 20140201126A1 · Zadeh et al. · 2014 [cited by applicant]
US 20140309790A1 · Ricci · 2014 [cited by applicant]
US 20140309806A1 · Ricci · 2014 [cited by applicant]
US 20150271557A1 · Tabe · 2015 [cited by applicant]
US 20150298565A1 · Iwamura et al. · 2015 [cited by applicant]
US 20150317990A1 · Fousek et al. · 2015 [cited by applicant]
US 20150344036A1 · Kristinsson et al. · 2015 [cited by applicant]
US 20160035150A1 · Barfield, Jr. et al. · 2016 [cited by applicant]
US 20160098561A1 · Keller et al. · 2016 [cited by applicant]
US 20160161275A1 · Waltermann et al. · 2016 [cited by applicant]
US 20160189056A1 · Mayhew · 2016 [cited by applicant]
US 20160297309A1 · Kim · 2016 [cited by applicant]
US 20160364823A1 · Cao · 2016 [cited by applicant]
US 20170021282A1 · Comploi · 2017 [cited by applicant]
US 20170025983A1 · Sills et al. · 2017 [cited by applicant]
US 20170057507A1 · Gordon et al. · 2017 [cited by applicant]
US 20170089721A1 · Akselrod et al. · 2017 [cited by applicant]
US 20170151956A1 · Boesen · 2017 [cited by applicant]
US 20170299399A1 · Yamaguchi et al. · 2017 [cited by applicant]
US 20170316533A1 · Goldman-Shenhar · 2017 [cited by applicant]
US 20170352267A1 · Tzirkel-Hancock et al. · 2017 [cited by applicant]
US 20180027215A1 · Carlson · 2018 [cited by applicant]
US 20180050686A1 · Alturi et al. · 2018 [cited by applicant]
US 20180053413A1 · Patil et al. · 2018 [cited by applicant]
US 20180082501A1 · Kochar et al. · 2018 [cited by applicant]
US 20180086223A1 · Lindemann et al. · 2018 [cited by applicant]
US 20180101800A1 · Lecue et al. · 2018 [cited by applicant]
US 20180120843A1 · Berntorp et al. · 2018 [cited by applicant]
US 20180137593A1 · Djuric et al. · 2018 [cited by applicant]
US 20180143635A1 · Zijderveld et al. · 2018 [cited by applicant]
US 20180157923A1 · Kaliouby et al. · 2018 [cited by applicant]
US 20180203455A1 · Cronin et al. · 2018 [cited by applicant]
US 20180208211A1 · Chiba · 2018 [cited by applicant]
US 20180238698A1 · Pedersen · 2018 [cited by applicant]
US 20180260414A1 · Gordo Soldevila · 2018 [cited by applicant]
US 20180266834A1 · Cronin et al. · 2018 [cited by applicant]
US 20180303397A1 · Krupat et al. · 2018 [cited by applicant]
US 20180322112A1 · Bellegarda et al. · 2018 [cited by applicant]
US 20180330178A1 · El Kaliouby et al. · 2018 [cited by applicant]
US 20190018067A1 · Kong et al. · 2019 [cited by applicant]
US 20190033085A1 · Ogale et al. · 2019 [cited by applicant]
US 20190047584A1 · Donnelly · 2019 [cited by applicant]
US 20190049267A1 · Huang · 2019 [cited by applicant]
US 20190049957A1 · Healey · 2019 [cited by examiner]
US 20190049969A1 · Qawami et al. · 2019 [cited by applicant]
US 20190050714A1 · Nosko et al. · 2019 [cited by applicant]
US 20190051069A1 · Cooley · 2019 [cited by applicant]
US 20190079659A1 · Adenwala et al. · 2019 [cited by applicant]
US 20190101985A1 · Sajda · 2019 [cited by examiner]
US 20190102840A1 · Perl et al. · 2019 [cited by applicant]
US 20190113362A1 · Kline et al. · 2019 [cited by applicant]
US 20190122544A1 · Schlesinger et al. · 2019 [cited by applicant]
US 20190156596A1 · Followell et al. · 2019 [cited by applicant]
US 20190178678A1 · Rahbari-Asr et al. · 2019 [cited by applicant]
US 20190204840A1 · Park et al. · 2019 [cited by applicant]
US 20190225232A1 · Blau · 2019 [cited by applicant]
US 20190226861A1 · Schimik et al. · 2019 [cited by applicant]
US 20190276037A1 · Ito et al. · 2019 [cited by applicant]
US 20190283762A1 · El Kaliouby et al. · 2019 [cited by applicant]
US 20190294159A1 · Pedersen et al. · 2019 [cited by applicant]
US 20190311614A1 · Yang et al. · 2019 [cited by applicant]
US 20190319477A1 · Manikfan · 2019 [cited by applicant]
US 20190332902A1 · Gallagher et al. · 2019 [cited by applicant]
US 20190370915A1 · Garden et al. · 2019 [cited by applicant]
US 20210091995A1 · Trim et al. · 2021 [cited by applicant]
US 20210197867A1 · Kirk · 2021 [cited by examiner]
US 20210217510A1 · Chakra et al. · 2021 [cited by applicant]
US 20220005291A1 · Konrardy et al. · 2022 [cited by applicant]
US 20220036122A1 · Higa · 2022 [cited by applicant]
CN 107235045A · 2017 [cited by examiner]
KR 1020150050134A · 2015 [cited by applicant]
WO 2009061687A1 · 2009 [cited by applicant]
WO 2011080321A1 · 2011 [cited by applicant]
WO 2018094375A1 · 2018 [cited by applicant]
Villarejo, et al., “A Stress Sensor Based on Galvanic Skin Response (GSR) Controlled by ZigBee Sensors”, Sensors, 12, 6075-6101, 2012. [cited by applicant]
Author Unknown, “The Difference Between Robotic Process Automation and Artificial Intelligence”, CFB Bots, retrieved from https://medium.com/@cfb_bots, 7 pages, Apr. 20, 2018. [cited by applicant]
Gallego, “Stress Level Assessment with Non-Intrusive Sensors, Doctoral Thesis”, Universidad Carlos III De Madrid, accessed at http://www.tsc.uc3m.es/˜fhernando/ research/ ThesisFHG.pdf on Jun. 21, 2021, Apr. 2018. [cited by applicant]
Yang, Carl, et al., “Did You Enjoy the Ride: Understanding Passenger Experience via Heterogeneous Network Embedding”, 2018 IEEE 34th International Conference on Data Engineering, pp. 1392-1403, 2018. [cited by applicant]
Sekar, M., et al., “Carbon fiber based electrochemical sensor for sweat cortisol measurement”, Scientific Reports, 9:403-403, 2019. [cited by applicant]