IP Library Granted Patent US 12,248,317
Granted Patent B2
US 12,248,317 · App. 18/395,073 · Granted Mar 11, 2025

Neural net-based use of perceptrons to mimic human senses associated with a vehicle occupant

Inventor: Charles Howard Cella (Pembroke, MA)
Assignee: Strong Force TP Portfolio 2022, LLC
G05D1/0022B60W40/08G01C21/3438G01C21/3461G01C21/3469G01C21/3617G05B13/027G05D1/0088G05D1/0212G05D1/0287G05D1/224G05D1/225G05D1/226G05D1/227G05D1/228G05D1/229G05D1/24G05D1/646G05D1/69G05D1/692G05D1/81G06F40/40G06N3/0418G06N3/045G06N3/08G06N3/086G06N20/00G06Q30/0208G06Q50/188G06Q50/40G06V10/764G06V10/82G06V20/56G06V20/59G06V20/597G06V20/64G07C5/006G07C5/008G07C5/02G07C5/08G07C5/0808G07C5/0816G07C5/0866G07C5/0891G10L15/16G10L25/63B60W2040/0881G06N3/02G06Q30/0281G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,248,317
App. No.
18/395,073
Granted
Mar 11, 2025
Kind
B2
Abstract

A system for operating a vehicle based on a state of a rider includes an artificial intelligence system, a vehicle control system, and a feedback loop. The artificial intelligence system processes a sensory input from a wearable device in a vehicle to determine a state of a rider and optimizes an operating parameter of the vehicle to improve the state of the rider. The artificial intelligence system includes a neural net with a perceptron to mimic human senses to facilitate determining a state of a rider based on an extent to which at least one of the senses of the rider is stimulated. The vehicle control system adjusts vehicle operating parameters and the feedback loop indicates the change in the state of the rider, where the vehicle control system adjusts at least one of the plurality of vehicle operating parameters responsive to the indication of the change.

Claims (38)

1. A system for operating a vehicle based on an emotional state of a rider, the system comprising:

an artificial intelligence system for processing a sensory input from a wearable device in the vehicle to determine a state of the rider in the vehicle and optimizing an operating parameter of the vehicle to improve the state of the rider, wherein the artificial intelligence system is configured to execute a genetic algorithm to generate mutations from an initial operating state of the vehicle to determine at least one optimized vehicle operating state, wherein the at least one optimized vehicle operating state is optimized to improve the state of the rider,

the artificial intelligence system including a neural net with one or more perceptrons to mimic human senses to facilitate determining the state of the rider based on an extent to which at least one of the senses of the rider is stimulated, wherein the artificial intelligence system is to indicate a change in the state of the rider through recognition of patterns of emotional state indicative wearable sensor data of the rider in the vehicle;

a vehicle control system to control an operation of the vehicle by adjusting a plurality of vehicle operating parameters; and

a feedback loop through which the indication of the change in the state of the rider is communicated between the vehicle control system and the artificial intelligence system, wherein the vehicle control system adjusts at least one of the plurality of vehicle operating parameters responsive to the indication of the change to achieve the at least one optimized vehicle operating state.

2. The system of claim 1 , wherein the sensory input from the wearable device includes at least one of: heart rate data, galvanic skin response data, temperature data, or motion data of the rider.

3. The system of claim 1 , wherein the vehicle control system is further configured to adjust the at least one of the plurality of vehicle operating parameters to include at least one of: a vehicle speed, a vehicle acceleration, a vehicle deceleration, or a vehicle route.

4. The system of claim 1 , wherein the feedback loop includes a user interface within the vehicle configured to present the rider with real-time feedback regarding a current operating state of the vehicle and the emotional state of the rider.

5. The system of claim 1 , wherein the artificial intelligence system is further configured to utilize machine learning techniques to refine the genetic algorithm based on historical data of the emotional state of the rider and corresponding vehicle operating parameters.

6. The system of claim 1 , wherein the artificial intelligence system is further configured to communicate with an electronic commerce system interface to provide in-vehicle content adapted based on the emotional state of the rider.

7. The system of claim 1 , wherein the artificial intelligence system is further configured to optimize the at least one optimized vehicle operating state to achieve a favorable rider mood, wherein the favorable rider mood includes at least one of: relaxation or alertness.

8. The system of claim 1 , wherein the artificial intelligence system is further configured to predict changes in the emotional state of the rider based on a pattern recognition of the wearable sensor data over time.

9. The system of claim 1 , wherein the artificial intelligence system includes a second neural network trained to classify the emotional state of the rider based on the wearable sensor data and to predict future states of the rider within the vehicle.

10. A method for operating a vehicle based on an emotional state of a rider, the method comprising:

determining a state of the rider in the vehicle by processing, via an artificial intelligence system, a sensory input from a wearable device in the vehicle;

optimizing, via the artificial intelligence system, an operating parameter of the vehicle to improve the state of the rider;

generating, by executing a genetic algorithm via the artificial intelligence system, mutations from an initial operating state of the vehicle to determine at least one optimized vehicle operating state, wherein the at least one optimized vehicle operating state is optimized to improve the state of the rider,

wherein the artificial intelligence system includes a neural net with one or more perceptrons to mimic human senses to facilitate the determining the state of the rider based on an extent to which at least one of the senses of the rider is stimulated, wherein the artificial intelligence system is to indicate a change in the state of the rider through recognition of patterns of emotional state indicative wearable sensor data of the rider in the vehicle;

controlling, via a vehicle control system, an operation of the vehicle by adjusting a plurality of vehicle operating parameters;

feeding back, via a feedback loop, the indication of the change in the state of the rider by communicating the indication of the change in the state of the rider between the vehicle control system and the artificial intelligence system; and

adjusting, via the vehicle control system, at least one of the plurality of vehicle operating parameters in response to the indication of the change to achieve the at least one optimized vehicle operating state.

11. The method of claim 10 , wherein the sensory input from the wearable device includes at least one of: heart rate data, galvanic skin response data, temperature data, or motion data of the rider.

12. The method of claim 10 , wherein the at least one of the plurality of vehicle operating parameters includes at least one of: a vehicle speed, a vehicle acceleration, a vehicle deceleration, or a vehicle route.

13. The method of claim 10 , further comprising:

presenting to the rider, via a user interface within the vehicle, real-time feedback regarding a current operating state of the vehicle and the emotional state of the rider, wherein the user interface is included in the feedback loop.

14. The method of claim 10 , further comprising:

refining the genetic algorithm based on historical data of the emotional state of the rider and corresponding vehicle operating parameters, wherein the refining is via the artificial intelligence system utilizing machine learning techniques.

15. The method of claim 10 , further comprising:

communicating by the artificial intelligence system with an electronic commerce system interface; and

adapting in-vehicle content based on the emotional state of the rider.

16. The method of claim 10 , further comprising:

optimizing, via the artificial intelligence system, the at least one optimized vehicle operating state to achieve a favorable rider mood, wherein the favorable rider mood includes at least one of: relaxation or alertness.

17. The method of claim 10 , further comprising:

predicting, via the artificial intelligence system, changes in the emotional state of the rider based on recognition of a pattern in the wearable sensor data over time.

18. The method of claim 10 , further comprising:

training a second neural network to classify the emotional state of the rider based on the wearable sensor data;

classifying the emotional state of the rider based on the wearable sensor data; and

predicting future states of the rider within the vehicle, wherein the second neural network is included in the artificial intelligence system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2024
From: CELLA, CHARLES HOWARD
To: STRONG FORCE TP PORTFOLIO 2022, LLC
Reel/Frame 066235/0543 →
Continuity (6)
Continuation 17977550 · Oct 31, 2022
Continuation 16887557 · May 29, 2020
Continuation 16803220 · Feb 27, 2020
Continuation PCTUS2019053857 · Sep 30, 2019
Provisional Application 62739335 · Sep 30, 2018
Related Publication 20240142970A1 · May 2, 2024
References Cited (119)
US 5400734A · Doyon · 1995 [cited by applicant]
US 5566072A · Momose et al. · 1996 [cited by applicant]
US 6058352A · Lu et al. · 2000 [cited by applicant]
US 6188945B1 · Graf et al. · 2001 [cited by applicant]
US 7982620B2 · Prokhorov et al. · 2011 [cited by applicant]
US 8630897B1 · Prada Gomez et al. · 2014 [cited by applicant]
US 8825374B2 · Dimitriadis · 2014 [cited by applicant]
US 8862317B2 · Shin et al. · 2014 [cited by applicant]
US 8996303B1 · Bogovich et al. · 2015 [cited by applicant]
US 9293042B1 · Wasserman · 2016 [cited by applicant]
US 9451396B2 · Takatsuji · 2016 [cited by applicant]
US 9527508B1 · Lee · 2016 [cited by applicant]
US 9649974B1 · Arumugasamy et al. · 2017 [cited by applicant]
US 9744363B2 · Grill, Jr. et al. · 2017 [cited by applicant]
US 9827993B2 · Prokhorov · 2017 [cited by applicant]
US 9889770B2 · Hotary et al. · 2018 [cited by applicant]
US 9914475B2 · Sun et al. · 2018 [cited by applicant]
US 10117109B2 · Madaiah et al. · 2018 [cited by applicant]
US 10122692B2 · Maccarthaigh · 2018 [cited by applicant]
US 10126743B2 · Fukumoto · 2018 [cited by applicant]
US 10147319B1 · Chen · 2018 [cited by applicant]
US 10235859B1 · Hiles · 2019 [cited by applicant]
US 10289618B2 · Fink et al. · 2019 [cited by applicant]
US 10322727B1 · Chan et al. · 2019 [cited by applicant]
US 10322728B1 · Porikli et al. · 2019 [cited by applicant]
US 10346415B1 · Smith et al. · 2019 [cited by applicant]
US 10373522B2 · Byron et al. · 2019 [cited by applicant]
US 10387205B2 · Boutnaru · 2019 [cited by applicant]
US 10387417B1 · Hansen et al. · 2019 [cited by applicant]
US 10387429B2 · Smith-Mickelson et al. · 2019 [cited by applicant]
US 10832261B1 · Chan et al. · 2020 [cited by applicant]
US 10850693B1 · Pertsel et al. · 2020 [cited by applicant]
US 11049383B1 · Shahamad et al. · 2021 [cited by applicant]
US 20050143845A1 · Kaji · 2005 [cited by applicant]
US 20090055824A1 · Rychtyckyj et al. · 2009 [cited by applicant]
US 20090058683A1 · Becker · 2009 [cited by applicant]
US 20090292528A1 · Kameyama · 2009 [cited by applicant]
US 20100134302A1 · Ahn et al. · 2010 [cited by applicant]
US 20100293033A1 · Hall et al. · 2010 [cited by applicant]
US 20110213511A1 · Msconti et al. · 2011 [cited by applicant]
US 20110313259A1 · Hatakeyama et al. · 2011 [cited by applicant]
US 20130070043A1 · Geva et al. · 2013 [cited by applicant]
US 20130188513A1 · Vasseur et al. · 2013 [cited by applicant]
US 20140171752A1 · Park et al. · 2014 [cited by applicant]
US 20140172910A1 · Jung et al. · 2014 [cited by applicant]
US 20140201004A1 · Parundekar et al. · 2014 [cited by applicant]
US 20140218187A1 · Chun et al. · 2014 [cited by applicant]
US 20140257920A1 · Gilman et al. · 2014 [cited by applicant]
US 20140277902A1 · Koch · 2014 [cited by applicant]
US 20140278029A1 · Tonguz et al. · 2014 [cited by applicant]
US 20140278910A1 · Visintainer et al. · 2014 [cited by applicant]
US 20140279021A1 · Macneille et al. · 2014 [cited by applicant]
US 20150112800A1 · Binion et al. · 2015 [cited by applicant]
US 20150166069A1 · Engelman et al. · 2015 [cited by applicant]
US 20150220991A1 · Butts et al. · 2015 [cited by applicant]
US 20150254955A1 · Fields · 2015 [cited by examiner]
US 20150262239A1 · Goralnick · 2015 [cited by applicant]
US 20150292894A1 · Goddard et al. · 2015 [cited by applicant]
US 20150301602A1 · Dow et al. · 2015 [cited by applicant]
US 20150342007A1 · Anderson et al. · 2015 [cited by applicant]
US 20150344036A1 · Kristinsson et al. · 2015 [cited by applicant]
US 20150379530A1 · Bostick et al. · 2015 [cited by applicant]
US 20160063561A1 · Macneille et al. · 2016 [cited by applicant]
US 20160104486A1 · Penilla et al. · 2016 [cited by applicant]
US 20160282132A1 · Bostick et al. · 2016 [cited by applicant]
US 20160354027A1 · Benson et al. · 2016 [cited by applicant]
US 20160356617A1 · Verosub et al. · 2016 [cited by applicant]
US 20170026790A1 · Flitsch et al. · 2017 [cited by applicant]
US 20170098231A1 · Dietrich · 2017 [cited by applicant]
US 20170105667A1 · Wei et al. · 2017 [cited by applicant]
US 20170171178A1 · Reynders · 2017 [cited by applicant]
US 20170285642A1 · Rander · 2017 [cited by applicant]
US 20170289184A1 · C et al. · 2017 [cited by applicant]
US 20170299399A1 · Yamaguchi et al. · 2017 [cited by applicant]
US 20170329331A1 · Gao · 2017 [cited by applicant]
US 20170355377A1 · Kumar et al. · 2017 [cited by applicant]
US 20170370732A1 · Bender et al. · 2017 [cited by applicant]
US 20180006822A1 · Brickell · 2018 [cited by applicant]
US 20180009444A1 · Grimm et al. · 2018 [cited by applicant]
US 20180032955A1 · Lindawati · 2018 [cited by applicant]
US 20180066833A1 · Draajer et al. · 2018 [cited by applicant]
US 20180113461A1 · Potnis et al. · 2018 [cited by applicant]
US 20180118218A1 · Miloser · 2018 [cited by applicant]
US 20180143635A1 · Zijderveld et al. · 2018 [cited by applicant]
US 20180174457A1 · Taylor · 2018 [cited by applicant]
US 20180281812A1 · Tochioka et al. · 2018 [cited by applicant]
US 20180297602A1 · Richmond et al. · 2018 [cited by applicant]
US 20190033085A1 · Ogale et al. · 2019 [cited by applicant]
US 20190035394A1 · Tsai · 2019 [cited by applicant]
US 20190049267A1 · Huang · 2019 [cited by applicant]
US 20190049957A1 · Healey et al. · 2019 [cited by applicant]
US 20190049969A1 · Qawami et al. · 2019 [cited by applicant]
US 20190187705A1 · Ganguli · 2019 [cited by examiner]
US 20190193591A1 · Migneco et al. · 2019 [cited by applicant]
US 20190197430A1 · Arditi · 2019 [cited by applicant]
US 20190212967A1 · Stanley et al. · 2019 [cited by applicant]
US 20190222885A1 · Cho et al. · 2019 [cited by applicant]
US 20190225232A1 · Blau · 2019 [cited by applicant]
US 20190232974A1 · Reiley et al. · 2019 [cited by applicant]
US 20190265060A1 · Han et al. · 2019 [cited by applicant]
US 20190357834A1 · Aarts · 2019 [cited by examiner]
US 20190373472A1 · Smith et al. · 2019 [cited by applicant]
US 20190391581A1 · Vardaro et al. · 2019 [cited by applicant]
US 20200023846A1 · Husain et al. · 2020 [cited by applicant]
US 20200070840A1 · Gunaratne · 2020 [cited by applicant]
US 20200074266A1 · Peake et al. · 2020 [cited by applicant]
US 20200097754A1 · Tawari et al. · 2020 [cited by applicant]
US 20200331465A1 · Herman et al. · 2020 [cited by applicant]
US 20210113129A1 · Huang · 2021 [cited by applicant]
US 20210374710A1 · Kuehne · 2021 [cited by applicant]
US 20210390581A1 · Chan et al. · 2021 [cited by applicant]
CN 107364368A · 2017 [cited by applicant]
KR 20150050134A · 2015 [cited by applicant]
WO 2009061687A1 · 2009 [cited by applicant]
WO 2019004468A1 · 2019 [cited by applicant]
Bojarksi et al., “End to End Learning for Self-Driving Cars”, arXiv preprint arXiv: 1604.07316, Apr. 25, 2016. [cited by applicant]
Author Unknown, “The Difference Between Robotic Process Automation and Artificial Intelligence”, CFB Bots, retrieved from https://medium.com/@cfb_bots, 7 pages, Apr. 20, 2018. [cited by applicant]
Popa, Alexandra, et al., “Intelligent Autonomous Driving”, 2018 22nd International Conference on System Theory, Control and Computing (ICSTCC), pp. 53-58, 2018. [cited by applicant]
Kocic et al., “Sim-to-Real Autonomous Vehicle Lane Keeping using Vision”, 2021 29th Telecommunications Forum (TELFOR), pp. 1-8, 2021. [cited by applicant]