IP Library Granted Patent US 12,235,641
Granted Patent B2
US 12,235,641 · App. 17/978,093 · Granted Feb 25, 2025

Hybrid neural networks sourcing social data sources to optimize satisfaction of rider in intelligent transportation systems

Inventor: Charles Howard Cella (Pembroke, MA)
Assignee: Strong Force TP Portfolio 2022, LLC
G05D1/0022B60W40/08G01C21/3438G01C21/3461G01C21/3469G01C21/3617G05B13/027G05D1/0088G05D1/0212G05D1/0287G05D1/224G05D1/225G05D1/226G05D1/227G05D1/228G05D1/229G05D1/24G05D1/646G05D1/692G06F40/40G06N3/0418G06N3/045G06N3/08G06N3/086G06N20/00G06Q30/0208G06Q50/188G06Q50/40G06V20/59G06V20/64G07C5/006G07C5/008G07C5/02G07C5/08G07C5/0808G07C5/0816G10L15/16G10L25/63B60W2040/0881G06N3/02G06Q30/0281G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,235,641
App. No.
17/978,093
Granted
Feb 25, 2025
Kind
B2
Abstract

A system for transportation includes a vehicle having at least one rider located in the vehicle and a data processing system for taking data from a plurality of social data sources. A hybrid neural network is connected to the data processing system. The system for transportation is to optimize satisfaction of the at least one rider based on processing the data from the plurality of social data sources with the hybrid neural network.

Claims (34)

1. A system for transportation, comprising:

a vehicle having at least one rider located in the vehicle;

a data processing system for taking data from a plurality of social data sources to determine a user profile of the at least one rider, wherein a portion of the data taken from the plurality of social data sources is specific to at least one of: interests, social relationships, or preferences of the at least one rider and includes at least one of: like activity, dislike activity, posts, comments, discussion threads, chats, or images, and wherein the data processing system includes an intelligent agent module; and

a hybrid neural network connected to the data processing system, wherein the hybrid neural network is configured to optimize satisfaction of the at least one rider by processing the portion of the data from the plurality of social data sources, wherein the hybrid neural network is configured to analyze keywords in the portion of the data to determine and execute at least one optimizing action likely to further optimize the satisfaction of the at least one rider,

wherein the at least one optimizing action includes adjusting an in-vehicle state of the vehicle by adjusting at least one of: seat positioning settings, climate control settings, window state, moonroof state, ventilation system state, temperature settings, humidity settings, fan speed setting, or in-vehicle entertainment system state including at least one of: video entertainment content, audio entertainment content, or sound system settings, and

wherein a characterization of the at least one rider's satisfaction resulting from the execution of the at least one optimizing action is used as feedback to improve the determination and the execution of the at least one optimizing action, wherein the feedback indicates an inconsistency between the at least one optimizing action and preferences of the at least one rider that are associated with the user profile, and wherein the improved determination of the at least one optimizing action is confirmed via a dialogue between the at least one rider and the intelligent agent module.

2. The system for transportation of claim 1 wherein the satisfaction of the at least one rider is optimized by optimizing a rider comfort state.

3. The system for transportation of claim 1 wherein the at least one optimizing action includes adjusting the in-vehicle state of the vehicle by adjusting the in-vehicle entertainment system state.

4. The system for transportation of claim 3 , wherein the adjusting of the in-vehicle entertainment system state involves adjusting music content in the vehicle.

5. The system for transportation of claim 1 wherein the portion of the data taken from the plurality of social data sources includes at least one of: traffic conditions or weather conditions, and wherein the at least one of the traffic conditions or the weather conditions affects the at least one rider's satisfaction resulting from the execution of the at least one optimizing action based on the portion of the data.

6. The system for transportation of claim 1 , wherein the processing analyzing of the portion of the data includes associating patterns of the in-vehicle state with the satisfaction of the at least one rider.

7. The system for transportation of claim 1 , wherein the satisfaction of the at least one rider is an overall satisfaction of a set of riders located in the vehicle.

8. The system for transportation of claim 1 , wherein the at least one optimizing action includes adjusting a weighting of at least one of: the seat positioning settings, the climate control settings, the window state, the moonroof state, the temperature settings, the humidity settings, or the fan speed setting.

9. The system for transportation of claim 8 , wherein the adjusting the weighting includes:

applying a genetic algorithm to randomly or systematically vary the weighting; and

determining the satisfaction of the at least one rider to determine the at least one optimizing action likely to further optimize the satisfaction of the at least one rider.

10. The system for transportation of claim 1 , wherein the analyzing of the keywords in the portion of the data to determine and execute the at least one optimizing action involves an indirect determination of preferences or intents of the at least one rider using the like activity, the dislike activity, the posts, the comments, the discussion threads, the chats, or the images.

11. A computer-implemented method, comprising:

processing, via a data processing system including an intelligent agent module, a portion of data taken from a plurality of social data sources to determine a user profile of at least one rider located in a vehicle, wherein the portion of the data is specific to at least one of: interests, social relationships, or preferences of the at least one rider and includes at least one of: like activity, dislike activity, posts, comments, discussion threads, chats, or images;

analyzing, via a hybrid neural network connected to the data processing system, keywords in the portion of the data to determine at least one optimizing action likely to optimize a satisfaction of the at least one rider;

executing, via the hybrid neural network, the at least one optimizing action by adjusting an in-vehicle state,

wherein the in-vehicle state includes at least one of: seat positioning settings, climate control settings, window state, moonroof state, ventilation system state, temperature settings, humidity settings, fan speed setting, or in-vehicle entertainment system state including at least one of: video entertainment content, audio entertainment content, or sound system settings, and

storing, in at least one social data source in the plurality of social data sources, a characterization of the at least one rider's satisfaction resulting from the execution of the at least one optimizing action and using the characterization as feedback to improve the determining and the executing of the at least one optimizing action, wherein the feedback indicates an inconsistency between the at least one optimizing action and preferences of the at least one rider that are associated with the user profile, and wherein the improved determination of the at least one optimizing action is confirmed via a dialogue between the at least one rider and the intelligent agent module.

12. The method of claim 11 , wherein the satisfaction of the at least one rider is optimized by optimizing a rider comfort state.

13. The method of claim 11 , wherein the at least one optimizing action includes adjusting the in-vehicle state of the vehicle by adjusting the in-vehicle entertainment system state.

14. The method of claim 13 , wherein the adjusting of the in-vehicle entertainment system state involves adjusting music content in the vehicle.

15. The method of claim 11 , wherein the portion of the data taken from the plurality of social data sources includes at least one of: traffic conditions or weather conditions, wherein the at least one of the traffic conditions or the weather conditions affects the at least one rider's satisfaction resulting from the execution of the at least one optimizing action based on the portion of the data.

16. The method of claim 11 , wherein the analyzing of the portion of the data includes associating patterns of the in-vehicle state with the satisfaction of the at least one rider.

17. The method of claim 11 , wherein the satisfaction of the at least one rider is an overall satisfaction of a set of riders located in the vehicle.

18. The method of claim 11 , wherein the at least one optimizing action includes adjusting a weighting of at least one of the seat positioning settings, the climate control settings, the window state, the moonroof state, the temperature settings, the humidity settings, or the fan speed setting.

19. The method of claim 18 , wherein the adjusting the weighting includes:

applying a genetic algorithm to randomly or systematically vary the weighting; and

determining the satisfaction of the at least one rider to determine the at least one optimizing action likely to further optimize the satisfaction of the at least one rider.

20. The method of claim 11 , wherein the analyzing of the keywords in the portion of the data to determine and execute the at least one optimizing action involves an indirect determination of preferences or intents of the at least one rider using the like activity, the dislike activity, the posts, the comments, the discussion threads, the chats, or the images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2022
From: CELLA, CHARLES HOWARD
To: STRONG FORCE TP PORTFOLIO 2022, LLC
Reel/Frame 061960/0760 →
Continuity (5)
Continuation 16887547 · May 29, 2020
Continuation 16694733 · Nov 25, 2019
Continuation PCTUS2019053857 · Sep 30, 2019
Provisional Application 62739335 · Sep 30, 2018
Related Publication 20230051185A1 · Feb 16, 2023
References Cited (114)
US 5400734A · Doyon · 1995 [cited by applicant]
US 6058352A · Lu et al. · 2000 [cited by applicant]
US 6188945B1 · Graf et al. · 2001 [cited by applicant]
US 6694054B1 · Gardes et al. · 2004 [cited by applicant]
US 9451396B2 · Takatsuji · 2016 [cited by applicant]
US 9493168B1 · Kim et al. · 2016 [cited by applicant]
US 9744363B2 · Grill, Jr. et al. · 2017 [cited by applicant]
US 9849044B1 · Groden et al. · 2017 [cited by applicant]
US 10117109B2 · Madaiah et al. · 2018 [cited by applicant]
US 10122692B2 · MacCarthaigh · 2018 [cited by applicant]
US 10126743B2 · Fukumoto · 2018 [cited by applicant]
US 10152875B2 · Khaligh et al. · 2018 [cited by applicant]
US 10289618B2 · Fink et al. · 2019 [cited by applicant]
US 10346415B1 · Smith et al. · 2019 [cited by applicant]
US 10372130B1 · Kaushansky et al. · 2019 [cited by applicant]
US 10373522B2 · Byron et al. · 2019 [cited by applicant]
US 10387205B2 · Boutnaru · 2019 [cited by applicant]
US 10387417B1 · Hansen et al. · 2019 [cited by applicant]
US 10387429B2 · Smith-Mickelson et al. · 2019 [cited by applicant]
US 10423934B1 · Zanghi et al. · 2019 [cited by applicant]
US 10482333B1 · El Kaliouby et al. · 2019 [cited by applicant]
US 10620631B1 · Abeloe · 2020 [cited by applicant]
US 10696306B1 · Benisch et al. · 2020 [cited by applicant]
US 10769525B2 · Redding et al. · 2020 [cited by applicant]
US 10942520B1 · Copeland et al. · 2021 [cited by applicant]
US 20030145647A1 · Ismail et al. · 2003 [cited by applicant]
US 20050143845A1 · Kaji · 2005 [cited by applicant]
US 20090112334A1 · Grichnik et al. · 2009 [cited by applicant]
US 20090112429A1 · Sah et al. · 2009 [cited by applicant]
US 20110213511A1 · Visconti et al. · 2011 [cited by applicant]
US 20120016551A1 · Krause et al. · 2012 [cited by applicant]
US 20120197504A1 · Sujan et al. · 2012 [cited by applicant]
US 20130057671A1 · Levin et al. · 2013 [cited by applicant]
US 20130110666A1 · Aubrey · 2013 [cited by applicant]
US 20130204874A1 · Frey · 2013 [cited by applicant]
US 20140201126A1 · Zadeh et al. · 2014 [cited by applicant]
US 20140309790A1 · Ricci · 2014 [cited by examiner]
US 20140309806A1 · Ricci · 2014 [cited by examiner]
US 20150271557A1 · Tabe · 2015 [cited by examiner]
US 20150298565A1 · Iwamura et al. · 2015 [cited by applicant]
US 20150317990A1 · Fousek et al. · 2015 [cited by applicant]
US 20150344036A1 · Kristinsson et al. · 2015 [cited by applicant]
US 20160035150A1 · Barfield, Jr · 2016 [cited by examiner]
US 20160098561A1 · Keller et al. · 2016 [cited by applicant]
US 20160161275A1 · Waltermann et al. · 2016 [cited by applicant]
US 20160189056A1 · Mayhew · 2016 [cited by applicant]
US 20160297309A1 · Kim · 2016 [cited by applicant]
US 20160364823A1 · Cao · 2016 [cited by examiner]
US 20170021282A1 · Comploi · 2017 [cited by applicant]
US 20170025983A1 · Sills et al. · 2017 [cited by applicant]
US 20170057507A1 · Gordon · 2017 [cited by examiner]
US 20170151956A1 · Boesen · 2017 [cited by applicant]
US 20170299399A1 · Yamaguchi et al. · 2017 [cited by applicant]
US 20170316533A1 · Goldman-Shenhar et al. · 2017 [cited by applicant]
US 20170352267A1 · Tzirkel-Hancock et al. · 2017 [cited by applicant]
US 20180027215A1 · Carlson · 2018 [cited by applicant]
US 20180050686A1 · Alturi et al. · 2018 [cited by applicant]
US 20180053413A1 · Patil et al. · 2018 [cited by applicant]
US 20180082501A1 · Kochhar · 2018 [cited by examiner]
US 20180086223A1 · Lindemann et al. · 2018 [cited by applicant]
US 20180101800A1 · Lecue et al. · 2018 [cited by applicant]
US 20180120843A1 · Berntop et al. · 2018 [cited by applicant]
US 20180137593A1 · Djuric · 2018 [cited by examiner]
US 20180143635A1 · Zijderveld et al. · 2018 [cited by applicant]
US 20180157923A1 · El Kaliouby, Jr. et al. · 2018 [cited by applicant]
US 20180203455A1 · Cronin et al. · 2018 [cited by applicant]
US 20180208211A1 · Chiba · 2018 [cited by applicant]
US 20180238698A1 · Pedersen · 2018 [cited by applicant]
US 20180260414A1 · Gordo Soldevila · 2018 [cited by applicant]
US 20180266834A1 · Cronin et al. · 2018 [cited by applicant]
US 20180303397A1 · Krupat et al. · 2018 [cited by applicant]
US 20180322112A1 · Bellegarda et al. · 2018 [cited by applicant]
US 20180330178A1 · El Kaliouby et al. · 2018 [cited by applicant]
US 20190018067A1 · Kong et al. · 2019 [cited by applicant]
US 20190033085A1 · Ogale et al. · 2019 [cited by applicant]
US 20190047584A1 · Donnelly · 2019 [cited by applicant]
US 20190049267A1 · Huang · 2019 [cited by applicant]
US 20190049957A1 · Healey et al. · 2019 [cited by applicant]
US 20190049969A1 · Qawami et al. · 2019 [cited by applicant]
US 20190050714A1 · Nosko et al. · 2019 [cited by applicant]
US 20190051069A1 · Cooley · 2019 [cited by applicant]
US 20190079659A1 · Adenwala et al. · 2019 [cited by applicant]
US 20190101985A1 · Sajda et al. · 2019 [cited by applicant]
US 20190102840A1 · Perl et al. · 2019 [cited by applicant]
US 20190113362A1 · Kline et al. · 2019 [cited by applicant]
US 20190122544A1 · Schlesinger et al. · 2019 [cited by applicant]
US 20190156596A1 · Followell et al. · 2019 [cited by applicant]
US 20190178678A1 · Rahbari Asr et al. · 2019 [cited by applicant]
US 20190204840A1 · Park et al. · 2019 [cited by applicant]
US 20190225232A1 · Blau · 2019 [cited by applicant]
US 20190226861A1 · Schimik et al. · 2019 [cited by applicant]
US 20190276037A1 · Ito et al. · 2019 [cited by applicant]
US 20190283762A1 · El Kaliouby et al. · 2019 [cited by applicant]
US 20190294159A1 · Pedersen et al. · 2019 [cited by applicant]
US 20190311614A1 · Yang et al. · 2019 [cited by applicant]
US 20190319477A1 · Manikfan · 2019 [cited by applicant]
US 20190332902A1 · Gallagher et al. · 2019 [cited by applicant]
US 20190370915A1 · Garden et al. · 2019 [cited by applicant]
US 20200103244A1 · Cella · 2020 [cited by examiner]
US 20210091995A1 · Trim · 2021 [cited by examiner]
US 20210197867A1 · Kirk et al. · 2021 [cited by applicant]
US 20210217510A1 · Chakra · 2021 [cited by examiner]
US 20220005291A1 · Konrardy et al. · 2022 [cited by applicant]
US 20220036122A1 · Higa · 2022 [cited by applicant]
CN 107235045A · 2017 [cited by applicant]
KR 1020150050134A · 2015 [cited by applicant]
WO 2009061687A1 · 2009 [cited by applicant]
WO WO2011080321A1 · 2011 [cited by examiner]
WO 2018094375A1 · 2018 [cited by applicant]
Villarejo, et al., “A Stress Sensor Based on Galvanic Skin Response (GSR) Controlled by ZigBee Sensors”, Sensors, 12, 6075-6101, 2012. [cited by applicant]
Author Unknown, “The Difference Between Robotic Process Automation and Artificial Intelligence”, CFB Bots, retrieved from https://medium.com/@cfb_bots, 7 pages, Apr. 20, 2018. [cited by applicant]
Gallego, “Stress Level Assessment with Non-Intrusive Sensors, Doctoral Thesis”, Universidad Carlos III De Madrid, accessed at http://www.tsc.uc3m.es/˜fhernando/ research/ ThesisFHG.pdf on Jun. 21, 2021, Apr. 2018. [cited by applicant]
Yang, Carl, et al., “Did You Enjoy the Ride: Understanding Passenger Experience via Heterogeneous Network Embedding”, 2018 IEEE 34th International Conference on Data Engineering, pp. 1392-1403, 2018. [cited by applicant]
Sekar, M., et al., “Carbon fiber based electrochemical sensor for sweat cortisol measurement”, Scientific Reports, 9:403-403, 2019. [cited by applicant]