IP Library Granted Patent US 12,298,759
Granted Patent B2
US 12,298,759 · App. 18/395,371 · Granted May 13, 2025

Using social media data of a vehicle occupant to alter a route plan of the vehicle

Inventor: Charles Howard Cella (Pembroke, MA)
Assignee: STRONG FORCE TP PORTFOLIO 2022, LLC
G05D1/0022B60W40/08G01C21/3438G01C21/3461G01C21/3469G01C21/3617G05B13/027G05D1/0088G05D1/0212G05D1/0287G05D1/224G05D1/225G05D1/226G05D1/227G05D1/228G05D1/229G05D1/24G05D1/646G05D1/69G05D1/692G05D1/81G06F40/40G06N3/0418G06N3/045G06N3/08G06N3/086G06N20/00G06Q30/0208G06Q50/188G06Q50/40G06V10/764G06V10/82G06V20/56G06V20/59G06V20/597G06V20/64G07C5/006G07C5/008G07C5/02G07C5/08G07C5/0808G07C5/0816G07C5/0866G07C5/0891G10L15/16G10L25/63B60W2040/0881G06N3/02G06Q30/0281G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,298,759
App. No.
18/395,371
Granted
May 13, 2025
Kind
B2
Abstract

A method of altering an operating state of a transportation system may include: receiving social data from a plurality of social data sources about at least one occupant of a vehicle of the transportation system; analyzing, at a first neural network, the social data and associating the social data with a route plan for the vehicle occupied by the at least one occupant; predicting, by the first neural network, an effect on a satisfaction of the at least one occupant based on the route plan of the vehicle through an analysis of the social data; and altering, by the first neural network, a route plan of the transportation system responsive to the predicted effect.

Claims (52)

1. A method of altering an operating state of a transportation system, the method comprising:

accessing social data sources;

extracting, by a data processing system, social data from a plurality of social data sources about at least one occupant of a vehicle of the transportation system, wherein the social data includes at least one of: an interest, a social relationship, or a preference of the at least one occupant, and wherein the plurality of social data sources include at least one of a like action, a dislike action, a social post, a comment, a discussion thread, a chat, or an image;

analyzing, at a first neural network, a route plan for the vehicle based on the extracted social data and associating the social data with the at least one occupant of the vehicle;

predicting, based on an analysis of the social data using the first neural network, an effect on a satisfaction of the at least one occupant based on the route plan of the vehicle;

responsive to the predicted effect on the satisfaction of the at least one occupant, altering, by the first neural network, the route plan of the vehicle to create an altered route plan; and

communicating the altered route plan via an in-vehicle navigation interface to facilitate following the altered route plan.

2. The method of claim 1 , wherein the plurality of social data sources include at least one of a social media platform, an online discussion thread, or a messaging application.

3. The method of claim 1 , wherein the social data includes at least one of text, images, videos, or audio.

4. The method of claim 1 , wherein the first neural network is a deep learning neural network.

5. The method of claim 1 , further comprising: receiving feedback, from the at least one occupant, on the altered route plan; and using the feedback to train the first neural network.

6. The method of claim 1 , wherein the route plan includes at least one of a suggested route, a suggested departure time, or a suggested mode of transportation.

7. The method of claim 1 , further comprising: providing the at least one occupant with information about the altered route plan.

8. The method of claim 1 , wherein the altered route plan is based on at least one of a predicted traffic condition, a predicted weather condition, a predicted event that may affect transportation, a predicted time of day, a predicted day of week, or a predicted transportation demand.

9. The method of claim 1 , wherein the altered route plan is further based on a predicted environmental impact.

10. The method of claim 1 , wherein the altered route plan is further based on a predicted cost of the altered route plan.

11. The method of claim 1 , wherein the social data includes at least a keyword or a phrase.

12. The method of claim 1 , further comprising:

identifying, at a second neural network, and based at least in part on the social data and the route plan, potential route options based on at least one of waypoints along the route plan or potential waypoints of interest; and

further predicting, by the first neural network, an effect on the satisfaction of the at least one occupant for each of the potential route options.

13. The method of claim 1 , further comprising:

generating, with the first neural network, an occupant profile based, at least in part, on the social data associated with the at least one occupant of the vehicle,

wherein predicting the effect on the satisfaction of the at least one occupant of the vehicle is further based, at least in part, on the occupant profile, and

wherein the analyzing the route plan further includes identifying occupant preferences for route features based on the occupant profile.

14. The method of claim 1 , wherein the accessing social data sources is via a mobile device of the at least one occupant of the vehicle.

15. The method of claim 1 , wherein the accessing social data sources is via a network enabled vehicle.

16. The method of claim 1 , further comprising automatically routing the vehicle via the altered route plan.

17. The method of claim 1 , wherein communicating the altered route plan via an in-vehicle navigation interface further includes communicating the altered route plan in real time.

18. A transportation system, the transportation system comprising:

a data processing system to extract social data, from a plurality of social data sources, about at least one occupant of a vehicle, wherein a portion of the social data taken from the plurality of social data sources is specific to at least one of: an interest, a social relationship, or a preference of the at least one occupant and is extracted from a social media source, wherein the social media source includes at least one a like action, a dislike action, a social post, a comment, a discussion thread, a chat, or an image;

a first neural network that receives the social data from the data processing system, the first neural network configured to:

analyze a route plan for the vehicle based on the social data and associate the extracted social data;

predict an effect on a satisfaction of the at least one occupant based on the analyzed route plan;

alter the route plan of the transportation system responsive to the predicted effect, resulting in an altered route plan; and

an in-vehicle navigation interface to receive the altered route plan and facilitate following the altered route plan.

19. The transportation system of claim 18 , wherein the social data sources include at least one of a social media platform, an online discussion thread, or a messaging application.

20. The transportation system of claim 18 , wherein the first neural network is a deep learning neural network.

21. The transportation system of claim 18 , further comprising a feedback module configured to receive feedback, from the at least one occupant, on the altered route plan and use the feedback to train the first neural network.

22. The transportation system of claim 18 , wherein the route plan includes at least one of a suggested route, a suggested departure time, or a suggested mode of transportation.

23. The transportation system of claim 18 , further comprising a communication module configured to provide the at least one occupant with information about the altered route plan.

24. The transportation system of claim 18 , wherein the altered route plan is further based on a predicted environmental impact.

25. The transportation system of claim 18 , wherein the altered route plan is further based on a predicted cost of the route plan and a predicted cost of the altered route plan.

26. The transportation system of claim 18 , wherein the first neural network is further configured to update the altered route plan in real-time based on changes in the social data.

27. The transportation system of claim 18 , wherein the first neural network is further configured to personalize the altered route plan based on individual preferences of the at least one occupant.

28. The transportation system of claim 18 , further comprising:

a second neural network configured to identify, based at least in part on the social data and the route plan, potential route options based on at least one of waypoints along the route plan or potential waypoints of interest; and

wherein the first neural network is configured to predict a further effect on the satisfaction of the at least one occupant of the potential route options, and

wherein altering the route plan is further responsive to the further effect on the satisfaction of the at least one occupant.

29. The transportation system of claim 18 ,

wherein the first neural network is further configured to generate an occupant profile based, at least in part, on the social data,

wherein the predicting the effect on the satisfaction of the at least one occupant is further based, at least in part, on the occupant profile, and

wherein the analyzing the route plan further includes identifying occupant preferences for route features based on the occupant profile.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2024
From: CELLA, CHARLES HOWARD
To: STRONG FORCE TP PORTFOLIO 2022, LLC
Reel/Frame 066235/0543 →
Continuity (6)
Continuation 17978093 · Oct 31, 2022
Continuation 16887547 · May 29, 2020
Continuation 16694733 · Nov 25, 2019
Continuation PCTUS2019053857 · Sep 30, 2019
Provisional Application 62739335 · Sep 30, 2018
Related Publication 20240126286A1 · Apr 18, 2024
References Cited (114)
US 5400734A · Doyon · 1995 [cited by applicant]
US 6058352A · Lu et al. · 2000 [cited by applicant]
US 6188945B1 · Graf et al. · 2001 [cited by applicant]
US 6694054B1 · Gardes et al. · 2004 [cited by applicant]
US 9451396B2 · Takatsuji · 2016 [cited by applicant]
US 9493168B1 · Kim et al. · 2016 [cited by applicant]
US 9744363B2 · Grill, Jr. et al. · 2017 [cited by applicant]
US 9849044B1 · Groden et al. · 2017 [cited by applicant]
US 10117109B2 · Madaiah et al. · 2018 [cited by applicant]
US 10122692B2 · MacCarthaigh · 2018 [cited by applicant]
US 10126743B2 · Fukumoto · 2018 [cited by applicant]
US 10152875B2 · Khaligh et al. · 2018 [cited by applicant]
US 10289618B2 · Fink et al. · 2019 [cited by applicant]
US 10346415B1 · Smith et al. · 2019 [cited by applicant]
US 10372130B1 · Kaushansky et al. · 2019 [cited by applicant]
US 10373522B2 · Byron et al. · 2019 [cited by applicant]
US 10387205B2 · Boutnaru · 2019 [cited by applicant]
US 10387417B1 · Hansen et al. · 2019 [cited by applicant]
US 10387429B2 · Smith-Mickelson et al. · 2019 [cited by applicant]
US 10423934B1 · Zanghi et al. · 2019 [cited by applicant]
US 10482333B1 · El Kaliouby et al. · 2019 [cited by applicant]
US 10620631B1 · Abeloe · 2020 [cited by applicant]
US 10696306B1 · Benisch et al. · 2020 [cited by applicant]
US 10769525B2 · Redding et al. · 2020 [cited by applicant]
US 10942520B1 · Copeland et al. · 2021 [cited by applicant]
US 20030145647A1 · Ismail et al. · 2003 [cited by applicant]
US 20050143845A1 · Kaji · 2005 [cited by applicant]
US 20090112334A1 · Grichnik et al. · 2009 [cited by applicant]
US 20090112429A1 · Sah et al. · 2009 [cited by applicant]
US 20110213511A1 · Visconti et al. · 2011 [cited by applicant]
US 20120016551A1 · Krause et al. · 2012 [cited by applicant]
US 20120197504A1 · Sujan et al. · 2012 [cited by applicant]
US 20130057671A1 · Levin et al. · 2013 [cited by applicant]
US 20130110666A1 · Aubrey · 2013 [cited by applicant]
US 20130204874A1 · Frey · 2013 [cited by applicant]
US 20140201126A1 · Zadeh · 2014 [cited by examiner]
US 20140309790A1 · Ricci · 2014 [cited by applicant]
US 20140309806A1 · Ricci · 2014 [cited by examiner]
US 20150271557A1 · Tabe · 2015 [cited by applicant]
US 20150298565A1 · Iwamura et al. · 2015 [cited by applicant]
US 20150317990A1 · Fousek et al. · 2015 [cited by applicant]
US 20150344036A1 · Kristinsson et al. · 2015 [cited by applicant]
US 20160035150A1 · Barfield, Jr. et al. · 2016 [cited by applicant]
US 20160098561A1 · Keller et al. · 2016 [cited by applicant]
US 20160161275A1 · Waltermann et al. · 2016 [cited by applicant]
US 20160189056A1 · Mayhew · 2016 [cited by applicant]
US 20160297309A1 · Kim · 2016 [cited by applicant]
US 20160364823A1 · Cao · 2016 [cited by applicant]
US 20170021282A1 · Comploi · 2017 [cited by applicant]
US 20170025983A1 · Sills et al. · 2017 [cited by applicant]
US 20170057507A1 · Gordon et al. · 2017 [cited by applicant]
US 20170089721A1 · Akselrod et al. · 2017 [cited by applicant]
US 20170151956A1 · Boesen · 2017 [cited by applicant]
US 20170299399A1 · Yamaguchi et al. · 2017 [cited by applicant]
US 20170316533A1 · Goldman-Shenhar · 2017 [cited by applicant]
US 20170352267A1 · Tzirkel-Hancock et al. · 2017 [cited by applicant]
US 20180027215A1 · Carlson · 2018 [cited by applicant]
US 20180050686A1 · Alturi et al. · 2018 [cited by applicant]
US 20180053413A1 · Patil et al. · 2018 [cited by applicant]
US 20180082501A1 · Kochar et al. · 2018 [cited by applicant]
US 20180086223A1 · Lindemann et al. · 2018 [cited by applicant]
US 20180101800A1 · Lecue et al. · 2018 [cited by applicant]
US 20180120843A1 · Berntorp et al. · 2018 [cited by applicant]
US 20180137593A1 · Djuric · 2018 [cited by examiner]
US 20180143635A1 · Zijderveld · 2018 [cited by examiner]
US 20180157923A1 · El Kaliouby et al. · 2018 [cited by applicant]
US 20180203455A1 · Cronin et al. · 2018 [cited by applicant]
US 20180208211A1 · Chiba · 2018 [cited by applicant]
US 20180238698A1 · Pedersen · 2018 [cited by applicant]
US 20180260414A1 · Gordo Soldevila · 2018 [cited by applicant]
US 20180266834A1 · Cronin · 2018 [cited by examiner]
US 20180303397A1 · Krupat et al. · 2018 [cited by applicant]
US 20180322112A1 · Bellegarda et al. · 2018 [cited by applicant]
US 20180330178A1 · El Kaliouby et al. · 2018 [cited by applicant]
US 20190018067A1 · Kong et al. · 2019 [cited by applicant]
US 20190033085A1 · Ogale et al. · 2019 [cited by applicant]
US 20190047584A1 · Donnelly · 2019 [cited by applicant]
US 20190049267A1 · Huang · 2019 [cited by applicant]
US 20190049957A1 · Healey et al. · 2019 [cited by applicant]
US 20190049969A1 · Qawami et al. · 2019 [cited by applicant]
US 20190050714A1 · Nosko et al. · 2019 [cited by applicant]
US 20190051069A1 · Cooley · 2019 [cited by applicant]
US 20190079659A1 · Adenwala et al. · 2019 [cited by applicant]
US 20190101985A1 · Sajda et al. · 2019 [cited by applicant]
US 20190102840A1 · Perl et al. · 2019 [cited by applicant]
US 20190113362A1 · Kline et al. · 2019 [cited by applicant]
US 20190122544A1 · Schlesinger et al. · 2019 [cited by applicant]
US 20190156596A1 · Followell et al. · 2019 [cited by applicant]
US 20190178678A1 · Rahbari-Asr et al. · 2019 [cited by applicant]
US 20190204840A1 · Park · 2019 [cited by examiner]
US 20190225232A1 · Blau · 2019 [cited by applicant]
US 20190226861A1 · Schimik et al. · 2019 [cited by applicant]
US 20190276037A1 · Ito et al. · 2019 [cited by applicant]
US 20190283762A1 · El Kaliouby et al. · 2019 [cited by applicant]
US 20190294159A1 · Pedersen et al. · 2019 [cited by applicant]
US 20190311614A1 · Yang et al. · 2019 [cited by applicant]
US 20190319477A1 · Manikfan · 2019 [cited by applicant]
US 20190332902A1 · Gallagher et al. · 2019 [cited by applicant]
US 20190370915A1 · Garden et al. · 2019 [cited by applicant]
US 20210091995A1 · Trim · 2021 [cited by examiner]
US 20210197867A1 · Kirk et al. · 2021 [cited by applicant]
US 20210217510A1 · Chakra · 2021 [cited by examiner]
US 20220005291A1 · Konrardy et al. · 2022 [cited by applicant]
US 20220036122A1 · Higa · 2022 [cited by applicant]
CN 107235045A · 2017 [cited by applicant]
KR 1020150050134A · 2015 [cited by applicant]
WO 2009061687A1 · 2009 [cited by applicant]
WO 2011080321A1 · 2011 [cited by applicant]
WO 2018094375A1 · 2018 [cited by applicant]
Villarejo, et al., “A Stress Sensor Based on Galvanic Skin Response (GSR) Controlled by ZigBee Sensors”, Sensors, 12, 6075-6101, 2012. [cited by applicant]
Author Unknown, “The Difference Between Robotic Process Automation and Artificial Intelligence”, CFB Bots, retrieved from https://medium.com/@cfb_bots, 7 pages, Apr. 20, 2018. [cited by applicant]
Gallego, “Stress Level Assessment with Non-Intrusive Sensors, Doctoral Thesis”, Universidad Carlos III De Madrid, accessed at http://www.tsc.uc3m.es/˜fhernando/ research/ ThesisFHG.pdf on Jun. 21, 2021, Apr. 2018. [cited by applicant]
Yang, Carl, et al., “Did You Enjoy the Ride: Understanding Passenger Experience via Heterogeneous Network Embedding”, 2018 IEEE 34th International Conference on Data Engineering, pp. 1392-1403, 2018. [cited by applicant]
Sekar, M., et al., “Carbon fiber based electrochemical sensor for sweat cortisol measurement”, Scientific Reports, 9:403-403, 2019. [cited by applicant]