IP Library Granted Patent US 12,038,745
Granted Patent B2
US 12,038,745 · App. 18/394,870 · Granted Jul 16, 2024

Transportation system to optimize an operating parameter of a vehicle based on a physiological state of an occupant of the vehicle determined from artificial intelligence analysis of a voice of the occupant

Inventor: Charles Howard Cella (Pembroke, MA)
Assignee: Strong Force TP Portfolio 2022, LLC
G05D1/0022B60W40/08G01C21/3438G01C21/3461G01C21/3469G01C21/3617G05B13/027G05D1/0088G05D1/0212G05D1/0287G05D1/224G05D1/225G05D1/226G05D1/227G05D1/228G05D1/229G05D1/24G06F40/40G06N3/0418G06N3/045G06N3/08G06N3/086G06N20/00G06Q30/0208G06Q50/188G06Q50/40G06V20/59G06V20/64G07C5/006G07C5/008G07C5/02G07C5/08G07C5/0808G07C5/0816G10L15/16G10L25/63B60W2040/0881G06N3/02G06Q30/0281G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,038,745
App. No.
18/394,870
Granted
Jul 16, 2024
Kind
B2
Abstract

A transportation system optimizes an operating parameter of a vehicle based on a physiological state of an occupant of the vehicle. The transportation system includes a sensor to sense a physiological condition of the occupant and to output data based on the sensed physiological condition. The sensor includes a voice capture system to capture a voice of the occupant and includes the voice as at least part of the output data. The transportation system further includes an artificial intelligence system to receive the output data, classifies an emotional state of the captured voice based on analysis of aspects of the output data and processes the classified emotional state of the captured voice to determine an emotional state of the occupant and to optimize, for achieving a favorable emotional state of the occupant, at least one operating parameter of the vehicle in response to the determined emotional state of the occupant.

Claims (34)

1. A transportation system configured to optimize an operating parameter of a vehicle based on a physiological state of an occupant of the vehicle, the transportation system comprising:

a sensor configured to sense a physiological condition of the occupant and to output data based on the sensed physiological condition, the sensor including a voice capture system configured to capture a voice of the occupant and to include the voice as at least part of the output data; and

an artificial intelligence system configured to receive the output data, to classify an emotional state of the captured voice based on analysis of aspects of the output data and to process the classified emotional state of the captured voice to determine an emotional state of the occupant and to optimize, for achieving a favorable emotional state of the occupant, at least one operating parameter of the vehicle in response to the determined emotional state of the occupant.

2. The transportation system of claim 1 , wherein the emotional state is further based on at least one of: traffic information, weather information, vehicle route information, a vehicle state, a physiological data of the occupant, in-vehicle audio content, a vehicle speed, a vehicle acceleration, a vehicle deceleration, a proximity to objects along the vehicle route, or a proximity to vehicles along the vehicle route.

3. The transportation system of claim 2 wherein the artificial intelligence system further comprises a first neural network trained to classify emotional states based on analysis of human voices.

4. The transportation system of claim 3 wherein the first neural network detects the emotional state of the occupant through processing the voice of the occupant and indicating at least one of the favorable emotional state, and an unfavorable emotional state of the occupant.

5. The transportation system of claim 1 , further comprising:

an intelligent agent module to provide a series of questions to the occupant and to obtain feedback from the occupant indicative of the emotional state of the occupant.

6. The transportation system of claim 5 wherein the series of questions are indicative of sources of stress including questions related to at least one of traffic conditions, potential for late arrival, and behavior of other drivers.

7. The transportation system of claim 6 wherein the series of questions are indicative of solutions to the stress including questions indicative of route options and communication options.

8. The transportation system of claim 7 wherein the intelligent agent module is configured to modify one of entertainment and ride options in the vehicle based on the feedback.

9. The transportation system of claim 7 wherein the intelligent agent module constrains optimization of vehicle parameters not related to the sources of stress.

10. The transportation system of claim 7 wherein the artificial intelligence system is configured to optimize the at least one operating parameter including to adjust at least one of: a route of the vehicle, in-vehicle audio content, a speed of the vehicle, an acceleration of the vehicle, a deceleration of the vehicle, a proximity to objects along the route, or a proximity to other vehicles along the route.

11. A method for optimizing an operating parameter of a vehicle based on a physiological state of an occupant of the vehicle, the method comprising:

sensing a physiological condition of the occupant and outputting data based on the sensed physiological condition, wherein the sensing includes:

capturing a voice of the occupant and providing the captured voice as at least part of the output data;

receiving, at an artificial intelligence system, the output data;

classifying an emotional state of the captured voice based on analysis of aspects of the output data;

processing the classified emotional state of the captured voice;

determining an emotional state of the occupant based on the processed classified emotional state of the captured voice; and

optimizing at least one operating parameter of the vehicle in response to the determined emotional state of the occupant.

12. The method of claim 11 wherein the emotional state is further based on at least one of: traffic information, weather information, vehicle route information, a vehicle state, physiological data of the occupant, in-vehicle audio content, a vehicle speed, a vehicle acceleration, a vehicle deceleration, a proximity to objects along the vehicle route, or a proximity to vehicles along the vehicle route.

13. The method of claim 12 , further comprising:

classifying, at a first neutral network, emotional states based on analysis of human voices.

14. The method of claim 13 , further comprising:

detecting the emotional state of the occupant through processing the voice of the occupant and indicating at least one of a favorable emotional state, and an unfavorable emotional state of the occupant.

15. The method of claim 11 , further comprising:

providing, at an intelligent agent module, a series of questions to the occupant; and

obtaining feedback from the occupant indicative of the emotional state of the occupant.

16. The method of claim 15 wherein the series of questions are indicative of sources of stress including questions related to at least one of traffic conditions, potential for late arrival, behavior of other drivers.

17. The method of claim 16 wherein the series of questions are indicative of solutions to the stress including questions indicative of route options and communication options.

18. The method of claim 17 wherein the intelligent agent module is configured to modify one of entertainment and ride options in the vehicle based on the feedback.

19. The method of claim 17 wherein the intelligent agent module constrains optimization of vehicle parameters not related to the sources of stress.

20. The method of claim 17 wherein the artificial intelligence system is configured to optimize the at least one operating parameter including to adjust at least one of: a route of the vehicle, in-vehicle audio content, a speed of the vehicle, an acceleration of the vehicle, a deceleration of the vehicle, a proximity to objects along the route, or a proximity to other vehicles along the route.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2024
From: CELLA, CHARLES HOWARD
To: STRONG FORCE TP PORTFOLIO 2022, LLC
Reel/Frame 066235/0543 →
Continuity (7)
Continuation 18371982 · Sep 22, 2023
Continuation 18113479 · Feb 23, 2023
Continuation 17976848 · Oct 30, 2022
Continuation 16694657 · Nov 25, 2019
Continuation PCTUS2019053857 · Sep 30, 2019
Provisional Application 62739335 · Sep 30, 2018
Related Publication 20240142969A1 · May 2, 2024