IP Library Granted Patent US 11,934,186
Granted Patent B2
US 11,934,186 · App. 18/370,362 · Granted Mar 19, 2024

Augmented reality in a vehicle configured for changing an emotional state of a rider

Inventor: Charles Howard Cella (Pembroke, MA)
Assignee: Strong Force TP Portfolio 2022, LLC
G05D1/0022B60W40/08G01C21/3438G01C21/3461G01C21/3469G01C21/3617G05B13/027G05D1/0088G05D1/0212G05D1/0287G05D1/224G05D1/225G05D1/226G05D1/227G05D1/228G05D1/229G05D1/24G05D1/646G05D1/692G06F40/40G06N3/0418G06N3/045G06N3/08G06N3/086G06N20/00G06Q30/0208G06Q50/188G06Q50/40G06V20/59G06V20/64G07C5/006G07C5/008G07C5/02G07C5/08G07C5/0808G07C5/0816G10L15/16G10L25/63B60W2040/0881G06N3/02G06Q30/0281G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,934,186
App. No.
18/370,362
Granted
Mar 19, 2024
Kind
B2
Abstract

Vehicles and methods described herein include a vehicle that operates with a rider according to an operating parameter. The vehicle includes: a physiological monitoring sensor configured to measure a physiological parameter of the rider; an experience hybrid neural network trained on outcomes related to a rider in-vehicle experience associated with the physiological parameter to determine an emotional state of the rider; an augmented reality system configured to present augmented reality content to the rider of the vehicle based, at least in part, on the operating parameter; and an optimization hybrid neural network that identifies a variation in the operating parameter to change the emotional state of the rider and that generates a command to vary the operating parameter and the augmented reality content according to the variation.

Claims (32)

1. A vehicle that operates with a rider according to an operating parameter, the vehicle comprising:

a set of physiological monitoring sensors configured to measure a physiological parameter of riders of the vehicle;

an experience neural network trained on data related to a set of rider in-vehicle experiences to determine a state of the rider by processing outputs of the set of physiological monitoring sensors;

an augmented or virtual reality system configured to present augmented reality content to the rider of the vehicle based, at least in part, on the operating parameter; and

an optimization neural network that automatically identifies a variation in the operating parameter to improve a measure of the state of the rider and generates a command to vary the operating parameter and the augmented reality content according to the variation.

2. The vehicle of claim 1 , wherein the optimization neural network identifies the variation, at least in part, by controlling a timing and an extent of the variation.

3. The vehicle of claim 1 , wherein the operating parameter indicates entertainment content presented to the rider.

4. The vehicle of claim 3 , wherein the optimization neural network identifies the variation based, at least in part, on what entertainment is most effective for the rider to change the state of the rider.

5. The vehicle of claim 4 , wherein the optimization neural network identifies the variation based, at least in part, on social media data associated with the rider.

6. The vehicle of claim 4 , wherein the experience neural network and the optimization neural network collectively perform at least one of random variations or systematized variations of various combinations of operating parameters to predict the state of the rider.

7. The vehicle of claim 6 , wherein the various combinations include combinations of entertainment settings, seat settings, suspension settings, and route types.

8. The vehicle of claim 6 , wherein the experience neural network and the optimization neural network include genetic programming that promotes favorable combinations of the various combinations and eliminates unfavorable combinations of the various combinations to predict the state of the rider.

9. The vehicle of claim 6 , wherein at least one of the experience neural network or the optimization neural network includes perceptrons that mimic human senses to determine a likely emotional state of the rider as the state of the rider after presenting the variation in the operating parameter.

10. The vehicle of claim 1 , wherein the vehicle further includes a location registration system that registers a location and an orientation of the vehicle, and wherein the augmented reality system is configured to retrieve the location and the orientation from the location registration system and to present the augmented reality content based on the location and the orientation.

11. A method of operating a vehicle having a rider according to an operating parameter, the method comprising:

measuring a physiological parameter of the rider with a physiological monitoring sensor;

determining an emotional state of the rider using an experience neural network trained on outcomes related to a rider in-vehicle experience associated with the physiological parameter;

presenting augmented reality content to the rider of the vehicle based, at least in part, on the operating parameter using an augmented reality system;

identifying, using an optimization neural network, a variation in the operating parameter that changes the emotional state of the rider; and

generating a command to vary the operating parameter and the augmented reality content according to the variation.

12. The method of claim 11 , wherein identifying the variation is based, at least in part, on controlling a timing and an extent of the variation.

13. The method of claim 11 , wherein operating the vehicle according to the operating parameter includes indicating entertainment content presented to the rider.

14. The method of claim 13 , wherein identifying the variation is based, at least in part, on what entertainment is most effective for the rider to change the emotional state of the rider.

15. The method of claim 14 , wherein identifying the variation is based, at least in part, on social media data associated with the rider.

16. The method of claim 14 , wherein identifying the variation includes performing at least one of random variations or systematized variations of various combinations of operating parameters to predict the emotional state of the rider.

17. The method of claim 16 , wherein the various combinations include combinations of entertainment settings, seat settings, suspension settings, and route types.

18. The method of claim 16 , wherein identifying the variation further includes using genetic programming that promotes favorable combinations of the various combinations and eliminates unfavorable combinations of the various combinations to predict the emotional state of the rider.

19. The method of claim 16 , further comprising utilizing perceptrons that mimic human senses to determine a likely emotional state of the rider after presenting the variation in the operating parameter.

20. The method of claim 11 , further comprising;

registering, at the vehicle, a location and an orientation of the vehicle;

retrieving, at the augmented reality system, the location and the orientation from the vehicle; and

presenting the augmented reality content based on the location and the orientation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2023
From: CELLA, CHARLES HOWARD
To: STRONG FORCE TP PORTFOLIO 2022, LLC
Reel/Frame 065864/0141 →
Continuity (6)
Continuation 18113510 · Feb 23, 2023
Continuation 17976848 · Oct 30, 2022
Continuation 16694657 · Nov 25, 2019
Continuation PCTUS2019053857 · Sep 30, 2019
Provisional Application 62739335 · Sep 30, 2018
Related Publication 20240004382A1 · Jan 4, 2024
Cited By (1)
US 12,673,569