IP Library › Granted Patent US 12,062,232
Granted Patent B2
US 12,062,232 · App. 16/652,639 · Granted Aug 13, 2024

Viewing digital content in a vehicle without suffering from motion sickness

Inventor: Daniel Profendiner (Ingolstadt, DE)
Assignee: AUDI AG
G06V20/20G06F1/163H04W4/40H04W4/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,062,232
App. No.
16/652,639
Granted
Aug 13, 2024
Kind
B2
Abstract

Digital content can be viewed in a vehicle without suffering from motion sickness by use of a system which includes a vehicle and data glasses. The vehicle includes a control unit and a plurality of sensors connected to the control unit. The data glasses can be wirelessly connected to the control unit and are intended to display a virtual 3-D integrating the digital content.

Claims (56)

1. A system for viewing digital content in a vehicle, the system comprising:

a plurality of sensors, and

a controller of the vehicle, connected to the plurality of sensors, configured to calculate control variables related to a virtual three-dimensional scene (virtual 3-D scene) and a movement of the vehicle from sensor data received from the plurality of sensors, so that the control variables are wirelessly transmittable to other processor to control a calculation of the virtual 3-D scene in real time by the other processor in a manner consistent with a movement of the vehicle, the sensor data being pre-processed by the controller so that the controller calculates from the sensor data fewer control variables than the sensor data, the fewer control variables reducing a volume of data to be transmitted; and

data glasses to wirelessly communicate with the controller of the vehicle and including the other processor to control wireless connectivity to the controller of the vehicle, the other processor of the data glasses further configured to,

receive the control variables from the controller of the vehicle,

calculate a virtual 3-D scene based on the control variables received from the controller of the vehicle, and

control the data glasses to display the virtual 3-D scene with the digital content integrated in the virtual 3-D scene in the real time in the manner consistent with the movement of the vehicle so as to reduce motion sickness of an occupant of the vehicle wearing the data glasses.

2. The system as claimed in claim 1 , wherein

the vehicle and the data glasses each have at least one wireless communication interface, and

the at least one wireless communication interface includes at least one of an infrared wireless communication interface, a Bluetooth wireless communication interface, a WiFi wireless communication interface, or a near field communication wireless communication interface.

3. The system as claimed in claim 1 , wherein the control variables calculated by the controller include an absolute position, an angle with respect to a horizon, a lateral acceleration, and a longitudinal acceleration of the vehicle.

4. The system as claimed in claim 1 , wherein the data glasses are configured to, before calculating the virtual 3-D scene, perform post-processing on the control variables received from the controller by smoothing the control variables.

5. The system as claimed in claim 1 , further comprising:

a mobile terminal, wirelessly connectable to the vehicle and/or to the data glasses, configured to display vehicle parameters and/or journey parameters, and

wherein the data glasses are configured to integrate a virtual terminal corresponding to the mobile terminal as the digital content into the virtual 3-D scene, such that the vehicle parameters and/or the journey parameters displayed by the mobile terminal are visible on the virtual terminal.

6. The system as claimed in claim 5 , wherein,

the mobile terminal is a smartwatch, and

the data glasses are configured to integrate a virtual smartwatch corresponding to the smartwatch as the digital content into the virtual 3-D scene, such that the vehicle parameters and/or the journey parameters displayed by the smartwatch are visible on the virtual smartwatch.

7. The system as claimed in claim 1 , wherein the data glasses are configured to integrate a visual indication, for a wearer of the data glasses, into the virtual 3-D scene to request the wearer of the data glasses to remove the data glasses.

8. The system as claimed in claim 1 , wherein the data glasses are configured to display a portal as a visual indication in the virtual 3-D scene to request a wearer of the data glasses to remove the data glasses.

9. The system as claimed in claim 1 , wherein,

the data glasses include:

at least one optical sensor configured to capture an environment of the data glasses, and

a memory to store a digital model of an interior environment of the vehicle, and

the data glasses are configured to use the digital model to distinguish between static parts of the environment captured by the at least one optical sensor, which correspond to the interior environment, and dynamic parts of the environment captured by the at least one optical sensor, which correspond to an exterior environment of the vehicle visible through a window of the vehicle, so as to integrate into the virtual 3-D scene a visual indication as the digital content based on the static parts of the environment and the dynamic parts of the environment.

10. The system as claimed in claim 1 , wherein the vehicle is configured to adjust a position of a seat and an airbag of the vehicle when the occupant wearing the data glasses is seated in the seat, to increase a distance between the seat and the airbag.

11. The system as claimed in claim 1 , wherein the data glasses are configured to:

integrate information relating to objects in an environment of the vehicle into the virtual 3-D scene, and/or

play back a two-dimensional moving image, on a virtual screen integrated into the virtual 3-D scene, the virtual screen being displayed in the virtual 3-D scene which corresponds to the two-dimensional moving image in terms of content.

12. The system as claimed in claim 1 , wherein

a frequency at which the controller calculates the control variables from the sensor data received from the plurality of sensors is lower than a frequency at which the controller receives the sensor data from the plurality of sensors.

13. Data glasses for a vehicle, comprising:

a communication interface configured to wirelessly connect to a controller of a vehicle to receive control variables related to a virtual three-dimensional scene (virtual 3-D scene) and movement of the vehicle calculated by the controller of the vehicle based on sensor data received by the controller of the vehicle from a plurality of sensors of the vehicle, so that the virtual 3-D scene is calculatable in real time based on the control variables in a manner consistent with a movement of the vehicle, the sensor data being pre-processed by the controller so that the controller calculates from the sensor data fewer control variables than the sensor data, the fewer control variables reducing to reduce a volume of data to be transmitted and received by the communication interface; and

a processor configured to

calculate a virtual 3-D scene based on the control variables received from the controller of the vehicle, and

control the data glasses to display the virtual 3-D scene with digital content integrated in the virtual 3-D scene in the real time in the manner consistent with the movement of the vehicle so as to reduce motion sickness of an occupant of the vehicle wearing the data glasses.

14. The data glasses as claimed in claim 13 , wherein the control variables calculated by the controller include an absolute position, an angle with respect to a horizon, a lateral acceleration, and a longitudinal acceleration of the vehicle.

15. The data glasses as claimed in claim 13 , wherein the processor is configured to, before calculating the virtual 3-D scene, perform post-processing on the control variables received from the controller by smoothing the control variables.

16. The data glasses as claimed in claim 13 , wherein

the communication interface is configured to wirelessly connect to a mobile terminal which is configured to display vehicle parameters and/or journey parameters of the vehicle, and

the processor is configured to integrate a virtual terminal corresponding to the mobile terminal as the digital content into the virtual 3-D scene, such that the vehicle parameters and/or the journey parameters displayed by the mobile terminal are visible on the virtual terminal.

17. The data glasses as claimed in claim 13 , further comprising:

at least one optical sensor configured to capture an environment of the data glasses; and

a memory to store a digital model of an interior environment of the vehicle,

wherein

the processor is configured to use the digital model to distinguish between static parts of the environment captured by the at least one optical sensor, which correspond to the interior environment, and dynamic parts of the environment captured by the at least one optical sensor, which correspond to an exterior environment of the vehicle, so as to integrate into the virtual 3-D scene a visual indication as the digital content based on the static parts of the environment and the dynamic parts of the environment.

18. The data glasses as claimed in claim 13 , wherein the processor is configured to:

integrate information relating to objects in an environment of the vehicle into the virtual 3-D scene, and/or

play back a two-dimensional moving image, on a virtual screen integrated into the virtual 3-D scene, the virtual screen being displayed in the virtual 3-D scene which corresponds to the two-dimensional moving image as the digital content.

19. A method of displaying digital content in a vehicle, the method comprising:

obtaining sensor data, by a plurality of sensors of the vehicle, relating to movement of the vehicle;

calculating, by a controller of the vehicle, control variables related to a virtual three-dimensional scene (virtual 3-D scene) and the movement of the vehicle, from the sensor data obtained by the plurality of sensors, so that the virtual 3-D scene is calculatable in real time based on the control variables in a manner consistent with a movement of the vehicle, the sensor data being pre-processed by the controller so that the controller calculates from the sensor data fewer control variables than the sensor data, the fewer control variables reducing a volume to be transmitted;

wirelessly transmitting, by the controller of the vehicle, the control variables to a processor of data glasses wirelessly connected to the controller of the vehicle;

calculating, by the processor of the data glasses, a virtual 3-D scene based on the control variables received from the controller of the vehicle; and

displaying, by the data glasses, the virtual 3-D scene with the digital content integrated in the virtual 3-D scene in the real time in the manner consistent with the movement of the vehicle so as to reduce motion sickness of an occupant of the vehicle wearing the data glasses.

20. The method as claimed in claim 19 , wherein the control variables calculated by the controller include an absolute position, an angle with respect to a horizon, a lateral acceleration, and a longitudinal acceleration of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2020
From: PROFENDINER, DANIEL
To: AUDI AG
Reel/Frame 052277/0381 →
Priority Claims (1)
DE 10 2017 217 592.3 · Oct 4, 2017 · national
Continuity (1)
Related Publication 20200242361A1 · Jul 30, 2020