IP Library › Granted Patent US 10,232,861
Granted Patent B2
US 10,232,861 · App. 15/788,119 · Granted Mar 19, 2019

Apparatus, method and system for controlling a user situation awareness modification of a user of a vehicle

Inventors: Guangbin Huang (Singapore, SG); Olga Sourina (Singapore, SG); Yan Yang (Singapore, SG); Alexander Koenig (Munich, DE); Josef Schumann (Munich, DE); Ralf Decke (Unterhaching, DE); Cornelia Denk (Munich, DE); Philipp Kerschbaum (Munich, DE)
Assignee: Bayerische Motoren Werke Aktiengesellschaft
B60W50/14B60W40/08B60W50/16G06K9/00805G06K9/00845B60W2040/0818B60W2540/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,232,861
App. No.
15/788,119
Granted
Mar 19, 2019
Kind
B2
Abstract

The invention relates to an apparatus that is configured to receive a first user detection signal comprising information usable for determining a user situation awareness level. The apparatus also includes a processing module configured to determine a currently necessary situation awareness level by selecting one predefined situation awareness level from a plurality of predefined situation awareness levels based on driving information. The processing module is configured to determine a current user situation awareness level based on the information usable for determining the user situation awareness level. The processing module is configured to generate a control signal to control a user situation awareness modification module based on the currently necessary situation awareness level and the current user situation awareness level.

Claims (36)

1. An apparatus configured to control a user situation awareness modification of a user of a vehicle, the apparatus comprising:

an input module configured to receive a first user detection signal comprising information usable for determining a user situation awareness level; and

a processing module configured to determine a currently necessary situation awareness level by selecting one predefined situation awareness level from a plurality of predefined situation awareness levels based on driving information,

wherein the processing module is configured to determine a current user situation awareness level based on the information usable for determining the user situation awareness level,

wherein the processing module is configured to generate a control signal to control a user situation awareness modification module based on the currently necessary situation awareness level and the current user situation awareness level, and

wherein each of the plurality of predefined situation awareness levels is associated with a different desired user reaction time or a different desired time-to-takeover.

2. The apparatus according to claim 1 , wherein the processing module is configured to generate the control signal to control the user situation awareness modification module to trigger a modification of the current user situation awareness level to the currently necessary situation awareness level.

3. The apparatus according to claim 1 , wherein the processing module is configured to generate the control signal to modify the current user situation awareness level to reach the currently necessary situation awareness level within a currently necessary transition time threshold value.

4. The apparatus according to claim 3 , wherein the processing module is configured to determine the currently necessary transition time threshold value based on at least one of the driving information and at least one predetermined temporal value associated with the selected predefined situation awareness level.

5. The apparatus according to claim 1 , wherein the control signal generated by the processing module comprises information for selecting at least one user situation awareness modification parameter to be varied by the situation awareness modification module for modifying the current user situation awareness level towards the currently necessary situation awareness level.

6. The apparatus according to claim 5 , wherein the control signal comprises information for selecting the at least one user situation awareness modification parameter from a plurality of controllable user situation awareness modification parameters.

7. The apparatus according to claim 5 , wherein each user situation awareness modification parameter is associated with a modification intensity level for modifying the current user situation awareness level towards the currently necessary situation awareness level.

8. The apparatus according to claim 5 , wherein the at least one user situation awareness modification parameter is selected based on a currently necessary transition time threshold value.

9. The apparatus according to claim 5 , wherein the processing module is configured to select at least one user situation awareness modification parameter based on a previous modification of a previous user situation awareness level towards a previously necessary situation awareness level.

10. The apparatus according to claim 8 , wherein the processing module is configured to select a first user situation awareness modification parameter associated with a lower modification intensity level during a first time interval and to select a second user situation awareness modification parameter associated with a higher modification intensity level during a second time interval if a modification of the current user situation awareness levels towards the currently necessary situation awareness level is too slow.

11. The apparatus according to claim 1 , wherein the processing module is configured to generate the control signal to repeatedly or continuously trigger a user situation awareness modification by the user situation awareness modification module until the currently necessary user situation awareness level is reached.

12. The apparatus according to claim 1 , wherein the processing module is configured to determine the currently necessary situation awareness level at regular or predefined time intervals based on the driving information by repeatedly selecting one predefined situation awareness level from the plurality of predefined situation awareness levels.

13. The apparatus according to claim 1 , wherein the processing module is configured to:

generate the control signal based on a comparison between the current user situation awareness level and the currently necessary situation awareness level, and

to trigger a user situation awareness modification by the user situation awareness module if the current user situation awareness level is lower than the currently necessary situation awareness level.

14. The apparatus according to claim 1 , wherein the driving information comprises information related to at least one driving situation parameter and/or information related to a detected event outside the vehicle.

15. The apparatus according to claim 14 , wherein the information related to the detected event outside the vehicle is information related to a position or a movement of an object outside the vehicle and/or a time of detection of the event outside the vehicle.

16. The apparatus according to claim 1 , wherein the information usable for determining the current user situation awareness level comprises information related to a pulse rate of the user, a skin conductance of the user, a gaze direction of the user, a saccadic speed of the user, or image data related to the user and/or a time of change of a pulse rate of the user, a skin conductance of the user, a gaze direction of the user, a saccadic speed of the user, or image data related to the user.

17. The apparatus according to claim 1 , wherein the information usable for determining the current user situation awareness level comprises speed variation of the vehicle, acceleration variation of the vehicle or jerk information of the vehicle caused by the user.

18. A partly-autonomous or highly autonomous vehicle comprising an apparatus configured to control a user situation awareness modification of a user of a vehicle, the apparatus comprising:

an input module configured to receive a first user detection signal comprising information usable for determining a user situation awareness level; and

a processing module configured to determine a currently necessary situation awareness level by selecting one predefined situation awareness level from a plurality of predefined situation awareness levels based on driving information,

wherein the processing module is configured to determine a current user situation awareness level based on the information usable for determining the user situation awareness level,

wherein the processing module is configured to generate a control signal to control a user situation awareness modification module based on the currently necessary situation awareness level and the current user situation awareness level, and

wherein each of the plurality of predefined situation awareness levels is associated with a different desired user reaction time or a different desired time-to-takeover.

19. A method for controlling a user situation awareness modification of a user of a vehicle, the method comprising:

receiving a first user detection signal comprising information usable for determining a user situation awareness level;

determining a currently necessary situation awareness level by selecting one predefined situation awareness level from a plurality of predefined situation awareness levels based on driving information;

determining a current user situation awareness level based on the information usable for determining the user situation awareness level; and

generating a control signal to control a user situation awareness modification module based on the currently necessary situation awareness level and the current user situation awareness level,

wherein each of the plurality of predefined situation awareness levels is associated with a different desired user reaction time or a different desired time-to-takeover.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2018
From: HUANG, GUANGBIN; SOURINA, OLGA; YANG, YAN; KOENIG, ALEXANDER; SCHUMANN, JOSEF; DECKE, RALF; DENK, CORNELIA; KERSCHBAUM, PHILIPP
To: BAYERISCHE MOTOREN WERKE AKTIENGESELLSCHAFT
Reel/Frame 046502/0030 →
Continuity (2)
Continuation PCTEP2015058534 · Apr 20, 2015
Related Publication 20180043906A1 · Feb 15, 2018