IP Library Granted Patent US 10,410,250
Granted Patent B2
US 10,410,250 · App. 15/395,924 · Granted Sep 10, 2019

Vehicle autonomy level selection based on user context

Inventors: Abhishek Singhal (Santa Clara, CA); Gautam Muralidhar (San Jose, CA); Christopher F. Pouliot (San Mateo, CA); Edward H. Baik (Mountain View, CA); Jonathan A. Cox (San Jose, CA)
Assignee: NIO USA, Inc.
G06Q30/0266A61B5/01A61B5/024A61B5/08A61B5/165A61B5/18B60R11/04B60S1/62B60W10/04B60W10/18B60W10/20B60W30/09B60W40/04B60W40/08B60W40/09B60W40/105B60W50/0097B60W50/0098B60W50/08B60W50/082B62D15/0265G01C21/3407G01C21/3461G01C21/3469G01C21/3484G01C21/3492G01C21/3682G01C21/3691G01C21/3697G01S7/4021G01S7/497G01S13/862G01S13/865G01S13/867G01S13/87G01S15/02G01S17/89G02B27/0006G05D1/0061G05D1/0088G05D1/0212G05D1/0214G05D1/0221G05D1/0276G06F16/29G06F16/95G06Q30/0269G08G1/161G08G1/163G08G1/164G08G1/165G08G1/166B60W2040/0809B60W2050/0004B60W2050/0014B60W2300/34B60W2510/08B60W2510/18B60W2520/04B60W2520/105B60W2540/18B60W2540/22B60W2540/28B60W2540/30B60W2550/10B60W2550/30B60W2710/18B60W2710/20B60W2750/40B60W2900/00G01S2007/4043G01S2007/4977G01S2013/935G01S2013/936G01S2013/9325G01S2013/9342G01S2013/9346G01S2013/9353G01S2013/9357G01S2013/9375G01S2013/9378G01S2013/9382G01S2013/9385G01S2013/9389G05D2201/0212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,410,250
App. No.
15/395,924
Granted
Sep 10, 2019
Kind
B2
Abstract

Embodiments herein relate to an autonomous vehicle or self-driving vehicle. The level of comfort with autonomous driving offered to the user and the parameters of operation of the autonomous vehicle might increase or decrease a driver's comfort (anxiety) with the vehicle. Sensors in the vehicle can detect a user's driving style, comfort level and may propose an autonomy level to the user and/or parameters of operation.

Claims (39)

1. A vehicle, comprising:

a sensor configured to sense driving functions associated with an operation of the vehicle;

a vehicle control system configured to autonomously control driving functions of the vehicle; and

a processor in communication with the sensor and the vehicle control system, the processor configured to:

receive information from the sensor when a driver of the vehicle is operating the vehicle in a manual operational mode, wherein the information corresponds to driving functions performed by the driver in the manual operational mode;

determine, based on the information received from the sensor, a manual control behavior for the driving functions performed by the driver in the manual operational mode, the manual control behavior defining a manual driving style of the driver;

determine, based on the determined manual control behavior, an autonomous operational mode for controlling driving functions of the vehicle during an autonomous operation of the vehicle, wherein the autonomous operational mode includes an autonomous control behavior that mimics the manual control behavior and matches the manual driving style of the driver;

send the autonomous operational mode to the vehicle control system to control driving functions of the vehicle during the autonomous operation of the vehicle using the determined autonomous control behavior that mimics the determined manual control behavior and matches the manual driving style of the driver;

monitor, while the vehicle control system is autonomously controlling a driving function of the vehicle using the determined autonomous control behavior, a biometric characteristic of the driver to determine a level of anxiety of the driver; and

present, in response to determining an increased level of anxiety of the driver above a baseline level of anxiety for the driver, an option for the driver to take control over the vehicle.

2. The vehicle of claim 1 , wherein the determined manual control behavior is stored as a driving characteristic in a driver behavior data structure.

3. The vehicle of claim 2 , wherein the driving characteristic is one or more of a speed characteristic, an acceleration or deceleration characteristic, a distance characteristic, a steering angle characteristic, and/or a lane change characteristic performed by the driver in the manual operational mode.

4. The vehicle of claim 3 , wherein the autonomous operational mode establishes a level of autonomy for the vehicle control system to control the vehicle, and wherein the operational mode is one of a Level 4 or a High Automation Level and a Level 5 or a Full Automation Level.

5. The vehicle of claim 4 , wherein the autonomous operational mode is represented by an autonomous operational mode data structure and wherein the autonomous operational mode data structure comprises an autonomy level indicator indicative of one of Level 0, Level 1, Level 2, Level 3, Level 4, and Level 5.

6. The vehicle of claim 5 , wherein the autonomous operational mode data structure further comprises one or more of an inter-vehicle distance setting, an acceleration or deceleration setting, a speed setting, and/or a lane change setting.

7. The vehicle of claim 6 , wherein, while the vehicle control system is autonomously controlling the driving function of the vehicle, sensors measure the biometric characteristic of the driver and/or a biometric characteristic of a passenger to determine the level of anxiety of the driver and/or a level of anxiety of the passenger.

8. The vehicle of claim 7 , wherein the biometric characteristic of the driver and/or the passenger is stored in an anxiety level data structure and compared against a baseline level for the driver and/or the passenger to determine whether the driver and/or the passenger has an increased level of anxiety in response to a sensed driving event.

9. The vehicle of claim 8 , wherein the biometric characteristic of the driver and/or the passenger is one or more of a heart rate characteristic, a breathing rate characteristic, a body temperature characteristic, and/or an eye characteristic.

10. The vehicle of claim 9 , wherein the comparison of the biometric characteristic of the driver and/or the passenger to the baseline level for the biometric characteristic indicates that the driver and/or the passenger has an increased level of anxiety in response to the sensed driving event.

11. The vehicle of claim 10 , wherein based on the increased level of anxiety of the passenger, the processor changes the level of autonomy used to control the vehicle.

12. A method, comprising:

receiving, from a sensor configured to sense driving functions associated with an operation of a vehicle, information corresponding to driving functions performed by a driver while operating the vehicle in a manual operational mode;

determining, via a processor and based on the information received from the sensor, a manual control behavior for the driving functions performed by the driver in the manual operational mode, the manual control behavior defining a manual driving style of the driver;

determining, via the processor and based on the determined manual control behavior, an autonomous operational mode for controlling driving functions of the vehicle during an autonomous operation of the vehicle, wherein the autonomous operational mode includes an autonomous control behavior that mimics the manual control behavior and matches the manual driving style of the driver;

sending, via the processor, the autonomous operational mode to a vehicle control system to control driving functions of the vehicle during the autonomous operation of the vehicle using the determined autonomous control behavior that mimics the determined manual control behavior and matches the manual driving style of the driver;

controlling, autonomously via a vehicle control system, driving functions of the vehicle during the autonomous operation of the vehicle based on the autonomous operational mode sent by the processor to mimic the determined manual control behavior and match the manual driving style of the driver;

monitoring, while the vehicle control system is autonomously controlling the driving functions of the vehicle using the determined autonomous control behavior, a biometric characteristic of the driver to determine a level of anxiety of the driver; and

presenting, in response to determining an increased level of anxiety of the driver above a baseline level of anxiety for the driver, an option for the driver to take control over the vehicle.

13. The method of claim 12 , wherein the determined manual control behavior is stored as a driving characteristic in a driver behavior data structure, wherein the driving characteristic is one or more of a speed characteristic, an acceleration or deceleration characteristic, an inter-vehicle distance characteristic, and/or a lane change characteristic performed by the driver in the manual operational mode.

14. The method of claim 13 , wherein the autonomous operational mode establishes a level of autonomy for the vehicle control system to control the vehicle, wherein the autonomous operational mode is represented by an autonomous operational mode data structure, wherein the autonomous operational mode data structure comprises one or more of an autonomy level, a distance setting, an acceleration setting, a speed setting, and/or a lane change setting, and wherein the operational mode data structure comprises an autonomy level indicator indicative of one of Level 0, Level 1, Level 2, Level 3, Level 4, and Level 5.

15. The method of claim 14 , wherein, while the vehicle control system is autonomously controlling a driving function of the vehicle, sensors measure the biometric characteristic of the driver and/or a biometric characteristic of a passenger to determine a level of anxiety of the driver and/or a level of anxiety of the passenger, wherein the biometric characteristic of the driver and/or the passenger is stored in an anxiety level data structure, wherein the autonomy level is one of a Level 4 or a High Automation Level and a Level 5 or a Full Automation Level, and wherein the biometric characteristic of the driver and/or the passenger is one of a driver identifier, a passenger identifier, a heart characteristic, a breath characteristic, a temperature characteristic, and/or an eye characteristic.

16. The method of claim 15 , wherein the biometric characteristic of the driver and/or the passenger indicates that the driver or the passenger has an increased level of anxiety, wherein the biometric characteristic of the driver and/or the passenger is compared against a baseline level for the driver and/or the passenger to determine whether the driver and/or the passenger has an increased level of anxiety in response to a sensed driving event, and wherein based on the increased level of anxiety of the passenger, the processor changes the level of autonomy used to control the vehicle.

17. A method of controlling a vehicle via a vehicle control system, comprising:

while the vehicle control system is autonomously controlling driving functions of the vehicle, measuring, by on board vehicle sensors, a biometric characteristic of a driver and/or a passenger to determine a level of anxiety of the driver and/or passenger;

comparing the biometric characteristic to a baseline level for the biometric characteristic to determine that the driver or passenger has an increased level of anxiety in response to the autonomously controlled driving functions; and

based on the increased level of anxiety, the vehicle control system proposes to the driver to take control over the vehicle and control the driving functions of the vehicle in a fully-manual level of operation.

18. The method of claim 17 , wherein the biometric characteristic is one or more of a heart rate characteristic, a breathing rate characteristic, a body temperature characteristic, and/or an eye characteristic.

19. The method of claim 17 , wherein the vehicle control system is autonomously controlling the driving function of the vehicle mimicking a learned manual driving style associated with the driver.

20. The method of claim 19 , wherein the learned manual driving style is stored as driving characteristics in a driver behavior data structure, and wherein the learned manual driving style is determined by a processor of the vehicle receiving, from a sensor, information corresponding to driving functions performed by the driver while operating the vehicle in a manual operational mode, determining based on the information received from the sensor, a manual control behavior for the driving functions performed by the driver in the manual operational mode, and wherein the manual control behavior defines a manual driving style for the driver.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2022
From: NIO USA, INC.
To: NIO TECHNOLOGY (ANHUI) CO., LTD.
Reel/Frame 060171/0724 →
CHANGE OF NAME Recorded Aug 18, 2017
From: NEXTEV USA, INC.
To: NIO USA, INC.
Reel/Frame 043600/0972 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2017
From: SINGHAL, ABHISHEK; MURALIDHAR, GAUTAM; POULIOT, CHRISTOPHER F.; BAIK, EDWARD H.; COX, JONATHAN A.
To: NEXTEV USA, INC.
Reel/Frame 041643/0018 →
Continuity (2)
Provisional Application 62424976 · Nov 21, 2016
Related Publication 20180141568A1 · May 24, 2018
Cited By (3)
US 12,188,778 US 12,384,410 US 12,554,257