IP Library Granted Patent US 10,308,258
Granted Patent B2
US 10,308,258 · App. 15/720,489 · Granted Jun 4, 2019

System and method for responding to driver state

Inventors: Kin C. Fung (Dublin, OH); Timothy J. Dick (Dublin, OH)
Assignee: Honda Motor Co., Ltd.
B60W40/08B60R25/25G06F19/00G06K9/00536G06K9/00845G07C5/02G07C9/00158G16H50/20B60W2540/22G06K2009/00939
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,308,258
App. No.
15/720,489
Filed
Sep 29, 2017
Granted
Jun 4, 2019
Kind
B2
Art Unit
3661
USPC
701/36
Abstract

A method for controlling vehicle systems includes receiving monitoring information from one or more monitoring systems and determining a plurality of driver states based on the monitoring information from the one or more monitoring systems. The method includes determining a combined driver state based on the plurality of driver states and modifying control of one or more vehicle systems based on the combined driver state.

Claims (60)

1. A method of controlling a vehicle system in a vehicle, comprising:

receiving monitoring information from one or more monitoring systems of the vehicle;

determining a first driver state of a driver and a second driver state of the driver based on the monitoring information from the one or more monitoring systems, wherein the first driver state is a behavioral driver state of the driver and the second driver state is a physiological driver state of the driver;

determining a combined driver state index by evaluating the first driver state and the second driver state together;

modifying a system status of the vehicle system as a function of the combined driver state index to increase alertness of the driver;

determining a third driver state of the driver based on the monitoring information from the one or more monitoring systems, wherein the third driver state is a vehicular sensed driver state;

determining a change in the combined driver state index based on the third driver state; and

modifying the vehicle system as a function of the third driver state.

2. The method of claim 1 , wherein the first driver state is determined based on eye movement information received from the one or more monitoring systems, and the second driver state is determined based on heart rate information received from the one or more monitoring systems.

3. The method of claim 1 , wherein the one or more monitoring systems includes a portable device associated with the driver, wherein the portable device stores user data about the driver tracked over time.

4. The method of claim 3 , wherein the second driver state is based on the user data about the driver tracked over time.

5. The method of claim 1 , including determining a vehicle state of the vehicle based on the monitoring information from the one or more monitoring systems, wherein the vehicle state is the system status of the vehicle system.

6. The method of claim 5 , including upon determining the driver is distracted based on the combined driver state index and upon determining the vehicle system is ON based on the system status, modifying the system status of the vehicle system as a function of the combined driver state index to increase alertness of the driver includes modifying the system status of the vehicle system to OFF.

7. The method of claim 1 , wherein determining the change in the combined driver state index based on the third driver state includes determining an increase in alertness of the driver from the combined driver state index.

8. The method of claim 1 , wherein the third driver state is an information transfer rate between the driver and the vehicle.

9. The method of claim 8 , wherein determining the change in the combined driver state index based on the third driver state includes determining an increase in alertness of the driver based on determining a high information transfer rate between the driver and the vehicle.

10. The method of claim 1 , wherein upon determining the driver is alert based on the change in the combined driver state index, modifying the vehicle system as a function of the third driver state includes modifying the system status to ON.

11. The method of claim 1 , wherein upon determining the driver is distracted based on the change in the combined driver state index, modifying the vehicle system as a function of the third driver state includes modifying the system status of the vehicle system to OFF for a period of time.

12. The method of claim 11 , determining a fourth driver state of the driver, wherein the fourth driver state is a physiological driver state of the driver, and the fourth driver state is based on stored monitoring information about the driver tracked over time received from a portable device of the driver.

13. The method of claim 12 , including determining the driver is alert based on the fourth driver state and modifying the system status of the vehicle system to ON.

14. A method of controlling a vehicle system in a vehicle, comprising:

receiving monitoring information from one or more monitoring systems of the vehicle;

determining a first driver state of a driver and a second driver state of the driver based on the monitoring information from the one or more monitoring systems;

determining a combined driver state index by evaluating the first driver state and the second driver state together;

modifying a system status of the vehicle system as a function of the combined driver state index to increase attention of the driver;

determining a third driver state of the driver based on the monitoring information from the one or more monitoring systems;

determining a second combined driver state index based on the third driver state; and

modifying the vehicle system by evaluating the combined driver state index and the second combined driver state index together.

15. The method of claim 14 , wherein the first driver state is a behavioral driver state based on behavioral information received from the one or more monitoring systems, the second driver state is a physiological driver state based on physiological information received from the one or more monitoring systems, and the third driver state is a vehicular sensed driver state based on vehicle information from the one or more monitoring systems.

16. The method of claim 14 , including identifying the driver based on the monitoring information from the one or more monitoring systems and receiving stored user data about the driver tracked over time from a wearable device associated with the driver.

17. The method of claim 16 , wherein the second driver state is based on the stored user data.

18. The method of claim 14 , including determining a vehicle state of the vehicle based on the monitoring information from the one or more monitoring systems, wherein the vehicle state is an auto control mode status indicating whether the vehicle is enabled for operating under automatic control.

19. The method of claim 18 , including upon determining the auto control mode status is ON and upon determining the combined driver state index indicates an inattentive driver, modifying the system status of the vehicle system as a function of the combined driver state index to increase attention of the driver includes modifying the system status to OFF.

20. The method of claim 14 , wherein modifying the system status of the vehicle system as a function of the combined driver state index to increase attention of the driver includes modifying the system status of the vehicle system to increase active driving of the vehicle by the driver.

21. The method of claim 20 , wherein determining the third driver state of the driver is based on vehicle information from the one or more monitoring systems, wherein the vehicle information is an information transfer rate between the driver and the vehicle in response to the driver transmitting information to the vehicle during active driving of the vehicle by the driver.

22. The method of claim 14 , wherein modifying the system status of the vehicle system as a function of the combined driver state index to increase attention of the driver includes modifying the system status of the vehicle system to increase manual control of the vehicle by the driver.

23. The method of claim 14 , wherein modifying the system status of the vehicle system as a function of the combined driver state index to increase attention of the driver includes modifying the system status of the vehicle system to OFF, and upon determining an increase in attention based on evaluating the combined driver state index and the second driver state together, modifying the vehicle system includes reactivating the vehicle system.

24. The method of claim 14 , including determining a fourth driver state of the driver based on the monitoring information from the one or more monitoring systems, wherein the fourth driver state is a behavioral driver state, and the fourth driver state is determined based on eye movement information received from the one or more monitoring systems.

25. The method of claim 24 , wherein determining the second combined driver state index based on the third driver state includes determining the second combined driver state index based on the third driver state and the fourth driver state.

26. The method of claim 14 , wherein modifying the vehicle system by evaluating the combined driver state index and the second combined driver state index together includes determining a change in the combined driver state index.

27. The method of claim 26 , wherein determining the change in the combined driver state index includes determining an increase in attention of the driver by comparing the combined driver state index to the second combined driver state index.

28. The method of claim 14 , including upon determining the attention of the driver meets a predetermined level based evaluating the combined driver state index and the second combined driver state index together, modifying the vehicle includes modifying the system status of the vehicle system to ON.

29. The method of claim 14 , including upon determining the driver is distracted by evaluating the combined driver state index and the second combined driver state index together, modifying the vehicle system includes disabling the vehicle system for a period of time.

30. A system for controlling a vehicle system in a vehicle, comprising:

a monitoring system for receiving monitoring information; and

an electronic control unit including a processor, wherein the processor:

determines a first driver state of a driver and a second driver state of the driver based on the monitoring information from the monitoring system, wherein the first driver state is a behavioral driver state of the driver and the second driver state is a physiological driver state of the driver;

determines a combined driver state index by evaluating the first driver state and the second driver state together;

modifies a system status of the vehicle system based on the combined driver state index to improve alertness of the driver;

determines a third driver state of the driver based on the monitoring information from the monitoring system, wherein the third driver state is a vehicular sensed driver state;

determines a change in the combined driver state index based on the third driver state; and

modifies the vehicle system as a function of the third driver state.

31. The system of claim 30 , wherein the monitoring system includes a wearable device associated with the driver, and wherein the wearable device tracks and stores user data patterns about the driver over time.

32. The system of claim 31 , wherein the processor determines the second driver state based on the user data patterns.

33. The system of claim 30 , wherein the processor modifies the system status of the vehicle system as a function of the combined driver state index by setting the system status of the vehicle system to require an increase in active driving of the vehicle by the driver to improve alertness of the driver.

34. The system of claim 30 , wherein the monitoring information indicates a flow of information from the driver to the vehicle, the processor calculates an information transfer rate based on the flow of information from the driver to the vehicle, and the processor determines the third driver state of the driver based on the information transfer rate.

35. The system of claim 30 , wherein upon the processor determining the driver is alert based on the change in the combined driver state index, the processor modifies the system status of the vehicle system to ON.

36. The system of claim 30 , wherein upon the processor determining the driver is distracted based on the change in the combined driver state index, the processor modifies the system status of the vehicle system to OFF for a period of time.

37. The system of claim 31 , wherein the processor determines a fourth driver state of the driver, wherein the fourth driver state is a physiological driver state of the driver, and the fourth driver state is based on the user data patterns received from the wearable device.

38. The system of claim 37 , wherein the processor determines the driver is alert based on the fourth driver state and the processor modifies the system status of the vehicle system to ON based on the fourth driver state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2017
From: FUNG, KIN C.; DICK, TIMOTHY J.
To: HONDA MOTOR CO., LTD.
Reel/Frame 043742/0009 →
Continuity (20)
Continuation 15656595 · Jul 21, 2017
Continuation 14851753 · Sep 11, 2015
Continuation PCTUS2015037019 · Jun 22, 2015
Continuation In Part 14573778 · Dec 17, 2014
Continuation In Part 14697593 · Apr 27, 2015
Continuation In Part 13858038 · Apr 6, 2013
Continuation In Part 14733836 · Jun 8, 2015
Continuation In Part 14744247 · Jun 19, 2015
Continuation In Part 14315726 · Jun 26, 2014
Continuation In Part 14461530 · Aug 18, 2014
Continuation In Part 13843077 · Mar 15, 2013
Continuation In Part 14074710 · Nov 7, 2013
Continuation In Part 14573778
Continuation In Part 14697593
Continuation In Part 14733836
Continuation In Part 14744247
Provisional Application 62016037 · Jun 23, 2014
Provisional Application 62098565 · Dec 31, 2014
Provisional Application 62016020 · Jun 23, 2014
Related Publication 20180022358A1 · Jan 25, 2018
Cited By (5)
US 12,216,465 US 12,216,466 US 12,242,262 US 12,242,264 US 12,430,889