IP Library Granted Patent US 10,640,122
Granted Patent B2
US 10,640,122 · App. 15/479,539 · Granted May 5, 2020

Driving consciousness estimation device

Inventors: Hiroshi Kishi (Toyota, JP); Masakazu Akutsu (Toyota, JP); Motoyuki Akamatsu (Tsukuba, JP); Toshihisa Sato (Tsukuba, JP)
Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA; NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
B60W40/08B60R1/00B60W10/04B60W10/18B60W10/20B60W30/08B60W50/12B60W50/14B60W50/16G05D1/0061G05D1/0248G06K9/00845G08G1/165G08G1/166G08G1/167B60K2370/149B60K2370/152B60K2370/193B60K2370/21B60K2370/333B60K2370/334B60K2370/77B60N2002/981B60R2300/105B60R2300/107B60R2300/205B60R2300/301B60R2300/302B60R2300/804B60R2300/8006B60R2300/8033B60R2300/8093B60W2040/0818B60W2050/143B60W2050/146B60W2420/42B60W2520/105B60W2520/125B60W2520/14B60W2520/28B60W2540/26B60W2550/143B60W2550/30B60W2550/302B60W2550/308B60W2550/402B60W2720/106B60W2720/125B60W2720/14B60W2720/28B60W2750/302B60W2750/308G01S19/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,640,122
App. No.
15/479,539
Granted
May 5, 2020
Kind
B2
Abstract

A driving consciousness estimation device includes a driving readiness estimation unit configured to estimate a driving readiness relating to a driving consciousness of the driver from a driver's reaction to the travelling environment, a driving task demand estimation unit configured to estimate a driving task demand which is an index required for the driver with respect to the driving readiness from the travelling environment, and an attention awakening unit configured to execute awakening of attention for the driver relating to the driving of the vehicle based on the result of comparison between the driving readiness and the driving task demand.

Claims (45)

1. A driving consciousness estimation device comprising:

a driver image acquisition unit configured to acquire a driver image in which a driver of a vehicle is imaged;

a travelling environment recognition unit configured to recognize a travelling environment around the vehicle;

a driving readiness estimation unit configured to estimate a driving readiness relating to a driving consciousness of the driver from a driver's reaction to the travelling environment based on the driver image and the travelling environment;

a driving task demand estimation unit configured to estimate a driving task demand;

a margin calculation unit configured to calculate a result of comparison between a value of the driving readiness and a value of the driving task demand as a margin; and

an attention awakening unit configured to execute awakening of attention for the driver relating to the driving of the vehicle,

wherein the vehicle is capable of autonomous driving by shifting between a plurality of autonomous driving levels, the levels of autonomous driving being defined according to a degree of autonomous driving,

wherein the driving readiness is a degree of height of the driving consciousness of the driver,

wherein the driving task demand is calculated based on at least one of the following:

a vehicle speed of the vehicle,

time to collision between the vehicle and a preceding vehicle, and

a curvature of a road that the vehicle is traveling,

wherein the driving task demand is a required driving readiness required from the traveling environment, wherein, in a case where the margin is smaller than a margin threshold value, the attention awakening unit is configured to execute awakening of the attention, and

wherein the higher the executed autonomous driving level is in the vehicle, the smaller the margin threshold value used.

2. The driving consciousness estimation device according to claim 1 , further comprising:

a manual driving possibility determination unit configured to determine whether or not the driver is in a manual driving possible situation based on the result of comparison between the driving readiness and the driving task demand when an autonomous driving electronic control unit (ECU) of the vehicle ends the autonomous driving.

3. The driving consciousness estimation device according to claim 1 ,

wherein the driving readiness estimation unit is configured to calculate the number of saccades of eye balls per a predetermined time interval during a period when the driver is facing the extending direction of the road on which the vehicle is travelling based on the driver image and the travelling environment, and estimate the driving readiness based on the number of saccades.

4. The driving consciousness estimation device according to claim 3 , further comprising:

a manual driving possibility determination unit configured to determine whether or not the driver is in a manual driving possible situation based on the result of comparison between the driving readiness and the driving task demand when an autonomous driving electronic control unit (ECU) of the vehicle ends the autonomous driving.

5. A driving consciousness estimation device comprising:

a driver image acquisition unit configured to acquire a driver image in which a driver of a vehicle is imaged;

a travelling environment recognition unit configured to recognize a travelling environment around the vehicle;

a vehicle state recognition unit configured to recognize a travelling state of the vehicle;

a driving readiness estimation unit configured to estimate a driving readiness relating to a driving consciousness of the driver from a driver's reaction to the vehicle state based on the driver image and the vehicle state;

a driving task demand estimation unit configured to estimate a driving task demand;

a margin calculation unit configured to calculate a result of comparison between a value of the driving readiness and a value of the driving task demand as a margin; and

an attention awakening unit configured to execute awakening of attention for the driver relating to the driving of the vehicle,

wherein the vehicle is capable of autonomous driving by shifting between a plurality of autonomous driving levels, the levels of autonomous driving being defined according to a degree of autonomous driving,

wherein the driving readiness is a degree of height of the driving consciousness of the driver,

wherein the driving task demand is calculated based on at least one of the following:

a vehicle speed of the vehicle,

time to collision between the vehicle and a preceding vehicle, and

a curvature of a road that the vehicle is traveling,

wherein the driving task demand is a required driving readiness required from the traveling environment,

wherein, in a case where the margin is smaller than a margin threshold value, the attention awakening unit is configured to execute awakening of the attention, and

wherein the higher the executed autonomous driving level is in the vehicle, the smaller the margin threshold value used.

6. The driving consciousness estimation device according to claim 5 , further comprising:

a manual driving possibility determination unit configured to determine whether or not the driver is in a manual driving possible situation based on the result of comparison between the driving readiness and the driving task demand when an autonomous driving electronic control unit (ECU) of the vehicle ends the autonomous driving.

7. The driving consciousness estimation device according to claim 5 ,

wherein the vehicle state recognition unit is configured to recognize a longitudinal acceleration of the vehicle as the vehicle state, and

wherein the driving readiness estimation unit is configured to estimate the driving readiness from a head pitch angle of the driver with respect to the longitudinal acceleration of the vehicle based on the driver image and the longitudinal acceleration of the vehicle.

8. The driving consciousness estimation device according to claim 7 , further comprising:

a manual driving possibility determination unit configured to determine whether or not the driver is in a manual driving possible situation based on the result of comparison between the driving readiness and the driving task demand when an autonomous driving electronic control unit (ECU) of the vehicle ends the autonomous driving.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2017
From: KISHI, HIROSHI; AKUTSU, MASAKAZU; AKAMATSU, MOTOYUKI; SATO, TOSHIHISA
To: TOYOTA JIDOSHA KABUSHIKI KAISHA; NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
Reel/Frame 041862/0211 →
Priority Claims (1)
JP 2016-091401 · Apr 28, 2016 · national
Continuity (1)
Related Publication 20170313319A1 · Nov 2, 2017
Cited By (3)
US 12,246,728 US 12,296,862 US 12,600,350