IP Library Granted Patent US 12,124,259
Granted Patent B2
US 12,124,259 · App. 16/630,898 · Granted Oct 22, 2024

Vehicle control device and vehicle control method

Inventor: Eiji Oba (Tokyo, JP)
Assignee: Sony Semiconductor Solutions Corporation
G05D1/0061B60W40/09B60W60/0053G06F3/017B60K35/10B60K2360/146B60W2420/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,124,259
App. No.
16/630,898
Granted
Oct 22, 2024
Kind
B2
Abstract

There is provided a vehicle control device including an imager that images a driver, and circuitry configured to detect a gesture action indicating that the driver is awake based on an image captured by the imager, and switch a driving mode in response to the detected gesture action.

Claims (37)

1. A vehicle control device comprising:

an image sensor configured to capture images of a driver; and

circuitry configured to:

detect a reactivity and/or a degree of wakefulness of the driver;

estimate a wakeup recovery time of the driver based on the detected reactivity and/or degree of wakefulness of the driver;

perform an awakening operation based on the detected reactivity and/or degree of wakefulness of the driver and the estimated wakeup recovery time of the driver;

detect a gesture action indicating that the driver is awake based on the images captured by the imaging sensor,

wherein the circuitry is configured to detect, as the gesture action, a pointing and checking action that is performed in a vehicle traveling direction while the driver is viewing the vehicle traveling direction, and

wherein detecting the pointing and checking action includes detecting that a finger tip of the driver is within a first distance to the right or left of a line of sight of the driver and is within a second distance below the line of sight of the driver;

detect an action of gripping a steering wheel by the driver after detecting the pointing and checking action; and

switch the driving mode from an automatic driving mode to a manual driving mode in a case in which the action of gripping the steering wheel is detected.

2. The vehicle control device according to claim 1 , wherein the circuitry is configured to switch the driving mode from an automatic driving mode to a manual driving mode in a case in which the pointing and checking action is detected.

3. The vehicle control device according to claim 1 , wherein the circuitry is configured to detect the pointing and checking action on a basis of characteristics specific to the driver.

4. The vehicle control device according to claim 3 , wherein the circuitry is further configured to learn the characteristics specific to the driver on a basis of the detected pointing and checking action.

5. The vehicle control device according to claim 1 , wherein the circuitry is configured to detect the pointing and checking action performed after the driver is seated in a driver's seat.

6. The vehicle control device according to claim 5 , wherein the circuitry is further configured to detect a seated action of the driver after a notification of switching the driving mode is provided to the driver.

7. The vehicle control device according to claim 1 , wherein the circuitry is configured to detect the reactivity and/or degree of wakefulness of the driver based on at least one of a response of the driver to presentation of a sound to the driver and accuracy of steering wheel operation.

8. A vehicle control method comprising:

capturing images of a driver;

detecting a reactivity and/or a degree of wakefulness of the driver;

estimating a wakeup recovery time of the driver based on the detected reactivity and/or degree of wakefulness of the driver;

performing an awakening operation based on the detected reactivity and/or degree of wakefulness of the driver and the estimated wakeup recovery time of the driver;

detecting a gesture action indicating that the driver is awake based on the images captured by the imaging sensor,

wherein the gesture action is a pointing and checking action that is performed in a vehicle traveling direction while the driver is viewing the vehicle traveling direction, and

wherein detecting the pointing and checking action includes detecting that a finger tip of the driver is within a first distance to the right or left of a line of sight of the driver and is within a second distance below the line of sight of the driver;

detecting an action of gripping a steering wheel by the driver after detecting the pointing and checking action; and

switching the driving mode from an automatic driving mode to a manual driving mode in a case in which the action of gripping the steering wheel is detected.

9. A non-transitory computer readable medium storing instructions that, when executed by processing circuitry, perform a vehicle control method comprising:

capturing images of a driver;

detecting a reactivity and/or a degree of wakefulness of the driver;

estimating a wakeup recovery time of the driver based on the detected reactivity and/or degree of wakefulness of the driver;

performing an awakening operation based on the detected reactivity and/or degree of wakefulness of the driver and the estimated wakeup recovery time of the driver;

detect a gesture action indicating that the driver is awake based on the images captured by the imaging sensor,

wherein the circuitry is configured to detect, as the gesture action, a pointing and checking action that is performed in a vehicle traveling direction while the driver is viewing the vehicle traveling direction, and

wherein detecting the pointing and checking action includes detecting that a finger tip of the driver is within a first distance to the right or left of a line of sight of the driver and is within a second distance below the line of sight of the driver;

detect an action of gripping a steering wheel by the driver after detecting the pointing and checking action; and

switch the driving mode from an automatic driving mode to a manual driving mode in a case in which the action of gripping the steering wheel is detected.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2021
From: OBA, EIJI
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 055889/0667 →
Priority Claims (1)
JP 2017-141552 · Jul 21, 2017 · national
Continuity (1)
Related Publication 20200231182A1 · Jul 23, 2020
Cited By (1)
US 12,415,536