IP Library › Granted Patent US 10,146,221
Granted Patent B2
US 10,146,221 · App. 15/128,036 · Granted Dec 4, 2018

Information presenting apparatus and information presenting method

Inventor: Masami Funakawa (Kanagawa, JP)
Assignee: Nissan Motor Co., Ltd.
G05D1/0061B60K28/066B60W30/14B60W30/16B60W30/182B60W40/08B60W50/082B60W50/14B60W2040/089B60W2040/0827B60W2040/0863B60W2050/146B60W2540/02B60W2540/04B60W2540/26B60W2900/00G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,146,221
App. No.
15/128,036
Granted
Dec 4, 2018
Kind
B2
Abstract

An information presenting apparatus is used in an autonomous vehicle capable of switching between autonomous driving control and manual driving control. The information presenting apparatus determines a response action for checking that the driver is ready to take over when the autonomous driving control is switched to the manual driving control, performs control for requesting the driver to perform the response action determined, and detects the response action performed by the driver.

Claims (49)

1. An information presenting apparatus for use in an autonomous vehicle capable of switching between autonomous driving control and manual driving control, in which the vehicle is driven by a driver, the information presenting apparatus comprising:

a memory; and

a processor configured to execute instructions stored in the memory to:

determine a response action to be performed by the driver of the autonomous vehicle, wherein

the response action being indicative of a driving operation of the autonomous driving control, and

the driving operation being selected from a plurality of self-vehicle behavior candidates of the autonomous driving control;

perform control for requesting the driver to perform the response action;

detect whether the driver performed the response action;

in response to detecting that the response action is not performed by the driver:

set a flag indicating that the driver is not ready take over when the autonomous driving control is switched to the manual driving control; and

in response to detecting that the response action is performed by the driver:

set the flag indicating that the driver is ready to take over when the autonomous driving control is switched to the manual driving control; and

maintain the autonomous driving control of the autonomous vehicle, wherein

performance, by the driver, of the response action, is indicative of an approval of the driver of the continuance of the autonomous driving, and

when a point to switch from the autonomous driving control to the manual driving control is predetermined, the processor shortens an interval for requesting the driver to perform the response action as the predetermined point approaches.

2. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to receive only an affirmative response from the driver.

3. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to receive only a negative response from the driver.

4. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to receive both an affirmative response and a negative response from the driver.

5. The information presenting apparatus according to claim 1 , wherein the processor is further configured to execute instructions stored in the memory to:

on condition that a frequency of the response action is below a predetermined frequency, ask the driver a question to which a response is inevitable.

6. The information presenting apparatus according to claim 1 , wherein the response action is a button operation by the driver.

7. The information presenting apparatus according to claim 1 , wherein the response action is a response speech by the driver.

8. The information presenting apparatus according to claim 7 , wherein when a frequency of the speech or a dialogue by the driver is below a predetermined frequency, a question to which the speech or the dialogue is inevitable is asked to the driver.

9. The information presenting apparatus according to claim 7 , wherein the processor is configured to execute instructions stored in the memory to shorten an interval of requesting the driver to perform the response action when the driver makes an inappropriate speech or dialogue.

10. The information presenting apparatus according to claim 1 , wherein the response action is a dialogue with the driver.

11. The information presenting apparatus according to claim 10 , wherein when the driver has a low level of awareness of surroundings in the dialogue with the driver, the dialogue with the driver is repeated.

12. The information presenting apparatus according to claim 1 , wherein the processor is further configured to execute instructions stored in the memory to:

stop the autonomous driving control of the autonomous vehicle when the driver does not perform the response action.

13. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to request the driver to perform the response action every time a predetermined period of time passes or every time the autonomous vehicle performs a predetermined number of cruise control operations.

14. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to request the driver to perform the response action when detecting that the driver is not awake or is not watching ahead.

15. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to set timing to request the driver to perform the response action, based on a state of the driver and a travelling condition and outside circumstance of the autonomous vehicle.

16. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to delay timing to request the driver to perform the response action when the driver manually drives the autonomous vehicle.

17. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to when requesting to perform the response action, display a pattern formed by spatial-frequency and temporal-frequency having no luminance edge.

18. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to when requesting to perform the response action, provide the driver with sensory stimulation in synchronization with displaying an image.

19. An information presenting method performed by an information presenting apparatus for use in an autonomous vehicle capable of switching between autonomous driving control and manual driving control, in which the vehicle is driven by a driver, the information presenting method comprising:

determining a response action for maintaining the autonomous driving control by determining that the driver of the autonomous vehicle approves of the autonomous driving control, wherein the response action being indicative of a driving operation of the autonomous driving control;

requesting the driver to perform the determined response action; and

detecting the response action performed by the driver;

in response to detecting that the response action is not performed by the driver:

determining that the driver is not ready take over when the autonomous driving control is switched to the manual driving control; and

in response to detecting that the response action is performed by the driver:

determining that the driver is ready to take over when the autonomous driving control is switched to the manual driving control; and

maintaining the autonomous driving control of the autonomous vehicle, wherein

performance, by the driver, of the response action, is indicative of an approval of the driver of the continuance of the autonomous driving, and

when a point switch from the autonomous driving control to the manual driving control is predetermined, shortening an interval for requesting the driver to perform the response action as the predetermined point approaches.

20. The information presenting apparatus according to claim 1 , wherein the processor is further configured to execute instructions stored in the memory to:

acquire the plurality of self-vehicle behavior candidates generated in accordance with system logic of an autonomous driving system; and

determine a feasible driving operation in consideration of surroundings of the autonomous vehicle, as the response action, from the self-vehicle behavior candidate.

21. The information presenting apparatus according to claim 1 , wherein the driving operation the plurality of self-vehicle behavior candidates includes driving operations of going straight, turning right, turning left, changing to a left lane, changing to a right lane, stopping, starting, speeding up, or slowing down.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2016
From: FUNAKAWA, MASAMI
To: NISSAN MOTOR CO., LTD.
Reel/Frame 039820/0631 →
Continuity (1)
Related Publication 20170220039A1 · Aug 3, 2017
Cited By (1)
US 12,746,950