IP Library › Granted Patent US 11,904,881
Granted Patent B2
US 11,904,881 · App. 17/749,327 · Granted Feb 20, 2024

HMI control device, HMI control program product, driving control device, and driving control program product

Inventors: Yuji Ota (Kariya, JP); Asako Nagata (Kariya, JP); Takeshi Yamamoto (Kariya, JP); Shizuka Yokoyama (Kariya, JP); Takuya Kume (Kariya, JP); Kazuki Kojima (Kariya, JP)
Assignee: DENSO CORPORATION
B60W50/14B60K35/00B60W40/04B60W40/09B60W40/105B60W50/0097B60W60/0016B60K2370/175B60K2370/1868B60K2370/193B60K2370/195B60W2040/0818B60W2050/146B60W2540/229B60W2554/406
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,904,881
App. No.
17/749,327
Granted
Feb 20, 2024
Kind
B2
Abstract

An HMI control device is configured to control an HMI device mounted in a vehicle, which is capable of performing an autonomous driving as a first task. The HMI control device is configured to: acquire a possible duration for the autonomous driving; and present, by the HMI device, a second task that an occupant on a driver's seat is able to start executing during the autonomous driving based on the possible duration acquired by the time acquisition unit.

Claims (91)

1. A human-machine-interface (HMI) control device configured to control an HMI device mounted in a vehicle, the vehicle being capable of performing an autonomous driving as a first task, the HMI control device comprising:

a time acquisition unit that acquires a possible duration for the autonomous driving; and

a presentation unit that presents, by the HMI device, a second task that an occupant on a driver's seat is able to start executing during the autonomous driving based on the possible duration acquired by the time acquisition unit, wherein the second task refers to a task executed by the occupant except for a driving operation.

2. The HMI control device according to claim 1 , wherein

the time acquisition unit acquires the possible duration based on a predicted duration of a traffic congestion in a case where the autonomous driving is started due to the traffic congestion.

3. The HMI control device according to claim 2 , further comprising

a continuation operation reception unit that receives an input operation for continuing the second task under execution in a case where a temporary resolution of the traffic congestion is detected.

4. The HMI control device according to claim 3 , further comprising

a behavior acquisition unit that acquires a detection result of a behavior of the occupant on the driver's seat,

wherein the continuation operation reception unit enables the input operation when the behavior acquisition unit acquires the detection result indicating that the occupant on the driver's seat is checking a road condition of a place toward which the vehicle is traveling.

5. The HMI control device according to claim 4 , wherein

the vehicle is capable of performing the autonomous driving within a predetermined speed range during the traffic congestion, and,

when the input operation is enabled, the continuation operation reception unit notifies a driving control device of the enabling of the input operation in order to control a traveling speed of the vehicle within the predetermined speed range.

6. The HMI control device according to claim 4 , further comprising

a display control unit that controls the HMI device to display the road condition of the place toward which the vehicle is traveling when the behavior acquisition unit acquires the detection result indicating that the occupant on the driver's seat is checking the road condition of the place toward which the vehicle is traveling.

7. The HMI control device according to claim 1 , further comprising:

a behavior acquisition unit that acquires a detection result of a behavior of the occupant on the driver's seat; and

a display control unit that controls the HMI device to display a road condition of a place toward which the vehicle is traveling when the behavior acquisition unit acquires the detection result indicating that the occupant on the driver's seat is checking the road condition of the place toward which the vehicle is traveling.

8. The HMI control device according to claim 1 , wherein

the presentation unit presents a plurality of the second tasks having different required execution durations in a case where the time acquisition unit fails to acquire the possible duration for the autonomous driving so that the occupant is able to select one of the plurality of second tasks.

9. The HMI control device according to claim 1 , wherein,

in a case where the possible duration corresponding to a specific traveling section, in which the autonomous driving is set to be possible, is shorter than a predetermined execution lower limit, no second task is permitted to start being executed in the specific traveling section.

10. The HMI control device according to claim 1 , wherein

the time acquisition unit acquires the possible duration based on a distance of a specific traveling section, in which the autonomous driving is set to be possible.

11. The HMI control device according to claim 2 , wherein

an execution of the second task during the traffic congestion is permitted regardless of a length of the possible duration acquired based on the predicted duration of the traffic congestion.

12. The HMI control device according to claim 11 , wherein

the presentation unit limits the HMI device that presents the second task during the traffic congestion to an in-vehicle device in a case where the possible duration acquired based on the predicted duration of the traffic congestion is shorter than a predetermined model-limiting duration.

13. The HMI control device according to claim 1 , wherein,

in a case where the possible duration is shorter than a predetermined time limit, the presentation unit presents, by the HMI device, information indicating that the second task is executable instead of or prior to presentation of the second task which is determined to be executable based on the possible duration.

14. The HMI control device according to claim 1 , wherein,

in a case where the autonomous driving is continued, from an execution start of the second task, for a time period equal to or longer than a predetermined interrupt wait time, the HMI device presents a traveling state of the vehicle and surrounding information of the vehicle.

15. An HMI control device configured to control an HMI device mounted in a vehicle, the vehicle being capable of performing an autonomous driving as a first task, the HMI control device comprising:

a time acquisition unit that acquires a possible duration for the autonomous driving, the time acquisition unit acquiring the possible duration based on a predicted duration of a traffic congestion in a case where the autonomous driving is started due to the traffic congestion;

a presentation unit that presents, by the HMI device, a second task that an occupant on a driver's seat is able to execute during the autonomous driving based on the possible duration acquired by the time acquisition unit; and

a continuation operation reception unit that receives an input operation for continuing the second task under execution in a case where a temporary resolution of the traffic congestion is detected, wherein the second task refers to a task executed by the occupant except for a driving operation.

16. An HMI control device configured to control an HMI device mounted in a vehicle, the vehicle being capable of performing an autonomous driving as a first task, the HMI control device comprising:

a time acquisition unit that acquires a possible duration for the autonomous driving;

a presentation unit that presents, by the HMI device, a second task that an occupant on a driver's seat is able to execute during the autonomous driving based on the possible duration acquired by the time acquisition unit;

a behavior acquisition unit that acquires a detection result of a behavior of the occupant on the driver's seat; and

a display control unit that controls the HMI device to display a road condition of a place toward which the vehicle is traveling when the behavior acquisition unit acquires the detection result indicating that the occupant on the driver's seat is checking the road condition of the place toward which the vehicle is traveling wherein the second task refers to a task executed by the occupant except for a driving operation.

17. An HMI control device configured to control an HMI device mounted in a vehicle, the vehicle being capable of performing an autonomous driving as a first task, the HMI control device comprising:

a time acquisition unit that acquires a possible duration for the autonomous driving; and

a presentation unit that presents, by the HMI device, a plurality of second tasks that an occupant on a driver's seat is able to execute during the autonomous driving based on the possible duration acquired by the time acquisition unit,

wherein the presentation unit presents the plurality of second tasks having different required execution durations in a case where the time acquisition unit fails to acquire the possible duration for the autonomous driving so that the occupant is able to select one of the plurality of second tasks, the second task refers to a task executed by the occupant except for a driving operation.

18. An HMI control device configured to control an HMI device mounted in a vehicle, the vehicle being capable of performing an autonomous driving as a first task, the HMI control device comprising:

a time acquisition unit that acquires a possible duration for the autonomous driving; and

a presentation unit that presents, by the HMI device, a second task that an occupant on a driver's seat is able to execute during the autonomous driving based on the possible duration acquired by the time acquisition unit,

wherein,

in a case where the possible duration corresponding to a specific traveling section, in which the autonomous driving is set to be possible, is shorter than a predetermined execution lower limit, no second task is permitted to start being executed in the specific traveling section.

19. An HMI control program product stored in a computer-readable non-transitory storage medium, the HMI control program product comprising instructions to be executed by at least one processor of an HMI control device to control an HMI device, the HMI device being mounted in a vehicle that is capable of performing an autonomous driving as a first task, the instructions comprising:

acquiring a possible duration for the autonomous driving; and

presenting, by the HMI device, a second task that an occupant on a driver's seat is able to start executing during the autonomous driving based on the acquired possible duration, wherein the second task refers to a task executed by the occupant except for a driving operation.

20. An HMI control program product stored in a computer-readable non-transitory storage medium, the HMI control program product comprising instructions to be executed by at least one processor of an HMI control device to control an HMI device, the HMI device being mounted in a vehicle that is capable of performing an autonomous driving as a first task, the instructions comprising:

acquiring a possible duration for the autonomous driving based on a predicted duration of a traffic congestion in a case where the autonomous driving is started due to the traffic congestion;

presenting, by the HMI device, a second task that an occupant on a driver's seat is able to execute during the autonomous driving based on the acquired possible duration; and

receiving an input operation for continuing the second task under execution in a case where a temporary resolution of the traffic congestion is detected, wherein the second task refers to a task executed by the occupant except for a driving operation.

21. An HMI control program product stored in a computer-readable non-transitory storage medium, the HMI control program product comprising instructions to be executed by at least one processor of an HMI control device to control an HMI device, the HMI device being mounted in a vehicle that is capable of performing an autonomous driving as a first task, the instructions comprising:

acquiring a possible duration for the autonomous driving;

presenting, by the HMI device, a second task that an occupant on a driver's seat is able to execute during the autonomous driving based on the acquired possible duration;

acquiring a detection result of a behavior of the occupant on the driver's seat;

and

controlling the HMI device to display a road condition of a place toward which the vehicle is traveling when the acquired detection result indicates that the occupant on the driver's seat is checking the road condition of the place toward which the vehicle is traveling, wherein the second task refers to a task executed by the occupant except for a driving operation.

22. An HMI control program product stored in a computer-readable non-transitory storage medium, the HMI control program product comprising instructions to be executed by at least one processor of an HMI control device to control an HMI device, the HMI device being mounted in a vehicle that is capable of performing an autonomous driving as a first task, the instructions comprising:

acquiring a possible duration for the autonomous driving in response to a success in the acquiring of the possible duration, presenting, by the HMI device, a second task that an occupant on a driver's seat is able to execute during the autonomous driving based on the acquired possible duration; and

in response to a failure in the acquiring of the possible duration, presenting, by the HMI device, a plurality of second tasks having different required execution durations so that an occupant on a driver's seat is able to select one of the plurality of second tasks during the autonomous driving, wherein the second task refers to a task executed by the occupant except for a driving operation.

23. An HMI control program product stored in a computer-readable non-transitory storage medium, the HMI control program product comprising instructions to be executed by at least one processor of an HMI control device to control an HMI device, the HMI device being mounted in a vehicle that is capable of performing an autonomous driving as a first task, the instructions comprising:

acquiring a possible duration for the autonomous driving; and

presenting, by the HMI device, a second task that an occupant on a driver's seat is able to execute during the autonomous driving based on the acquired possible duration,

wherein,

in a case where the possible duration corresponding to a specific traveling section, in which the autonomous driving is set to be possible, is shorter than a predetermined execution lower limit, no second task is permitted to start being executed in the specific traveling section.

24. A driving control device configured to control a driving of a vehicle capable of performing an autonomous driving as a first task within a predetermined speed range during a traffic congestion, the driving control device comprising:

an information acquisition unit that acquires at least a traveling state of the vehicle;

a driving level determination unit that determines an executability of the autonomous driving based on the traveling state acquired by the information acquisition unit; and

a vehicle speed control unit that controls a traveling speed of the vehicle in accordance with the executability of the autonomous driving determined by the driving level determination unit, wherein the information acquisition unit acquires a congestion state as the traveling state, the information acquisition unit further acquires, from an HMI control device that controls an HMI device mounted in the vehicle, an execution state of a second task operated by an occupant on a driver's seat, and

the vehicle speed control unit performs a speed-increase control to increase the traveling speed of the vehicle within the predetermined speed range of the autonomous driving in response to the acquired congestion state indicating a temporary resolution of the traffic congestion and a continuation request for the second task under execution being made by the occupant, wherein the second task refers to a task executed by the occupant except for a driving operation.

25. The driving control device according to claim 24 , wherein

the driving level determination unit determines an execution of the autonomous driving in a case where the vehicle travels on an exclusive road where the traffic congestion is occurred,

the exclusive road has a minimum speed limit and the minimum speed limit is within the predetermined speed range of the autonomous driving, and,

during a traveling on the exclusive road, the vehicle speed control unit controls the traveling speed of the vehicle to be equal to or higher than the minimum speed limit of the exclusive road and within the predetermined speed range of the autonomous driving in response to the acquired congestion state indicating the temporary resolution of the traffic congestion and the continuation request for the second task under execution being made by the occupant.

26. The driving control device according to claim 24 , wherein

the driving level determination unit determines continuation of the autonomous driving in a case where an input operation for continuing the second task under execution is effectively received by the HMI device and accordingly the continuation request is notified from the HMI device.

27. The driving control device according to claim 26 , wherein

the input operation for continuing the second task under execution is determined to be effectively received by the HMI device and accordingly the continuation request is determined to be notified from the HMI device in a case where a detection result of a behavior of the occupant on the driver's seat indicates that the occupant checks a road condition of a place toward which the vehicle is traveling.

28. A driving control program product stored in a computer-readable non-transitory storage medium, the driving control program product comprising instructions to be executed by at least one processor of a driving control device that controls driving of a vehicle, the vehicle being capable of performing an autonomous driving as a first task within a predetermined speed range during a traffic congestion, the instructions comprising:

acquiring at least a traveling state of the vehicle;

determining an executability of the autonomous driving based on the acquired traveling state;

controlling a traveling speed of the vehicle in accordance with the determined executability of the autonomous driving;

acquiring at least a congestion state as the traveling state of the vehicle;

acquiring, from an HMI control device that controls an HMI device mounted in the vehicle, an execution state of a second task operated by an occupant on a driver's seat; and

controlling the traveling speed of the vehicle to be increased within the predetermined speed range of the autonomous driving in response to the acquired congestion state indicating a temporary resolution of the traffic congestion and a continuation request for the second task under execution being made by the occupant, wherein the second task refers to a task executed by the occupant except for a driving operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2022
From: OTA, YUJI; NAGATA, ASAKO; YAMAMOTO, TAKESHI; YOKOYAMA, SHIZUKA; KUME, TAKUYA; KOJIMA, KAZUKI
To: DENSO CORPORATION
Reel/Frame 059968/0635 →
Priority Claims (2)
JP 2019-214229 · Nov 27, 2019 · national
JP 2020-184660 · Nov 4, 2020 · national
Continuity (2)
Continuation PCTJP2020042454 · Nov 13, 2020
Related Publication 20220274621A1 · Sep 1, 2022