IP Library › Granted Patent US 12,370,893
Granted Patent B2
US 12,370,893 · App. 17/886,581 · Granted Jul 29, 2025

HMI control device and non-transitory computer readable storage medium

Inventors: Shizuka Yokoyama (Kariya, JP); Takeshi Yamamoto (Kariya, JP); Asako Nagata (Kariya, JP); Yuji Ota (Kariya, JP); Takuya Kume (Kariya, JP); Kazuki Kojima (Kariya, JP)
Assignee: DENSO CORPORATION
B60K35/00B60K35/28B60K35/29B60K2360/161B60K2360/1868B60K2360/195
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,370,893
App. No.
17/886,581
Granted
Jul 29, 2025
Kind
B2
Abstract

A human machine interface (HMI) device for presenting information recognizably by an occupant of a vehicle capable of autonomous driving is controlled. An acceleration and deceleration state, which is an execution status of acceleration and deceleration control in the vehicle during autonomous driving, is acquired. Acceleration and deceleration information relating to the acceleration and deceleration state is presented in a mode corresponding to the acceleration and deceleration state.

Claims (67)

1. A human machine interface (HMI) control device configured to control an HMI device that presents information recognizably by an occupant of a vehicle capable of autonomous driving, the HMI control device comprising:

an acceleration and deceleration state acquisition unit that acquires an acceleration and deceleration state, which is an execution status of acceleration and deceleration control in the vehicle during autonomous driving; and

an acceleration and deceleration information presentation unit that presents acceleration and deceleration information relating to the acceleration and deceleration state in a manner corresponding to the acceleration and deceleration state;

a second task control unit that controls an execution state of a second task in the HMI device during autonomous driving and that limits an execution of the second task according to the acceleration and deceleration state;

wherein:

the acceleration and deceleration information presentation unit presents chronological time until a start of execution of one of acceleration and deceleration control as the acceleration and deceleration information; and

the second task control unit increases a degree of restriction on the execution of the second task when the one of the acceleration and deceleration control is a deceleration control than when the one of the acceleration and deceleration control is an acceleration control.

2. The HMI control device according to claim 1 , wherein:

the second task control unit determines an execution restriction mode of the second task according to a type of a reason for the one of the acceleration and deceleration control.

3. The HMI control device according to claim 1 , wherein:

the second task control unit determines an execution restriction mode of the second task according to a state of a driver who is an occupant of the vehicle.

4. The HMI control device according to claim 1 , wherein:

the second task control unit stops the execution of the second task when the acceleration and deceleration state is an execution or an execution schedule of a rapid one of acceleration and deceleration control.

5. The HMI control device according to claim 1 , wherein:

when the second task is being executed by a display device that displays an image to an occupant of the vehicle visually recognizable, the acceleration and deceleration information presentation unit changes a display mode of the acceleration and deceleration information on the display device according to the acceleration and deceleration state.

6. The HMI control device according to claim 1 , wherein:

the acceleration and deceleration information presentation unit presents, as the acceleration and deceleration information, execution information corresponding to an execution or an execution schedule of the one of the acceleration and deceleration control, and reason information corresponding to a reason for the one of the acceleration and deceleration control.

7. The HMI control device according to claim 6 , wherein:

the acceleration and deceleration information presentation unit presents the execution information and the reason information at different timings.

8. The HMI control device according to claim 1 , wherein:

the acceleration and deceleration information presentation unit presents the acceleration and deceleration information in a manner corresponding to a state of a driver who is an occupant of the vehicle.

9. The HMI control device according to claim 1 , wherein:

the acceleration and deceleration information presentation unit determines a presentation mode of the acceleration and deceleration information according to the acceleration and deceleration state.

10. The HMI control device according to claim 1 , further comprising:

one or more processors; and

a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to provide at least: the acceleration and deceleration state acquisition unit; and the acceleration and deceleration information presentation unit.

11. A human machine interface (HMI) control device configured to control an HMI device that presents information recognizably by an occupant of a vehicle capable of autonomous driving, the HMI control device comprising:

an acceleration and deceleration state acquisition unit that acquires an acceleration and deceleration state, which is an execution status of one of acceleration and deceleration control in the vehicle during autonomous driving;

an acceleration and deceleration information presentation unit that presents acceleration and deceleration information relating to the acceleration and deceleration state in a manner corresponding to the acceleration and deceleration state; and

a second task control unit that controls an execution state of a second task in the HMI device during autonomous driving, wherein:

the second task control unit limits an execution of the second task according to the acceleration and deceleration state; and

the second task control unit increases a degree of restriction on the execution of the second task when the one of the acceleration and deceleration control is a deceleration control than when the one of the acceleration and deceleration control is an acceleration control.

12. The HMI control device according to claim 11 , further comprising:

one or more processors; and

a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to provide at least: the acceleration and deceleration state acquisition unit; the acceleration and deceleration information presentation unit; and the second task control unit.

13. A human machine interface (HMI) control device configured to control an HMI device that presents information recognizably by an occupant of a vehicle capable of autonomous driving, the HMI control device comprising:

an acceleration and deceleration state acquisition unit that acquires an acceleration and deceleration state, which is an execution status of one of acceleration and deceleration control in the vehicle during autonomous driving;

an acceleration and deceleration information presentation unit that presents acceleration and deceleration information relating to the acceleration and deceleration state in a manner corresponding to the acceleration and deceleration state; and

a second task control unit that controls an execution state of a second task in the HMI device during autonomous driving, wherein:

the second task control unit limits an execution of the second task according to the acceleration and deceleration state;

the second task control unit determines an execution restriction mode of the second task according to a state of a driver who is an occupant of the vehicle; and

the second task control unit increases a degree of restriction on the execution of the second task when the one of the acceleration and deceleration control is a deceleration control than when the one of the acceleration and deceleration control is an acceleration control.

14. The HMI control device according to claim 13 , further comprising:

one or more processors; and

a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to provide at least: the acceleration and deceleration state acquisition unit; the acceleration and deceleration information presentation unit; and the second task control unit.

15. A human machine interface (HMI) control device configured to control an HMI device that presents information recognizably by an occupant of a vehicle capable of autonomous driving, the HMI control device comprising:

an acceleration and deceleration state acquisition unit that acquires an acceleration and deceleration state, which is an execution status of one of acceleration and deceleration control in the vehicle during autonomous driving; and

an acceleration and deceleration information presentation unit that presents acceleration and deceleration information relating to the acceleration and deceleration state in a manner corresponding to the acceleration and deceleration state;

a second task control unit that controls an execution state of a second task in the HMI device during autonomous driving and that limits an execution of the second task according to the acceleration and deceleration state;

wherein:

the acceleration and deceleration information presentation unit presents the acceleration and deceleration information in a manner corresponding to a state of a driver who is an occupant of the vehicle; and

the second task control unit increases a degree of restriction on the execution of the second task when the one of the acceleration and deceleration control is a deceleration control than when the one of the acceleration and deceleration control is an acceleration control.

16. The HMI control device according to claim 15 , further comprising:

one or more processors; and

a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to provide at least: the acceleration and deceleration state acquisition unit; and the acceleration and deceleration information presentation unit.

17. A non-transitory tangible computer readable storage medium comprising instructions being executed by a computer, the instructions including a computer-implemented method for controlling a human machine interface (HMI) device that presents information recognizably by an occupant of a vehicle capable of autonomous driving, the instructions including:

acquiring an acceleration and deceleration state, which is an execution status of one of acceleration and deceleration control in the vehicle during autonomous driving; and

presenting acceleration and deceleration information relating to the acceleration and deceleration state in a manner corresponding to the acceleration and deceleration state;

controlling an execution state of a second task in the HMI device during autonomous driving and limiting an execution of the second task according to the acceleration and deceleration state; and

increasing a degree of restriction on the execution of the second task when the one of the acceleration and deceleration control is a deceleration control than when the one of the acceleration and deceleration control is an acceleration control;

wherein the presenting of the acceleration and deceleration information includes presenting chronological time until a start of execution of one of acceleration and deceleration control as the acceleration and deceleration information.

18. A non-transitory tangible computer readable storage medium comprising instructions being executed by a computer, the instructions including a computer-implemented method for controlling a human machine interface (HMI) device that presents information recognizably by an occupant of a vehicle capable of autonomous driving, the instructions including:

acquiring an acceleration and deceleration state, which is an execution status of one of acceleration and deceleration control in the vehicle during autonomous driving; and

presenting acceleration and deceleration information relating to the acceleration and deceleration state in a manner corresponding to the acceleration and deceleration state

controlling an execution state of a second task in the HMI device during autonomous driving and limiting an execution of the second task according to the acceleration and deceleration state; and

increasing a degree of restriction on the execution of the second task when the one of the acceleration and deceleration control is a deceleration control than when the one of the acceleration and deceleration control is an acceleration control;

wherein the presenting of the acceleration and deceleration information includes presenting the acceleration and deceleration information in a manner corresponding to a state of a driver who is an occupant of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2022
From: YOKOYAMA, SHIZUKA; YAMAMOTO, TAKESHI; NAGATA, ASAKO; OTA, YUJI; KUME, TAKUYA; KOJIMA, KAZUKI
To: DENSO CORPORATION
Reel/Frame 061523/0689 →
Priority Claims (2)
JP 2020-025306 · Feb 18, 2020 · national
JP 2020-204443 · Dec 9, 2020 · national
Continuity (2)
Continuation PCTJP2021001270 · Jan 15, 2021
Related Publication 20220379727A1 · Dec 1, 2022
References Cited (21)
US 9955319B2 · Matus · 2018 [cited by examiner]
US 10604013B1 · Briggs · 2020 [cited by examiner]
US 20160101728A1 · Chan · 2016 [cited by applicant]
US 20160231743A1 · Bendewald · 2016 [cited by examiner]
US 20170210228A1 · Katayama · 2017 [cited by examiner]
US 20190204827A1 · Bhalla · 2019 [cited by examiner]
US 20200282979A1 · Kim · 2020 [cited by examiner]
US 20210043083A1 · Bandi · 2021 [cited by examiner]
US 20210078407A1 · Kim · 2021 [cited by examiner]
US 20210155268A1 · Oba · 2021 [cited by examiner]
JP H10188067A · 1998 [cited by applicant]
JP H11281662A · 1999 [cited by applicant]
JP 2005024494A · 2005 [cited by applicant]
JP 2008292753A · 2008 [cited by applicant]
JP 2009003766A · 2009 [cited by applicant]
JP 2011016385A · 2011 [cited by examiner]
JP 2016081511A · 2016 [cited by applicant]
JP 2016222143A · 2016 [cited by applicant]
JP 2017107502A · 2017 [cited by applicant]
JP 2018112850A · 2018 [cited by applicant]
JP 2019001350A · 2019 [cited by applicant]