IP Library › Granted Patent US 12,559,026
Granted Patent B2
US 12,559,026 · App. 18/075,716 · Granted Feb 24, 2026

Vehicle and control method thereof

Inventors: Sung Soo Park (Seoul, KR); Chang Woo Chun (Suwon-si, KR)
Assignees: Hyundai Motor Company; Kia Corporation
B60Q9/00B60K35/10B60K35/28B60K35/80G06F3/167G06F40/30G10L15/16G10L15/1815G10L15/22G10L25/63B60K35/22B60K35/265
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,559,026
App. No.
18/075,716
Granted
Feb 24, 2026
Kind
B2
Abstract

A vehicle includes a user interface; and at least one processor configured to control the user interface, wherein the at least one processor is configured to: determine an intention of a speech of a driver and an emotion of the driver based on the driver's speech input through the user interface; determine vehicle status information based on a driving status and a warning light status; determine a dialogue processing scenario based on the intention of the driver's speech, the driver's emotion and the vehicle status information; and control to perform the dialogue processing scenario.

Claims (40)

1 . A vehicle, comprising:

a user interface; and

at least one processor configured to control the user interface,

wherein the at least one processor is configured to:

determine an intention of a speech of a driver of the vehicle and an emotion of the driver based on the driver's speech input through the user interface;

determine vehicle status information of the vehicle based on a driving status and a warning light status;

determine a dialogue processing scenario based on the intention of the driver's speech, the driver's emotion and the vehicle status information; and

control to perform the dialogue processing scenario to output, in response to the intention of the driver's speech, a voice based on a dialogue scenario and information based on an additional notification scenario through the user interface,

wherein the dialogue processing scenario comprises:

the dialogue scenario corresponding to the intention of the driver's speech; and

the additional notification scenario corresponding to the driver's emotion and the vehicle status information,

wherein the at least one processor is configured to:

determine the additional notification scenario based on the dialogue scenario, an excitement level of the driver, a risk level of the warning light status and a driving risk level, and

determine the additional notification scenario, based on a sum of a first additional notification count value proportional to the excitement level of the driver, a second additional notification count value proportional to the risk level of the warning light status, and a third additional notification count value proportional to the driving risk level.

2 . The vehicle of claim 1 , wherein the at least one processor is configured to determine the intention of the driver's speech based on an output of a neural network for a text of the driver's speech, and determine the driver's emotion based on a speech waveform of the driver's speech.

3 . The vehicle of claim 2 , wherein the at least one processor is configured to control at least one of a notification mode, a notification frequency, and a level of description or an emergency assistance level of the additional notification scenario to increase, as the excitement level of the driver increases.

4 . The vehicle of claim 1 , wherein the at least one processor is configured to determine the risk level of the warning light status based on a warning light color and a number of warning lights that are on, and

control at least one of a notification mode, a notification frequency, a level of description or an emergency assistance level of the additional notification scenario to increase, as the risk level of the warning light status increases.

5 . The vehicle of claim 1 , wherein the at least one processor is configured to determine the driving risk level based on the driving status and whether an emergency light is on, and

control at least one of a notification mode, a notification frequency, a level of description or an emergency assistance level of the additional notification scenario to increase, as the driving risk level increases.

6 . The vehicle of claim 1 , wherein the at least one processor is configured to control at least one of a notification mode, a notification frequency, a level of description or an emergency assistance level of the additional notification scenario to increase, as the sum increases.

7 . The vehicle of claim 1 , wherein the additional notification scenario comprises at least one of a warning voice message output, a vehicle inspection reservation, an SOS call connection, a roadside assistance call or an emergency light that is turned on.

8 . A method to control a vehicle comprising a user interface, the method comprising:

determining, by at least one processor, an intention of a speech of a driver of the vehicle and an emotion of the driver based on the driver's speech input through the user interface;

determining, by the at least one processor, vehicle status information of the vehicle based on a driving status and a warning light status;

determining, by the at least one processor, a dialogue processing scenario based on the intention of the driver's speech, the driver's emotion and the vehicle status information; and

controlling, by the at least one processor, the user interface to perform the dialogue processing scenario to output, in response to the intention of the driver's speech, a voice based on a dialogue scenario and information based on an additional notification scenario through the user interface,

wherein the dialogue processing scenario comprises:

the dialogue scenario corresponding to the intention of the driver's speech; and

the additional notification scenario corresponding to the driver's emotion and the vehicle status information, wherein the determining of the dialogue processing scenario comprises:

determining, by the at least one processor, the additional notification scenario based on the dialogue scenario, an excitement level of the driver, a risk level of the warning light status and a driving risk level; and

determining, by the at least one processor, the additional notification scenario, based on a sum of a first additional notification count value proportional to the excitement level of the driver, a second additional notification count value proportional to the risk level of the warning light status, and a third additional notification count value proportional to the driving risk level.

9 . The method of claim 8 , wherein the determining of the intention of the driver's speech and the driver's emotion comprises determining, by the at least one processor, the intention of the driver's speech based on an output of a neural network for a text of the driver's speech, and determining, by the at least one processor, the driver's emotion based on a speech waveform of the driver's speech.

10 . The method of claim 9 , wherein the determining of the dialogue processing scenario comprises controlling, by the at least one processor, at least one of a notification mode, a notification frequency, a level of description or an emergency assistance level of the additional notification scenario to increase, as the excitement level of the driver increases.

11 . The method of claim 8 , wherein the determining of the dialogue processing scenario comprises determining, by the at least one processor, the risk level of the warning light status based on a warning light color and a number of warning lights that are on, and

controlling at least one of a notification mode, a notification frequency, a level of description or an emergency assistance level of the additional notification scenario to increase, as the risk level of the warning light status increases.

12 . The method of claim 8 , wherein the determining of the dialogue processing scenario comprises determining, by the at least one processor, the driving risk level based on the driving status and whether an emergency light is on, and

controlling at least one of a notification mode, a notification frequency, a level of description or an emergency assistance level of the additional notification scenario to increase, as the driving risk level increases.

13 . The method of claim 8 , wherein the determining of the dialogue processing scenario comprises controlling, by the at least one processor, at least one of a notification mode, a notification frequency, a level of description or an emergency assistance level of the additional notification scenario to increase, as the sum increases.

14 . The method of claim 8 , wherein the additional notification scenario comprises at least one of a warning voice message output, a vehicle inspection reservation, an SOS call connection, a roadside assistance call or an emergency light that is turned on.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2022
From: PARK, SUNG SOO; CHUN, CHANG WOO
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 061998/0255 →
Priority Claims (1)
KR 10-2022-0039477 · Mar 30, 2022 · national
Continuity (1)
Related Publication 20230311757A1 · Oct 5, 2023
References Cited (8)
US 11289082B1 · Lacy · 2022 [cited by examiner]
US 20140309893A1 · Ricci · 2014 [cited by examiner]
US 20150276424A1 · Kwon · 2015 [cited by examiner]
US 20180314689A1 · Wang · 2018 [cited by examiner]
US 20190378515A1 · Kim · 2019 [cited by examiner]
US 20200258514A1 · Park · 2020 [cited by examiner]
US 20200388387A1 · Rebolledo Mendez · 2020 [cited by examiner]
US 20210287697A1 · Marti · 2021 [cited by examiner]