IP Library › Granted Patent US 12,626,701
Granted Patent B2
US 12,626,701 · App. 18/565,570 · Granted May 12, 2026

Dialogue service device and dialogue system control method

Inventors: Masaru Tasaki (Kanagawa, JP); Eiji Sonezaki (Kanagawa, JP); Tatsuya Matsumoto (Kanagawa, JP)
Assignee: Nissan Motor Co., Ltd.
G10L15/22B60H1/00757B60R16/0373G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,626,701
App. No.
18/565,570
Granted
May 12, 2026
Kind
B2
Abstract

A dialogue service device includes a dialogue system control unit configured to recognize an occupant's voice and control a dialogue system that interacts with the occupant in order to provide a service, and an activation unit that activates the dialogue system. The dialogue system includes a first dialogue system having a first voice recognition engine, and a second dialogue system having a second voice recognition engine. The activation unit has a first interface that outputs an activation command to the dialogue system via operation of a steering wheel switch of the vehicle, and a second interface that outputs the activation command to the dialogue system via a wake-up word uttered by the occupant. The first interface transmits the activation command to the first dialogue system, and the second interface transmits the activation command to either the first dialogue system or the second dialogue system.

Claims (50)

1 . A dialogue service device that recognizes an occupant's voice of an occupant of a vehicle and provides a service, the dialogue service device comprising:

an electronic controller including a dialogue system control unit, an activation unit, a first dialogue system, a first interface, a second interface, and a display control unit; and

a remote server including a second dialogue system,

the dialogue system control unit being configured to recognize the occupant's voice and control a dialogue system that interacts with the occupant and provide the service,

the activation unit being configured to activate the dialogue system,

the dialogue system including the first dialogue system that has a first voice recognition engine that outputs control commands to in-vehicle devices via an in-vehicle communication path, and the second dialogue system that has a second voice recognition engine that is different from the first voice recognition engine,

the activation unit including the first interface that outputs an activation command to the dialogue system via an operation of a steering wheel switch of the vehicle, and the second interface that outputs an activation command to the dialogue system via a wake-up word uttered by the occupant,

the first interface being configured to transmit the activation command to either the first dialogue system or the second dialogue system,

the second interface being configured to transmit the activation command to the first dialogue system,

the second dialogue system not being capable of being activated with the wake-up word if the wake-up word is assigned to activate the first dialogue system,

activation of the dialogue system via the steering wheel switch being exclusively selected from the first dialogue system and the second dialogue system according to a user setting, and

the dialogue system being activated via the wake-up word is fixed to the first dialogue system.

2 . The dialogue service device according to claim 1 , further comprising

a communicator configured to communicate externally to the vehicle,

the first dialogue system being configured to output the control commands to the in-vehicle devices via the in-vehicle communication path other than a communication path connecting the communicator and the dialogue system, and

the second dialogue system being configured to not output the control commands to the in-vehicle devices via the in-vehicle communication path other than the communication path connecting the communicator and the dialogue system.

3 . The dialogue service device according to claim 1 , wherein

the first voice recognition engine is provided in the vehicle, and

the second voice recognition engine is provided external to the vehicle.

4 . The dialogue service device according to claim 1 , wherein

the first interface is configured to transmit the activation command to the first dialogue system.

5 . The dialogue service device according to claim 1 , wherein

the activation unit is configured to set a transmission destination of the activation command to one of either the first dialogue system or the second dialogue system based on an occupant's operation, and

in an initial setting, the second dialogue system is set as the transmission destination of the activation command.

6 . The dialogue service device according to claim 1 , wherein

the activation unit is configured to set a transmission destination of the activation command to one of either the first dialogue system or the second dialogue system based on an occupant's operation, and

in an initial setting, the first dialogue system is set as the transmission destination of the activation command.

7 . The dialogue service device according to claim 1 , wherein

the activation unit is configured to set a transmission destination of the activation command via the first interface to one of either the first dialogue system or the second dialogue system based on an occupant's operation.

8 . The dialogue service device according to claim 1 , wherein

the activation unit is configured to set a transmission destination of the activation command via the first interface to one of either the first dialogue system or the second dialogue system based on a voice recognized by the dialogue system control unit.

9 . The dialogue service device according to claim 4 , wherein

the dialogue system control unit is configured to output a changed content to the occupant by voice when a transmission destination of the activation command is changed.

10 . The dialogue service device according to claim 1 , wherein

the electronic controller further includes a display control unit,

the display control unit being configured to control a display screen of a touch panel display provided in the vehicle,

the display screen including a first icon that enables touch operation for activating the first dialogue system and a second icon that enables touch operation for activating the second dialogue system.

11 . The dialogue service device according to claim 1 , wherein

the dialogue system control unit is configured to output the control commands to a control unit that controls one of an air conditioning device, a window, a rear door, a sunroof, and a sliding door included among the in-vehicle devices.

12 . A dialogue system control method that recognizes an occupant's voice of an occupant of a vehicle to control a dialogue system that provides a service, the dialogue system control method comprising:

transmitting an activation command from a first interface to a dialogue system based on operation of a steering wheel switch of the vehicle;

carrying out a voice recognition process for recognizing the occupants voice;

transmitting the activation command to the dialogue system from a second interface based on a wake-up word recognized via the voice recognition process, and

interacting with the occupant to provide the service via an activated dialogue system,

the dialogue system including a first dialogue system that has a first voice recognition engine that outputs control commands to an in-vehicle device through an in-vehicle communication path, and a second dialogue system that has a second voice recognition engine that is different from the first voice recognition engine,

the activation command being transmitted to either the first dialogue system or the second dialogue system when the activation command is transmitted from the first interface,

the activation command being transmitted to the first dialogue system when the activation command is transmitted from the second interface,

the second dialogue system not being capable of being activated with the wake-up word if the wake-up word is assigned to activate the first dialogue system,

activation of the dialogue system via the steering wheel switch being exclusively selected from the first dialogue system and the second dialogue system according to a user setting, and

the dialogue system being activated via the wake-up word is fixed to the first dialogue system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2024
From: TASAKI, MASARU; SONEZAKI, EIJI; MATSUMOTO, TATSUYA
To: NISSAN MOTOR CO., LTD.
Reel/Frame 067682/0953 →
Continuity (1)
Related Publication 20240371372A1 · Nov 7, 2024
References Cited (12)
US 20200262445A1 · Kuramochi · 2020 [cited by examiner]
US 20240265918A1 · Tasaki · 2024 [cited by examiner]
US 20240371372A1 · Tasaki · 2024 [cited by examiner]
EP 3855305A1 · 2021 [cited by applicant]
JP 2020106997A · 2020 [cited by applicant]
JP 2020144274A · 2020 [cited by applicant]
JP 2020147214A · 2020 [cited by applicant]
WO WO2022254667A1 · 2022 [cited by examiner]
WO WO2022254669A1 · 2022 [cited by examiner]
WO WO2022254670A1 · 2022 [cited by examiner]
Extended European Search Report of Feb. 29, 2024 of corresponding European Patent Application No. 21943345.5. [cited by applicant]
Office Action received for EP Application No. 21943345.5, mailed on May 23, 2025, 6 pages. [cited by applicant]