IP Library › Granted Patent US 12,451,130
Granted Patent B2
US 12,451,130 · App. 17/695,358 · Granted Oct 21, 2025

Information processing apparatus, information processing method, mobile object control device, and mobile object control method

Inventor: Naoki Hosomi (Wako, JP)
Assignee: HONDA MOTOR CO., LTD.
G10L15/22G06F18/285G06Q50/40G10L15/142G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,451,130
App. No.
17/695,358
Filed
Mar 15, 2022
Granted
Oct 21, 2025
Kind
B2
Examiner
HE, JIALONG
Art Unit
2659
USPC
704/275
Abstract

An information processing apparatus capable of controlling a mobile object on the basis of an instruction by an utterance of a user identifies which scene a use scene of a target user is among a plurality of use scenes in a case where the mobile object is used, acquires utterance information of the target user, and selects a different machine learning model according to the identified use scene of the target user. The information processing apparatus estimates an intent of an utterance of the target user by using the selected machine learning model.

Claims (42)

1. An information processing apparatus capable of controlling a self-driving vehicle on the basis of an instruction by an utterance of a user, the information processing apparatus comprising:

one or more processors; and

a memory storing instructions which, when the instructions are executed by the one or more processors, cause the information processing apparatus to:

identify a use scene of a target user among a plurality of use scenes, wherein each of the use scenes is a state of a user comprising a state before boarding, a state during boarding, or a state after alighting a self-driving vehicle;

acquire utterance information of the target user;

select a different machine learning model from a plurality of machine learning models according to the identified use scene of the target user, wherein each one of the machine learning models relates to a corresponding one of the state before boarding, the state during boarding, or the state after alighting the self-driving vehicle; and

estimate an intent of an utterance of the target user by using the selected machine learning model.

2. The information processing apparatus according to claim 1 , wherein

each one of the machine learning models has a different intent class to be estimated for each of the use scenes with which the respective machine learning models are associated.

3. The information processing apparatus according to claim 2 , wherein

the instructions cause the information processing apparatus to estimate the intent of the target user by using one of the machine learning models that outputs the likelihood for predetermined intent classes among all intent classes associated with the plurality of use scenes.

4. The information processing apparatus according to claim 1 , wherein

the instructions cause the information processing apparatus to estimate the intent of the utterance of the target user in consideration of calculation using an initial state probability distribution set to an intent class as a prior distribution to output of the selected machine learning model.

5. The information processing apparatus according to claim 4 , wherein

the initial state probability distribution set as the prior distribution is separately determined for each of the use scenes.

6. The information processing apparatus according to claim 1 , wherein

the instructions cause the information processing apparatus to estimate the intent of the utterance of the target user in consideration of calculation using a state transition probability distribution between intent classes to output of the selected machine learning model.

7. The information processing apparatus according to claim 6 , wherein

the state transition probability distribution is separately determined for each one of the use scenes.

8. The information processing apparatus according to claim 1 , wherein

in a case where an intent of an utterance at time t is estimated, the instructions cause the information processing apparatus to estimate the intent of the utterance of the target user in consideration of an estimation result estimated for an utterance immediately before the utterance at the time t to output of the selected machine learning model.

9. The information processing apparatus according to claim 1 , wherein

each of the machine learning models is learned using learning data different for each corresponding ones of the use scenes, and the learning data includes a label indicating the corresponding one of the use scenes.

10. The information processing apparatus according to claim 1 , wherein

the instructions cause the information processing apparatus to identify one of the use scenes of the target user on a basis of information from a vehicle associated with the target user.

11. An information processing method in an information processing apparatus capable of controlling a self-driving vehicle on the basis of an instruction by an utterance of a user, the information processing method comprising:

identifying a use scene of a target user among a plurality of use scenes, wherein each of the use scenes is a state of a user comprising a state before boarding, a state during boarding, or a state after alighting a self-driving vehicle;

acquiring utterance information of the target user;

selecting a different machine learning model from a plurality of machine learning models according to the identified use scene of the target user, wherein each one of the machine learning models relates to a corresponding one of the state before boarding, the state during boarding, or the state after alighting the self-driving vehicle; and

estimating an intent of an utterance of the target user by using the selected machine learning model.

12. A control device of a self-driving vehicle that is controllable on the basis of an instruction by an utterance of a user, the control device comprising:

one or more processors; and

a memory storing instructions which, when the instructions are executed by the one or more processors, cause the control device to:

identify a use scene of a target user among a plurality of use scenes, wherein each of the use scenes is a state of a user comprising a state before boarding, a state during boarding, or a state after alighting a self-driving vehicle;

acquire utterance information of the target user;

select a different machine learning model from a plurality of machine learning models according to the identified use scene of the target user, wherein each one of the machine learning models relates to a corresponding one of the state before boarding, the state during boarding, or the state after alighting the self-driving vehicle; and

estimate an intent of an utterance of the target user by using the selected machine learning model.

13. A method for controlling a self-driving vehicle that is controllable on the basis of an instruction by an utterance of a user, the method comprising:

identifying a use scene of a target user among a plurality of use scenes, wherein each of the use scenes is a state of a user comprising a state before boarding, a state during boarding, or a state after alighting a self-driving vehicle;

acquiring utterance information of the target user;

selecting a different machine learning model from a plurality of machine learning models according to the identified use scene of the target user, wherein each one of the machine learning models relates to a corresponding one of the state before boarding, the state during boarding, or the state after alighting the self-driving vehicle; and

estimating an intent of an utterance of the target user by using the selected machine learning model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2023
From: HOSOMI, NAOKI
To: HONDA MOTOR CO., LTD.
Reel/Frame 062338/0394 →
Priority Claims (1)
JP 2021-058446 · Mar 30, 2021 · national
Continuity (1)
Related Publication 20220319514A1 · Oct 6, 2022
References Cited (19)
US 11318935B2 · Kindo · 2022 [cited by applicant]
US 11715111B2 · Teo · 2023 [cited by examiner]
US 20190243899A1 · Yi · 2019 [cited by examiner]
US 20200334539A1 · Wang · 2020 [cited by examiner]
US 20210107162A1 · Kim · 2021 [cited by examiner]
US 20210350139A1 · Pardeshi · 2021 [cited by examiner]
CN 109688512A · 2019 [cited by examiner]
CN 109710941A · 2019 [cited by applicant]
CN 111717217A · 2020 [cited by applicant]
CN 112009480A · 2020 [cited by applicant]
CN 112036550A · 2020 [cited by applicant]
CN 114945979A · 2022 [cited by examiner]
JP 2000020090A · 2000 [cited by applicant]
JP 2015230384A · 2015 [cited by applicant]
JP 2018045332A · 2018 [cited by applicant]
KR 20220118698A · 2022 [cited by examiner]
Qian Chen et al., BERT for Joint Intent Classification and Slot Filling, Feb. 28, 2019, arXiv:1902.10909v1, Speech Lab, DAMO Academy, Alibaba Group, pp. 1-6, published on the Internet at https://arxiv.org/pdf/1902.10909… [cited by applicant]
Japanese Office Action for Japanese Patent Application No. 2021058446 mailed Sep. 20, 2024. [cited by applicant]
Chinese Office Action for Chinese Patent Application No. 202210248247.X mailed Jul. 1, 2025 (partially translated). [cited by applicant]