IP Library › Granted Patent US 12,725,050
Granted Patent B2
US 12,725,050 · App. 17/964,477 · Granted Sep 1, 2026

Knowledge-based dialogue system for self-learning dialogues and learning method thereof

Inventor: Yo Han Lee (Daejeon, KR)
Assignee: Electronics and Telecommunications Research Institute
G06N5/02G06F16/3329G06N5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,725,050
App. No.
17/964,477
Granted
Sep 1, 2026
Kind
B2
Abstract

Disclosed is a self-learning method of a knowledge-based dialogue system. The method includes generating, by the query generating module, a natural language query by itself based on a knowledge path for a query selected from a knowledge graph, inferring, by the answer generating module, a knowledge path for an answer corresponding to a query intention of the natural language query from the knowledge graph, and generating a natural language answer by itself based on the knowledge path for an answer, comparing and evaluating, by the dialogue evaluating unit, the knowledge path for a query and the knowledge path for an answer, and learning, by the query generating module and the answer generating module, a dialogue between the query generating module and the answer generating module based on an evaluation result of the dialogue evaluating unit.

Claims (82)

1 . A self-learning method of a knowledge-based dialogue system, as a learning method of a dialogue system including a query generating module, an answer generating module, and a dialogue evaluating unit executed by a processor, the self-learning method comprising:

generating, by the query generating module, a natural language query by itself based on a knowledge path for a query selected from a knowledge graph;

inferring, by the answer generating module, a knowledge path for an answer corresponding to a query intention of the natural language query from the knowledge graph, and generating a natural language answer by itself based on the knowledge path for an answer;

comparing and evaluating, by the dialogue evaluating unit, the knowledge path for a query and the knowledge path for an answer; and

learning, by the query generating module and the answer generating module, a dialogue between the query generating module and the answer generating module based on an evaluation result of the dialogue evaluating unit;

wherein

the generating of the natural language query by itself includes:

selecting a knowledge path for a query connecting an entity used in a current dialogue turn and a correct answer entity to be used in a next dialogue turn in the knowledge graph; and

generating the natural language query corresponding to the knowledge path for a query by using a machine learning model trained to generate the natural language query based on a knowledge graph for learning extracted from a dialogue corpus; and

wherein

the generating of the natural language answer by itself includes:

analyzing the query intention by analyzing a relationship between entities included in the natural language query;

inferring the knowledge path for an answer describing a relationship between at least one entity among the entities in the knowledge graph and a correct answer entity corresponding to the query intention; and

generating a natural language answer based on the correct answer entity and the knowledge path for an answer.

2 . The self-learning method of claim 1 , further comprising:

expressing, by a knowledge expressing unit executed by the processor, complex knowledge including unstructured knowledge and structured knowledge as the knowledge graph including a set of triples describing a relationship between entities.

3 . The self-learning method of claim 1 , wherein

the generating of the natural language query by itself includes:

selecting a correct answer entity to be used in a next dialogue turn based on a partial knowledge graph used in a current dialogue turn, the partial knowledge graph representing a part of the knowledge graph;

selecting the knowledge path for a query describing a relationship between an entity included in the partial knowledge graph and the correct answer entity; and

generating the natural language query based on the knowledge path for a query.

4 . The self-learning method of claim 3 , wherein

the selecting of the correct answer entity includes:

selecting a plurality of candidate correct answer entities connected to the entity included in the partial knowledge graph within the knowledge graph; and

selecting, as the correct answer entity, a candidate correct answer entity having a lowest number of use in the current dialogue turn from among the plurality of candidate correct answer entities.

5 . The self-learning method of claim 1 , wherein

the knowledge path for a query describes a first relationship between a first entity used in the current dialogue turn and a first correct answer entity connected to the first entity in the knowledge graph, and

the knowledge path for an answer describes a second relationship between a second entity included in the natural language query and a second correct answer entity corresponding to the query intention of the natural language.

6 . The self-learning method of claim 5 , wherein

the evaluating includes:

comparing the first correct answer entity with the second correct answer entity; and

comparing the first relationship with the second relationship.

7 . A knowledge-based dialogue system for self-learning conversations, the knowledge-based dialogue system comprising:

a communication interface configured to receive complex knowledge including unstructured knowledge and structured knowledge;

a knowledge conversion unit configured to convert the complex knowledge into a knowledge graph including a set of knowledge triples describing relationships between entities;

a query generating module configured to generate a natural language query by itself based on a knowledge path for a query selected from the knowledge graph;

an answer generating module configured to infer a knowledge path for an answer corresponding to a query intention of the natural language query from the knowledge graph, and generating a natural language answer by itself based on the knowledge path for an answer;

a dialogue evaluating unit configured to compare the knowledge path for a query and the knowledge path for an answer to evaluate a difference between the knowledge path for a query and the knowledge path for an answer; and

a processor configured to control operations of the knowledge conversion unit, the query generating module, the answer generating module, and the dialogue evaluating unit;

wherein generating the natural language query includes using a machine learning model trained to generate the natural language query based on the knowledge graph for learning extracted from a dialogue corpus;

wherein

the generating of the natural language answer by itself includes:

analyzing the query intention by analyzing a relationship between entities included in the natural language query; and

wherein

inferring the knowledge path for an answer includes describing a relationship between at least one entity among the entities in the knowledge graph and a correct answer entity corresponding to the query intention; and

generating a natural language answer based on the correct answer entity and the knowledge path for an answer.

8 . The knowledge-based dialogue system of claim 7 , wherein

the query generating module includes:

a correct answer selecting unit configured to select a correct answer entity to be used in a next dialogue turn based on a partial knowledge graph used in a current dialogue turn, the partial knowledge graph representing a part of the knowledge graph;

a path selecting unit configured to select the knowledge path for a query describing a relationship between an entity included in the partial knowledge graph and the correct answer entity; and

a natural language query generating unit configured to generate the natural language query based on the knowledge path for a query.

9 . The knowledge-based dialogue system of claim 8 , wherein

the correct answer selecting unit selects a plurality of candidate correct answer entities connected to the entity included in the partial knowledge graph in the knowledge graph and then selects a candidate correct answer entity having a least number of use in the current dialogue turn, among the plurality of candidate correct answer entities, as the correct answer entity.

10 . The knowledge-based dialogue system of claim 7 , wherein

the answer generating module includes:

a query understanding unit configured to analyze a relationship between the entities included in the natural language query and analyze the query intention;

a correct answer interfering unit configured to infer the knowledge path for an answer describing a relationship between at least one of the entities in the knowledge graph and the correct answer entity corresponding to the query intention; and

a natural language answer generating unit configured to generate a natural language answer based on the correct answer entity and the knowledge path for an answer.

11 . The knowledge-based dialogue system of claim 7 , wherein

the dialogue evaluating unit compares the knowledge path for a query describing a first relationship between the entity used in the current dialogue turn and a first correct answer entity selected based on the entity used in the current dialogue turn with the knowledge path for an answer describing a second relationship between the entity included in the natural language query and a second correct answer entity inferred based on the entity included in the natural language query.

12 . The knowledge-based dialogue system of claim 11 , wherein

the dialogue evaluating unit compares the first correct answer entity with the second correct answer entity and compares the first relationship with the second relationship.

13 . A self-learning method of a knowledge-based dialogue system, as a learning method of a dialogue system including a query generating module, an answer generating module, and a dialogue evaluating unit executed by a processor, the self-learning method comprising:

selecting, by the query generating module, a knowledge path for a query describing a first relationship between a first entity used in a current dialogue turn and a first correct answer entity to be used in a next dialogue turn in a knowledge graph and generating a natural language query based on the knowledge path for a query;

selecting, by the answer generating module, a knowledge path for an answer describing a second relationship between a second entity included in the natural language query and a second correct answer entity corresponding to a query intention of the natural language query in the knowledge graph and generating a natural language answer by itself based on the knowledge path for an answer;

evaluating, by the dialogue evaluating unit, an error between the knowledge path for a query and the knowledge path for an answer; and

learning, by the query generating module and the answer generating module, the knowledge path for a query and the knowledge path for an answer based on the error,

wherein generating the natural language query includes using a machine learning model trained to generate the natural language query based on the knowledge graph for learning extracted from a dialogue corpus; and

wherein

the generating of the natural language answer by itself includes:

analyzing the query intention by analyzing a relationship between entities included in the natural language query,

inferring the knowledge path for an answer describing a relationship between at least one entity among the entities in the knowledge graph and a correct answer entity corresponding to the query intention; and

generating a natural language answer based on the correct answer entity and the knowledge path for an answer.

14 . The self-learning method of claim 13 , wherein

the knowledge graph expresses a complex knowledge including unstructured knowledge and structured knowledge as a set of triples describing a relationship between entities.

15 . The self-learning method of claim 13 , wherein

the knowledge path for a query is triple data structured in the order of the first entity, the first relationship, and the first correct answer entity, and

the knowledge path for an answer is triple data structured in the order of the second entity, the second relationship, and the second correct answer entity.

16 . The self-learning method of claim 15 , wherein

measuring of an error includes:

measuring an error between the first relationship and the second relationship; and

measuring an error between the first correct answer entity and the second correct answer entity.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2022
From: LEE, YO HAN
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 061395/0867 →
Priority Claims (2)
KR 10-2021-0149917 · Nov 3, 2021 · national
KR 10-2022-0074701 · Jun 20, 2022 · national
Continuity (1)
Related Publication 20230134933A1 · May 4, 2023
References Cited (15)
US 10650814B2 · Wang et al. · 2020 [cited by applicant]
US 11144833B2 · Kwon et al. · 2021 [cited by applicant]
US 11442992B1 · Moon · 2022 [cited by examiner]
US 11847424B1 · Harkous · 2023 [cited by examiner]
US 20220207067A1 · Lee · 2022 [cited by examiner]
US 20220335219A1 · Sengupta · 2022 [cited by examiner]
US 20220351716A1 · Kim · 2022 [cited by examiner]
US 20230009983A1 · Subramanian · 2023 [cited by examiner]
US 20230100883A1 · Luus · 2023 [cited by examiner]
KR 20190034490A · 2019 [cited by applicant]
KR 1020200014047A · 2020 [cited by applicant]
KR 102252459B1 · 2021 [cited by applicant]
Chen, W. et al., “Open Question Answering Over Tables and Text”, arXiv:2010.10439v2 [cs.CL], Feb. 10, 2021. [cited by applicant]
Liu, B. et al., “Iterative Policy Learning in End-To-End Trainable Task-Oriented Neural Dialog Models”, arXiv:1709.06136v1 [cs.CL], Sep. 18, 2017. [cited by applicant]
Shah, P. et al., “Building a Conversational Agent Overnight with Dialogue Self-Play”, arXiv:1801.04871v1 [cs.AI], Jan. 15, 2018. [cited by applicant]