IP Library › Granted Patent US 12,651,156
Granted Patent B2
US 12,651,156 · App. 17/211,381 · Granted Jun 9, 2026

Method and apparatus for determining causality, electronic device and storage medium

Inventors: Yuguang Chen (Beijing, CN); Lu Pan (Beijing, CN); Yanhui Huang (Beijing, CN)
Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
G06N3/08G06F9/542G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,651,156
App. No.
17/211,381
Granted
Jun 9, 2026
Kind
B2
Abstract

Embodiments of the present disclosure provide a method for determining causality, an apparatus for determining causality, an electronic device and a storage medium, and relates to a field of knowledge graph technologies. The method includes: obtaining event words expressing individual events and related words adjacent to the event words in a target text; inputting the event words and the related words into a graph neural network; and determining whether there is a causal relationship between any two events through the graph neural network.

Claims (72)

1 . A method for determining causality, comprising:

obtaining event words expressing individual events and related words adjacent to the event words in a target text;

inputting the event words and the related words into a graph neural network, wherein a graph is a data structure composed of two components: a vertex and an edge, the graph is described based on a set of vertices and edges, the edges are directed or undirected, which depends on whether there is a direction dependency between the vertices, and the graph neural network is a neural network directly running on a graph structure; and

determining whether there is a causal relationship between any two events through the graph neural network;

wherein the determining whether there is a causal relationship between any two events through the graph neural network comprises:

inputting the event words and the related words to an input layer of the graph neural network and outputting semantic vectors of the event words and semantic vectors of the related words through the input layer;

inputting the semantic vectors of the event words, the semantic vectors of the related words, and a pre-labeled adjacency matrix representing causal relationships between the event words and the related words to a convolutional layer of the graph neural network, and outputting a vector matrix representing combination relations between the event words and the related words through the convolutional layer, wherein in the pre-labeled adjacency matrix, a value of 1 indicates that there is a causal relationship between an event word and a related word corresponding to the value, and a value of 0 indicates that there is no causal relationship between an event word and a related word corresponding to the value;

inputting the vector matrix to a fully connected layer of the graph neural network, and outputting a probability value indicating whether there is a causal relationship between any two event words through the fully connected layer; and

inputting the probability value indicating whether there is a causal relationship between any two event words into an output layer of the graph neural network, and outputting a result on whether there is a causal relationship between the any two event words through the output layer;

wherein the outputting the vector matrix representing the combination relations between the event words and the related words through the convolutional layer comprises:

determining feature information of each event word and feature information of the related word adjacent to the event word as content of an event node to obtain at least two event nodes;

generating one or more edges between the at least two event nodes through the convolutional layer based on relevancy information between the at least two event nodes to obtain an event graph; and

outputting the vector matrix based on the event graph;

wherein the method further comprises:

identifying, from the event graph stored in memory, one or more nodes connected by a causal edge to a current event node; selecting a subsequent event node having a probability value of causality exceeding a threshold; and outputting the subsequent event as a predicted event.

2 . The method according to claim 1 , wherein the obtaining the event words expressing individual events and the related words adjacent to the event words in the target text comprises:

dividing the target text into a plurality of sentences;

extracting a sentence from the plurality of sentences as a current sentence, and extracting an event word from the current sentence when the current sentence meets an event word extraction condition;

extracting a related word adjacent to the event word from the current sentence when the current sentence meets a related word extraction condition; and

repeating the operation of extracting the event word and the related word for each of the plurality of sentences until the event word and related word adjacent to the event word are extracted from each of the plurality of sentences.

3 . The method according to claim 1 , further comprising:

obtaining training data of the graph neural network; and

training processing parameters of the graph neural network based on the training data to generate the graph neural network.

4 . An electronic device, comprising:

at least one processor; and

a memory communicatively connected to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor is caused to:

obtain event words expressing individual events and related words adjacent to the event words in a target text;

input the event words and the related words into a graph neural network, wherein a graph is a data structure composed of two components: a vertex and an edge, the graph is described based on a set of vertices and edges, the edges are directed or undirected, which depends on whether there is a direction dependency between the vertices, and the graph neural network is a neural network directly running on a graph structure; and

determine whether there is a causal relationship between any two events through the graph neural network;

wherein the processor is configured to determine whether there is a causal relationship between any two events through the graph neural network by:

inputting the event words and the related words to an input layer of the graph neural network and outputting semantic vectors of the event words and semantic vectors of the related words through the input layer;

inputting the semantic vectors of the event words, the semantic vectors of the related words, and a pre-labeled adjacency matrix representing causal relationships between the event words and the related words to a convolutional layer of the graph neural network, and outputting a vector matrix representing combination relations between the event words and the related words through the convolutional layer, wherein in the pre-labeled adjacency matrix, a value of 1 indicates that there is a causal relationship between an event word and a related word corresponding to the value, and a value of 0 indicates that there is no causal relationship between an event word and a related word corresponding to the value;

inputting the vector matrix to a fully connected layer of the graph neural network, and outputting a probability value indicating whether there is a causal relationship between any two event words through the fully connected layer; and

inputting the probability value indicating whether there is a causal relationship between any two event words into an output layer of the graph neural network, and outputting a result on whether there is a causal relationship between the any two event words through the output layer;

wherein the outputting the vector matrix representing the combination relations between the event words and the related words through the convolutional layer comprises:

determining feature information of each event word and feature information of the related word adjacent to the event word as content of an event node to obtain at least two event nodes;

generating one or more edges between the at least two event nodes through the convolutional layer based on relevancy information between the at least two event nodes to obtain an event graph; and

outputting the vector matrix based on the event graph;

wherein the processor is configured to identify, from the event graph stored in memory, one or more nodes connected by a causal edge to a current event node;

select a subsequent event node having a probability value of causality exceeding a threshold; and output the subsequent event as a predicted event.

5 . The electronic device according to claim 4 , wherein the processor is configured to obtain the event words expressing individual events and the related words adjacent to the event words in the target text by:

dividing the target text into a plurality of sentences;

extracting a sentence from the plurality of sentences as a current sentence, and extracting an event word from the current sentence when the current sentence meets an event word extraction condition;

extracting a related word adjacent to the event word from the current sentence when the current sentence meets a related word extraction condition; and

repeating the operation of extracting the event word and the related word for each of the plurality of sentences until the event word and related word adjacent to the event word are extracted from each of the plurality of sentences.

6 . The electronic device according to claim 4 , wherein the processor is further configured to:

obtain training data of the graph neural network; and

train processing parameters of the graph neural network based on the training data to generate the graph neural network.

7 . A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to make the computer implement a method for determining causality, comprising:

obtaining event words expressing individual events and related words adjacent to the event words in a target text;

inputting the event words and the related words into a graph neural network, wherein a graph is a data structure composed of two components: a vertex and an edge, the graph is described based on a set of vertices and edges, the edges are directed or undirected, which depends on whether there is a direction dependency between the vertices, and the graph neural network is a neural network directly running on a graph structure; and

determining whether there is a causal relationship between any two events through the graph neural network;

wherein the determining whether there is a causal relationship between any two events through the graph neural network comprises:

inputting the event words and the related words to an input layer of the graph neural network and outputting semantic vectors of the event words and semantic vectors of the related words through the input layer;

inputting the semantic vectors of the event words, the semantic vectors of the related words, and a pre-labeled adjacency matrix representing causal relationships between the event words and the related words to a convolutional layer of the graph neural network, and outputting a vector matrix representing combination relations between the event words and the related words through the convolutional layer, wherein in the pre-labeled adjacency matrix, a value of 1 indicates that there is a causal relationship between an event word and a related word corresponding to the value, and a value of 0 indicates that there is no causal relationship between an event word and a related word corresponding to the value;

inputting the vector matrix to a fully connected layer of the graph neural network, and outputting a probability value indicating whether there is a causal relationship between any two event words through the fully connected layer; and

inputting the probability value indicating whether there is a causal relationship between any two event words into an output layer of the graph neural network, and outputting a result on whether there is a causal relationship between the any two event words through the output layer;

wherein the outputting the vector matrix representing the combination relations between the event words and the related words through the convolutional layer comprises:

determining feature information of each event word and feature information of the related word adjacent to the event word as content of an event node to obtain at least two event nodes;

generating one or more edges between the at least two event nodes through the convolutional layer based on relevancy information between the at least two event nodes to obtain an event graph; and

outputting the vector matrix based on the event graph;

wherein the method further comprises:

identifying, from the event graph stored in memory, one or more nodes connected by a causal edge to a current event node; selecting a subsequent event node having a probability value of causality exceeding a threshold; and outputting the subsequent event as a predicted event.

8 . The non-transitory computer-readable storage medium according to claim 7 , wherein the obtaining the event words expressing individual events and the related words adjacent to the event words in the target text comprises:

dividing the target text into a plurality of sentences;

extracting a sentence from the plurality of sentences as a current sentence, and extracting an event word from the current sentence when the current sentence meets an event word extraction condition;

extracting a related word adjacent to the event word from the current sentence when the current sentence meets a related word extraction condition; and

repeating the operation of extracting the event word and the related word for each of the plurality of sentences until the event word and related word adjacent to the event word are extracted from each of the plurality of sentences.

9 . The non-transitory computer-readable storage medium according to claim 8 , wherein the method further comprises:

obtaining training data of the graph neural network; and

training processing parameters of the graph neural network based on the training data to generate the graph neural network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2021
From: CHEN, YUGUANG; PAN, LU; HUANG, YANHUI
To: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
Reel/Frame 055767/0729 →
Priority Claims (1)
CN 202010231943.0 · Mar 27, 2020 · national
Continuity (1)
Related Publication 20210209472A1 · Jul 8, 2021
References Cited (34)
US 20100161612A1 · Chen et al. · 2010 [cited by applicant]
US 20170250932A1 · Tee et al. · 2017 [cited by applicant]
US 20190073420A1 · Agapiev · 2019 [cited by examiner]
US 20190294671A1 · Chatterjee · 2019 [cited by examiner]
US 20200034722A1 · Oh et al. · 2020 [cited by applicant]
CN 109791569A · 2019 [cited by applicant]
CN 110196978A · 2019 [cited by applicant]
CN 110704890A · 2020 [cited by applicant]
CN 110782002A · 2020 [cited by applicant]
JP H05120250A · 1993 [cited by applicant]
JP 2008203964A · 2008 [cited by applicant]
JP 4935405B2 · 2012 [cited by applicant]
JP 2013130929A · 2013 [cited by applicant]
JP 2018049587A · 2018 [cited by applicant]
JP 2018060364A · 2018 [cited by applicant]
KR 20190040825A · 2019 [cited by applicant]
WO 2018066445A1 · 2018 [cited by applicant]
On Event Causality Detection in Tweets; Kayesh et al. (Year: 2019). [cited by examiner]
Zhou et al., “Graph neural networks: A review of methods and applications” (Year: 2019). [cited by examiner]
Ji et al., “Refining Event Extraction through Cross-document Inference” (Year: 2008). [cited by examiner]
Kayesh et al., “On Event Causality Detection in Tweets”, (Year: 2019). [cited by examiner]
Liu et al., “Jointly Multiple Events Extraction via Attention-based Graph Information Aggregation”, (Year: 2018). [cited by examiner]
Li et al., “Constructing Narrative Event Evolutionary Graph for Script Event Prediction” (Year: 2018). [cited by examiner]
Extended European Search Report issued in European Application No. 21156353.1, mailed on Jul. 8, 2021 (12 pages). [cited by applicant]
“Jointly Multiple Events Extraction via Attention-based Graph Information Aggregation;” Oct. 23, 2018; XP055818680; Retrieved from the Internet: URL:https://arxiv.org/pdf/1809.09078v2.pdf (10 pages). [cited by applicant]
“Graph Neural Networks:A Review of Methods and Applications” Jul. 10, 2019; XP055787108; Retrieved from the Internet: URL: http://web.archive.org/web/20080403235803/http://arxiv.org/pdf/1812.08434.pdf (22 pages). [cited by applicant]
“Graph Convolutional Networks with Argument-Aware Pooling for Event Detection” Feb. 2, 2018 XP055818672; Retrieved from the Internet: URL: http:///aaai.org/ocs/index.php/AAAI/AA AilS/paper/viewFile/16329/16155 (8 pages). [cited by applicant]
Office Action issued in Chinese Application No. 202010231943.0, mailed on Feb. 28, 2023 (16 pages). [cited by applicant]
Written Decision on Registration issued in Korean Application No. 210-2021-0038733, mailed on Mar. 31, 2023 (10 pages). [cited by applicant]
Shengwei et al.; “Causal Relation Extraction of Uyghur Events Based on Bidirectional Long Short-term Memory Model;” Journal of Electronics & Information Technology; vol. 40; No. 1; Jan. 2018; pp. 201-208 (9 pages). [cited by applicant]
Wenjing et al.; “Argument Causality Judgement of Journalism Field;” Harbin Institute of Technology; Jun. 2018; pp. 1-62 (68 pages). [cited by applicant]
Li et al.; “Knowledge-oriented Convolutional Neural Network for Causal Relation Extraction from Natural Language Texts;” Expert Systems with Applications; Aug. 7, 2018; pp. 1-42 (43 pages). [cited by applicant]
Mayuanyuan et al.; “Research on Technology and Application of Information Extraction” p. 1 (1 page). [cited by applicant]
Office Action issued in corresponding JP Application No. 2021-047864 with English translation dated May 31, 2022 (10 pages). [cited by applicant]