IP Library › Granted Patent US 8,959,043
Granted Patent B2
US 8,959,043 · App. 13/600,628 · Granted Feb 17, 2015

Fact checking using and aiding probabilistic question answering

Inventors: David A. Ferrucci (Yorktown Heights, NY); David C. Gondek (Hawthrone, NY); Aditya A. Kalyanpur (Westwood, NJ); Adam P. Lally (Cold Spring, NY); Siddharth Patwardhan (Elmsford, NY)
Assignee: International Business Machines Corporation
G06N7/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,959,043
App. No.
13/600,628
Granted
Feb 17, 2015
Kind
B2
Abstract

A system and a computer program product for verifying a statement are provided. The system is configured to receive a statement. The system is configured to decompose the received statement into one or more sets of question and answer pairs. The system is configured to determine a confidence value of each answer in the one or more question and answer pair sets. The system is configured to combine the determined confidence values. The combined confidence values represent a probability that the received statement is evaluated as true.

Claims (38)

1. A system for verifying a statement, the system comprising:

a first computing system including at least one memory device and at least one processor connected to the memory device, wherein the first computing system is configured to:

receive a statement;

decompose the received statement into one or more sets of question and answer pairs;

determine a confidence value of each answer in the one or more question and answer pair sets; and

combine the determined confidence values, the combined confidence values representing a probability that the received statement is evaluated as correct,

wherein in order to combine the determined confidence values, the first computing system is further configured to:

fit the determined confidence values to training data in order to obtain weights associated with the determined confidence values;

obtain, based on the fitting, weights associated with the determined confidence values; and

obtain a mathematical model, Z=w 1 xx 1 +w 2 xx 2 +. . . +w n xx n , f(Z)=1/(1+e^(-Z)), where w 1 , w 2 , . . . , w n , are the obtained weights, x 1 x 2 . . . , x n are the determined confidence values, and f(Z) represents a probability of correctness of a statement associated with the determined confidence values.

2. The system according to claim 1 , further comprising:

identify words and phrases in the received statement;

replace the identified words and phrases in the received statement with one or more words that can be used to create questions in the one or more question and answer pair sets; and

indicate the identified words and phrases in the received statement as answers in the one or more question and answer pair sets.

3. The system according to claim 2 , where in the one or more words that can be used to create the questions include one or more of: who, why, when, what, where, and how.

4. The system according to claim 1 , wherein to decompose the received statement, the first computing system is configured to identify one or more of: at least one clause in the received statement, at least one syntactic label in the received statement, at least one conjunction in the received statement, configuration information in the received statement, at least one pre-modifier or post-modifier in the received statement, and at least one relative qualifier in the received statement, and

the first computing system is further configured to separate the received statement according to one or more of: the identified at least one clause, the identified at least one syntactic label, the identified at least one conjunction, the identified configuration information, the identified at least one pre-modifier or post-modifier, and the identified at least one relative qualifier.

5. The system according to claim 1 , wherein to determine the confidence value, the first computing system is configured to:

run a search engine or querying a database with one or more questions of the one or more question and answer pair sets;

obtain one or more candidate responses from the search engine or the database; and

compare the obtained candidate responses to one or more answers of the one or more question and answer pair sets.

6. The system according to claim 1 , wherein to determine the confidence value, the first computing system is configured to:

run a second computing system with one or more questions of the one or more question and answer pair sets;

obtain one or more candidate responses from the second computing system; and

compare the obtained candidate responses to one or more answers of the one or more question and answer pair sets.

7. The system according to claim 1 , wherein to combine the determined confidence values, the first computing system is configured to: multiply each said confidence value.

8. A computer program product for verifying a statement, the computer program product comprising a non-transitory storage medium readable by a processing circuit and storing instructions run by the processing circuit for performing a method, the method comprising:

receiving, at a first computing system including at least one memory device and at least one processor connected to the memory device, a statement;

decomposing the received statement, by the first computing system, into one or more sets of question and answer pairs;

determining, by the first computing system, a confidence value of each answer in the one or more question and answer pair sets; and

combining, by the first computing system, the determined confidence values, the combined confidence values representing a probability that the received statement is evaluated as true, the combining including:

fitting the determined confidence value of the each answer in the question and answer pair sets to training data having statements predetermined as correct;

obtaining, based on the fitting, weights associated with the determined confidence values; and

obtaining, by using the obtained weights and the determined confidence values, a mathematical model, Z=w 1 xx 1 +w 2 xx 2 +. . . +w n xx n , f(Z)=1/(1+e^(-Z)), where w 1 , w 2 . . . , w n are the obtained weights, x 1 x 2 . . . , x n are the determined confidence values, and f(Z) represents the probability of correctness of the statement associated with the determined confidence values.

9. The computer program product according to claim 8 , wherein the step of determining includes:

running a second computing system with one or more questions of the one or more question and answer pair sets;

obtaining one or more candidate responses from the second computing system; and

comparing the obtained candidate responses to one or more answers of the one or more question and answer pair sets.

Continuity (3)
Continuation 13247527 · Sep 28, 2011
Provisional Application 61387666 · Sep 29, 2010
Related Publication 20120330882A1 · Dec 27, 2012