IP Library Granted Patent US 9,519,686
Granted Patent B2
US 9,519,686 · App. 14/248,762 · Granted Dec 13, 2016

Confidence ranking of answers based on temporal semantics

Inventors: John P. Bufe, III (Washington, DC); Donna K. Byron (Petersham, MA); Alexander Pikovsky (Lexington, MA); Timothy P. Winkler (Clinton, MA)
Assignee: International Business Machines Corporation
G06F17/3053G06F17/30401G06F17/30528G06F17/30551G06F17/30554G06F17/30867G06N99/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,519,686
App. No.
14/248,762
Granted
Dec 13, 2016
Kind
B2
Abstract

A mechanism is provided, in a data processing system comprising a processor and a memory configured to implement a question and answer system (QA), for providing confidence rankings based on temporal semantics. Responsive to receiving an input question, a set of candidate answers is identified from a knowledge domain based on a correlation between an identified one or more predicates and an identified one or more arguments to the knowledge domain. A confidence score is associated with each of the candidate answers and each confidence score associated with each candidate answer is refined based on a set of temporal characteristics identified in the input question. A set of temporally refined candidate answers is then provided to the user.

Claims (24)

1. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to:

responsive to receiving an input question, identify a set of candidate answers from a knowledge domain based on a correlation between an identified one or more predicates and an identified one or more arguments associated with the one or more predicates from the input question;

associate an initial confidence score with each candidate answer of the set of candidate answers;

refine each initial confidence score associated with each candidate answer based on a set of temporal characteristics identified in the input question, wherein each confidence score associated with each candidate answer is refined based on the set of temporal characteristics using a reference time of the input question and a respective reference time associated with the candidate answer thereby forming a temporally refined confidence score associated with the candidate answer, wherein the temporally refined confidence score associated with the candidate answer is identified by:

generating a distance value in terms of years for the respective reference time associated with the candidate answer and the reference time of the input question;

using the distance value, determining a multiplier value with which to weight the confidence score associated with the candidate answer using multiplier function: multiplier value=1/(2*distance value+0.5);

identifying a sentiment value of the candidate answer to weight the determined multiplier value either positively or negatively; and

providing a final weight for the temporally refined confidence score associated with the candidate answer using distance function: final weight=initial confidence score*multiplier value*sentiment value; and

provide a set of candidate answers with the temporally refined confidence scores to the user.

2. The computer program product of claim 1 , wherein the reference time of the input question is identified from the set of temporal characteristics.

3. The computer program product of claim 1 , wherein in the reference time of the input question is a current time if no temporal characteristics are identifiable in the input question.

4. An apparatus comprising:

a processor; and

a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to:

responsive to receiving an input question, identify a set of candidate answers from a knowledge domain based on a correlation between an identified one or more predicates and an identified one or more arguments associated with the one or more predicates from the input question;

associate an initial confidence score with each candidate answer of the set of candidate answers;

refine each initial confidence score associated with each candidate answer based on a set of temporal characteristics identified in the input question, wherein each confidence score associated with each candidate answer is refined based on the set of temporal characteristics using a reference time of the input question and a respective reference time associated with the candidate answer thereby forming a temporally refined confidence score associated with the candidate answer, wherein the temporally refined confidence score associated with the candidate answer is identified by:

generating a distance value in terms of years for the respective reference time associated with the candidate answer and the reference time of the input question;

using the distance value, determining a multiplier value with which to weight the confidence score associated with the candidate answer using multiplier function: multiplier value=1/(2*distance value+0.5);

identifying a sentiment value of the candidate answer to weight the determined multiplier value either positively or negatively; and

providing a final weight for the temporally refined confidence score associated with the candidate answer using distance function: final weight=initial confidence score*multiplier value*sentiment value; and

provide a set of candidate answers with the temporally refined confidence scores to the user.

5. The apparatus of claim 4 , wherein the reference time of the input question is identified from the set of temporal characteristics.

6. The apparatus of claim 4 , wherein in the reference time of the input question is a current time if no temporal characteristics are identifiable in the input question.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2014
From: BUFE, JOHN P., III; BYRON, DONNA K.; PIKOVSKY, ALEXANDER; WINKLER, TIMOTHY P.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 032636/0696 →
Continuity (1)
Related Publication 20150293917A1 · Oct 15, 2015