IP Library › Granted Patent US 9,679,051
Granted Patent B2
US 9,679,051 · App. 14/708,510 · Granted Jun 13, 2017

Answer sequence evaluation

Inventors: Kevin S. Barker (Raleigh, NC); Thomas J. Eggebraaten (Rochester, MN); Mark G. Megerian (Rochester, MN)
Assignee: International Business Machines Corporation
G06F17/30734G06F17/271G06F17/2705G06F17/277G06F17/2785G06F17/28G06F17/3043G06F17/3053G06F17/3097G06F17/30528G06F17/30595G06F17/30598G06F17/30663G06F17/30864G06F17/30867G06F17/30876G06F19/325G06F19/363G06N5/022G06N5/046G06N7/005G06N99/005G06Q30/0203G09B7/00G09B7/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,679,051
App. No.
14/708,510
Granted
Jun 13, 2017
Kind
B2
Abstract

Aspects of the present disclosure are directed toward evaluating an answer sequence. Aspects are directed toward receiving a set of answer sequences including a first answer sequence. The first answer sequence may have a first set of answers. Aspects are also directed toward identifying a set of scores coupled with the first set of answers. Aspects are also directed toward determining, based on a subject matter corresponding to the first answer sequence, a set of evaluation rules. Aspects are also directed toward generating, based on the set of scores and the set of evaluation rules, a sequence evaluation score for the first answer sequence.

Claims (35)

1. A computer implemented method for evaluating an answer sequence comprising:

receiving, by a question-answering system and via a graphical user interface, an input query from a user;

parsing, using natural language processing techniques configured to parse semantic and syntactic content and by the question-answering system, the input query;

searching, based on the parsed input query and by the question-answering system, a set of corpora;

generating, based on the searching and by the question-answering system, a set of answer sequences including a first answer sequence having a first set of answers and a set of scores coupled with the first set of answers;

identifying, by the question-answering system, a set of answer categories corresponding to the first set of answers of the first answer sequence;

collecting, by the question-answering system and for the set of answer categories corresponding to the first set of answers of the first answer sequence, context data from the set of corpora indicating a relative importance of a first answer category of the set of answer categories to the first answer sequence;

determining, by the question-answering system and based on a subject matter corresponding to the first answer sequence, a set of evaluation rules, wherein a first evaluation rule of the set of evaluation rules comprises:

assigning, based on the context data, a first weighting value to the first answer category of the set of answer categories;

assigning, based on the context data, a second weighting value to a second answer category of the set of answer categories; and

calculating, by a statistical algorithm using the first weighting value and the second weighting value, an aggregate score;

receiving, by the question-answering system and from the user, a first set of answer preference data indicating an inclination for the first answer category of the set of answer categories;

increasing, by the question-answering system and based on the first set of answer preference data, the first weighting value assigned to the first answer category;

generating, by the question-answering system and based on the set of scores and the set of evaluation rules, a first sequence evaluation score for the first answer sequence, wherein generating the first sequence evaluation score for the first answer sequence includes assigning, to the first answer sequence, the aggregate score as the first sequence evaluation score;

comparing, by the question-answering system, the first sequence evaluation score to sequence evaluation scores of other answer sequences of the set of answer sequences; and

providing, by the question-answering system and based on the comparing the sequence evaluation scores, the first answer sequence to the user, via the graphical user interface, as a response to the input query.

2. The method of claim 1 , further comprising:

receiving, from the user, a second set of answer preference data indicating a disinclination for the second answer category of the set of answer categories; and

decreasing, based on the second set of answer preference data, the second weighting value assigned to the second answer category.

3. A computer implemented method for evaluating an answer sequence comprising:

receiving, by a question-answering system and via a graphical user interface, an input query from a user;

parsing, using natural language processing techniques configured to parse semantic and syntactic content and by the question-answering system, the input query;

searching, based on the parsed input query and by the question-answering system, a set of corpora;

generating, based on the searching and by the question-answering system, a set of answer sequences including a first answer sequence having a first set of answers and a set of scores coupled with the first set of answers;

identifying, by the question-answering system, a set of answer categories corresponding to the first set of answers of the first answer sequence;

collecting, by the question-answering system and for the set of answer categories corresponding to the first set of answers of the first answer sequence, context data from the set of corpora indicating a relative importance of a first answer category of the set of answer categories to the first answer sequence;

determining, by the question-answering system and based on a subject matter corresponding to the first answer sequence, a set of evaluation rules, wherein a first evaluation rule of the set of evaluation rules comprises:

assigning, based on the context data, a first weighting value to the first answer category of the set of answer categories;

assigning, based on the context data, a second weighting value to a second answer category of the set of answer categories; and

calculating, by a statistical algorithm using the first weighting value and the second weighting value, an aggregate score;

receiving, by the question-answering system and from the user, a first set of answer preference data indicating a disinclination for the first answer category of the set of answer categories;

decreasing, by the question-answering system and based on the first set of answer preference data, the first weighting value assigned to the first answer category;

generating, by the question-answering system and based on the set of scores and the set of evaluation rules, a first sequence evaluation score for the first answer sequence, wherein generating the first sequence evaluation score for the first answer sequence includes assigning, to the first answer sequence, the aggregate score as the first sequence evaluation score;

comparing, by the question-answering system, the first sequence evaluation score to sequence evaluation scores of other answer sequences of the set of answer sequences; and

providing, by the question-answering system and based on the comparing the sequence evaluation scores, the first answer sequence to the user, via the graphical user interface, as a response to the input query.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2015
From: BARKER, KEVIN S.; EGGEBRAATEN, THOMAS J.; MEGERIAN, MARK G.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 035606/0185 →
Continuity (3)
Continuation 14570797 · Dec 15, 2014
Provisional Application 62075635 · Nov 5, 2014
Related Publication 20160125750A1 · May 5, 2016