Models for classifying documents
Some embodiments provide a method for defining a content relevance model for determining whether a content segment is relevant to a particular category. The method receives a first set of content segments that contain content relevant to the particular category and a second set of content segments that contain content not relevant to the particular category. The method identifies a set of key word sets more likely to appear in the first set of content segments than the second set of content segments. The method defines a content relevance model that comprises a set of groups of word sets and a score for each group, each of the groups of word sets comprising a key word set from the set of key word sets and at least one word set found in a context of the key word set in at least one of the received content segments.
1. An apparatus for defining and utilizing a content relevance model for a particular category to at least in part determine whether a content segment is relevant to the particular category, the apparatus comprising:
a processor of a computer system; and
a memory storing code, wherein when executing the code by the processor, the computer system performs operations comprising:
receive a first set of content segments that contain content relevant to the particular category and a second set of content segments that contain content not relevant to the particular category;
identify a set of key word sets more likely to appear in the first set of content segments than the second set of content segments; and
define a content relevance model that comprises a set of groups of word sets and a score for each group, each of the groups of word sets comprising a key word set from the set of key word sets and at least one word set found in a context of the key word set in at least one of the received content segments, wherein define the content relevance model further comprises:
determine the set of key word sets for the particular category based on an analysis of (i) a first set of content segments defined as relevant to the particular category and (ii) a second set of content segments defined as not relevant to the particular category;
determine (i) a set of pairs of word sets that each comprise a key word set and a word set that appears in a defined context of the keyword and (ii) a score for each of the word set pairs, the score for a particular word set pair quantifying a likelihood that a content segment containing the word set pair is relevant to the particular category; and
define a content relevance model for the particular category, the content relevance model comprising (i) a context definition and (ii) the set of word set pairs and corresponding scores; and
utilize the content relevance model in a system to identify content segments in documents for relevancy to one or more particular categories.
2. The apparatus of claim 1 , wherein the content segments comprise text documents.
3. The apparatus of claim 1 , wherein the particular category comprises one of a company, product, person, industry, or concept.
4. The apparatus of claim 1 , wherein identify the set of key word sets comprises:
calculating a score for each word set that appears in at least one content segment of the first or second sets of content segments;
identifying a plurality of word sets with the highest scores as the key word sets.
5. The apparatus of claim 4 , wherein calculate a score for a particular word set comprises comparing a probability of finding the particular word set in the first set of content segments and a probability of finding the particular word set in the second set of content segments.
6. The apparatus of claim 5 , wherein calculate the score for the particular word set further comprises accounting for a number of occurrences of the particular word set in the first set of content segments.
7. The apparatus of claim 1 , wherein define the content relevance model comprises:
identify the set of groups of word sets;
calculate a score for each group of word sets; and
store (i) the set of groups of word sets (ii), the calculated scores, and (iii) a set of model parameters in the content relevance model.
8. The apparatus of claim 7 , wherein the content relevance model is stored as a text file.
9. The apparatus of claim 1 , wherein the groups of word sets are pairs of word sets.
10. A non-transitory, computer readable medium that includes code for defining and utilizing a content relevance model for a particular category—to at least in part determine whether a content segment is relevant to the particular category, wherein when the code is executed by a computer system, the computer system performs operations comprising:
receiving a first set of content segments that contain content relevant to the particular category and a second set of content segments that contain content not relevant to the particular category;
identifying a set of key word sets more likely to appear in the first set of content segments than the second set of content segments; and
defining a content relevance model that comprises a set of groups of word sets and a score for each group, each of the groups of word sets comprising a key word set from the set of key word sets and at least one word set found in a context of the key word set in at least one of the received content segments, wherein define the content relevance model further comprises:
determining the set of key word sets for the particular category based on an analysis of (i) a first set of content segments defined as relevant to the particular category and (ii) a second set of content segments defined as not relevant to the particular category;
determining (i) a set of pairs of word sets that each comprise a key word set and a word set that appears in a defined context of the keyword and (ii) a score for each of the word set pairs, the score for a particular word set pair quantifying a likelihood that a content segment containing the word set pair is relevant to the particular category; and
defining a content relevance model for the particular category, the content relevance model comprising (i) a context definition and (ii) the set of word set pairs and corresponding scores; and
utilizing the content relevance model in a system to identify content segments in documents for relevancy to one or more particular categories.
11. The non-transitory, computer readable medium of claim 1 , wherein the content segments comprise text documents.
12. The non-transitory, computer readable medium of claim 1 , wherein the particular category comprises one of a company, product, person, industry, or concept.
13. The non-transitory, computer readable medium of claim 1 , wherein identifying the set of key word sets comprises:
calculating a score for each word set that appears in at least one content segment of the first or second sets of content segments;
identifying a plurality of word sets with the highest scores as the key word sets.
14. The non-transitory, computer readable medium of claim 13 , wherein calculating a score for a particular word set comprises comparing a probability of finding the particular word set in the first set of content segments and a probability of finding the particular word set in the second set of content segments.
15. The non-transitory, computer readable medium of claim 14 , wherein calculating the score for the particular word set further comprises accounting for a number of occurrences of the particular word set in the first set of content segments.
16. The non-transitory, computer readable medium of claim 1 , wherein defining the content relevance model comprises:
identifying the set of groups of word sets;
calculating a score for each group of word sets; and
store (i) the set of groups of word sets (ii), the calculated scores, and (iii) a set of model parameters in the content relevance model.
17. The non-transitory, computer readable medium of claim 16 , wherein the content relevance model is stored as a text file.
18. The non-transitory, computer readable medium of claim 1 , wherein the groups of word sets are pairs of word sets.