Large-scale sentiment analysis
A method for determining a sentiment associated with an entity includes inputting a plurality of texts associated with the entity, labeling seed words in the plurality of texts as positive or negative, determining a score estimate for the plurality of words based on the labeling, re-enumerating paths of the plurality of words and determining a number of sentiment alternations, determining a final score for the plurality of words using only paths whose number of alternations is within a threshold, converting the final scores to corresponding z-scores for each of the plurality of words, and outputting the sentiment associated with the entity.
1. A method performed by a specifically programmed computer system for tracking statistical sentiment associated with an entity over time, the method comprising:
(a) inputting a first plurality of texts associated with the entity from a first time period;
(b) determining, using the specifically programmed computer system, a first entity statistical sentiment for the first plurality of texts based on terms in the sentiment lexicon which are associated with text corresponding to the entity in the first plurality of texts;
(c) ranking the entity in comparison to other entities based on the first entity statistical sentiment and statistical sentiment of the other entities for the first time period to obtain an first entity score for the first time period;
(d) repeating steps (a) through (c) for at least a second time period different from the first time period to obtain a second entity score for the second time period; and
(e) smoothing the second entity score based on the first entity score.
2. The method of claim 1 , wherein step (e) further includes smoothing the second entity score based on a frequency of occurrence of the text corresponding to the entity in the first plurality of texts.
3. The method of claim 1 , wherein step (e) further includes smoothing the second entity score based on the first entity score and the second entity score.
4. A method performed by a specifically programmed computer system for determining a statistical sentiment associated with an entity, the method comprising:
inputting a plurality of texts associated with the entity;
inputting a sentiment lexicon comprising a plurality of terms each associated with a positive or negative polarity and each associated with a subjectivity score;
determining, using the specifically programmed computer system, an entity polarity for the plurality of texts processed based on polarity of terms in the sentiment lexicon which are associated with text corresponding to the entity in the plurality of texts;
determining an entity subjectivity for the plurality of texts processed based on subjectivity scores of terms in the sentiment lexicon which are associated with text corresponding to the entity in the plurality of texts;
determining an entity statistical sentiment based on the entity polarity and entity subjectivity; and
outputting the entity statistical sentiment.
5. The method of claim 4 , further comprising:
determining a world polarity based on polarity of terms in the sentiment lexicon in the plurality of texts and
normalizing the entity polarity based on the world polarity.
6. The method of claim 4 , further comprising:
determining a world subjectivity based on subjectivity scores of terms in the sentiment lexicon in the plurality of texts and
normalizing the entity subjectivity based on the world subjectivity.
7. The method of claim 4 , further comprising:
inputting a plurality of texts of a first type associated with the entity;
inputting a plurality of texts of a second type associated with the entity;
determining a first entity statistical sentiment for the plurality of texts of the first type based on terms in the sentiment lexicon which are associated with text corresponding to the entity in the plurality of texts of the first type; and
determining a second entity statistical sentiment for the plurality of texts of the second type based on terms in the sentiment lexicon which are associated with text corresponding to the entity in the plurality of texts of the second type.
8. A computer system configured to track statistical sentiment associated with an entity over time, the computer system comprising a memory and a processor and being configured to:
(a) input a first plurality of texts associated with the entity from a first time period;
(b) determine a first entity statistical sentiment for the first plurality of texts based on terms in the sentiment lexicon which are associated with text corresponding to the entity in the first plurality of texts;
(c) rank the entity in comparison to other entities based on the first entity statistical sentiment and statistical sentiment of the other entities for the first time period to obtain an first entity score for the first time period;
(d) repeat steps (a) through (c) for at least a second time period different from the first time period to obtain a second entity score for the second time period; and
(e) smooth the second entity score based on the first entity score.
9. A computer system configured to determine a statistical sentiment associated with an entity, the computer system comprising a memory and a processor and being configured to:
input a plurality of texts associated with the entity;
input a sentiment lexicon comprising a plurality of terms each associated with a positive or negative polarity and each associated with a subjectivity score;
determine an entity polarity for the plurality of texts processed based on polarity of terms in the sentiment lexicon which are associated with text corresponding to the entity in the plurality of texts;
determine an entity subjectivity for the plurality of texts processed based on subjectivity scores of terms in the sentiment lexicon which are associated with text corresponding to the entity in the plurality of texts;
determine an entity statistical sentiment based on the entity polarity and entity subjectivity; and
output the entity statistical sentiment.