IP Library Granted Patent US 11,010,564
Granted Patent B2
US 11,010,564 · App. 16/507,953 · Granted May 18, 2021

Method for fine-grained affective states understanding and prediction

Inventors: Zhe Liu (San Jose, CA); Jalal Mahmud (San Jose, CA); Anbang Xu (San Jose, CA); Yufan Guo (San Jose, CA); Haibin Liu (San Jose, CA); Rama Kalyani T. Akkiraju (Cupertino, CA)
Assignee: International Business Machines Corporation
G06F40/30G06N3/04G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,010,564
App. No.
16/507,953
Granted
May 18, 2021
Kind
B2
Abstract

A computer-implemented method for fine-grained affective states prediction. The computer-implemented method creates training data comprising content conveying emotions. The method creates a trained model by performing an emotion vector space model training process using the training data to train a model using a feed forward neural network that converts discrete emotions into emotion vector representations. The trained model can be used to predict fine-grained affective states for text conveying an emotion.

Claims (26)

1. A computer-implemented method for fine-grained affective states prediction, the computer-implemented method comprising:

creating training data comprising content conveying emotions;

creating a trained model by performing an emotion vector space model training process using the training data to train a model using a feed forward neural network, wherein the emotion vector space model training process converts discrete emotions into emotion vector representations, wherein an output layer of the feed forward neural network are word vectors that indicate probabilities of words and emojis that are within a window size of an emotion vector representation that is input for an input layer of the feed forward neural network, and wherein a hidden layer of the feed forward neural network is represented by a weight matrix with a row for each of the discrete emotions and a column for every hidden neuron in the hidden layer; and

using the trained model to predict fine-grained affective states for text conveying an emotion.

2. The method of claim 1 , further comprising applying dimension reduction and rotation techniques on the trained model to identify a principle dimension of a set of fine-grained affective states.

3. The method of claim 1 , further comprising applying clustering techniques on the trained model to identify basic emotions of a set of fine-grained affective states.

4. The method of claim 1 , further comprising generating domain-specific emotional taxonomy by aggregating predicted results.

5. The method of claim 1 , wherein the emotion vector space model training process further comprises projecting the emotion vector representations of the fine-grained affective states into a distributed vector space, wherein similar fine-grained affective states are close to each other in the distributed vector space.

6. The method of claim 5 , further comprising gathering all sentences from the content conveying emotions that express a same emotional state together into a corresponding emotional document to form an input layer of the feed forward neural network.

7. The method of claim 6 , wherein the emotion vector space model training process further comprises converting words in the corresponding emotional document into word vectors and projecting the word vectors into the distributed vector space.

8. The method of claim 1 , wherein creating training data comprising content conveying emotions comprises gathering content that includes fine-grained emotions from online content based on context dependencies.

9. The method of claim 8 , wherein the training data comprises a random sampling of a same number of the content conveying emotions for each of the fine-grained emotions.

10. The method of claim 1 , wherein creating the training data comprising crawling for online posts containing a keyword, parsing the online posts containing the keyword to construct dependency relations between words appearing in the online posts, and extracting adjective terms that have dependencies with the keyword and treating the adjective terms as discrete emotions in the training data.

11. The method of claim 10 , further comprising deleting all discrete emotions with less than predetermined number of appearances from the training data.

12. The method of claim 10 , further comprising removing duplicate online posts containing the keyword found after crawling for the online posts containing the keyword.

13. The method of claim 10 , further comprising randomly sampling up to a predetermined number of the online posts for each of the discrete emotions.

14. A system configured to predict fine-grained affective states, the system comprising a processor configured to execute instructions to:

create training data comprising content conveying emotions;

create a trained model by performing an emotion vector space model training process using the training data to train a model using a feed forward neural network, wherein the emotion vector space model training process converts the discrete emotions into emotion vector representations, wherein an output layer of the feed forward neural network are word vectors that indicate probabilities of words and emojis that are within a window size of an emotion vector representation that is input for an input layer of the feed forward neural network, and wherein a hidden layer of the feed forward neural network is represented by a weight matrix with a row for each of the discrete emotions and a column for every hidden neuron in the hidden layer; and

use the trained model to predict fine-grained affective states for text conveying an emotion.

15. The system of claim 14 , further comprising applying dimension reduction and rotation techniques on the trained model to identify a principle dimension of a set of fine-grained affective states.

16. The system of claim 14 , further comprising applying clustering techniques on the trained model to identify basic emotions of a set of fine-grained affective states.

17. The system of claim 14 , further comprising generating domain-specific emotional taxonomy by aggregating predicted results.

18. The system of claim 14 , wherein the emotion vector space model training process further comprises projecting the emotion vector representations of the fine-grained affective states into a distributed vector space, wherein similar fine-grained affective states are close to each other in the distributed vector space.

19. The system of claim 18 , further comprising gathering all sentences from the content conveying emotions that express a same emotional state together into a corresponding emotional document to form an input layer of the feed forward neural network.

20. The system of claim 19 , wherein the emotion vector space model training process further comprises converting words in the corresponding emotional document into word vectors and projecting the word vectors into the distributed vector space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2019
From: LIU, ZHE; MAHMUD, JALAL U.; XU, ANBANG; GUO, YUFAN; LIU, HAIBIN; AKKIRAJU, RAMA KALYANI
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 049717/0913 →
Continuity (2)
Continuation 16268105 · Feb 5, 2019
Related Publication 20200250278A1 · Aug 6, 2020