IP Library Granted Patent US 12,148,445
Granted Patent B2
US 12,148,445 · App. 17/491,269 · Granted Nov 19, 2024

Emotion detection and moderation based on voice inputs, errors in gameplay, physiological indicators of heart rate or skin tone of users of a communication session

Inventors: Victoria Dorn (San Mateo, CA); Celeste Bean (San Mateo, CA); Olga Rudi (San Mateo, CA); Courtney Yingling (San Mateo, CA); Hsin-Yi Chien (San Mateo, CA)
Assignee: Sony Interactive Entertainment Inc.
G10L25/63G10L15/22H04L67/306H04N7/152H04W76/45A61B5/16G10L15/222
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,148,445
App. No.
17/491,269
Granted
Nov 19, 2024
Kind
B2
Abstract

Systems and methods for emotion detection and emotion-based moderation based on voice inputs are provided. A user emotion profile may be stored in memory for a user. The user emotion profile may include one or more moderation rules that specifies a moderation action responsive to one or more emotional states. A current communication session associated with the user and one or more other users may be monitored based on the user emotion profile. An emotional state detected as being associated with a subset of the messages may trigger at least one of the moderation rules by corresponding to at least one of the emotional states specified by the user emotion profile. A presentation of at least one of the messages in the subset being provided to the user device may be modified in accordance with the moderation action specified by the user emotion profile.

Claims (36)

1. A method for emotion-based moderation, the method comprising:

storing a user emotion profile in memory for a user, wherein the user emotion profile includes one or more moderation rules that specify a moderation action responsive to one or more emotional states of other users;

monitoring a current communication session associated with a user device of the user based on the user emotion profile, wherein the current communication session includes messages from one or more other user devices of the other users;

identifying an emotional state of one of the other users based on analyzing a subset of the messages from the other user using an emotion learning model that correlates emotion to one or more emotional indicators including at least one of error in gameplay, character behavior, or player physiological indicator that includes at least one of a heart rate or a skin tone;

detecting that the emotional state identified for the other user triggers at least one of the moderation rules, wherein the detected emotional state corresponds to at least one of the emotional states specified by the user emotion profile; and

modifying a presentation of at least one of the messages in the subset being provided to the user device in accordance with the at least one triggered moderation rule, wherein at least a part of the at least one message is filtered out of the modified presentation in accordance with the moderation action specified by the at least one triggered moderation rule from the user emotion profile of the user, and wherein the modified presentation is different from a version provided to each of the other users of the current communication session.

2. The method of claim 1 , wherein monitoring the current communication session includes monitoring emotional states associated with the user and with each of the other users.

3. The method of claim 2 , wherein monitoring the current communication session further includes assigning the emotional states associated with the user and with each of the other users to one or more predetermined categories.

4. The method of claim 3 , wherein the predetermined categories include one or more subcategories corresponding to a gradient between mild and extreme levels of the associated emotional state.

5. The method of claim 1 , wherein the subset of messages is associated with one or more identified users within the current communication session.

6. The method of claim 5 , further comprising imposing a punishment for the identified users, wherein the punishment includes a loss of one or more privileges associated with the current communication session.

7. The method of claim 1 , wherein modifying the presentation of the at least one message includes neutralizing the detected emotional state associated with the at least one message.

8. A system for emotion-based moderation, the system comprising:

memory that stores a user emotion profile for a user, wherein the user emotion profile includes one or more moderation rules that specify a moderation action responsive to one or more emotional states of other users;

a communication interface that communicates over a communication network, wherein the communication interface connects to a current communication session associated with a user device of the user, wherein the current communication session includes messages from one or more other user devices of the other users; and

a processor that executes instructions stored in memory, wherein the processor executes the instructions to:

monitor the current communication session based on the user emotion profile,

identify an emotional state of one of the other users based on analyzing a subset of the messages from the other user using an emotion learning model that correlates emotion to one or more emotional indicators including at least one of error in gameplay, character behavior, or player physiological indicator that includes at least one of a heart rate or a skin tone;

detect that the emotional state identified for the other user triggers at least one of the moderation rules, wherein the detected emotional state corresponds to at least one of the emotional states specified by the user emotion profile, and

modify a presentation of at least one of the messages in the subset being provided to the user device in accordance with the at least one triggered moderation rule, wherein at least a part of the at least one message is filtered out of the modified presentation in accordance with the moderation action specified by the at least one triggered moderation rule from the user emotion profile of the user, and wherein the modified presentation is different from a version provided to each of the other users of the current communication session.

9. The system of daim 8 , wherein the processor monitors the current communication session by monitoring emotional states associated with the user and with each of the other users.

10. The system of claim 9 , wherein the processor monitors the current communication session by further assigning the emotional states associated with the user and with each of the other users to one or more predetermined categories.

11. The system of claim 10 , wherein the predetermined categories include one or more subcategories corresponding to a gradient between mild and extreme levels of the associated emotional state.

12. The system of claim 8 , wherein the subset of messages is associated with one or more identified users within the current communication session.

13. The system of claim 12 , wherein the processor executes further instructions to impose a punishment for the identified users, wherein the punishment includes a loss of one or more privileges associated with the current communication session.

14. The system of claim 8 , wherein the processor modifies the presentation of the at least one message by neutralizing the detected emotional state associated with the at least one message.

15. A non-transitory, computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for emotion-based moderation, the method comprising:

storing a user emotion profile in memory for a user, wherein the user emotion profile includes one or more moderation rules that specify a moderation action responsive to one or more emotional states of other users;

monitoring a current communication session associated with a user device of the user based on the user emotion profile, wherein the current communication session includes messages from one or more other user devices of the other users;

identifying an emotional state of one of the other users based on analyzing a subset of the messages from the other user using an emotion learning model that correlates emotion to one or more emotional indicators including at least one of error in gameplay, character behavior, or player physiological indicator that includes at least one of a heart rate or a skin tone;

detecting that the emotional state identified for the other user triggers at least one of the moderation rules, wherein the detected emotional state corresponds to at least one of the emotional states specified by the user emotion profile; and

modifying a presentation of at least one of the messages in the subset being provided to the user device in accordance with the at least one triggered moderation rule, wherein at least a part of the at least one message is filtered out of the modified presentation in accordance with the moderation action specified by the at least one triggered moderation rule from the user emotion profile of the user, and wherein the modified presentation is different from a version provided to each of the other users of the current communication session.

16. The non-transitory, computer-readable storage medium of claim 15 , wherein monitoring the current communication session further includes assigning the emotional states associated with the user and with each of the other users to one or more predetermined categories.

17. The non-transitory, computer-readable storage medium of claim 16 , wherein the predetermined categories include one or more subcategories corresponding to a gradient between mild and extreme levels of the associated emotional state.

18. The non-transitory, computer-readable storage medium of claim 15 , wherein the subset of messages is associated with one or more identified users within the current communication session.

19. The non-transitory, computer-readable storage medium of claim 15 , further comprising instructions executable to impose a punishment for the identified users, wherein the punishment includes a loss of one or more privileges associated with the current communication session.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2023
From: DORN, VICTORIA; BEAN, CELESTE; RUDI, OLGA; CHIEN, HSIN-YI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 064957/0727 →
Continuity (1)
Related Publication 20230096357A1 · Mar 30, 2023