IP Library Granted Patent US 10,237,304
Granted Patent B1
US 10,237,304 · App. 15/227,217 · Granted Mar 19, 2019

Systems and methods of administering computer activities based upon emotional intelligence

Inventors: Ilya Sokolov (Boston, MA); Keith Newstadt (West Newton, MA)
Assignee: SYMANTEC CORPORATION
H04L63/20G06F3/013G06F17/30528G06F17/30598H04L67/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,237,304
App. No.
15/227,217
Granted
Mar 19, 2019
Kind
B1
Abstract

Systems and methods of administering computer activities based upon user emotional intelligence are provided. One method may include receiving a user request for a computer activity and sensing emotional context data associated with the user, such as voice stress analysis of use a communication, eye motion, pupil dilation, mood and stress changes, sporadic user movement, and video contexts indicating micro-expressions (i.e. anxiety, anger, amusement, and the like). The method may further include retrieving a policy associated with the requested computer activity and applying the sensed emotional context data to the policy. In response to policy permission, the system may enable full or restricted access to the requested computer activity based upon the sensed emotional context. In the alternative, in response to policy violation, the system may deny access to the computer activity. The system may solicit feedback such that parental or third party controls may be established using emotional intelligence.

Claims (103)

1. A method of administering computer activities comprising:

receiving, at a computer system, a user request for a computer activity;

sensing, in real-time, emotional context data associated with the user by way of a biometric sensor, camera, microphone, or combination thereof coupled to the computer system;

applying, by the computer system, the sensed emotional context data to a policy associated with the computer activity to detect policy permission or policy violation;

adjusting, by the computer system, a level of access to the computer activity based on applying the sensed emotional context data to the policy; and

automatically modifying the policy based in part on adjusting the level of access.

2. The method of claim 1 , wherein receiving user request further comprises:

detecting an attempted user initiation of a game or an application; detecting an attempted user opening of a website or file;

identifying, in response to the attempted initiation or opening, whether the game, the website, the file, or the application is associated with at least one policy; and

verifying, in response to the identified association, to the attempted initiation or opening as the user request.

3. The method of claim 1 , wherein sensing emotional context by way of the biometric receiver, camera, microphone, or combination thereof further comprises:

retrieving voice stress analysis of user communications;

capturing video context using the camera to detect a variety of micro-expressions including amusement, contempt, embarrassment, anxiety, guilt, pride, relief, contentment, pleasure, and shame;

detecting eye motion using the camera;

detecting pupil dilation using the camera;

detecting mood and stress changes by sensing at least a heart rate, a perspiration rate, a body temperature, an adrenaline level, or a blood oxygen level using the biometric sensor; and

detecting sporadic user movement associated with stress using the camera or a motion detector; and

packaging the voice stress analysis, the video context, the eye motion, the pupil dilation, the mood and stress changes, and the sporadic user movement to form the emotional context data.

4. The method of claim 1 , wherein applying sensed emotional context data further comprises:

processing a set of instructions associated with the policy using the sensed emotional context;

generating, in response to the processed instruction approval, the policy permission with full access;

generating, in response to the processed instruction conditional approval, the policy permission with restricted access; and

generating, in response to the processed instruction denial, the policy violation.

5. The method of claim 1 , wherein correlating computer activity with emotional context data further comprises:

detecting whether a sensed negative micro-expression exists that includes anxiety, pride, contempt, or anger;

classifying, in response to the sensed negative micro-expression, a user response to the computer activity as stressed;

detecting whether a sensed positive micro-expression exists that includes amusement, relief, contentment, or pleasure; and

classifying, in response to the sensed positive micro-expression, the user response to the computer activity as preferred.

6. The method of claim 1 , further comprising:

storing the correlation between the computer activity and the emotional context in a database associated with the user.

7. The method of claim 1 , further comprising:

reporting the correlation between the computer activity and the emotional context to a parent of a minor user;

soliciting feedback from the parent; and

modifying a user profile and a corresponding set of policies based upon the solicited feedback and prior user computer activity.

8. A computing system comprising:

a memory; and

a processor operable to:

receive, at a computer system, a user request for a computer activity;

sense, in real-time, emotional context data associated with the user by way of a biometric sensor, camera, microphone, or combination thereof coupled to the computer system;

apply, by the computer system, the sensed emotional context data to a policy associated with the computer activity to detect policy permission or policy violation;

adjust, by the computer system, a level of access to the computer activity based on applying the sensed emotional context data to the policy; and

automatically modify the policy based in part on adjusting the level of access.

9. The controller of claim 8 , wherein the processor, for receiving user request, is further operable to:

detect an attempted user initiation of a game or an application; detect an attempted user opening of a website or file;

identify, in response to the attempted initiation or opening, whether the game, the website, the file, or the application is associated with at least one policy; and

verify, in response to the identified association, to the attempted initiation or opening as the user request.

10. The controller of claim 8 , wherein the processor, for sensing emotional context, is further operable to:

retrieve voice stress analysis of user communications;

capture video context using the camera to detect a variety of micro-expressions including amusement, contempt, embarrassment, anxiety, guilt, pride, relief, contentment, pleasure, and shame;

detect eye motion using the camera;

detect pupil dilation using the camera;

detect mood and stress changes by sensing at least a heart rate, a perspiration rate, a body temperature, an adrenaline level, or a blood oxygen level using the biometric sensor; and

detect sporadic user movement associated with stress using the camera or a motion detector; and

package the voice stress analysis, the video context, the eye motion, the pupil dilation, the mood and stress changes, and the sporadic user movement to form the emotional context data.

11. The controller of claim 8 , wherein the processor, for applying sensed emotional context data, is further operable to:

process a set of instructions associated with the policy using the sensed emotional context;

generate, in response to the processed instruction approval, the policy permission with full access;

generate, in response to the processed instruction conditional approval, the policy permission with restricted access; and

generate, in response to the processed instruction denial, the policy violation.

12. The controller of claim 8 , wherein the processor, for correlating computer activity with emotional context data, is further operable to:

detect whether a sensed negative micro-expression exists that includes anxiety, pride, contempt, or anger;

classify, in response to the sensed negative micro-expression, a user response to the computer activity as stressed;

detect whether a sensed positive micro-expression exists that includes amusement, relief, contentment, or pleasure; and

classify, in response to the sensed positive micro-expression, the user response to the computer activity as preferred.

13. The controller of claim 8 , wherein the processor is further operable to:

store the correlation between the computer activity and the emotional context in a database associated with the user.

14. The controller of claim 8 , wherein the processor is further operable to:

report the correlation between the computer activity and the emotional context to a parent of a minor user;

solicit feedback from the parent; and

modify a user profile and a corresponding set of policies based upon the solicited feedback and prior user computer activity.

15. A non-transitory computer-readable medium including code for performing a method, the method comprising:

receiving, at a computer system, a user request for a computer activity;

sensing, in real-time, emotional context data associated with the user by way of a biometric sensor, camera, microphone, or combination thereof coupled to the computer system;

applying, by the computer system, the sensed emotional context data to a policy associated with the computer activity to detect policy permission or policy violation;

adjusting, by the computer system, a level of access to the computer activity based on applying the sensed emotional context data to the policy; and

automatically modifying the policy based in part on adjusting the level of access.

16. The computer-readable medium of claim 15 , wherein receiving user request further comprises:

detecting an attempted user initiation of a game or an application;

detecting an attempted user opening of a website or file;

identifying, in response to the attempted initiation or opening, whether the game, the website, the file, or the application is associated with at least one policy; and

verifying, in response to the identified association, to the attempted initiation or opening as the user request.

17. The computer-readable medium of claim 15 , wherein sensing emotional context further comprises:

retrieving voice stress analysis of user communications;

capturing video context using the camera to detect a variety of micro-expressions including amusement, contempt, embarrassment, anxiety, guilt, pride, relief, contentment, pleasure, and shame;

detecting eye motion using the camera;

detecting pupil dilation using the camera;

detecting mood and stress changes by sensing at least a heart rate, a perspiration rate, a body temperature, an adrenaline level, or a blood oxygen level using the biometric sensor; and

detecting sporadic user movement associated with stress using the camera or a motion detector; and

packaging the voice stress analysis, the video context, the eye motion, the pupil dilation, the mood and stress changes, and the sporadic user movement to form the emotional context data.

18. The computer-readable medium of claim 15 , wherein applying sensed emotional context data further comprises:

processing a set of instructions associated with the policy using the sensed emotional context;

generating, in response to the processed instruction approval, the policy permission with full access;

generating, in response to the processed instruction conditional approval, the policy permission with restricted access; and

generating, in response to the processed instruction denial, the policy violation.

19. The computer-readable medium of claim 15 , wherein correlating computer activity with emotional context data further comprises:

detecting whether a sensed negative micro-expression exists that includes anxiety, pride, contempt, or anger;

classifying, in response to the sensed negative micro-expression, a user response to the computer activity as stressed;

detecting whether a sensed positive micro-expression exists that includes amusement, relief, contentment, or pleasure; and

classifying, in response to the sensed positive micro-expression, the user response to the computer activity as preferred.

20. The computer-readable medium of claim 15 , wherein the method further comprises:

reporting the correlation between the computer activity and the emotional context to a parent of a minor user;

soliciting feedback from the parent; and

modifying a user profile and a corresponding set of policies based upon the solicited feedback and prior user computer activity.

Assignments (6)
CHANGE OF NAME Recorded May 18, 2023
From: NORTONLIFELOCK INC.
To: GEN DIGITAL INC.
Reel/Frame 063697/0493 →
NOTICE OF SUCCESSION OF AGENCY (REEL 050926 / FRAME 0560) Recorded Sep 13, 2022
From: JPMORGAN CHASE BANK, N.A.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 061422/0371 →
SECURITY AGREEMENT Recorded Sep 13, 2022
From: NORTONLIFELOCK INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 062220/0001 →
CHANGE OF NAME Recorded Mar 5, 2020
From: SYMANTEC CORPORATION
To: NORTONLIFELOCK INC.
Reel/Frame 052109/0186 →
SECURITY AGREEMENT Recorded Nov 4, 2019
From: SYMANTEC CORPORATION; BLUE COAT LLC; LIFELOCK, INC,; SYMANTEC OPERATING CORPORATION
To: JPMORGAN, N.A.
Reel/Frame 050926/0560 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2016
From: SOKOLOV, ILYA; NEWSTADT, KEITH
To: SYMANTEC CORPORATION
Reel/Frame 039347/0392 →
Cited By (3)
US 12,211,483 US 12,335,224 US 12,424,026