IP Library › Granted Patent US 11,507,855
Granted Patent B2
US 11,507,855 · App. 16/362,454 · Granted Nov 22, 2022

Generating action suggestions based on a change in user mood

Inventors: Leo S. Woiceshyn (Chicago, IL); Yi Wu (Chicago, IL); Thomas Yates Merrell (St Charles, IL); Zhengping Ji (Hinsdale, IL)
Assignee: Motorola Mobility LLC
G06N5/04G06K7/1413G06N20/00G16H50/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,507,855
App. No.
16/362,454
Filed
Mar 22, 2019
Granted
Nov 22, 2022
Kind
B2
Examiner
XIAO, DI
Art Unit
2179
USPC
706/14
Abstract

In aspects of generating action suggestions based on a change in user mood, a computing device implements an action generation module that generates action suggestions. The action generation module analyzes sensor data from sensors to determine a current user state associated with a user. The action generation module also analyzes environment data received from Internet-of-Things (IoT) devices to determine a current environment context associated with the user. The action generation module can detect a change in a user mood based on a comparison of the current user state with user history data that includes user state parameters and environment context parameters that indicate the user mood. The action generation module can analyze the user history data to determine the user state parameters and/or the environment context parameters that correlate to the change in the user mood, and generate an action suggestion that is intended to modify the current user state.

Claims (65)

1. A method, comprising:

analyzing sensor data from sensors of a mobile device to determine a current user state associated with a user of the mobile device;

analyzing environment data received from Internet-of-Things (IoT) devices to determine a current environment context associated with the user;

detecting a change in a user mood associated with the user based on a comparison of the current user state with user history data that includes user state parameters and environment context parameters that indicate the user mood;

prioritizing the environment context parameters by applying weighting data to the environment context parameters, the weighting data prioritizes first environment context parameters associated with more frequently visited locations higher than second environment context parameters associated with less frequently visited locations;

analyzing the user history data based on the current environment context to determine at least one of the user state parameters or the environment context parameters that correlates to the change in the user mood; and

generating, based on the at least one of the user state parameters or the environment context parameters, an action suggestion that is intended to modify the current user state.

2. The method of claim 1 , wherein the detecting the change in the user mood comprises detecting a transition from a positive mood state to a negative mood state.

3. The method of claim 1 , wherein the analyzing the user history data comprises analyzing the user history data to identify a past point in time where a past user state differs from the current user state.

4. The method of claim 1 , further comprising:

identifying a correlation between the current user state and the current environment context; and

updating the user history data by adding the correlation between the current user state and the current environment context to the user history data.

5. The method of claim 1 , wherein the analyzing the user history data comprises applying the weighting data to the user history data effective to prioritize the user history data.

6. The method of claim 1 , wherein the analyzing the environment data received from the IoT devices comprises:

extracting location information from the environment data; and

prioritizing the environment data based on the location information.

7. The method of claim 1 , wherein the analyzing the sensor data to determine the current user state comprises analyzing images captured by a camera sensor to identify facial expressions, and wherein the current user state is determined based on the facial expressions.

8. The method of claim 1 , wherein the environment data received from the IoT devices includes barcode information associated with a food item, and the analyzing the environment data received from the IoT devices comprises:

determining a health metric associated with the food item by using the barcode information to collect nutritional information associated with the food item; and

generating the current environment context based on the health metric.

9. The method of claim 1 , further comprising:

identifying a sequence of user mood state changes based on the user history data, the current user state, and the current environment context;

correlating the user history data, the current user state, and the current environment context with the sequence of the user mood state changes to identify a sequence of the environment context parameters that are associated with the sequence of the user mood state changes; and

updating the user history data to link the sequence of the user mood state changes with the sequence of the environment context parameters.

10. A computing device, comprising:

sensors to produce sensor data associated with a user;

a memory to maintain user history data that includes user state parameters and environment context parameters that indicate a user mood associated with the user; and

a processor system that implements an action generation module to:

determine a current user state associated with the user and a current environment context associated with the user based on the sensor data and environment data received from Internet-of-Things (IoT) devices;

detect a change in the user mood based on a comparison of the current user state with the user history data;

prioritize the environment context parameters by applying weighting data to the environment context parameters, the weighting data prioritizes first environment context parameters associated with more frequently visited locations higher than second environment context parameters associated with less frequently visited locations;

analyze the user history data based on the current environment context to determine at least one of the user state parameters or the environment context parameters that correlates to the change in the user mood; and

generate, based on the user state parameters or the environment context parameters, an action suggestion that is intended to modify the current user state.

11. The computing device of claim 10 , wherein:

the environment data received from the IoT devices comprises exercise data that includes heartbeat information associated with the user; and

the action generation module is implemented to determine the current user state based on the heartbeat information.

12. The computing device of claim 11 , wherein:

the exercise data includes an exercise activity identifier; and

the action generation module is implemented to:

assign the exercise activity identifier as a current environment parameter that is included in the current environment context;

identify a link between the exercise activity identifier and the current user state; and

update the user history data to include the link between the exercise activity identifier and the current user state.

13. The computing device of claim 10 , wherein the action generation module is implemented to:

analyze the user history data to find a point in time that corresponds to a positive user mood state;

identify an environment difference that correlates to the change in the user mood based on the environment context parameters included in the user history data at the point in time that corresponds to the positive user mood state, and based on current environment context parameters included in the current environment context; and

determine the at least one of the user state parameters or the environment context parameters based on the environment difference.

14. The computing device of claim 10 , wherein the action generation module is implemented to update the user history data with the current user state and the current environment context.

15. A method, comprising:

compiling user history data by aggregating, over a duration, user state parameters and environment context parameters that indicate a user mood associated with a user of a computing device;

determining a current user state associated with the user based on sensor data received from sensors of the computing device;

determining a current environment context associated with the user based on environment data received from Internet-of-Things (IoT) devices;

detecting a change in the user mood by comparing the current user state with the user history data;

prioritizing the environment context parameters by applying weighting data to the environment context parameters, the weighting data prioritizes first environment context parameters associated with more frequently visited locations higher than second environment context parameters associated with less frequently visited locations;

analyzing the user history data based on the current environment context to determine at least one of the user state parameters or the environment context parameters that correlates to the change in the user mood;

generating, based on the at least one of the user state parameters or the environment context parameters, an action suggestion that is intended to modify the current user state; and

updating the user history data by combining the current user state and the current environment context with the user state parameters and the environment context parameters effective to compile updated user history data.

16. The method of claim 15 , further comprising:

extracting location information from the environment data; and

prioritizing the environment data based on the location information.

17. The method of claim 15 , wherein the determining the current user state associated with the user is based on one or more audio characteristics including at least one of: an intensity, a pitch, a formant, or a frequency.

18. The method of claim 15 , wherein the updating the user history data comprises:

identifying a correlation between the current user state and a current activity identified by the current environment context; and

adding the correlation between the current user state and the current activity to the user history data.

19. The method of claim 15 , wherein the analyzing the user history data comprises analyzing the user history data to identify a past point in time where a past user state differs from the current user state.

20. The method of claim 15 , wherein the analyzing the user history data comprises applying the weighting data to the user history data effective to prioritize the user history data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2019
From: WOICESHYN, LEO S.; WU, YI; MERRELL, THOMAS YATES; JI, ZHENGPING
To: MOTOROLA MOBILITY LLC
Reel/Frame 048741/0784 →
Continuity (1)
Related Publication 20200302310A1 · Sep 24, 2020
Cited By (1)
US 12,432,443