IP Library › Granted Patent US 11,812,347
Granted Patent B2
US 11,812,347 · App. 16/948,185 · Granted Nov 7, 2023

Non-textual communication and user states management

Inventors: Andrés Monroy-Hernández (Seattle, WA); Chunjong Park (Seattle, WA); Fannie Liu (Seattle, WA); Yu Jiang Tham (Los Angeles, CA)
Assignee: Snap Inc.
H04W4/21H04M1/7243H04W4/38
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,812,347
App. No.
16/948,185
Filed
Sep 8, 2020
Granted
Nov 7, 2023
Kind
B2
Art Unit
2647
USPC
455/412.1
Abstract

A method and a system include receiving a first signal value generated by a biosignal sensor coupled to the first client device, receiving one or more second signal values corresponding to a respective sensor reading or environmental condition associated with the first client device, determining a total score based on a first score and one or more second scores determined based on the first and the one or more second signal values, selecting a first state of the plurality of states based on a ranking of total scores of the plurality of states, and causing a display of a first notification associated with a first user-selectable element corresponding to the first state on the first client device.

Claims (82)

1. A method comprising:

detecting a first signal that includes real-time biosignal data of a sending user of a first device, the real-time biosignal data being generated by a biosignal sensor coupled to the first device;

detecting a second signal from the first device, the second signal including real-time physical activity data of the sending user of the first device;

for each state of a plurality of states relating to the sending user of the first device:

determining a first score based on a first signal value included in the real-time biosignal data,

determining a second score based on the real-time physical activity data, and

determining a total score based on the first score determined based on the first signal value included in the real-time biosignal data of the sending user and further based on the second score determined based on the real-time physical activity data of the sending user;

selecting a first state from the plurality of states based on a ranking of total scores of the plurality of states;

determining a time period for a display of an ephemeral message based on immediacy of the first state, the ephemeral message including a first user-selectable element representing the first state:

generating a first notification that includes the ephemeral message; and

causing display of the first notification on the first device, the ephemeral message being displayed on the first device within the time period.

2. The method of claim 1 , further comprising:

determining an arousal level based on the first signal value, the first signal value corresponding to real-time heart rate data of the sending user;

generating an emotion status based on the arousal level; and

for each state of the plurality of states, determining the first score based on at least one of the arousal level or the emotion status.

3. The method of claim 2 , wherein the arousal level includes a first arousal level and a second arousal level, wherein the first arousal level is associated with a value lower than a pre-determined threshold.

4. The method of claim 3 , wherein the first arousal level corresponds to a negative emotion status, and the second arousal level corresponds to a positive emotion status.

5. The method of claim 1 , further comprising:

detecting a third signal associated with one of time data, location data, weather data, surrounding sound data, or light exposure data;

for each state of a plurality of states relating to the sending user of the first device, determining a third score based on the third signal; and

determining the total score based on the first score, the second score, and the third score.

6. The method of claim 1 , further comprising:

receiving indication of user selection of the first user-selectable element by the sending user;

providing, in response to receiving the user selection, for display of a second notification corresponding to the first state to a second device of a recipient user;

receiving indication of user selection of the second notification from the second device;

providing for display of a first media content item representing the first state of the sending user on the second device;

generating a plurality of selectable user interface elements, each selectable user interface element representing a reaction in response to the first state of the sending user, on the second device;

receiving indication of user selection of a first selectable user interface element, from among the plurality of selectable user interface elements, responsive to the first media content item from the second device; and

providing for display of a third notification corresponding to a second media content item on the first device.

7. The method of claim 6 , further comprising:

generating the second media content item including the reaction represented by the first selectable user interface element.

8. The method of claim 1 , wherein the first notification is associated with an adjustable haptic pattern caused by the first device.

9. The method of claim 1 , wherein the first notification is associated with a plurality of user-selectable elements each corresponding to a state in the plurality of states, the plurality of user-selectable elements including the first user-selectable element.

10. The method of claim 9 , further comprising:

assigning a first weight to each of the first score and the second score based on the user selection of the first user-selectable element corresponding to the first state by the sending user.

11. The method of claim 9 , further comprising:

assigning a second weight to each of the first score and the second score based on a user selection of a second state from the plurality of states by the sending user.

12. The method of claim 1 , wherein the second score is generated within a pre-defined time period.

13. A system comprising:

one or more processors; and

a non-transitory computer readable storage medium comprising instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising:

detecting a first signal that includes real-time biosignal data of a sending user of a first device, the real-time biosignal data being generated by a biosignal sensor coupled to the first device;

detecting a second signal from the first device, the second signal including real-time physical activity data of the sending user of the first device;

for each state of a plurality of states relating to the sending user of the first device:

determining a first score based on a first signal value included in the real-time biosignal data,

determining a second score based on the real-time physical activity data, and

determining a total score based on the first score determined based on the first signal value included in the real-time biosignal data of the sending user and further based on the second score determined based on the real-time physical activity data of the sending user;

selecting a first state from the plurality of states based on a ranking of total scores of the plurality of states;

determining a time period for a display of an ephemeral message based on immediacy of the first state, the ephemeral message including a first user-selectable element representing the first state:

generating a first notification that includes the ephemeral message; and

causing display of the first notification on the first device, the ephemeral message being displayed on the first device within the time period.

14. The system of claim 13 , wherein the one or more processors further performs operations comprising:

determining an arousal level based on the first signal value, the first signal value corresponding to real-time heart rate data of the sending user;

generating an emotion status based on the arousal level; and

for each state of the plurality of states, determining the first score based on at least one of the arousal level or the emotion status.

15. The system of claim 14 , wherein the arousal level includes a first arousal level and a second arousal level, wherein the first arousal level is associated with a value lower than a pre-determined threshold.

16. The system of claim 15 , wherein the first arousal level corresponds to a negative emotion status, and the second arousal level corresponds to a positive emotion status.

17. The system of claim 13 , wherein the operations further comprise:

detecting a third signal associated with one of time data, location data, weather data, surrounding sound data, or light exposure data;

for each state of a plurality of states relating to the sending user of the first device, determining a third score based on the third signal; and

determining the total score based on the first score, the second score, and the third score.

18. The system of claim 13 , wherein the one or more processors further performs operations comprising:

receiving indication of user selection of the first user-selectable element by the sending user;

providing, in response to receiving the user selection, for display of a second notification corresponding to the first state to a second device of a recipient user;

receiving indication of user selection of the second notification from the second device;

providing for display of a first media content item representing the first state of the sending user on the second device;

generating a plurality of selectable user interface elements, each selectable user interface element representing a reaction in response to the first state of the sending user, on the second device;

receiving indication of user selection of a first selectable user interface element, from among the plurality of selectable user interface elements, responsive to the first media content item from the second device; and

providing for display of a third notification corresponding to a second media content item on the first device.

19. The system of claim 18 , wherein the one or more processors further performs operations comprising:

generating the second media content item including the reaction represented by the first selectable user interface element.

20. A machine-readable non-transitory storage medium having instruction data executable by a machine to cause the machine to perform operations comprising:

detecting a first signal that includes real-time biosignal data of a sending user of a first device, the real-time biosignal data being generated by a biosignal sensor coupled to the first device;

detecting a second signal from the first device, the second signal including real-time physical activity data of the sending user of the first device;

for each state of a plurality of states relating to the sending user of the first device:

determining a first score based on a first signal value included in the real-time biosignal data,

determining a second score based on the real-time physical activity data, and

determining a total score based on the first score determined based on the first signal value included in the real-time biosignal data of the sending user and further based on the second score determined based on the real-time physical activity data of the sending user;

selecting a first state from the plurality of states based on a ranking of total scores of the plurality of states;

determining a time period for a display of an ephemeral message based on immediacy of the first state, the ephemeral message including a first user-selectable element representing the first state:

generating a first notification that includes the ephemeral message; and

causing display of the first notification on the first device, the ephemeral message being displayed on the first device within the time period.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2023
From: MONROY-HERNÁNDEZ, ANDRÉS; PARK, CHUNJONG; LIU, FANNIE; THAM, YU JIANG
To: SNAP INC.
Reel/Frame 065058/0229 →
Continuity (2)
Provisional Application 62896981 · Sep 6, 2019
Related Publication 20210076173A1 · Mar 11, 2021