IP Library › Granted Patent US 11,120,601
Granted Patent B2
US 11,120,601 · App. 16/946,463 · Granted Sep 14, 2021

Animated expressive icon

Inventors: Newar Husam Al Majid (New York, NY); Nathan Kenneth Boyd (Los Angeles, CA); Sheldon Chang (Venice, CA); Chamal Samaranayake (Venice, CA); Jeremy Voss (Los Angeles, CA)
Assignee: Snap Inc.
G06T13/40G06F3/04817G06K9/00268H04L67/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,120,601
App. No.
16/946,463
Granted
Sep 14, 2021
Kind
B2
Abstract

Embodiments described herein include an expressive icon system to present an animated graphical icon, wherein the animated graphical icon is generated by capture facial tracking data at a client device. In some embodiments, the system may track and capture facial tracking data of a user via a camera associated with a client device (e.g., a front facing camera, or a paired camera), and process the facial tracking data to animate a graphical icon.

Claims (57)

1. A method comprising:

initiating, at a client device, a communication session with a recipient;

detecting a contextual condition at the client device, the contextual condition including location data;

selecting a graphical icon from among a plurality of graphical icons based on the recipient of the communication session and user profile data that includes a user input that correlates the graphical icon to the location data and an identifier of the recipient;

receiving facial tracking data at the client device; and

animating a presentation of graphical icon based on the facial tracking data.

2. The method of claim 1 , wherein the receiving the facial tracking data at the client device includes:

capturing image data at the client device, the image data comprising a depiction of a set of facial landmarks;

generating a set of points based on positions of the set of facial landmarks, each point among the set of points corresponding to a facial landmark from among the set of facial landmarks; and

generating the facial tracking data based on the set of points.

3. The method of claim 1 , wherein the selecting the graphical icon from among the plurality of graphical icons based on the contextual condition includes:

accessing a user profile associated with the client device, the user profile comprising the user profile data that correlates the graphical icon to the contextual condition.

4. The method of claim 1 , wherein the client device is a first client device, the contextual condition includes user profile data associated with a second client device, and the method further comprises:

receiving a request to generate a message to a second client device from the first client device; and

selecting the graphical icon based on the user profile data associated with the second client device.

5. The method of claim 1 , wherein the contextual condition includes location data and temporal data.

6. The method of claim 1 , wherein the animating the presentation of the graphical icon based on the facial tracking data includes:

transposing the facial tracking data upon the graphical icon.

7. The method of claim 1 , wherein the method further comprises:

generating a message that includes the presentation of the graphical icon.

8. The method of claim 7 , wherein the message includes an ephemeral message.

9. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

initiating, at a client device, a communication session with a recipient detecting a contextual condition at the client device, the contextual condition including location data;

selecting a graphical icon from among a plurality of graphical icons based on the recipient of the communication session and user profile data that includes a user input that correlates the graphical icon to the location data and an identifier of the recipient;

receiving facial tracking data at the client device; and

animating a presentation of graphical icon based on the facial tracking data.

10. The system of claim 9 , wherein the receiving the facial tracking data at the client device includes:

capturing image data at the client device, the image data comprising a depiction of a set of facial landmarks;

generating a set of points based on positions of the set of facial landmarks, each point among the set of points corresponding to a facial landmark from among the set of facial landmarks; and

generating the facial tracking data based on the set of points.

11. The system of claim 9 , wherein the selecting the graphical icon from among the plurality of graphical icons based on the contextual condition includes:

accessing a user profile associated with the client device, the user profile comprising the user profile data that correlates the graphical icon to the contextual condition.

12. The system of claim 9 , wherein the client device is a first client device, the contextual condition includes user profile data associated with a second client device, and the instructions further comprise:

receiving a request to generate a message to a second client device from the first client device; and

selecting the graphical icon based on the user profile data associated with the second client device.

13. The system of claim 9 , wherein the contextual condition includes location data and temporal data.

14. The system of claim 9 , wherein the animating the presentation of the graphical icon based on the facial tracking data includes:

transposing the facial tracking data upon the graphical icon.

15. The system of claim 9 , wherein the instructions further comprise:

generating a message that includes the presentation of the graphical icon.

16. The system of claim 15 , wherein the message includes an ephemeral message.

17. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

initiating, at a client device, a communication session with a recipient detecting a contextual condition at the client device, the contextual condition including location data;

selecting a graphical icon from among a plurality of graphical icons based on the recipient of the communication session and user profile data that includes a user input that correlates the graphical icon to the location data and an identifier of the recipient contextual condition;

receiving facial tracking data at the client device; and

animating a presentation of graphical icon based on the facial tracking data.

18. The non-transitory machine-readable storage medium of claim 17 , wherein the receiving the facial tracking data at the client device includes:

capturing image data at the client device, the image data comprising a depiction of a set of facial landmarks;

generating a set of points based on positions of the set of facial landmarks, each point among the set of points corresponding to a facial landmark from among the set of facial landmarks; and

generating the facial tracking data based on the set of points.

19. The non-transitory machine-readable storage medium of claim 17 , wherein the selecting the graphical icon from among the plurality of graphical icons based on the contextual condition includes:

accessing a user profile associated with the client device, the user profile comprising the user profile data that correlates the graphical icon to the contextual condition.

20. The non-transitory machine-readable storage medium of claim 17 , wherein the client device is a first client device, the contextual condition includes user profile data associated with a second client device, and the instructions further comprise:

receiving a request to generate a message to a second client device from the first client device; and

selecting the graphical icon based on the user profile data associated with the second client device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2020
From: AL MAJID, NEWAR HUSAM; BOYD, NATHAN KENNETH; CHANG, SHELDON; SAMARANAYAKE, CHAMAL; VOSS, JEREMY
To: SNAP INC.
Reel/Frame 053097/0621 →
Continuity (2)
Continuation 15908422 · Feb 28, 2018
Related Publication 20200320767A1 · Oct 8, 2020
Cited By (1)
US 12,400,389