IP Library Granted Patent US 11,645,806
Granted Patent B2
US 11,645,806 · App. 17/823,760 · Granted May 9, 2023

Animating digital graphics based on dynamic attributes

Inventor: Dmitri Stukalov (Palo Alto, CA)
Assignee: WhatsApp LLC
G06T13/80G06T11/001G06T11/60G06T13/00G06F3/0346G06F3/04842G06F2200/1637G06T3/40G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,806
App. No.
17/823,760
Granted
May 9, 2023
Kind
B2
Abstract

This disclosure covers methods, computer-readable media, and systems that animate a digital graphic associated with a video or other visual media item based on a detected dynamic attribute. In particular, the disclosed methods, computer-readable media, and systems detect sensor data from a client device or a motion of an object within a video or other visual media item. Based on the detected sensor data or motion of an object within a visual media item, the methods, computer-readable media, and systems overlay and animate an emoji or other digital graphic selected by a user on a video or other visual media item.

Claims (59)

1. A method comprising:

providing, from a first client device, a video of a person for presentation on a second client device;

receiving, from the second client device, an indication of a selection of a digital graphic from among a set of digital graphics;

detecting a motion of the person within the video;

based on the selected digital graphic and the motion of the person, determining an animation effect for the digital graphic; and

providing, for display on the first client device and the second client device, the video comprising the digital graphic as an overlay on the video of the person with an animation effect based on the motion of the person.

2. The method of claim 1 , wherein providing the video comprises providing a live-stream video originating from the first client device.

3. The method of claim 1 , further comprising:

detecting an additional motion of an additional person within an additional video; and

providing, for display on the first client device and the second client device, the additional video comprising the digital graphic as an overlay on the additional video of the additional person with the animation effect.

4. The method of claim 1 , further comprising:

receiving an indication that a magnitude of the motion has changed; and

based on the indication that the magnitude of the motion has changed, adjusting the animation effect of the digital graphic.

5. The method of claim 1 , wherein determining the animation effect for the digital graphic comprises determining that the motion of the person corresponds to a scaling animation that scales the digital graphic based on the motion of the person within the video.

6. The method of claim 1 , wherein determining the animation effect for the digital graphic comprises determining that the motion of the person corresponds to a mimicking animation that mimics the motion of the person within the video.

7. The method of claim 1 , further comprising:

detecting a brightness of the person or background within the video or a change in light detected by the first client device; and

changing a color of the digital graphic based on the brightness of the person or the background or the change in light detected by the first client device.

8. The method of claim 1 , further comprising:

accessing metadata associated with the digital graphic;

determining the metadata specifies that motions of a body part type trigger the animation effect; and

triggering the animation effect based a body part of the person within the video being of the body part type.

9. The method of claim 1 , wherein:

determining the animation effect for the digital graphic comprises identifying a particular animation effect that changes a portion of the digital graphic; and

providing the video comprising the digital graphic as an overlay comprises providing the digital graphic as an overlay on the video with the animation effect that changes the portion of the digital graphic.

10. A non-transitory computer readable medium storing instructions thereon that, when executed by at least one processor, cause the at least one processor to:

provide, from a first client device, a video of a person for presentation on a second client device;

receive, from the second client device, an indication of a selection of a digital graphic from among a set of digital graphics;

detect a motion of the person within the video;

based on the selected digital graphic and the motion of the person, determine an animation effect for the digital graphic; and

provide, for display on the first client device and the second client device, the video comprising the digital graphic as an overlay on the video of the person with an animation effect based on the motion of the person.

11. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to provide the video by providing a live-stream video originating from the first client device.

12. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to:

detect an additional motion of an additional person within an additional video; and

provide, for display on the first client device and the second client device, the additional video comprising the digital graphic as an overlay on the additional video of the additional person with the animation effect.

13. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to determine the animation effect for the digital graphic by determining that the motion of the person corresponds to a scaling animation that scales the digital graphic based on the motion of the person within the video.

14. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to determine the animation effect for the digital graphic by determining that the motion of the person corresponds to a mimicking animation that mimics the motion of the person within the video.

15. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to:

detect a brightness of the person or background within the video or a change in light detected by the first client device; and

change a color of the digital graphic based on the brightness of the person or the background or the change in light detected by the first client device.

16. A system comprising:

a computer readable storage medium storing a video of a person; and

at least one processor configured to cause the system to:

provide, from a first client device, the video of the person for presentation on a second client device;

receive, from the second client device, an indication of a selection of a digital graphic from among a set of digital graphics;

detect a motion of the person within the video;

based on the selected digital graphic and the motion of the person, determine an animation effect for the digital graphic; and

provide, for display on the first client device and the second client device, the video comprising the digital graphic as an overlay on the video of the person with an animation effect based on the motion of the person.

17. The system of claim 16 , wherein the at least one processor is configured to cause the system to provide the video by providing a live-stream video of a person originating from the first client device.

18. The system of claim 16 , wherein the at least one processor is further configured to cause the system to:

detect an additional motion of an additional person within an additional video; and

provide, for display on the first client device and the second client device, the additional video comprising the digital graphic as an overlay on the additional video of the additional person with the animation effect.

19. The system of claim 16 , wherein the at least one processor is further configured to cause the system to:

access metadata associated with the digital graphic;

determine the metadata specifies that motions of a body part type trigger the animation effect; and

trigger the animation effect based on a body part of the person within the video being of the body part type.

20. The system of claim 16 , wherein the at least one processor is further configured to cause the system to:

determine the animation effect for the digital graphic comprises identifying a particular animation effect that changes a portion of the digital graphic; and

provide the video comprising the digital graphic as an overlay by providing the digital graphic as an overlay on the video with the animation effect that changes the portion of the digital graphic.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: STUKALOV, DMITRI
To: WHATSAPP INC.
Reel/Frame 060955/0968 →
CHANGE OF NAME Recorded Aug 31, 2022
From: WHATSAPP INC.
To: WHATSAPP LLC
Reel/Frame 061365/0124 →
Continuity (5)
Continuation 17330129 · May 25, 2021
Continuation 16943936 · Jul 30, 2020
Continuation 16664479 · Oct 25, 2019
Continuation 15717795 · Sep 27, 2017
Related Publication 20220414965A1 · Dec 29, 2022