IP Library Granted Patent US 11,468,619
Granted Patent B2
US 11,468,619 · App. 17/330,129 · Granted Oct 11, 2022

Animating digital graphics overlaid on visual media items based on dynamic attributes

Inventor: Dmitri Stukalov (Palo Alto, CA)
Assignee: WhatsApp LLC
G06T13/80G06T11/001G06T11/60G06T13/00G06F3/0346G06F3/04842G06F2200/1637G06T3/40G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,468,619
App. No.
17/330,129
Granted
Oct 11, 2022
Kind
B2
Abstract

This disclosure covers methods, computer-readable media, and systems that animate a digital graphic associated with a video or other visual media item based on a detected dynamic attribute. In particular, the disclosed methods, computer-readable media, and systems detect sensor data from a client device or a motion of an object within a video or other visual media item. Based on the detected sensor data or motion of an object within a visual media item, the methods, computer-readable media, and systems overlay and animate an emoji or other digital graphic selected by a user on a video or other visual media item.

Claims (59)

1. A method comprising:

providing, from a first client device, a video of an object for presentation on a second client device;

receiving, from the second client device, an indication of a selection of a digital graphic from among a set of digital graphics;

detecting a motion of the object within the video;

based on the selected digital graphic and the motion of the object, determining an animation effect for the digital graphic; and

providing, for display on the first client device and the second client device, the video comprising the digital graphic as an overlay on the video of the object with the animation effect.

2. The method of claim 1 , wherein providing the video comprises providing a live-stream video originating from the first client device.

3. The method of claim 1 , further comprising:

detecting an additional motion of an additional object within an additional video; and

providing, for display on the first client device and the second client device, the additional video comprising the digital graphic as an overlay on the additional video of the additional object with the animation effect.

4. The method of claim 1 , further comprising:

receiving an indication that a magnitude of the motion has changed; and

based on the indication that the magnitude of the motion has changed, adjusting the animation effect of the digital graphic.

5. The method of claim 1 , wherein determining the animation effect for the digital graphic comprises determining that the motion of the object corresponds to a scaling animation that scales the digital graphic based on the motion of the object within the video.

6. The method of claim 1 , wherein determining the animation effect for the digital graphic comprises determining that the motion of the object corresponds to a mimicking animation that mimics the motion of the object within the video.

7. The method of claim 1 , further comprising:

detecting a brightness of the object or background within the video or a change in light detected by the first client device; and

changing a color of the digital graphic based on the brightness of the object or the background or the change in light detected by the first client device.

8. The method of claim 1 , further comprising:

accessing metadata associated with the digital graphic;

determining the metadata specifies that motions of an object type trigger the animation effect; and

triggering the animation effect based on the object within the video being of the object type.

9. The method of claim 1 , wherein:

determining the animation effect for the digital graphic comprises identifying a particular animation effect that changes a portion of the digital graphic; and

providing the video comprising the digital graphic as an overlay comprises providing the digital graphic as an overlay on the video with the animation effect that changes the portion of the digital graphic.

10. A non-transitory computer readable medium storing instructions thereon that, when executed by at least one processor, cause a computing device to:

provide, from a first client device, a video of an object for presentation on a second client device;

receive, from the second client device, an indication of a selection of a digital graphic from among a set of digital graphics;

detect a motion of the object within the video;

based on the selected digital graphic and the motion of the object, determine an animation effect for the digital graphic; and

provide, for display on the first client device and the second client device, the video comprising the digital graphic as an overlay on the video of the object with the animation effect.

11. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to provide the video by providing a live-stream video originating from the first client device.

12. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:

detect an additional motion of an additional object within an additional video; and

provide, for display on the first client device and the second client device, the additional video comprising the digital graphic as an overlay on the additional video of the additional object with the animation effect.

13. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to determine the animation effect for the digital graphic by determining that the motion of the object corresponds to a scaling animation that scales the digital graphic based on the motion of the object within the video.

14. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to determine the animation effect for the digital graphic by determining that the motion of the object corresponds to a mimicking animation that mimics the motion of the object within the video.

15. The non-transitory computer readable medium of claim 10 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:

detect a brightness of the object or background within the video or a change in light detected by the first client device; and

change a color of the digital graphic based on the brightness of the object or the background or the change in light detected by the first client device.

16. A system comprising:

at least one processor; and

at least one non-transitory computer readable storage medium storing instructions that, when executed by the at least one processor, cause the system to:

provide, from a first client device, a video of an object for presentation on a second client device;

receive, from the second client device, an indication of a selection of a digital graphic from among a set of digital graphics;

detect a motion of the object within the video;

based on the selected digital graphic and the motion of the object, determine an animation effect for the digital graphic; and

provide, for display on the first client device and the second client device, the video comprising the digital graphic as an overlay on the video of the object with the animation effect.

17. The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to provide the video by providing a live-stream video of a person originating from the first client device.

18. The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to:

detect an additional motion of an additional object within an additional video; and

provide, for display on the first client device and the second client device, the additional video comprising the digital graphic as an overlay on the additional video of the additional object with the animation effect.

19. The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to:

access metadata associated with the digital graphic;

determine the metadata specifies that motions of an object type trigger the animation effect; and

trigger the animation effect based on the object within the video being of the object type.

20. The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to:

determine the animation effect for the digital graphic comprises identifying a particular animation effect that changes a portion of the digital graphic; and

provide the video comprising the digital graphic as an overlay by providing the digital graphic as an overlay on the video with the animation effect that changes the portion of the digital graphic.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2021
From: STUKALOV, DMITRI
To: WHATSAPP INC.
Reel/Frame 058009/0573 →
CHANGE OF NAME Recorded Nov 3, 2021
From: WHATSAPP INC.
To: WHATSAPP LLC
Reel/Frame 058015/0241 →
Continuity (4)
Continuation 16943936 · Jul 30, 2020
Continuation 16664479 · Oct 25, 2019
Continuation 15717795 · Sep 27, 2017
Related Publication 20220044465A1 · Feb 10, 2022