IP Library › Granted Patent US 11,651,539
Granted Patent B2
US 11,651,539 · App. 17/163,053 · Granted May 16, 2023

System for generating media content items on demand

Inventors: Bradley Kotsopoulos (Pickering, CA); Michael Kozakov (Toronto, CA); Yingying Wang (Marina del Rey, CA); Nicholas Hendriks (York, CA); Derek Spencer (Etobicoke, CA)
Assignee: Snap Inc.
G06T13/40G06F3/04845G06T13/80H04N21/2393H04N21/26258H04N21/44H04N21/8146H04N21/84G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,539
App. No.
17/163,053
Granted
May 16, 2023
Kind
B2
Abstract

Method for generating media content items on demand starts with a processor receiving an animation file including a first metadata based on an animation input. The animation file is associated with a media content identification. The processor generates puppets associated with frames in the animation file using the first metadata. The processor causes a puppet matching interface to be displayed on a client device. The puppet matching interface includes one of the puppets in a first pose. The processor receives a puppet posing input associated with a second pose from the client device. The processor causes the one of the puppets to be displayed in the second pose in the puppet matching interface by the client device. The processor can also generate a second metadata based on the puppet posing input. Other embodiments are disclosed herein.

Claims (67)

1. An avatar matching system comprising:

a processor; and

a memory storing instructions thereon, when executed by the processor, causes the avatar matching system to perform operations comprising:

receiving, from a puppet animation system, an animation file including a first metadata, wherein the animation file is associated with a media content identification, wherein the puppet animation system receives an animation input from a client device and generates the animation file including the first metadata based on the animation input,

generating a plurality of puppets associated with a plurality of frames using the first metadata, wherein the animation file comprises the plurality of frames,

causing a puppet matching interface to be displayed on the client device, wherein the puppet matching interface includes one of the plurality of puppets in a first pose,

receiving a puppet posing input from the client device, the puppet posing input being associated with a second pose,

causing the one of the plurality of puppets to be displayed in the second pose in the puppet matching interface by the client device, and

generating a second metadata based on the puppet posing input.

2. The avatar matching system of claim 1 , wherein the operations further comprise:

transmitting the second metadata to the puppet animation system, or to a metadata database.

3. The avatar matching system of claim 2 , wherein the operations further comprise:

causing the puppet animation system to display an animation interface including the one of the plurality of puppets in the second pose.

4. A content controller system comprising:

a puppet animation system to

receive an animation input from a client device, and

generate an animation file including a first metadata based on the animation input, wherein the animation file is associated with a media content identification;

an avatar matching system to

receive an animation file including the first metadata,

generate a plurality of puppets associated with a plurality of frames using the first metadata, wherein the animation file comprises the plurality of frames,

causing a puppet matching interface to be displayed on a client device, wherein the puppet matching interface includes one of the plurality of puppets in a first pose,

receiving a puppet posing input from the client device, the puppet posing input being associated with a second pose,

causing the one of the plurality of puppets to be displayed in the second pose in the puppet matching interface by the client device, and

generating a second metadata based on the puppet posing input; and

a rendering server system to:

render a set of media content item segments using the media content identification, wherein rendering the set of media content item segments comprises:

retrieving the first metadata and the second metadata from a metadata database associated with the media content identification, and

rendering the set of media content item segments using the first metadata and second metadata.

5. The content controller system of claim 4 , wherein the rendering server system to render the set of media content item segments comprises:

generating a main user avatar based on a main user identification,

incorporating the main user avatar into the set of media content item segments,

uploading the set of media content item segments to a segment database, and

updating segment states in the segment state database to indicate that the set of media content item segments are available.

6. The content controller system of claim 5 , wherein the rendering server system is further configured to:

receive a request for a media content item from a viewer client device, the request comprising the media content identification and the main user identification.

7. The content controller system of claim 6 , wherein the rendering server system is further configured to:

transmit to the viewer client device a playlist including the set of media content item segments.

8. The content controller system of claim 7 , wherein the rendering server system is further configured to:

retrieve segment states from a segment state database.

9. The content controller system of claim 8 , wherein the rendering server system is further configured to:

update the playlist based on the segment states.

10. The content controller system of claim 4 , wherein the avatar matching system is further configured to:

transmit the second metadata to the puppet animation system, or to the metadata database.

11. The content controller system of claim 6 , wherein the main user identification is associated with a user of the viewer client device.

12. The content controller system of claim 10 , wherein the puppet animation system is further configured to:

transmit to the metadata database the first metadata or the second metadata or a combination thereof.

13. The content controller system of claim 4 , wherein the puppet animation system is further configured to:

an animation interface including the one of the plurality of puppets in the second pose.

14. The content controller system of claim 4 , wherein the media content item is a video associated with the media content identification.

15. A method comprising:

receiving, by a processor from a puppet animation system, an animation file including a first metadata, wherein the animation file is associated with a media content identification, wherein the puppet animation system receives an animation input from a client device and generates the animation file including the first metadata based on the animation input;

generating a plurality of puppets associated with a plurality of frames using the first metadata, wherein the animation file comprises the plurality of frames;

causing a puppet matching interface to be displayed on the client device, wherein the puppet matching interface includes one of the plurality of puppets in a first pose;

receiving a puppet posing input from the client device, the puppet posing input being associated with a second pose;

causing the one of the plurality of puppets to be displayed in the second pose in the puppet matching interface by the client device; and

generating a second metadata based on the puppet posing input.

16. The method of claim 15 , further comprising:

transmitting the second metadata to the puppet animation system, or to a metadata database.

17. The method of claim 16 , further comprising:

causing the puppet animation system to display an animation interface including the one of the plurality of puppets in the second pose.

18. A non-transitory computer-readable storage medium having stored thereon, instructions when executed by a processor, causes the processor to perform operations comprising:

receiving, from a puppet animation system, an animation file including a first metadata, wherein the animation file is associated with a media content identification, wherein the puppet animation system receives an animation input from a client device and generates the animation file including the first metadata based on the animation input;

generating a plurality of puppets associated with a plurality of frames using the first metadata, wherein the animation file comprises the plurality of frames;

causing a puppet matching interface to be displayed on the client device, wherein the puppet matching interface includes one of the plurality of puppets in a first pose;

receiving a puppet posing input from the client device, the puppet posing input being associated with a second pose;

causing the one of the plurality of puppets to be displayed in the second pose in the puppet matching interface by the client device; and

generating a second metadata based on the puppet posing input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2022
From: KOTSOPOULOS, BRADLEY; KOZAKOV, MICHAEL; WANG, YINGYING; HENDRIKS, NICHOLAS; SPENCER, DEREK
To: SNAP INC.
Reel/Frame 060548/0021 →
Continuity (2)
Provisional Application 62968111 · Jan 30, 2020
Related Publication 20210241512A1 · Aug 5, 2021
Cited By (3)
US 12,231,709 US 12,277,638 US 12,335,575