IP Library › Granted Patent US 11,284,144
Granted Patent B2
US 11,284,144 · App. 16/777,817 · Granted Mar 22, 2022

Video generation system to render frames on demand using a fleet of GPUs

Inventors: Bradley Kotsopoulos (Pickering, CA); Eli Semory (Fair Lawn, NJ); Rahul Bhupendra Sheth (Los Angeles, CA)
Assignee: Snap Inc.
H04N21/26258G06F16/2379G06F16/43G06T1/20H04N21/234H04N21/235H04N21/2393H04N21/25891H04N21/84G06T2200/16G06T2200/24H04N21/4788
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,284,144
App. No.
16/777,817
Filed
Jan 30, 2020
Granted
Mar 22, 2022
Kind
B2
Art Unit
2426
USPC
725/116
Abstract

A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.

Claims (60)

1. A content controller system comprising:

a rendering server system comprising a plurality of graphics processing units (GPUs) to render a set of media content item segments using a media content identification and a main user identification, wherein the set of media content item segments are a plurality of sequential frames of a media content item, wherein rendering the set of media content item segments comprises

retrieving metadata from a metadata database associated with the media content identification,

rendering the set of media content item segments using the metadata,

generating a main user avatar based on the main user identification, and

incorporating the main user avatar into the set of media content item segments;

to upload the set of media content item segments to a segment database; and

to update segment states in a segment state database to indicate that the set of media content item segments are available.

2. The content controller system of claim 1 , further comprising:

a delivery server system to receive a request for the media content item from a client device, the request comprising the media content identification and the main user identification.

3. The content controller system of claim 2 , wherein

the media content item is a video associated with the media content identification.

4. The content controller system of claim 2 , wherein the main user identification is associated with a user of the client device.

5. The content controller system of claim 2 , wherein

the delivery server system is further

to retrieve the segment states from the segment state database, wherein the segment states indicate availability associated with media content item segments.

6. The content controller system of claim 5 , wherein

the delivery server system is further

to compile and transmit to the client device a playlist including the set of media content item segments.

7. The content controller system of claim 1 , wherein the plurality of GPUs is a fleet of GPUs.

8. A content controller system comprising:

a delivery server system

to receive a request for a media content item from a client device, the request comprising a media content identification and a main user identification;

to retrieve segment states from a segment state database, wherein the segment states indicate availability associated with media content item segments;

to compile and transmit to the client device a playlist including a first set of media content item segments, wherein the first set of media content item segments is based on the segment states;

to initialize rendering of a second set of media content item segments; and

a rendering server system comprising a plurality of graphics processing units (GPUs)

to render a second set of media content item segments using the media content identification and the main user identification, wherein rendering the second set of media content item segments comprises

retrieving metadata from a metadata database associated with the media content identification,

rendering the second set of media content item segments using the metadata,

generating a main user avatar based on the main user identification, and

incorporating the main user avatar into the second set of media content item segments;

to upload the second set of media content item segments to a segment database; and

to update the segment states in the segment state database to indicate that the second set of media content item segments are available,

wherein the first set of media content item segments and the second set of media content items are a plurality of sequential frames of the media content item.

9. The content controller system of claim 8 , wherein the delivery server system is further to update the playlist to include the second set of media content item segments.

10. The content controller system of claim 9 , wherein the delivery server system updating the playlist comprises:

compiling the updated playlist to include the second set of media content item segments; and

transmitting the updated playlist to the client device.

11. The content controller system of claim 8 , wherein the client device receives the second set of media content item segments from the segment database.

12. The content controller system of claim 8 , wherein

the media content item is a video associated with the media content identification.

13. The content controller system of claim 8 , wherein the first set of media content item segments is sequential to the second set of media content item segments.

14. The content controller system of claim 8 , wherein the main user identification is associated with a user of the client device.

15. The content controller system of claim 8 , wherein the plurality of GPUs is a fleet of GPUs.

16. A rendering server system comprising:

a plurality of graphics processing units (GPUs); and

a memory component having instructions stored thereon, when executed by at least one of the plurality of GPUs, causes the at least one of the plurality of GPUs to perform operations comprising:

rendering a set of media content item segments using a media content identification and a main user identification, wherein the set of media content item segments is a plurality of sequential frames of the media content item, wherein rendering the set of media content item segments comprises

retrieving metadata from a metadata database associated with the media content identification,

rendering the set of media content item segments using the metadata,

generating a main user avatar based on the main user identification, and

incorporating the main user avatar into the set of media content item segments;

uploading the set of media content item segments to a segment database; and

updating segment states in a segment state database to indicate that the set of media content item segments are available.

17. The rendering server system of claim 16 , wherein

the media content item is a video associated with the media content identification; and

the main user identification is associated with a user of the client device.

18. The rendering server system of claim 17 , wherein

the plurality of GPUs is a fleet of GPUs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2022
From: KOTSOPOULOS, BRADLEY; SEMORY, ELI; SHETH, RAHUL BHUPENDRA
To: SNAP INC.
Reel/Frame 059027/0226 →
Continuity (1)
Related Publication 20210243487A1 · Aug 5, 2021
Cited By (76)
US 1,089,291 US 12,198,398 US 12,223,672 US 12,229,901 US 12,231,709 US 12,235,991 US 12,236,512 US 12,254,577 US 12,271,536 US 12,277,632 US 12,277,638 US 12,284,146 US 12,284,698 US 12,288,273 US 12,293,433 US 12,299,775 US 12,307,564 US 12,315,495 US 12,321,577 US 12,335,575 US 12,340,453 US 12,361,934 US 12,387,444 US 12,394,154 US 12,395,456 US 12,412,347 US 12,417,562 US 12,418,504 US 12,429,953 US 12,436,598 US 12,469,273 US 12,472,435 US 12,475,621 US 12,475,658 US 12,499,483 US 12,499,638 US 12,504,866 US 12,513,098 US 12,517,626 US 12,518,437 US 12,518,738 US 12,530,847 US 12,530,852 US 12,536,751 US 12,541,930 US 12,548,267 US 12,555,274 US 12,555,310 US 12,567,102 US 12,579,204 US 12,580,784 US 12,580,980 US 12,586,562 US 12,602,842 US 12,614,354 US 12,614,359 US 12,620,188 US 12,620,216 US 12,632,890 US 12,633,073 US 12,646,266 US 12,646,268 US 12,651,292 US 12,651,409 US 12,670,674 US 12,682,508 US 12,695,929 US 12,699,802 US 12,700,187 US 12,705,875 US 12,711,538 US 12,725,332 US 12,731,342 US 12,731,343 US 12,737,973 US 12,744,958