IP Library › Granted Patent US 10,792,566
Granted Patent B1
US 10,792,566 · App. 14/871,733 · Granted Oct 6, 2020

System for streaming content within a game application environment

Inventor: Jan Andrik Oliver Schmid (Jarfalla, SE)
Assignee: ELECTRONIC ARTS INC.
A63F13/355H04N19/127H04N19/172H04N19/179H04N19/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,792,566
App. No.
14/871,733
Granted
Oct 6, 2020
Kind
B1
Abstract

Embodiments of the present disclosure comprise a content streaming system 120 that can stream content assets within the game environment. The content streaming system 120 can include a decoding module 124 that can decode content prior to streaming. The content streaming system 120 can stream the content asset to the environmental element during runtime without dynamically rendering the content asset during runtime, the decoded content asset can be applied as a textures on elements within the game environment. A content management module 122 can prioritize the order in which the content asset content is decoded and manage the process of streaming the content asset to the environmental elements during runtime. The content management module 122 can also dynamically select the content asset with an appropriate resolution to stream to the environmental element based on runtime gameplay information.

Claims (39)

1. A computer-implemented method for streaming media content within a game application, comprising:

by a hardware processor configured with computer executable instructions,

executing a game application comprising a game environment, the game environment comprising a plurality of environmental elements for display within the game environment, wherein each of the environmental elements comprise a mesh defining a shape of the environmental element;

determining priority information of a plurality of content assets of a content asset feed based at least in part on first gameplay information associated with a gameplay state of the game application, wherein the priority information identifies a decoding order of the plurality of content assets, an amount of content of each content asset that is to be decoded, and a priority level associated with each content asset, wherein the amount of content of each content asset identified by the priority information is a number of frames and each priority level identifies a minimum number of frames to be decoded for each content asset associated with the priority level, wherein each content asset of the content asset feed comprises video data that includes a plurality of sequential frames, wherein the video data of each content asset of the content asset feed comprises the same video content pre-rendered at a different resolution;

decoding frames of the plurality of content assets based at least in part on the priority information, wherein the frames of individual content assets are decoded sequentially to generate decoded frames;

selecting a first content asset of the plurality of content assets having a specific resolution for use within the game environment based at least in part on second gameplay information associated with a gameplay state of the game application;

designating a first mesh of a first environmental element of the plurality of environmental elements to receive the decoded frames of the first content asset as a texture, wherein the texture defines an appearance of the first environmental element within the game environment;

providing at least a first decoded frame of the first content asset during runtime of the game application within the game environment as the texture of the first mesh of the first environmental element, wherein decoded frames of the first content asset are provided sequentially to the first environmental element; and

rendering a game output frame for display to a user during runtime of the game application, the game output frame comprising at least a portion of the first decoded frame as the texture of the first mesh of the first environmental element.

2. The computer-implemented method of claim 1 , wherein designating the first environmental element of the plurality of environmental elements to receive the first content asset comprises designating a receiving channel of the first environmental element to receive the decoded frames from an emitting channel of the first content asset.

3. The computer-implemented method of claim 1 further comprising allocating decoding processing resources prior to the decoding frames of individual content assets.

4. The computer-implemented method of claim 1 , wherein the first content asset comprises an average light value associated with each decoded frame.

5. The computer-implemented method of claim 1 further comprising designating a plurality environmental elements to receive the decoded frames of the first content asset.

6. The computer-implemented method of claim 1 further comprising designating a second content asset to replace the first content asset based at least in part on updated gameplay information.

7. The computer-implemented method of claim 6 , wherein the second content asset comprises different video content.

8. The computer-implemented method of claim 1 further comprising updating the priority information based at least in part on updated gameplay information.

9. The computer-implemented method of claim 1 , wherein the amount of content of each content asset identified by the priority information is a time value representative of a minimum amount of time of the content asset to be decoded, wherein the time value comprises a base time value and a priority time value, wherein the priority time value is indicative of an amount of decoding specific to each content asset that is above the base time value.

10. A computing system comprising:

a data store storage device configured to store computer readable instruction configured to execute a game application, and a plurality of content assets of a content asset feed for the game application, wherein each content asset comprises a plurality of sequential frames of media data, wherein the media data of each content asset of the content asset feed comprises the same media content pre-rendered at a defined resolution;

a processor configured to execute the game application, the game application configured to generate a game environment including a plurality of environmental elements for display within the game environment, the game application configured to:

determine priority information of the plurality of content assets of a content asset feed based at least in part on gameplay information associated with a gameplay state of the game application, wherein the priority information identifies a decoding order of the plurality of content assets, an amount of content of each content asset that is to be decoded, and a priority level associated with each content asset, wherein the amount of content of each content asset identified by the priority information is a number of frames and each priority level identifies a minimum number of frames to be decoded for each content asset associated with the priority level;

decode frames of the plurality of content assets based at least in part on the priority information, wherein the frames of individual content assets are decoded sequentially to generate decoded frames;

select a first content asset of the plurality of content assets having a specific resolution for use within the game environment based at least in part on gameplay information of the game application;

designate a first mesh of a first environmental element of the plurality of environmental elements to receive decoded frames of the first content asset as a texture, wherein the texture defines an appearance of the first environmental element within the game environment; and

provide at least a first decoded frame of the first content asset as the texture of the first mesh of the first environmental element during runtime of the game application, wherein decoded frames of the first content asset are provided sequentially to the first environmental element; and

render a game output frame for display to a user during runtime of the game application, the game output frame comprising at least a portion of the first decoded frame as the texture of the first mesh of the first environmental element.

11. The system of claim 10 , wherein the processor is further configured to designate a second content asset based at least in part on updated gameplay information.

12. The system of claim 11 , wherein the second content asset comprises different video content from the first content asset.

13. The system of claim 10 , wherein the gameplay information comprises at least one of a location of a virtual character within the game environment, and a facing direction of the virtual character within the game environment, and a size of the first environmental element within a user interface.

14. A non-transitory computer readable medium comprising computer-executable instructions for streaming content within a game application that, when executed by a computer, causes the computer to perform operations comprising:

executing a game application comprising a game environment, the game environment comprising a plurality of environmental elements for display within the game environment, wherein each of the environmental elements comprise a mesh defining a shape of the environmental element;

determining priority information of a plurality of content assets of a content asset feed based at least in part on first gameplay information associated with a gameplay state of the game application, wherein the priority information identifies a decoding order of the plurality of content assets, an amount of content of each content asset that is to be decoded, and a priority level associated with each content asset, wherein the amount of content of each content asset identified by the priority information is a number of frames and each priority level identifies a minimum number of frames to be decoded for each content asset associated with the priority level, wherein each content asset of the content asset feed comprises video data that includes a plurality of sequential frames, wherein the video data of each content asset of the content asset feed comprises the same video content pre-rendered at a different resolution;

decoding frames of the plurality of content assets based at least in part on the priority information, wherein the frames of individual content assets are decoded sequentially to generate decoded frames;

selecting a first content asset of the plurality of content assets having a specific resolution for use within the game environment based at least in part on second gameplay information associated with a gameplay state of the game application;

designating a first mesh of a first environmental element of the plurality of environmental elements to receive the decoded frames of the first content asset as a texture, wherein the texture defines an appearance of the first environmental element within the game environment;

providing at least a first decoded frame of the first content asset during runtime of the game application within the game environment as the texture of the first mesh of the first environmental element, wherein decoded frames of the first content asset are provided sequentially to the first environmental element; and

rendering a game output frame for display to a user during runtime of the game application, the game output frame comprising at least a portion of the first decoded frame as the texture of the first mesh of the first environmental element.

15. The non-transitory computer readable medium of claim 14 , wherein designating the first environmental element of the plurality of environmental elements to receive the first content asset comprises designating a receiving channel of the first environmental element to receive the decoded frames from an emitting channel of the first content asset.

16. The non-transitory computer readable medium of claim 14 further comprising designating a second content asset based at least in part on updated gameplay information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2020
From: SCHMID, JAN ANDRIK OLIVER
To: ELECTRONIC ARTS INC.
Reel/Frame 053457/0231 →
Cited By (14)
US 12,205,214 US 12,236,510 US 12,322,015 US 12,370,445 US 12,374,014 US 12,387,409 US 12,403,400 US 12,444,115 US 12,456,245 US 12,508,508 US 12,518,170 US 12,569,761 US 12,589,303 US 12,688,649