Video game overlay
View Patent ↗A video server is configured to provide streaming video to players of computer games over a computing network. The video server can provided video of different games to different players simultaneously. This is accomplished by rendering several video streams in parallel using a single GPU (Graphics Processing Unit). The output of the GPU is provided to graphics processing pipelines that are each associated with a specific client/player and are dynamically allocated as needed. A client qualifier may be used to assure that only clients capable of presenting the streaming video to a player at a minimum level of quality receive the video stream. Video frames provided by the video server optionally include overlays added to the output of the GPU. These overlays can include voice data received from another game player.
1. A method for generating video for a video game, comprising:
transmitting information about a decoder capability of a client computing system to a server computing system;
receiving encoded video data from the server computing system at the client computing system, the encoded video data including an encoded version of video data for the video game representing a game environment rendered based on game rules and one or more input signals, the encoded video data generated by processing video data for the video game through a dynamically provisioned encoding pipeline that includes an encoder compatible with the decoder capability of the client computing system;
decoding the received encoded video data at the client computing system to obtain the video data for the video game;
applying a video overlay to at least a portion of the video data for the video game at the client computing system to generate modified video data for the video game locally at the client computing system, wherein applying the video overlay includes mapping pixels of a video overlay image to specific pixels in a video frame defined by the video data for the video game; and
providing the modified video data for the video game for display at the client computing system.
2. The method for generating video for the video game as recited in claim 1 , wherein the video overlay is defined by overlay data sourced at the client computing system.
3. The method for generating video for the video game as recited in claim 2 , wherein the overlay data provides one or more graphical controls for a computer program executing on the client computing system.
4. The method for generating video for the video game as recited in claim 3 , wherein the computer program executing on the client computing system enables audio communication between a player of the video game at the client computing system and one or more other players of the video game.
5. The method for generating video for the video game as recited in claim 4 , wherein the one or more other players of the video game are respectively associated with one or more other client computer systems.
6. The method for generating video for the video game as recited in claim 5 , wherein the audio communication between the player of the video game at the client computing system and one or more other players of the video game at the one or more other client computer systems is transmitted through the server computing system.
7. The method for generating video for the video game as recited in claim 1 , further comprising:
receiving overlay data through a network connection, the overlay data defining the video overlay.
8. The method for generating video for the video game as recited in claim 7 , wherein the overlay data provides one or more graphical controls for a computer program executing on a remote computing system.
9. The method for generating video for the video game as recited in claim 8 , wherein the computer program executing on the remote computing system enables audio communication between a player of the video game at the client computing system and one or more other players of the video game.
10. The method for generating video for the video game as recited in claim 1 , further comprising:
receiving encoded audio data at the client computing system;
decoding the encoded audio data to generate decoded audio data;
detecting activation of a graphical control presented by the video overlay, the graphical control defined to control playback of the decoded audio data; and
upon detecting activation of the graphical control, playing the decoded audio data at the client computing system.
11. The method for generating video for the video game as recited in claim 10 , further comprising:
receiving overlay data through a network connection, the overlay data defining the video overlay, wherein the encoded audio data is included in the overlay data.
12. The method for generating video for the video game as recited in claim 1 , further comprising:
detecting activation of a graphical control presented by the video overlay, the graphical control defined to establish an audio communication channel between the client computing system and one or more other client computing systems; and
upon detecting activation of the graphical control, establishing the audio communication channel between the client computing system and at least one other client computing system.
13. A video game system, comprising:
an agent configured to determine information about a decoder capability of the video game system and transmit the information about the decoder capability of the video game system to a server computing system;
a network interface configured to receive encoded video data from the server computing system, the encoded video data including an encoded version of video data for a video game representing a game environment rendered based on game rules and one or more user input signals, the encoded video data generated by processing video data for the video game through a dynamically provisioned encoding pipeline that includes an encoder compatible with the decoder capability of the video game system as determined by the agent;
a decoder corresponding to the decoder capability of the video game system as determined by the agent, the decoder configured to decode the received encoded video data to obtain the video data for the video game;
overlay logic configured to apply a video overlay to at least a portion of the video data for the video game to generate modified video data for the video game locally at the video game system, the video overlay sourced independently from the video game, wherein the overlay logic is configured to map pixels of a video overlay image to specific pixels in a video frame defined by the video data for the video game; and
a video output interface configured to provide the modified video data for display on a display device.
14. The video game system as recited in claim 13 , wherein the overlay data provides one or more graphical controls for a computer program executing locally on the video game system.
15. The video game system as recited in claim 14 , wherein the computer program executing on the video game system enables audio communication between a player of the video game at the video game system and one or more other players of the video game.
16. The video game system as recited in claim 15 , wherein the one or more other players of the video game are respectively associated with one or more other video game systems.
17. The video game system as recited in claim 16 , wherein the audio communication between the player of the video game at the video game system and one or more other players of the video game at the one or more other video game systems is transmitted through the server computing system.
18. The video game system as recited in claim 13 , wherein the video overlay is defined by overlay data sourced at the video game system.
19. The video game system as recited in claim 13 , wherein the video overlay is defined by overlay data received through the network interface.