Systems and methods for separable foreground and background rendering
Various aspects of the subject technology relate to systems, methods, and machine-readable media for streaming a game. The method includes receiving a background stream rendered on a server and including a server time stamp, the background stream rendered at a first resolution and displayed at a second resolution, the first resolution larger than the second resolution. The method also includes receiving a foreground stream rendered on the server. The method also includes receiving control input from a player at a current time, the control input controlling a camera angle of the game. The method also includes determining a difference in the camera angle intended by the player between the current time and the server time stamp. The method also includes adjusting a display output based on the difference by shifting a focal point of the background stream according to the control input by utilizing extra rendered pixels.
1. A computer-implemented method for streaming a game, comprising:
receiving from a server a background stream, the background stream rendered on the server and comprising background data and a server time stamp, the background stream rendered at a first resolution, the background stream displayed at a second resolution on a display of a local client, the first resolution larger than the second resolution and comprising extra rendered pixels such that a rendered area of the background stream is larger than a display area of the background stream, the rendered area rectangular in shape;
receiving from the server a foreground stream, the foreground stream rendered on the server and comprising foreground data, the foreground data comprising location information of the foreground data in relation to the background data;
receiving, at the local client, control input from a player at a current time, the control input controlling a camera angle of the game;
determining a difference in the camera angle intended by the player between the current time and the server time stamp; and
adjusting a display output based on the difference by shifting a focal point of the background stream according to the control input by utilizing the extra rendered pixels.
2. The computer-implemented method of claim 1 , further comprising:
displaying the display output on the display of the local client, the display output comprising the background stream and the foreground stream.
3. The computer-implemented method of claim 1 , further comprising:
detecting that the control input has been input by the player.
4. The computer-implemented method of claim 1 , wherein the background stream and the foreground stream are rendered concurrently.
5. The computer-implemented method of claim 1 , wherein the background stream is rendered at a first interval and the foreground stream is rendered at a second interval.
6. The computer-implemented method of claim 1 , wherein the local client displays a cropped version of the background stream.
7. The computer-implemented method of claim 1 , further comprising:
compositing the background stream with the foreground stream to achieve the display output.
8. A system for streaming a game, comprising:
a processor; and
a memory comprising instructions stored thereon, which when executed by the processor, causes the processor to perform:
receiving from a server a background stream, the background stream rendered on the server and comprising background data and a server time stamp, the background stream rendered at a first resolution, the background stream displayed at a second resolution on a display of a local client, the first resolution larger than the second resolution and comprising extra rendered pixels such that a rendered area of the background stream is larger than a display area of the background stream, the rendered area rectangular in shape;
receiving from the server a foreground stream, the foreground stream rendered on the server and comprising foreground data, the foreground data comprising location information of the foreground data in relation to the background data;
receiving, at the local client, control input from a player at a current time, the control input controlling a camera angle of the game;
determining a difference in the camera angle intended by the player between the current time and the server time stamp; and
adjusting a display output based on the difference by shifting a focal point of the background stream according to the control input by utilizing the extra rendered pixels.
9. The system of claim 8 , further comprising stored sequences of instructions, which when executed by the processor, cause the processor to perform:
displaying the display output on the display of the local client, the display output comprising the background stream and the foreground stream.
10. The system of claim 8 , further comprising stored sequences of instructions, which when executed by the processor, cause the processor to perform:
detecting that the control input has been input by the player.
11. The system of claim 8 , wherein the background stream and the foreground stream are rendered concurrently.
12. The system of claim 8 , wherein the background stream is rendered at a first interval and the foreground stream is rendered at a second interval.
13. The system of claim 8 , wherein the local client displays a cropped version of the background stream.
14. The system of claim 8 , further comprising stored sequences of instructions, which when executed by the processor, cause the processor to perform:
compositing the background stream with the foreground stream to achieve the display output.
15. A non-transitory computer-readable storage medium is provided including instructions that, when executed by a processor, cause the processor to perform a method for streaming a game, comprising:
receiving from a server a background stream, the background stream rendered on the server and comprising background data and a server time stamp, the background stream rendered at a first resolution, the background stream displayed at a second resolution on a display of a local client, the first resolution larger than the second resolution and comprising extra rendered pixels such that a rendered area of the background stream is larger than a display area of the background stream, the rendered area rectangular in shape;
receiving from the server a foreground stream, the foreground stream rendered on the server and comprising foreground data, the foreground data comprising location information of the foreground data in relation to the background data;
receiving, at the local client, control input from a player at a current time, the control input controlling a camera angle of the game;
determining a difference in the camera angle intended by the player between the current time and the server time stamp; and
adjusting a display output based on the difference by shifting a focal point of the background stream according to the control input by utilizing the extra rendered pixels.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the method further comprises:
displaying the display output on the display of the local client, the display output comprising the background stream and the foreground stream.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the method further comprises:
rendering the background stream and the foreground stream concurrently.
18. The non-transitory computer-readable storage medium of claim 15 , wherein the method further comprises:
rendering the background stream at a first interval; and
rendering the foreground stream at a second interval.
19. The non-transitory computer-readable storage medium of claim 15 , wherein the method further comprises:
displaying a cropped version of the background stream on the local client.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the method further comprises:
compositing the background stream with the foreground stream to achieve the display output.