Split hierarchy graphics processing system
A split hierarchy graphics processor system including a master node executing a virtual reality (VR) application responsive to input from a client device received over a network to generate primitives for in a VR environment. The graphics processor system including render nodes performing rendering based on the primitives for views into the VR environment taken from a location in the VR environment, the views corresponding to a grid map of the VR environment. Each of the render nodes renders, encodes and streams a corresponding sequence of frames of a corresponding view to the client device. The processor system including an asset library storing input geometries for the objects used for building the VR environment, wherein the objects in the asset library are accessible by the master node and the render nodes.
1. A split hierarchy graphics processor system in a cloud system, comprising:
a plurality of render nodes at a server performing rendering in parallel based on a plurality of primitives for a plurality of views into a VR environment generated by an application, the plurality of views corresponding to a plurality of sides of a grid map of the VR environment, wherein each of the plurality of render nodes renders a corresponding sequence of frames at high resolution of a corresponding view of the plurality of views,
a plurality of encoders, wherein each of the plurality of encoders is located at a corresponding render node of the plurality of render nodes, wherein the each of the plurality of encoders encodes the corresponding sequence of frames and streams the corresponding sequence of frames that is encoded to a client device,
wherein the grid map provides a three dimensional representation of the VR environment centered to a location in the VR environment.
2. The split hierarchy graphics processor system of claim 1 , further comprising:
a master node at the server executing the application to generate the plurality of primitives.
3. The split hierarchy graphics processor system of claim 2 ,
wherein the master node is configured to synchronize rendering performed by the plurality of render nodes by applying timestamps or frame numbers to frames in the corresponding sequence of frames generated by the each of the plurality of render nodes.
4. The split hierarchy graphics processor system of claim 1 ,
wherein the grid map is a cube map including six sides.
5. The split hierarchy graphics processing system of claim 1 ,
wherein there is a one-to-one relationship between the each of the plurality of render nodes and a corresponding side of the grid map.
6. The split hierarchy graphics processing system of claim 1 ,
wherein each of the plurality of sides of the grid map corresponds to one of the plurality of views into the VR environment.
7. The split hierarchy graphics processing system of claim 1 ,
wherein the client device includes one or more decoders configured for decoding and buffering the corresponding sequence of frames that is encoded and streamed from the each of the plurality of render nodes,
wherein the client device is configured to select and decode one or more corresponding sequence of frames that is encoded of one or more of the plurality of views to generate a point-of-view at the high resolution into the VR environment for displaying.
8. A method for performing graphics processing using a split hierarchy graphics processor system of a cloud system, comprising:
rendering in parallel at a plurality of render nodes of a server based on a plurality of primitives for a plurality of views into a VR environment generated by an application, the plurality of views corresponding to a plurality of sides of a grid map of the VR environment, wherein each of the plurality of render nodes renders a corresponding sequence of frames at high resolution of a corresponding view of the plurality of views;
encoding at each of a plurality of encoders the corresponding sequence of frames; and
streaming at the each of the plurality of encoders the corresponding sequence of frames that is encoded to a client device, wherein the each of the plurality of encoders is located at a corresponding render node of the plurality of render nodes,
wherein the grid map provides a three dimensional representation of the VR environment centered to a location in the VR environment.
9. The method of claim 8 , further comprising:
executing at a master node of the server the application to generate the plurality of primitives,
wherein the executing the application is responsive to input from the client device.
10. The method of claim 8 , further comprising:
synchronizing the rendering performed in parallel at the plurality of render nodes by applying timestamps or frame numbers to frames in the corresponding sequence of frames generated by the each of the plurality of render nodes.
11. The method of claim 8 ,
wherein the grid map is a cube map including six sides.
12. The method of claim 8 ,
wherein there is a one-to-one relationship between the each of the plurality of render nodes and a corresponding side of the grid map.
13. The method of claim 8 ,
wherein each of the plurality of sides of the grid map corresponds to one of the plurality of views into the VR environment.
14. The method of claim 8 ,
wherein the client device includes one or more decoders configured for decoding and buffering the corresponding sequence of frames that is encoded and streamed from the each of the plurality of render nodes,
wherein the client device is configured to select and decode one or more corresponding sequence of frames that is encoded of one or more of the plurality of views to generate a point-of-view at the high resolution into the VR environment for displaying.
15. A non-transitory computer-readable medium storing a computer program for performing a method for performing graphics processing using a split hierarchy graphics processor system of a cloud system, the computer-readable medium comprising:
program instructions for rendering in parallel at a plurality of render nodes of a server based on a plurality of primitives for a plurality of views into a VR environment generated by an application, the plurality of views corresponding to a plurality of sides of a grid map of the VR environment, wherein each of the plurality of render nodes renders a corresponding sequence of frames at high resolution of a corresponding view of the plurality of views;
program instructions for encoding at each of a plurality of encoders the corresponding sequence of frames; and
program instructions for streaming at the each of the plurality of encoders the corresponding sequence of frames that is encoded to a client device, wherein the each of the plurality of encoders is located at a corresponding render node of the plurality of render nodes,
wherein the grid map provides a three dimensional representation of the VR environment centered to a location in the VR environment.
16. The non-transitory computer-readable medium of claim 15 , further comprising:
program instructions for executing at a master node of the server the application to generate the plurality of primitives,
wherein the executing the application is responsive to input from the client device.
17. The non-transitory computer-readable medium of claim 15 , further comprising:
program instructions for synchronizing the rendering performed in parallel at the plurality of render nodes by applying timestamps or frame numbers to frames in the corresponding sequence of frames generated by the each of the plurality of render nodes.
18. The non-transitory computer-readable medium of claim 15 ,
wherein the grid map is a cube map including six sides.
19. The non-transitory computer-readable medium of claim 15 ,
wherein there is a one-to-one relationship between the each of the plurality of render nodes and a corresponding side of the grid map.
20. The non-transitory computer-readable medium of claim 15 ,
wherein the client device includes one or more decoders configured for decoding and buffering the corresponding sequence of frames that is encoded and streamed from the each of the plurality of render nodes,
wherein the client device is configured to select and decode one or more corresponding sequence of frames that is encoded of one or more of the plurality of views to generate a point-of-view at the high resolution into the VR environment for displaying.