System and method for real-time ray tracing in a 3D environment
For rendering a three-dimensional (3D) scene, a set of parameters for one or more objects in the 3D scene are identified. Intermediate structures and corresponding objects for each of the one or more objects in the 3D scene are determined based on the set of identified parameters. A hybrid acceleration structure is determined based on the determined intermediate structures and a classical acceleration structure. A color contribution is determined for the hybrid acceleration structure. The 3D scene is then rendered based on the determined color contribution of the hybrid acceleration structure.
1 . A method, comprising:
identifying a set of parameters for one or more objects in a three-dimensional (3D) scene of a video;
determining intermediate structures and corresponding substitute objects for each of the one or more objects in the 3D scene based on the set of identified parameters,
wherein each substitute object comprises a middle-field image or a proxy object that comprises an identifier having color and depth information;
determining a hybrid acceleration structure that integrates the intermediate structures with nodes of a classical acceleration structure, the hybrid acceleration structure including, for each reflective or refractive object of the 3D scene, an indicator specifying whether a color contribution for the object is ray traced or is derived from a substitute object;
determining a color contribution for the determined hybrid acceleration structure by selectively combining ray-traced color data and substitute-object color data in accordance with the indicator; and
providing for rendering the 3D scene of the video based on the determined color contribution of the hybrid acceleration structure.
2 . The method of claim 1 , wherein the set of parameters comprises at least one of a rendering quality level, an environment importance value and information about the reflective and refractive objects in the 3D scene.
3 . The method of claim 1 , wherein the intermediate structures comprise an identifier which comprises color and depth information associated with each substitute object.
4 . The method of claim 1 , wherein the intermediate structures are determined using an array camera projection matrix for each substitute object representing a middle-field image or proxy object.
5 . The method of claim 1 , wherein the corresponding substitute objects include geometric data that defines the proxy object within the hybrid acceleration structure.
6 . The method of claim 5 , wherein the geometric data is at least one of a center location, and x, y and z-extend values for a primitive shape.
7 . The method of claim 1 , wherein the classical acceleration structure is one of a grid structure, a bounding volume hierarchy (BVH) structure, a k-dimensional tree structure and a binary space partitioning data structure.
8 . A device for rendering a three-dimensional (3D) scene of a video, comprising:
at least one processor configured to:
identify a set of parameters for one or more objects in a 3D scene of the video;
determine intermediate structures and corresponding substitute objects for each of the one or more objects in the 3D scene based on the set of identified parameters,
wherein each substitute object comprises a middle-field image or a proxy object that comprises an identifier having color and depth information;
determine a hybrid acceleration structure that integrates the intermediate structures with nodes of a classical acceleration structure, the hybrid acceleration structure including, for each reflective or refractive object of the 3D scene, an indicator specifying whether a color contribution is ray traced or is derived from a substitute object;
determine a color contribution for the determined hybrid acceleration structure by selectively combining ray-traced color data and substitute-object color data in accordance with the indicator; and
provide for rendering the 3D scene of the video based on the determined color contribution of the hybrid acceleration structure.
9 . The device of claim 8 , wherein the set of parameters comprises at least one of a rendering quality level, an environment importance value and information about the reflective and refractive objects in the 3D scene.
10 . The device of claim 8 , wherein the intermediate structures comprise an identifier which comprises color and depth information associated with each substitute object.
11 . The device of claim 8 , wherein the intermediate structures are determined using an array camera projection matrix for each substitute object representing a middle-field image or proxy object.
12 . The device of claim 8 , wherein the corresponding substitute objects include geometric data that defines the proxy object within the hybrid acceleration structure.
13 . The device of claim 12 , wherein the geometric data is at least one of a center location and x, y, and z-extend values for a primitive shape.
14 . The device of claim 8 , wherein the classical acceleration structure is one of a grid structure, a bounding volume hierarchy (BVH) structure, a k-dimensional tree structure and a binary space partitioning data structure.