Dynamic stereoscopic rendering method and processor
View Patent ↗A method comprising the steps of generating a first representation and a second representation, where the first representation represents a first view of a computer-generated scene obtained from a first virtual camera and the second representation represents a second view of the computer-generated scene obtained from a second virtual camera. Each of the first and second representation comprises a plurality of rays which intersect with objects of the scene. A relationship is determined between a ray of the first representation and a ray of the second representation; which are grouped based on the relationship, to form a group of substantially similar rays. One or more of the groups of substantially similar rays are processed substantially simultaneously to produce a first a second rendered view of the computer-generated scene. The first the second rendered view are output to one or more display devices.
1. A method comprising the steps of:
identifying at least one target region of a computer-generated scene, the at least one target region being associated with data relating to a gaze direction of a viewer;
generating at least a first computer-generated representation and a second computer- generated representation, where the first computer-generated representation represents a first view of the computer-generated scene obtained from a first virtual camera and the second computer-generated representation represents a second view of the computer-generated scene obtained from a second virtual camera, and each of the first computer-generated representation and the second computer-generated representation comprises a plurality of rays which intersect with objects of the computer-generated scene, wherein the first virtual camera and the second virtual camera are positioned within the computer-generated scene so as to represent an interocular distance associated with the viewer, and wherein generating at least the first computer-generated representation and the second computer-generated representation comprises:
increasing the number of rays in the first view and the second view, arranged to intersect with objects in the target region of the computer-generated scene; and
decreasing the number of rays in the first view and the second view arranged to intersect with objects outside the target region of the computer-generated scene;
determining a relationship between at least one ray of the first computer-generated representation and at least one ray of the second computer-generated representation;
grouping the at least one ray of the first computer-generated representation and the at least one ray of the second computer-generated representation based on the relationship, to form a group of substantially similar rays;
processing one or more of the group of substantially similar rays, substantially simultaneously to produce a first rendered view and a second rendered view of the computer-generated scene, wherein the first rendered view and the second rendered view are rendered using a first rendering technique in the target region and a second rendering technique outside the target region; and
outputting the first rendered view and the second rendered view to one or more display devices.
2. The method of claim 1 , wherein determining the relationship comprises determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect an object in the computer-generated scene.
3. The method of claim 2 , wherein determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect an object in the computer-generated scene, is based on at least:
a start point and a direction of each of the ray of the first computer-generated representation and the ray of the second computer-generated representation; and
a distance between the first virtual camera and the second virtual camera.
4. The method of claim 2 , wherein determining the relationship is also based on an intersect between the ray of the first computer-generated representation and the ray of the second computer-generated representation.
5. The method of claim 4 , wherein the intersect is determined using at least one of rasterization or ray tracing.
6. The method of claim 2 , where the ray of the first computer-generated representation and the ray of the second computer-generated representation have a substantially similar direction, and wherein processing the ray of the second computer-generated representation comprises processing the ray of the first computer-generated representation and applying an offset associated with a distance between the first virtual camera and the second virtual camera.
7. The method of claim 1 , wherein the first rendering technique and the second rendering technique are at least one of rasterization; or ray tracing.
8. The method of claim 1 , wherein the data relating to the gaze direction of a viewer comprises eye-tracking data.
9. The method of claim 1 , wherein the one or more display devices comprises at least one of a head-mounted display; a stereoscopic display, a multiview display, and a holographic display.
10. A processor comprising:
an input module for receiving an input from at least a first virtual camera and a second virtual camera arranged to obtain at least a first view and a second view of a computer-generated scene, wherein the first virtual camera and the second virtual camera are positioned within the computer-generated scene so as to represent an interocular distance associated with the viewer;
a target region identification module arranged to identify at least one target region of the computer-generated scene, the at least one target region being associated with a gaze direction of a viewer;
a generation module for generating a first computer-generated representation representative of the first view based on the input from the first virtual camera and a second computer-generated representation of the second view based on the input from the second virtual camera, the first computer-generated representation and the second computer-generated representation comprising a plurality of rays which intersect with objects of the scene, wherein generating the first computer-generated representation and second computer-generated representation comprises:
increasing the number of rays in the first view and the second view, arranged to intersect with objects in the target region of the computer-generated scene; and
decreasing the number of rays in the first view and the second view arranged to intersect with objects outside the target region of the computer-generated scene;
a relationship determination module for determining a relationship between at least one ray of the first computer-generated representation and at least one ray of the second computer-generated representation;
a grouping module arranged to group at least one ray of the first computer-generated representation and the at least one ray of the second computer-generated representation based on the relationship, to form a group of rays;
a processing module arranged to process one or more of the group of rays, substantially simultaneously to produce a first rendered view and a second rendered view of the computer-generated scene, wherein the first rendered view and the second rendered view are rendered using a first rendering technique in the target region and a second rendering technique outside the target region; and
an output module arranged to output the first rendered view and the second rendered view to one or more display devices.
11. The processor of claim 10 , wherein the relationship determination module comprises an intersection detection module for determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect an object in the computer-generated scene.
12. The processor of claim 11 , wherein determining whether a ray of the first computer-generated representation and a ray of the second computer-generated representation intersect and object in the computer-generated scene, is based on at least:
a start point and a direction of each of the ray of the first computer-generated representation and the ray of the second computer-generated representation; and
a distance between the first virtual camera and the second virtual camera.
13. The processor of claim 11 , wherein the intersection detection module is arranged to determine an intersect between the ray of the first computer-generated representation and the second computer-generated representation.
14. The processor of claim 10 , wherein the target region identification module comprises an eye-tracking sensor arranged to track at least one eye of the viewer.
15. The processor of claim 10 , wherein the one or more display devices comprises at least one of a head-mounted display; a stereoscopic display, a multiview display, and a holographic display.
16. A non-transitory computer-readable storage medium comprising a set of computer-readable instructions stored thereon which, when executed by at least one processor, cause the at least one processor to:
identify at least one target region of a computer-generated scene, the at least one target region being associated with data relating to a gaze direction of a viewer;
generate at least a first computer-generated representation and a second computer-generated representation, where the first computer-generated representation represents a first view of the computer-generated scene obtained from a first virtual camera and the second computer-generated representation represents a second view of the computer-generated scene obtained from a second virtual camera, and each of the first computer-generated representation and the second computer-generated representation comprises a plurality of rays which intersect with objects of the computer-generated scene, wherein the first virtual camera and the second virtual camera are positioned within the computer-generated scene so as to represent an interocular distance associated with the viewer, and wherein generating at least the first representation and the second representation comprises:
increasing the number of rays in the first view and the second view, arranged to intersect with objects in the target region of the computer-generated scene; and
decreasing the number of rays in the first view and the second view arranged to intersect with objects outside the target region of the computer-generated scene;
determine a relationship between at least one ray of the first computer-generated representation and at least one ray of the computer-generated second representation;
group the at least one ray of the first computer-generated representation and the at least one ray of the second computer-generated representation based on the relationship, to form a group of substantially similar rays;
process one or more of the group of substantially similar rays, substantially simultaneously to produce a first rendered view and a second rendered view of the computer-generated scene, wherein the first rendered view and the second rendered view are rendered using a first rendering technique in the target region and a second rendering technique outside the target region; and
output the first rendered view and the second rendered view to one or more display devices.