Variable resolution virtual reality display system
A virtual reality display system that renders images at different resolutions in different parts of a display. Reduces rendering latency by rendering at a lower resolution in selected regions, for example on the sides of a display where human vision has lower resolution than in the center. Pixels in low resolution regions are combined into grid elements, and rendering may generate grid element values rather than individual pixel values. Rendering may use ray casting, rasterization, or both. Variable resolution rendering may be combined with variable level of detail geometry models to further reduce rendering time. Selected objects may be designed as high resolution objects that are rendered at a high resolution even in low resolution display regions.
1. A variable resolution virtual reality display system comprising:
at least one display viewable by a user and partitioned into at least two display regions having different resolutions;
a pose analyzer that calculates a pose of one or more body parts of said user;
a scene renderer coupled to said at least one display and to said pose analyzer, wherein said scene renderer
receives said pose from said pose analyzer; and,
based on said pose, calculates a rendered image for each of said at least two display regions; and,
an image warper coupled to said at least one display, said scene renderer, and said pose analyzer, wherein said image warper
receives said pose from said pose analyzer;
calculates a change in pose from said pose; and,
when said change in pose is below a threshold value,
generates a rerendering approximation of said rendered image for each of said at least two display regions based on said change in pose; and,
modifies one or more pixels of said at least one display based on said rerendering approximation.
2. The system of claim 1 , wherein
said at least two display regions comprise
a high resolution center region located in a center of a field of view of said user;
a low resolution left region located in a left portion of said field of view; and,
a low resolution right region located in a right portion of said field of view.
3. The system of claim 1 , further comprising a 3D model of a scene, wherein
at least one object in said 3D model comprises at least two geometry models at different levels of detail;
for each display region of said at least two display regions, said scene renderer
selects a level of detail for said at least one object; and,
calculates said rendered image using a geometry model for said level of detail associated with said at least one object.
4. The system of claim 1 , further comprising
at least one sensor that generates sensor data that measures one or more aspects of said pose of said one or more body parts of said user; and,
wherein said pose analyzer calculates said pose of said one or more body parts of said user based on said sensor data generated by said at least one sensor.
5. The system of claim 1 , wherein said rerendering approximation comprises
calculating a pixel translation vector; and,
translating one or more pixels of said rendered image for each of said at least two display regions by said pixel translation vector.
6. The system of claim 5 , wherein calculating said pixel translation vector comprises
approximating said change in pose as a rotation around a unit vector {circumflex over (ω)} comprising {circumflex over (ω)} y and {circumflex over (ω)} x by an angle Δθ;
calculating a spatial translation vector ({circumflex over (ω)} y Δθ,−{circumflex over (ω)} x Δθ);
calculating a scaling factor to convert spatial distances to pixels based on pixel dimensions and fields of view of said rendered image for each of said at least two display regions; and,
calculating said pixel translation vector by scaling said spatial translation vector by said scaling factor.