DEPTH BASED FOVEATED RENDERING FOR DISPLAY SYSTEMS
Methods and systems for depth-based foveated rendering in a display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include monitoring eye orientations of a user of the display system. A fixation point can be determined based on the eye orientations, the fixation point representing a three-dimensional location with respect to a field of view. Location information of virtual object(s) to present is obtained, with the location information including three-dimensional position(s) of the virtual object(s). A resolution of the virtual object(s) can be adjusted based on a proximity of the location(s) of the virtual object(s) to the fixation point. The resolution can also be adjusted based on color, ambient illumination level, and/or other considerations. The virtual object(s) are presented by the display system according to the adjusted resolution(s).
1 . A display system comprising:
one or more processors; and
one or more computer storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
determining an ambient illumination level using a light sensor; and
adjusting a resolution of component color images forming virtual content based on:
a proximity of the virtual content from a user fixation point; and
the ambient illumination level and a color of the component color image that is not visible at the ambient illumination level, wherein the component color images of the color are lower in resolution than component color images of another color.
2 . The display system of claim 1 , wherein the resolution corresponds to at least a color depth.
3 . The display system of claim 1 , wherein the resolution corresponds to at least polygon count.
4 . The display system of claim 1 , wherein the component color images comprise red component color images, green component color images, and blue component color images:
wherein when the ambient illumination level corresponds to a first illumination level, the green component color images have a higher resolution than the red or the blue component color images.
5 . The display system of claim 4 , wherein when the ambient illumination level corresponds to a second illumination level, the red component color images have a higher resolution than the blue component color images.
6 . The display system of claim 1 , wherein adjusting resolution of the virtual content comprises decreasing a contrast ratio of images forming the virtual content with decreases in one or both of ambient light and light outputted by the display system to display the virtual content.
7 . The display system of claim 1 , wherein the operations further comprise causing presentation, via a display device, of the virtual content to a user, the virtual content being rendered according to an associated adjusted resolution.
8 . A method performed by a display system comprising one or more processors and a head-mountable display, the method comprising:
determining an ambient illumination level using a light sensor, and
adjusting a resolution of component color images forming virtual content based on:
a proximity of the virtual content from a user fixation point; and
the ambient illumination level and a color of the component color image that is not visible at the ambient illumination level, wherein the component color images of the color are lower in resolution than component color images of another color.