Virtual and augmented reality systems and methods using display system control information embedded in image data
A virtual or augmented reality display system that controls power inputs to the display system as a function of image data. Image data itself is made of a plurality of image data frames, each with constituent color components of, and depth planes for displaying on, rendered content. Light sources or spatial light modulators to relay illumination from the light sources may receive signals from a display controller to adjust a power setting to the light source or spatial light modulator, and/or control depth of displayed image content, based on control information embedded in an image data frame.
1. A system comprising:
a display configured to present image data at a plurality of depth planes; and
a display controller communicatively coupled to the display, the display controller configured to:
receive the image data to be presented through the display, the image data including a current image data frame;
read control information embedded in the current image data frame, the control information including depth plane indicator data that indicates at which of the plurality of depth planes to present at least a portion of the current image data frame; and
cause the display to present the current image data frame, including presenting at least the portion of the current image data frame at the indicated depth plane,
wherein the image data includes rows and columns of pixel data for a plurality of pixels of the current image data frame to be presented,
wherein the pixel data comprises a plurality of color values, and
wherein the depth plane indicator data is substituted for one or more bits of at least one of the color values.
2. The system of claim 1 , wherein the control information comprises at least one of a row or a column of the control information that is substituted for at least one of the rows or the columns of the pixel data.
3. The system of claim 1 , wherein the control information comprises at least one of a row or a column of the control information that is appended to the pixel data.
4. The system of claim 1 , wherein the depth plane indicator data is substituted for one or more least significant bits of at least one of the color values.
5. The system of claim 1 , wherein the depth plane indicator data is substituted for one or more bits of a blue color value.
6. The system of claim 1 , wherein the depth plane indicator data is included in the pixel data for each pixel.
7. The system of claim 1 , wherein the control information is embedded in the current image frame data without altering a number of the rows and the columns of the pixel data.
8. The system of claim 1 , wherein the display controller is further configured to order a plurality of image data frames included in the image data, wherein the ordering is based at least in part on the depth plane indicator data.
9. A method performed by a display controller, the method comprising:
receiving image data to be presented through a display that is configured to present the image data at a plurality of depth planes, the image data including a current image data frame;
reading control information embedded in the current image data frame, the control information including depth plane indicator data that indicates at which of the plurality of depth planes to present at least a portion of the current image data frame; and
causing the display to present the current image data frame, including presenting at least the portion of the current image data frame at the indicated depth plane,
wherein the image data includes rows and columns of pixel data for a plurality of pixels of the current image data frame to be presented,
wherein the pixel data comprises a plurality of color values, and
wherein the depth plane indicator data is substituted for one or more bits of at least one of the color values.
10. The method of claim 9 , wherein the control information comprises at least one of a row or a column of the control information that is substituted for at least one of the rows or the columns of the pixel data.
11. The method of claim 9 , wherein the control information comprises at least one of a row or a column of the control information that is appended to the pixel data.
12. The method of claim 9 , wherein the depth plane indicator data is substituted for one or more least significant bits of at least one of the color values.
13. The method of claim 9 , wherein the depth plane indicator data is substituted for one or more bits of a blue color value.
14. The method of claim 9 , wherein the depth plane indicator data is included in the pixel data for each pixel.
15. The method of claim 9 , wherein the control information is embedded in the current image frame data without altering a number of the rows and the columns of the pixel data.
16. The method of claim 9 , further comprising:
ordering a plurality of image data frames included in the image data, wherein the ordering is based at least in part on the depth plane indicator data.