Virtual and augmented reality systems and methods using display system control information embedded in image data
A display system, such as a virtual reality or augmented reality display system, can control a display to present image data including a plurality of color components, on a plurality of depth planes supported by the display. The presentation of the image data through the display can be controlled based on control information that is embedded in the image data, for example to indicate an active or inactive color component and/or depth plane. In some examples, light sources and/or spatial light modulators that relay illumination from the light sources may receive signals from a display controller to adjust a power setting to the light source or spatial light modulator based on control information embedded in an image data frame.
1 . A display system comprising:
a display configured to display image data, the image data comprising a current image data frame with a plurality of color components;
a plurality of light sources configured to illuminate the display; and
a display system controller configured to:
receive the current image data frame,
read control information embedded in the current image data frame, the control information comprising an indication to inactivate a selected color component within the current image data frame, and
control at least a first control input for at least one of the plurality of light sources based on the embedded control information so as to inactivate the selected color component within the current image data frame,
wherein the embedded control information is inserted into the current image data frame in place of a portion of the image data, and
wherein the embedded control information further comprises advance frame display information which includes an indication to selectively re-activate the selected color component within a subsequent image data frame.
2 . The display system of claim 1 , further comprising a plurality of spatial light modulators configured to modulate light from the plurality of light sources with the image data, wherein the display system controller is further configured to control at least a second control input for at least one of the plurality of spatial light modulators based on the embedded control information, wherein the second control input comprises a reduced-power setting for a spatial light modulator corresponding to the selected color component.
3 . The display system of claim 2 , wherein the second control input comprises a complete power shut-off setting for the spatial light modulator corresponding to the selected color component.
4 . The display system of claim 1 , wherein the display system controller is configured to control a second control input for at least one of the plurality of light sources based on the advance frame display information embedded in the current image data frame.
5 . The display system of claim 4 , wherein the second control input comprises an increased-power setting for a light source corresponding to the selected color component.
6 . The display system of claim 5 , wherein the advance frame display information includes an indication of a timing for implementing the increased-power setting.
7 . The display system of claim 6 , wherein the timing for implementing the increased-power setting is prior to a timing for displaying the subsequent image data frame.
8 . The display system of claim 6 , wherein the timing for implementing the increased-power setting is based on a user's motion.
9 . The display system of claim 5 , wherein the second control input comprises a full power setting for the light source corresponding to the inactivated color component.
10 . The display system of claim 9 , wherein the advance frame display information includes an indication of a timing for implementing the full power setting.
11 . The display system of claim 10 , wherein the timing for implementing the full power setting is prior to a timing for displaying the subsequent image data frame.
12 . The display system of claim 10 , wherein the timing for implementing the increased-power setting is based on a user's motion.
13 . The display system of claim 1 , wherein the embedded control information comprises one or more substituted values in one or more pixels of the image data.
14 . The display system of claim 1 , wherein the display system controller is further configured to remove the embedded control information from the current image data frame before the current image data frame is displayed.
15 . A method for controlling a display system comprising a display and a plurality of light sources, the method performed by at least one processor of the display system, the method comprising:
receiving a current image data frame to be presented through the display, the current image data frame including a plurality of color components;
reading control information embedded in the current image data frame, the control information comprising an indication to inactivate a selected color component within the current image data frame, and
based on the embedded control information, controlling at least a first control input for at least one of the plurality of light sources that are configured to illuminate the display, wherein the first control input inactivates the selected color component within the current image data frame,
wherein the embedded control information is inserted into the current image data frame in place of a portion of image data, and
wherein the embedded control information further comprises advance frame display information which includes an indication to selectively re-activate the selected color component within a subsequent image data frame.
16 . The method of claim 15 , wherein the display system further comprises a plurality of spatial light modulators configured to modulate light from the plurality of light sources with the image data, and wherein the method further comprises controlling at least a second control input for at least one of the plurality of spatial light modulators based on the embedded control information, wherein the second control input comprises a reduced-power setting for a spatial light modulator corresponding to the selected color component.
17 . The method of claim 15 , further comprising controlling a second control input for at least one of the plurality of light sources based on the advance frame display information embedded in the current image data frame.
18 . The method of claim 15 , further comprising removing the embedded control information from the current image data frame before the current image data frame is displayed.
19 . A display system comprising:
a display configured to display image data, the image data comprising a current image data frame with a plurality of color components;
a plurality of light sources configured to illuminate the display;
a plurality of spatial light modulators configured to modulate light from the plurality of light sources with the image data; and
a display system controller configured to:
receive the current image data frame,
read control information embedded in the current image data frame, the control information comprising an indication to inactivate a selected color component within the current image data frame,
control at least a first control input for at least one of the plurality of light sources based on the embedded control information so as to inactivate the selected color component within the current image data frame, and
control at least a second control input for at least one of the plurality of spatial light modulators based on the embedded control information,
wherein the second control input comprises a reduced-power setting for a spatial light modulator corresponding to the selected color component,
wherein the second control input comprises a complete power shut-off setting for the spatial light modulator corresponding to the selected color component, and
wherein the embedded control information further comprises advance frame display information which includes an indication to selectively re-activate the selected color component within a subsequent image data frame.
20 . A method for controlling a display system comprising a display configured to display image data, a plurality of light sources, and a plurality of spatial light modulators configured to modulate light from the plurality of light sources with the image data, the method performed by at least one processor of the display system, the method comprising:
receiving a current image data frame to be presented through the display, the current image data frame including a plurality of color components;
reading control information embedded in the current image data frame, the control information comprising an indication to inactivate a selected color component within the current image data frame,
based on the embedded control information, controlling at least a first control input for at least one of the plurality of light sources that are configured to illuminate the display, wherein the first control input inactivates the selected color component within the current image data frame, and
based on the embedded control information, controlling at least a second control input for at least one of the plurality of spatial light modulators based on the embedded control information,
wherein the second control input comprises a reduced-power setting for a spatial light modulator corresponding to the selected color component,
wherein the second control input comprises a complete power shut-off setting for the spatial light modulator corresponding to the selected color component, and
wherein the embedded control information further comprises advance frame display information which includes an indication to selectively re-activate the selected color component within a subsequent image data frame.
21 . A display system comprising:
a display configured to display image data, the image data comprising a current image data frame with a plurality of color components;
a plurality of light sources configured to illuminate the display; and
a display system controller configured to:
receive the current image data frame,
read control information embedded in the current image data frame, the control information comprising an indication to inactivate a selected color component within the current image data frame,
control at least a first control input for at least one of the plurality of light sources based on the embedded control information so as to inactivate the selected color component within the current image data frame, and
remove the embedded control information from the current image data frame before the current image data frame is displayed,
wherein the embedded control information further comprises advance frame display information which includes an indication to selectively re-activate the selected color component within a subsequent image data frame.
22 . A method for controlling a display system comprising a display and a plurality of light sources, the method performed by at least one processor of the display system, the method comprising:
receiving a current image data frame to be presented through the display, the current image data frame including a plurality of color components;
reading control information embedded in the current image data frame, the control information comprising an indication to inactivate a selected color component within the current image data frame,
based on the embedded control information, controlling at least a first control input for at least one of the plurality of light sources that are configured to illuminate the display, wherein the first control input inactivates the selected color component within the current image data frame, and
removing the embedded control information from the current image data frame before the current image data frame is displayed,
wherein the embedded control information further comprises advance frame display information which includes an indication to selectively re-activate the selected color component within a subsequent image data frame.