System and method for generating video content with hue-preservation in virtual production
A system is provided for generating video content with hue-preservation in virtual production. A processor determines data in a scene-based encoding format based on raw data received in a pre-defined format. The raw data includes a computer-generated background rendered on a rendering panel and a foreground object. Based on the data in the scene-based encoding format, scene linear data is determined. A saturation of the scene linear data is controlled when a first color gamut corresponding to the pre-defined format is mapped to a second color gamut corresponding to a display-based encoding color space. Based on the scene linear data, a standard dynamic range (SDR) video content in the display-based encoding color space is determined. Hue of the SDR video content is preserved, when the rendering panel is in-focus or out-of-focus, based on a scaling factor that is applied to three primary color values that describe the first color gamut.
1. A system, comprising:
memory for storing instructions; and
a processor configured to execute the instructions, and based on the executed instructions, the processor is further configured to:
determine data in a scene-based encoding format based on raw data received in a pre-defined format,
wherein the raw data includes a computer-generated background rendered on a rendering panel and a foreground object;
determine scene linear data based on the data in the scene- based encoding format;
control a saturation of the scene linear data when a first color gamut corresponding to the pre-defined format is mapped to a second color gamut corresponding to a display-based encoding color space; and
determine a standard dynamic range (SDR) video content in the display-based encoding color space based on the scene linear data,
wherein hue of the SDR video content is preserved, when the rendering panel is in-focus or out-of-focus, based on a scaling factor that is applied to three primary color values that describe the first color gamut.
2. The system according to claim 1 , wherein the processor is further configured to determine a norm value of the three primary color values based on a mathematical function applied on the three primary color values in the scene linear data.
3. The system according to claim 2 , wherein the mathematical function corresponds to one of a maximum of the three primary color values, a linear average value of the three primary color values, a weighted average value of the three primary color values with approximate luminance weights for the first color gamut, or power cube over square of the three primary color values.
4. The system according to claim 2 , wherein the processor is further configured to determine a display linear representation of the norm value for the first color gamut based on a tonemap of the norm value of the three primary color values.
5. The system according to claim 4 , wherein the tonemap is a function that renders the scene linear data into an SDR display linear representation of the video content.
6. The system according to claim 4 , wherein the processor is further configured to determine the scaling factor based on a ratio of the display linear representation of the norm value for the first color gamut and the norm value of the three primary color values.
7. The system according to claim 6 , wherein the processor is further configured to determine a first display linear representation of each of the three primary color values that describes the first color gamut based on the scaling factor and corresponding primary color value in the scene linear data.
8. The system according to claim 7 , wherein the processor is further configured to determine a second display linear representation of each of the three primary color values in the display-based encoding color space based on the first display linear representation of the three primary color values that describes the first color gamut.
9. The system according to claim 8 , wherein the processor is further configured to:
generate a video signal based on a gamma correction on the second display linear representation of each of the three primary color values in the display-based encoding color space,
wherein the gamma correction on the second display linear representation of each of the three primary color values in the display-based encoding color space results in display non-linear representation of each of the three primary color values in the display-based encoding color space; and
communicate the video signal, as the SDR video content, to an SDR video display.
10. The system according to claim 1 , wherein the first color gamut is wider than the second color gamut.
11. A method, comprising:
determining, by a processor, data in a scene-based encoding format based on raw data received in a pre-defined format,
wherein the raw data includes a computer-generated background rendered on a rendering panel and a foreground object;
determining, by the processor, scene linear data based on the data in the scene-based encoding format;
controlling, by the processor, a saturation of the scene linear data when a first color gamut corresponding to the pre-defined format is mapped to a second color gamut corresponding to a display-based encoding color space; and
determining, by the processor, a standard dynamic range (SDR) video content in the display-based encoding color space based on the scene linear data,
wherein hue of the SDR video content is preserved, when the rendering panel is in-focus or out-of-focus, based on a scaling factor that is applied to three primary color values that describe the first color gamut.
12. The method according to claim 11 , further comprising determining, by the processor, a norm value of the three primary color values based on a mathematical function applied on the three primary color values in the scene linear data.
13. The method according to claim 12 , wherein the mathematical function corresponds to one of a maximum of the three primary color values, a linear average value of the three primary color values, a weighted average value of the three primary color values with approximate luminance weights for the first color gamut, or power cube over square of the three primary color values.
14. The method according to claim 12 , further comprising determining, by the processor, a display linear representation of the norm value for the first color gamut based on a tonemap of the norm value of the three primary color values.
15. The method according to claim 14 , wherein the tonemap is a function that renders the scene linear data into an SDR display linear representation of the video content.
16. The method according to claim 14 , further comprising determining, by the processor, the scaling factor based on a ratio of the display linear representation of the norm value for the first color gamut and the norm value of the three primary color values.
17. The method according to claim 16 , further comprising determining, by the processor, a first display linear representation of each of the three primary color values that describes the first color gamut based on the scaling factor and corresponding primary color value in the scene linear data.
18. The method according to claim 17 , further comprising determining, by the processor, a second display linear representation of each of the three primary color values in the display-based encoding color space based on the first display linear representation of the three primary color values that describes the first color gamut.
19. The method according to claim 18 , further comprising:
generating, by the processor, a video signal based on a gamma correction on the second display linear representation of each of the three primary color values in the display-based encoding color space,
wherein the gamma correction on the second display linear representation of each of the three primary color values in the display-based encoding color space results in display non-linear representation of each of the three primary color values in the display-based encoding color space; and
communicating, by the processor, the video signal, as the SDR video content, to an SDR video display.
20. A non-transitory computer readable medium, having stored thereon, computer executable code, which when executed by a processor, cause the processor to execute operations, the operations comprising:
determining data in a scene-based encoding format based on raw data received in a pre-defined format,
wherein the raw data includes a computer-generated background rendered on a rendering panel and a foreground object;
determining scene linear data based on the data in the scene-based encoding format;
controlling a saturation of the scene linear data when a first color gamut corresponding to the pre-defined format is mapped to a second color gamut corresponding to a display-based encoding color space; and
determining a standard dynamic range (SDR) video content in the display-based encoding color space based on the scene linear data,
wherein hue of the SDR video content is preserved, when the rendering panel is in-focus or out-of-focus, based on a scaling factor that is applied to three primary color values that describe the first color gamut.