IP Library Granted Patent US 11,736,670
Granted Patent B2
US 11,736,670 · App. 17/902,136 · Granted Aug 22, 2023

System and method for generating video content with hue-preservation in virtual production

Inventors: Michael Zink (Altadena, CA); Michael Smith (Hermosa Beach, CA)
Assignee: WARNER BROS. ENTERTAINMENT INC.
H04N9/643H04N9/67H04N9/73H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,736,670
App. No.
17/902,136
Granted
Aug 22, 2023
Kind
B2
Abstract

A system is provided for generating video content with hue-preservation in virtual production. The system comprises a memory for storing instructions and a processor configured to execute the instructions. Based on the executed instructions, the processor is further configured to control a saturation of scene linear data based on mapping of a first color gamut corresponding to a first encoding format of raw data to a second color gamut corresponding to a defined color space. The processor is further configured to determine a standard dynamic range (SDR) video content in the defined color space based on the scene linear data. Based on a scaling factor that is applied to three primary color values that describe the first color gamut, hue of the SDR video content is preserved.

Claims (52)

1. A system, comprising:

a memory for storing instructions; and

a processor configured to execute the instructions, and based on the executed instructions, the processor is further configured to:

control a saturation of scene linear data based on mapping of a first color gamut corresponding to a first encoding format of raw data to a second color gamut corresponding to a defined color space; and

determine a standard dynamic range (SDR) video content in the defined color space based on the scene linear data,

wherein a hue of the SDR video content is preserved based on a scaling factor that is applied to three primary color values that describe the first color gamut.

2. The system according to claim 1 , wherein the processor is further configured to determine a norm value of the three primary color values based on a mathematical function applied on the three primary color values in the scene linear data.

3. The system according to claim 2 , wherein the mathematical function corresponds to one of a maximum of the three primary color values, a linear average value of the three primary color values, a weighted average value of the three primary color values with approximate luminance weights for the first color gamut, or power cube over square of the three primary color values.

4. The system according to claim 2 , wherein the processor is further configured to determine a display linear representation of the norm value for the first color gamut based on a tonemap of the norm value of the three primary color values.

5. The system according to claim 4 , wherein the tonemap is a function that renders the scene linear data into an SDR display linear representation of the video content.

6. The system according to claim 4 , wherein the processor is further configured to determine the scaling factor based on a ratio of the display linear representation of the norm value for the first color gamut and the norm value of the three primary color values.

7. The system according to claim 6 , wherein the processor is further configured to determine a first display linear representation of each of the three primary color values that describes the first color gamut based on the scaling factor and corresponding primary color value in the scene linear data.

8. The system according to claim 7 , wherein the processor is further configured to determine a second display linear representation of each of the three primary color values in the defined color space based on the first display linear representation of the three primary color values that describes the first color gamut.

9. The system according to claim 8 , wherein the processor is further configured to:

generate a video signal based on a gamma correction on the second display linear representation of each of the three primary color values in the defined color space,

wherein the gamma correction on the second display linear representation of each of the three primary color values in results of the defined color space in display non-linear representation of each of the three primary color values in the defined color space; and

communicate the video signal, as the SDR video content, to an SDR video display.

10. The system according to claim 1 , wherein the first color gamut is wider than the second color gamut, and

wherein the first encoding format corresponds to a pre-defined format and the defined color space corresponds to a display-based encoding color space.

11. The system according to claim 10 , wherein the processor is further configured to:

determine data in a scene-based encoding format based on raw data received in the pre-defined format,

wherein the raw data includes a computer-generated background rendered on a rendering panel and a foreground object, and

wherein the rendering panel is in-focus or out-of-focus; and

determine the scene linear data based on the data in the scene-based encoding format.

12. A method, comprising:

controlling, by a processor, a saturation of scene linear data based on mapping of a first color gamut corresponding to a first encoding format of raw data to a second color gamut corresponding to a defined color space; and

determining, by the processor, a standard dynamic range (SDR) video content in the defined color space based on the scene linear data,

wherein a hue of the SDR video content is preserved based on a scaling factor that is applied to three primary color values that describe the first color gamut.

13. The method according to claim 12 , further comprising determining, by the processor, a norm value of the three primary color values based on a mathematical function applied on the three primary color values in the scene linear data.

14. The method according to claim 13 , wherein the mathematical function corresponds to one of a maximum of the three primary color values, a linear average value of the three primary color values, a weighted average value of the three primary color values with approximate luminance weights for the first color gamut, or power cube over square of the three primary color values.

15. The method according to claim 13 , further comprising:

determining, by the processor, a display linear representation of the norm value for the first color gamut based on a tonemap of the norm value of the three primary color values,

wherein the tonemap is a function that renders the scene linear data into an SDR display linear representation of the video content; and

determining, by the processor, the scaling factor based on a ratio of the display linear representation of the norm value for the first color gamut and the norm value of the three primary color values.

16. The method according to claim 15 , further comprising:

determining, by the processor, a first display linear representation of each of the three primary color values that describes the first color gamut based on the scaling factor and corresponding primary color value in the scene linear data; and

determining a second display linear representation of each of the three primary color values in the defined color space based on the first display linear representation of the three primary color values that describes the first color gamut.

17. The method according to claim 16 , further comprising:

generating, by the processor, a video signal based on a gamma correction on the second display linear representation of each of the three primary color values in the defined color space,

wherein the gamma correction on the second display linear representation of each of the three primary color values in results of the defined color space in display non-linear representation of each of the three primary color values in the defined color space; and

communicating, by the processor, the video signal, as the SDR video content, to an SDR video display.

18. The method according to claim 12 , wherein the first color gamut is wider than the second color gamut, and

wherein the first encoding format corresponds to a pre-defined format and the defined color space corresponds to a display-based encoding color space.

19. The method according to claim 18 , further comprising:

determining, by the processor, data in a scene-based encoding format based on raw data received in the pre-defined format,

wherein the raw data includes a computer-generated background rendered on a rendering panel and a foreground object, and

wherein the rendering panel is in-focus or out-of-focus; and

determining, by the processor, the scene linear data based on the data in the scene-based encoding format.

20. A non-transitory computer readable medium, having stored thereon, computer executable code, which when executed by a processor, cause the processor to execute operations, the operations comprising:

controlling a saturation of scene linear data based on mapping of a first color gamut corresponding to a first encoding format of raw data to a second color gamut corresponding to a defined color space; and

determining a standard dynamic range (SDR) video content in the defined color space based on the scene linear data,

wherein a hue of the SDR video content is preserved based on a scaling factor that is applied to three primary color values that describe the first color gamut.

Assignments (2)
SECURITY INTEREST Recorded Oct 1, 2025
From: WARNER BROS. DISCOVERY, INC.; WARNER MEDIA, LLC; TURNER BROADCASTING SYSTEM, INC.; HOME BOX OFFICE, INC.; DISCOVERY COMMUNICATIONS, LLC; WARNERMEDIA DIRECT LLC; DISCOVERY.COM LLC; WARNER BROS. ENTERTAINMENT INC.; CNN INTERACTIVE GROUP, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 072995/0858 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2023
From: ZINK, MICHAEL; SMITH, MICHAEL
To: WARNER BROS. ENTERTAINMENT INC.
Reel/Frame 063215/0419 →