Decoding and display of high dynamic range video
Novel methods and systems for decoding and displaying enhanced dynamic range (EDR) video signals are disclosed. To accommodate legacy digital media players with constrained computational resources, compositing and display management (DM) operations are moved from a digital media player to its attached EDR display. On a video receiver, base and enhancement video layers are decoded and multiplexed together with overlay graphics into an interleaved stream. The video and graphics signals are all converted to a common format which allows metadata to be embedded in the interleaved signal as part of the least significant bits in the chroma channels. On the display, the video and the graphics are de-interleaved. After compositing and display management operations guided by the received metadata, the received graphics data are blended with the output of the DM process and the final video output is displayed on the display's panel.
1. A system for decoding and displaying enhanced dynamic range (EDR) images, the system comprising:
a video receiver, the video receiver comprising one or more processors to perform decoding operations, the decoding operations comprising:
receiving a layered coded video stream comprising a first coded video stream, a second coded video stream, and metadata;
decoding the first coded video stream to generate a decoded first video signal in a first video format;
decoding the second video stream to generate a decoded second video signal in a second video format;
receiving graphics data in a third video format;
converting the decoded first video signal from the first video format to a formatted first video signal in a fourth video format;
converting the decoded second video signal from the second video format to a formatted second video signal in the fourth video format;
converting the graphics data in the third video format to formatted graphics data in the fourth video format;
interleaving the formatted first video signal, the formatted second video signal, and the formatted graphics data to generate an interleaved video signal;
embedding the metadata to the interleaved video signal to generate an output signal; and
transmitting the output signal to a display.
2. The system of claim 1 , wherein the decoding operations further comprise:
extracting alpha blend data from the received graphics data; and
embedding the alpha blend data to the interleaved video signal.
3. The system of claim 1 , wherein decoding the first and second coded video streams is performed by an AVC decoder.
4. The system of claim 1 , wherein the first and second video formats comprise an 8-bit YCbCr 4:2:0 format.
5. The system of claim 1 , wherein the third video format comprises an 8-bit YCbCr 4:4:4 format.
6. The system of claim 1 , wherein the fourth video format comprises a 12-bit YCbCr 4:2:2 format.
7. The system of claim 1 , wherein the metadata are embedded to the interleaved video data as LSB data in the chroma pixel components of the video data.
8. The system of claim 1 , wherein the output signal is transmitted as 12-bit YCbCr 4:2:2 or 8-bit RGB 4:4:4 HDMI-compliant signal.
9. A method to decode EDR data in a digital media player, the method comprising:
receiving a layered coded video stream comprising a first coded video stream, a second coded video stream, and metadata;
decoding the first coded video stream to generate a decoded first video signal in a first video format;
decoding the second video stream to generate a decoded second video signal in a second video format;
receiving graphics data in a third video format;
converting the decoded first video signal from the first video format to a formatted first video signal in a fourth video format;
converting the decoded second video signal from the second video format to a formatted second video signal in the fourth video format;
converting the graphics data in the third video format to formatted graphics data in the fourth video format;
interleaving the formatted first video signal, the formatted second video signal, and the formatted graphics data to generate an interleaved video signal;
embedding the metadata to the interleaved video signal to generate an output signal; and
transmitting the output signal to a display.
10. The method of claim 9 , wherein the first and second video formats comprise an 8-bit YCbCr 4:2:0 format.
11. The method of claim 9 , wherein the third video format comprises an 8-bit YCbCr 4:4:4 format.
12. The method of claim 9 , wherein the fourth video format comprises a 12-bit YCbCr 4:2:2 format.
13. The method of claim 9 , wherein the metadata are embedded to the interleaved video data as LSB data in the chroma pixel components of the video data.
14. The method of claim 9 , wherein the output signal is transmitted as 12-bit YCbCr 4:2:2 or 8-bit RGB 4:4:4 HDMI-compliant signal.
15. The method of claim 9 wherein the output signal is transmitted at 60 frames per second (fps), wherein 24 fps are allocated to each of the formatted first and second video signals and 12 fps are allocated to the formatted graphics data.
16. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing a method with a computer in accordance with claim 9 .