IP Library Granted Patent US 10,659,749
Granted Patent B2
US 10,659,749 · App. 16/312,251 · Granted May 19, 2020

Efficient histogram-based luma look matching

Inventors: Harshad Kadu (Santa Clara, CA); Guan-Ming Su (Fremont, CA)
Assignee: Dolby Laboratories Licensing Corporation
H04N11/20G06T5/008G06T5/009G06T5/40H04N9/646H04N9/67H04N19/117H04N19/126H04N19/154H04N19/182H04N19/186G06T2207/10016G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,659,749
App. No.
16/312,251
Granted
May 19, 2020
Kind
B2
Abstract

In a method to reconstruct a high dynamic range video signal, a decoder receives parameters in the input bitstream to generate a prediction function. Using the prediction function, it generates a first set of nodes for a first prediction lookup table, wherein each node is characterized by an input node value and an output node value. Then, it modifies the output node values of one or more of the first set of nodes to generate a second set of nodes for a second prediction lookup table, and generates output prediction values using the second lookup table. Low-complexity methods to modify the output node value of a current node in the first set of nodes based on computing modified slopes between the current node and nodes surrounds the current node are presented.

Claims (34)

1. A method for forward reshaping luma components of an input image of a first dynamic range, comprising:

providing a reference tone-mapped image over a second dynamic range that corresponds to the input image of the first dynamic range, wherein the first dynamic range is greater than the second dynamic range;

providing a luma forward reshaping function to forward reshape luma components of the input image of the first dynamic range into luma components of a corresponding forward reshaped image over the second dynamic range based on one or more luma mapping parameters;

providing a plurality of combinations of candidate parameter values for the one or more luma mapping parameters;

generating a luma histogram of the input image over the first dynamic range;

generating a luma histogram of the reference tone-mapped image over the second dynamic range;

generating a plurality of mapped luma histograms over the second dynamic range by converting, for each of the provided candidate parameter values for the one or more luma mapping parameters, the luma histogram of the input image over the first dynamic range via the luma forward reshaping function with a respective combination of the provided candidate parameter values to a corresponding mapped luma histogram over the second dynamic range;

comparing the plurality of luma histograms over the second dynamic range with the luma histogram of the reference tone-mapped image over the second dynamic range;

selecting, based on results of comparing the plurality of luma histograms with the luma histogram of the reference tone-mapped image, a specific combination of candidate parameter values from among the plurality of combinations of candidate parameter values;

using the luma forward reshaping function with the one or more luma parameter values that are set to the specific combination of candidate parameter values to forward reshape luma components of the input image into the luma components of the corresponding forward reshaped image over the second dynamic range; and

transmitting the corresponding forward reshaped image to one or more recipient devices.

2. The method of claim 1 , wherein the luma forward reshaping function maps the input image into the corresponding forward reshaped image free of clipping.

3. The method of claim 1 , further comprising:

generating backward reshaping metadata that is to be used by the one or more recipient devices to generate a luma backward reshaping function that corresponds to an inverse of the luma forward reshaping function with the one or more luma parameter values set to the specific combination of candidate parameter values; and

transmitting the forward reshaped image with the backward reshaping metadata to the one or more recipient devices.

4. The method of claim 1 , further comprising:

deriving a chroma forward reshaping mapping for predicting chroma codewords of the forward reshaped image, wherein the chroma forward reshaping mapping is generated using chroma codewords of the reference tone-mapped image as a prediction target;

generating a portion of backward reshaping metadata that is to be used by the one or more recipient devices to generate a chroma backward reshaping mapping; and

transmitting the forward reshaped image with the backward reshaping metadata to the one or more recipient devices.

5. The method of claim 4 , wherein the chroma forward reshaping mapping is generated based on a multivariate multi-regression—MMR—based algorithm that supports multiple-channel reshaping.

6. The method of claim 1 , wherein the luma forward reshaping function is derived as a combination of one or more of: luma tone-mapping functions, luma tone-mapping modification functions, electro-optical transfer functions, or content-adaptive-quantized functions generated based on noise measurements of the input image.

7. The method of claim 1 , wherein the one or more luma mapping parameters comprise one or more of: slope, offset and power—SOP—parameters; lift, gain and gamma—LGG—parameters; or other luma mapping parameters.

8. The method of claim 1 , wherein one or both of the input image or the reference tone-mapped image are generated in post-production editing.

9. The method of claim 1 , wherein the forward reshaped image is encoded in a video signal of the second dynamic range, and wherein the backward reshaping metadata is carried in the video signal as metadata separate from the forward reshaped image.

10. The method of claim 9 , wherein the video signal excludes one or both of the input image or the reference tone-mapped image.

11. The method of claim 1 , wherein the input image is represented in a different color space than that in which the reference tone-mapped image is represented.

12. The method of claim 1 , wherein the input image is formatted in a different sampling format than that in which the reference tone-mapped image is formatted.

13. The method of claim 1 , wherein at least one of the input image or the reference tone-mapped image is represented in one of: an IPT PQ—ICtCp—color space, an YCbCr color space, an RGB color space, a Rec. 2020 color space, a Rec. 709 color space, an extended dynamic range—EDR—color space, a gamma/HLG/PQ color space, or a standard dynamic range—SDR—color space.

14. The method of claim 1 , wherein the forward reshaped image is of a bit depth of one of 8, 9, 10, or 11+ bits.

15. The method of claim 1 , wherein the input image is of a bit depth of one of 10, 11, 12, 13, 14, or 15+ bits.

16. The method of claim 1 , wherein one or both of the input image or the reference tone-mapped image are created based a video professional's artistic intent.

17. A computer system configured to perform the method recited in claim 1 .

18. An apparatus comprising a processor and configured to perform the method recited in claim 1 .

19. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing a method with one or more processors in accordance with claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2019
From: KADU, HARSHAD; SU, GUAN-MING
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 048041/0803 →
Priority Claims (1)
GB 1611253.4 · Jun 29, 2016 · national
Continuity (2)
Provisional Application 62356087 · Jun 29, 2016
Related Publication 20190208173A1 · Jul 4, 2019
Cited By (2)
US 12,217,392 US 12,581,136