IP Library Granted Patent US 10,542,289
Granted Patent B2
US 10,542,289 · App. 15/580,246 · Granted Jan 21, 2020

Signal reshaping and coding for HDR and wide color gamut signals

Inventors: Peng Yin (Ithaca, NY); Taoran Lu (Santa Clara, CA); Fangjun Pu (Sunnyvale, CA); Tao Chen (Palo Alto, CA); Walter J. Husak (Simi Valley, CA)
Assignee: Dolby Laboratories Licensing Corporation
H04N19/70G06T5/007H04N19/186H04N19/85G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,542,289
App. No.
15/580,246
Granted
Jan 21, 2020
Kind
B2
Abstract

In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.

Claims (44)

1. A decoder for generating high-dynamic range video data, wherein the decoder comprises one or more processors and non-transitory memory, wherein generating an output image with the decoder comprises:

receiving an input bitstream comprising sequence processing set (SPS) data and storing at least a portion of the SPS data in the non-transitory memory;

parsing the SPS data; and upon detecting that an HDR extension syntax structure is present in the parsed SPS data:

extracting from the HDR extension syntax structure post-processing information comprising an SDR viewable flag and one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, or a color correction enabled flag, wherein the SDR viewable flag indicates whether a decoded version of the input bitstream is directly viewable on a standard dynamic range (SDR) display;

decoding the input bitstream to generate a preliminary output decoded signal; and

generating a second output signal based on the preliminary output signal and the post-processing information;

wherein the adaptive reshaping enabled flag indicates that information related to adaptive reshaping is present,

wherein the information related to adaptive reshaping comprises reshaping function parameters to determine a reshaping function based on one or more polynomial functions, and

wherein the reshaping function parameters comprise:

a first parameter based on a total number of polynomial functions used to define the reshaping function, and for each (p i ) polynomial function in the reshaping function, further comprising:

a starting pivot point for the polynomial function;

a second parameter based on an order of the polynomial function, wherein the order of the polynomial function can't exceed the value of two; and

one or more non-zero coefficients for the polynomial function.

2. The decoder of claim 1 , wherein the color space enabled flag indicates that color space information is present.

3. The decoder of claim 2 , wherein the color space information comprises information related to color transformation matrices.

4. The decoder of claim 1 , wherein the HDR extension syntax structure comprises a color space ID flag.

5. The decoder of claim 4 , wherein a value of the color space ID flag equal to zero indicates that a processing color space is defined in another part of the input bitstream and a non-zero value of the color space ID flag indicates the processing color space.

6. The decoder of claim 1 , wherein, for a first polynomial function in the reshaping function following a second adjoining polynomial function, coefficients for the first polynomial function, the first polynomial function and the second polynomial function each having an order, comprise:

a second order coefficient (c i ), if the order of the first polynomial function is two; and

a first order coefficient (b i ), if the order of the first polynomial function is two and the order of the second polynomial function is not two, or if the order of the first polynomial function is one.

7. The decoder of claim 6 , wherein if the coefficients for the first polynomial function do not include the first order coefficient (b i ), then if the order of the first polynomial function is two, the first order coefficient is computed based on the first order and second order coefficients of the second polynomial function, the third order coefficient of the first polynomial function, and the starting pivot point for the first polynomial function.

8. The decoder of claim 6 , wherein a zero order coefficient (a i ) for the first polynomial function is computed based on the coefficients of the second polynomial function, the second order and third order coefficients of the first polynomial function, and the starting pivot point for the first polynomial function.

9. The decoder of claim 1 , further comprising:

parsing picture processing set (PPS) data in the input bitstream; and upon detecting that a picture-HDR extension syntax structure is present in the parsed PPS data,

extracting from the picture-HDR extension syntax structure post-processing information for one or more pictures in the input bit stream.

10. The decoder of claim 1 , further comprising:

parsing slice header data in the input bitstream; and upon detecting that a slice-HDR extension syntax structure is present in the parsed slice header data,

extracting from the slice-HDR extension syntax structure post-processing information for one or more picture slices in the input bit stream.

11. The decoder of claim 1 , wherein the decoding of the input bitstream is performed based on the HEVC standard specification.

12. The decoder of claim 1 , wherein a decoder conformance point for a compliant decoder is defined after generating the second output signal.

13. A method for generating high-dynamic range video data with a decoder, the method comprising:

receiving an input bitstream comprising sequence processing set (SPS) data and storing at least a portion of the SPS data in the non-transitory memory;

parsing the SPS data; and upon detecting that an HDR extension syntax structure is present in the parsed SPS data:

extracting from the HDR extension syntax structure post-processing information comprising one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag;

decoding the input bitstream to generate a preliminary output decoded signal; and

generating a second output signal based on the preliminary output signal and the post-processing information;

wherein the adaptive reshaping enabled flag indicates that information related to adaptive reshaping is present,

wherein the information related to adaptive reshaping comprises reshaping function parameters to determine a reshaping function based on one or more polynomial functions, and

wherein the reshaping function parameters comprise:

a first parameter based on a total number of polynomial functions used to define the reshaping function, and for each (p i ) polynomial function in the reshaping function, further comprising:

a starting pivot point for the polynomial function;

a second parameter based on an order of the polynomial function, wherein the order of the polynomial function can't exceed the value of two; and

one or more non-zero coefficients for the polynomial function.

14. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing a method with one or more processors in accordance with claim 13 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2017
From: YIN, PENG; PU, FANGJUN; LU, TAORAN; CHEN, TAO; HUSAK, WALTER J.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 044448/0075 →
Continuity (3)
Provisional Application 62237852 · Oct 6, 2015
Provisional Application 62193508 · Jul 16, 2015
Related Publication 20180167637A1 · Jun 14, 2018
Cited By (3)
US 12,244,869 US 12,387,305 US 12,501,056