IP Library Granted Patent US 12,212,786
Granted Patent B2
US 12,212,786 · App. 18/470,353 · Granted Jan 28, 2025

Signal reshaping and coding for HDR and wide color gamut signals

Inventors: Peng Yin (Ithaca, NY); Taoran Lu (Santa Clara, CA); Fangjun Pu (Sunnyvale, CA); Tao Chen (Palo Alto, CA); Walter J. Husak (Simi Valley, CA)
Assignee: DOLBY LABORATORIES LICENSING CORPORATION
H04N19/70G06T5/90H04N19/186H04N19/30H04N19/85G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,786
App. No.
18/470,353
Granted
Jan 28, 2025
Kind
B2
Abstract

In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.

Claims (26)

1. An apparatus to encode video data, the apparatus comprising:

an input to receive a sequence of input video pictures; and

a processor, wherein the processor:

generates an output comprising a coded bitstream and signal parameters, wherein the coded bitstream comprises coded video pictures generated based on the sequence of input video pictures, and the signal parameters comprise a flag indicating whether adaptive reshaping is enabled or not in the output, and if adaptive reshaping is enabled in the output, then the signal parameters further comprise at least parameters related to a piece-wise polynomial representation of a reshaping function to be used in decoding the output.

2. The apparatus of claim 1 , wherein the signal parameters are part of at least one of a slice header, a sequence parameter set, a picture parameter set, a network abstraction layer unit header, or a supplemental enhancement information message.

3. The apparatus of claim 1 , wherein generating the coded video pictures comprises:

generating reshaped video pictures by applying a representation of the reshaping function to the input sequence of video pictures; and

encoding the reshaped video pictures to generate the coded video pictures.

4. The apparatus of claim 1 , wherein if adaptive reshaping is enabled, then the signal parameters comprise:

a first parameter based on a total number of polynomial functions used to define the reshaping function, and for each (p i ) polynomial function in the reshaping function, further comprising:

a starting pivot point for the polynomial function;

a second parameter based on the polynomial function's order, wherein the polynomial function's order does not exceed a value of two; and

one or more non-zero coefficients for the polynomial function.

5. The apparatus of claim 4 , wherein, for a first polynomial function in the reshaping function following a second adjoining polynomial function, the coefficients for the first polynomial function comprise:

a second order coefficient (c i ), if the first polynomial function's order is two; and

a first order coefficient (b i ), if the first polynomial function's order is two and the second adjoining polynomial function's order is not two, or if the first polynomial function's order is one.

6. The apparatus of claim 5 , wherein if the coefficients for the first polynomial function do not include the first order coefficient (b i ), then if the first polynomial function's order is two, the first order coefficient is computed based on the first order and second order coefficients of the second adjoining polynomial function, a third order coefficient of the first polynomial function, and the starting pivot point for the first polynomial function.

7. The apparatus of claim 6 , wherein the first order coefficient (b i ) for the first polynomial is computed as:

b i =b i−1 +2( c i−1 −C i ) x i ,

wherein b i−1 and c i−1 denote the first order and second order coefficients of the second adjoining polynomial function, c i denotes the third order coefficient of the first polynomial function, and x i denotes the starting pivot point for the first polynomial function.

8. The apparatus of claim 6 , wherein the zero order coefficient (a i ) for the first polynomial function is computed based on the coefficients of the second adjoining polynomial function, the second order and third order coefficients of the first polynomial function, and the starting pivot point for the first polynomial function.

9. The apparatus of claim 8 , wherein the zero order coefficient (a i ) for the first polynomial function is computed as:

a i =a i−1 +( b i−1 −b i ) x i +( c i−1 −c ) x i 2 ,

wherein a i−1 , b i−1 and c i−1 denote the zero order, first order, and second order coefficients of the second adjoining polynomial function, b i and c i denotes the second order and third order coefficients of the first polynomial function, and x i denotes the starting pivot point for the first polynomial function.

10. The apparatus of claim 1 , wherein the piece-wise polynomial representation comprises N linear (first order) segments, wherein N is an integer larger than 0.

11. The apparatus of claim 1 , wherein the piece-wise polynomial representation comprises N linear or second order segments, wherein N is an integer larger than 0.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: YIN, PENG; LU, TAORAN; PU, FANGJUN; CHEN, TAO; HUSAK, WALTER J.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 065919/0767 →
Continuity (7)
Continuation 17581827 · Jan 21, 2022
Continuation 17203698 · Mar 16, 2021
Continuation 16710904 · Dec 11, 2019
Continuation 15580246
Provisional Application 62237852 · Oct 6, 2015
Provisional Application 62193508 · Jul 16, 2015
Related Publication 20240007678A1 · Jan 4, 2024
References Cited (51)
US 5787390A · Quinquis · 1998 [cited by applicant]
US 9077994B2 · Miller · 2015 [cited by applicant]
US 9111330B2 · Messmer · 2015 [cited by applicant]
US 9497456B2 · Su · 2016 [cited by applicant]
US 10136162B2 · Qu · 2018 [cited by applicant]
US 10219007B2 · Francois · 2019 [cited by applicant]
US 10298923B2 · Su · 2019 [cited by applicant]
US 20060233239A1 · Sethi · 2006 [cited by applicant]
US 20070223813A1 · Segall · 2007 [cited by applicant]
US 20090003449A1 · Sekiguchi · 2009 [cited by applicant]
US 20100085487A1 · Sarkar · 2010 [cited by applicant]
US 20100028386A1 · Kei · 2010 [cited by applicant]
US 20100283861A1 · Tamagawa · 2010 [cited by applicant]
US 20120314129A1 · Mertens · 2012 [cited by applicant]
US 20130223542A1 · Kim · 2013 [cited by applicant]
US 20140140406A1 · Yu · 2014 [cited by examiner]
US 20140301441A1 · Wang · 2014 [cited by applicant]
US 20150010059A1 · Hattori · 2015 [cited by applicant]
US 20150043637A1 · Morigami · 2015 [cited by applicant]
US 20150098510A1 · Ye · 2015 [cited by applicant]
US 20150103925A1 · Chen · 2015 [cited by applicant]
US 20150131904A1 · Hattori · 2015 [cited by applicant]
US 20150245044A1 · Guo · 2015 [cited by applicant]
US 20150296232A1 · Hwang · 2015 [cited by applicant]
US 20160134872A1 · Su · 2016 [cited by examiner]
US 20170251211A1 · Froehlich et al. · 2017 [cited by applicant]
US 20200162759A1 · Yin · 2020 [cited by applicant]
CN 1659889 · 2005 [cited by applicant]
CN 101048940A · 2007 [cited by applicant]
CN 101431691A · 2009 [cited by applicant]
CN 101963751 · 2011 [cited by applicant]
CN 103535038A · 2014 [cited by applicant]
CN 104041036A · 2014 [cited by applicant]
CN 104322072A · 2015 [cited by applicant]
CN 104380738A · 2015 [cited by applicant]
EP 1954060 · 2008 [cited by applicant]
JP 2011142565A · 2011 [cited by applicant]
JP 2014523661 · 2011 [cited by applicant]
JP 2018506938 · 2018 [cited by applicant]
WO 2014105385 · 2014 [cited by applicant]
WO 2014130343 · 2014 [cited by applicant]
WO 2014204865 · 2014 [cited by applicant]
WO 2016172091 · 2016 [cited by applicant]
Baylon, D. et al “Test Model Draft for HDR Reshaping and Adaptation” MPEG Meeting, ISO/IEC JTC1/SC29, WG11 MPEG2015, Oct. 2015, Geneva, CH. [cited by applicant]
Ebner, F. et al. “Development and Testing of a Color Space (IPT) with Improved Hue Uniformity” The Sixth Color Imaging Conference: Color Science, Systems, and Applications, Scottsdale, Arizona, Nov. 1998, pp. 8-13. [cited by applicant]
ITU-R BT.1886 “Reference Electro-Optical Transfer Function for Flat Panel Displays Used in HDTV Studio Production” Mar. 2011. [cited by applicant]
Joshi, R. et al “High Efficiency Video Coding (HEVC) Screen Content Coding: Draft 3” 20th Meeting: Geneva, CH Feb. 10-17, 2015, pp. 1-563. [cited by applicant]
Minoo, K. et al “Description of the Exploratory Test Model (ETM) for HDR/WCG Extension of HEVC” 23rd Meeting: San Diego, USA, Feb. 19-26, 2016, pp. 1-4. [cited by applicant]
SMPTE ST 2084:2014 “High Dynamic Range EOTF of Mastering Reference Displays”. [cited by applicant]
Yin, P. “Common Technologies and Architectures for HDR Coding” ISO/IEC JTC1/SC29/WG11 N15454, Jun. 2016, Warsaw, PL. [cited by applicant]
Zhang, Y. et al “High Dynamic Range Video Compression Exploiting Luminance Masking” IEEE Transactions on Circuits and Systems for Video Technology, Jan. 2015. [cited by applicant]