IP Library Granted Patent US 12,149,753
Granted Patent B2
US 12,149,753 · App. 17/920,391 · Granted Nov 19, 2024

Iterative optimization of reshaping functions in single-layer HDR image codec

Inventors: Guan-Ming Su (Fremont, CA); Harshad Kadu (Santa Clara, CA)
Assignee: DOLBY LABORATORIES LICENSING CORPORATION
H04N19/98G06T5/90H04N19/186H04N23/741G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,149,753
App. No.
17/920,391
Granted
Nov 19, 2024
Kind
B2
Abstract

A method, for generating (a) a forward reshaping function for compressing an input high-dynamic range (HDR) image into a reshaped standard-dynamic-range (SDR) image and (b) a backward reshaping function for decompressing the reshaped SDR image into a reconstructed HDR image, includes (i) optimizing the forward reshaping function to minimize a deviation between the reshaped SDR image and an input SDR image corresponding to the input HDR image, (ii) optimizing the backward reshaping function to minimize a deviation between the reconstructed HDR image and the input HDR image, and (iii) until a termination condition is met, applying a correction to the input SDR image and reiterating, based on the input SDR image as corrected, the steps of optimizing the forward and backward reshaping functions.

Claims (30)

1. A method for generating (a) a forward reshaping function for compressing an input high-dynamic range (HDR) image into a reshaped standard-dynamic-range (SDR) image and (b) a backward reshaping function for decompressing the reshaped SDR image into a reconstructed HDR image, comprising:

optimizing the forward reshaping function to minimize a deviation between the reshaped SDR image and an input SDR image corresponding to the input HDR image;

optimizing the backward reshaping function to minimize a deviation between the reconstructed HDR image and the input HDR image; and

until a termination condition is met:

applying a correction to the input SDR image, and

reiterating, based on the input SDR image as corrected, the steps of optimizing the forward and backward reshaping functions.

2. The method of claim 1 , wherein the step of applying the correction comprises:

applying, to each pixel of each of one or more color-component channels of the input SDR image, a deviation-based correction value that is proportional to the deviation between the reconstructed HDR image and the input HDR image for a corresponding pixel and a corresponding color-component channel.

3. The method of claim 2 , the deviation-based correction value is limited to be less than a predefined maximum correction value.

4. The method of claim 2 , at least until reaching a predefined maximum number of iterations of the steps of optimizing the forward and backward reshaping functions, the termination condition being that a deviation measure at least between the reconstructed HDR image and the input HDR image is no greater than a threshold amount.

5. The method of claim 4 , the deviation measure being a weighted combination of (i) the deviation between the reconstructed HDR image and the input HDR image and (ii) a deviation between the reshaped SDR image and the input SDR image.

6. The method of claim 4 , the deviation measure being based on only a subset of the color-component channels defining each of the input SDR and input HDR images.

7. The method of claim 6 , the color-component channels including a luma channel and two chroma channels, the subset being the luma channel.

8. The method of claim 6 , the color-component channels including a luma channel and two chroma channels, the subset being the two chroma channels.

9. The method of claim 1 , the step of optimizing the backward reshaping function comprising applying the backward reshaping function to the reshaped SDR image as generated by the optimized forward reshaping function.

10. The method of claim 1 , the steps of optimizing the forward reshaping function and applying a correction to the input SDR image utilizing a local copy of the input SDR image, the method further comprising maintaining an uncorrected version of the input SDR image.

11. The method of claim 1 , comprising performing the steps of optimizing the forward reshaping function and optimizing the backward reshaping function for each of a plurality of color-component channels.

12. The method of claim 11 , the color-component channels including a luma channel, a first chroma channel, and a second chroma channel, wherein:

for the luma channel, the method optimizes the forward and backward reshaping functions in only a single iteration of the steps of optimizing the forward and backward reshaping functions; and

for each of the first and second chroma channels, the steps of optimizing the forward and backward reshaping functions utilize multivariate multiple regression.

13. A method for encoding an HDR image, comprising:

performing the method of claim 1 to generate an iteratively optimized forward reshaping function and an iteratively optimized backward reshaping function;

prior to performing the method of claim 1 , receiving the input HDR image and the input SDR image; and

after performing the method of claim 1 , outputting (i) the reshaped SDR image generated in a last iteration of the step of optimizing the forward reshaping function and (ii) parameters characterizing the backward reshaping function as optimized in a last iteration of the step of optimizing the backward reshaping function.

14. A non-transitory computer readable medium storing program instructions which cause a computing device or a system to perform the method according to claim 1 .

15. An encoder comprising:

a non-transitory computer readable medium storing the computer program of claim 14 ;

a processor for executing the computer program;

an input interface for receiving the input HDR image and the input SDR image; and

an output interface for outputting (i) the reshaped SDR image generated using the forward reshaping function as optimized, and (ii) parameters characterizing the backward reshaping function as optimized.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2023
From: SU, GUAN-MING; KADU, HARSHAD
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 063082/0490 →
Priority Claims (1)
EP 20170837 · Apr 22, 2020 · regional
Continuity (2)
Provisional Application 63013807 · Apr 22, 2020
Related Publication 20230164366A1 · May 25, 2023
Cited By (1)
US 12,506,894