IP Library Granted Patent US 10,652,588
Granted Patent B2
US 10,652,588 · App. 15/761,425 · Granted May 12, 2020

Inverse reshaping for high dynamic range video coding

Inventors: Louis Kerofsky (San Diego, CA); Yuwen He (San Diego, CA); Yan Ye (San Diego, CA); Arash Vosoughi (San Jose, CA)
Assignee: VID SCALE, Inc.
H04N19/98G06T5/009H04N19/186H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,652,588
App. No.
15/761,425
Granted
May 12, 2020
Kind
B2
Abstract

Systems, methods, and instrumentalities are disclosed for inverse shaping for high dynamic range (HDR) video coding. A video coding device, e.g., such as a decoder, may determine a plurality of pivot points associated with a plurality of piecewise segments of an inverse reshaping model. The plurality of pivot points may be determined based on an indication received via a message. Each piecewise segment may be defined by a plurality of coefficients. The video coding device may receive an indication of a first subset of coefficients associated with the plurality of piecewise segments. The video coding device may calculate a second subset of coefficients based on the first subset of coefficients and the plurality of pivot points. The video coding device may generate an inverse reshaping model using one or more of the plurality of pivot points, the first subset of coefficients, and the second subset of coefficients.

Claims (46)

1. A method of inverse reshaping for a high dynamic range (HDR) video, the method comprising:

determining a plurality of pivot points associated with a plurality of piecewise segments, wherein each of the plurality of piecewise segments is defined by a plurality of coefficients that comprise a constant coefficient, a slope coefficient, and a curvature coefficient;

receiving an indication of a first subset of coefficients associated with the plurality of piecewise segments;

calculating, based on the first subset of coefficients and the plurality of pivot points, a second subset of coefficients associated with the plurality of piecewise segments, wherein the second subset of coefficients are calculated using a continuity relation based on a left hand endpoint of one or more of the plurality of piecewise segments;

generating an inverse reshaping model using the plurality of pivot points, the first subset of coefficients, and the second subset of coefficients; and

applying inverse reshaping to the HDR video using the inverse reshaping model.

2. The method of claim 1 , wherein the plurality of pivot points are determined based on an indication received via a message.

3. The method of claim 1 , wherein the first subset of coefficients comprises a first slope coefficient associated with a first piecewise segment of the plurality of piecewise segments and a plurality of constant coefficients associated with the plurality of piecewise segments.

4. The method of claim 3 , wherein the second subset of coefficients comprises a plurality of slope coefficients associated with the remaining piecewise segments of the plurality of piecewise segments and a plurality of curvature coefficients.

5. The method of claim 1 , wherein determining the plurality of pivot points comprises determining a location for each of the plurality of pivot points.

6. The method of claim 1 , wherein the plurality of pivot points are evenly spaced.

7. The method of claim 1 , further comprising:

receiving an indication that a first piecewise segment of the plurality of piecewise segments is flat;

modifying a first constant coefficient of the first piecewise segment of the inverse reshaping model to a value signaled for a second constant coefficient of a second piecewise segment of the inverse reshaping model; and

setting a first slope coefficient and a first curvature coefficient associated with the first piecewise segment to zero.

8. A video coding device comprising:

a processor configured to:

determine a plurality of pivot points associated with a plurality of piecewise segments, wherein each of the plurality of piecewise segments is defined by a plurality of coefficients that comprise a constant coefficient, a slope coefficient, and a curvature coefficient;

receive an indication of a first subset of coefficients associated with the plurality of piecewise segments;

calculate, based on the first subset of coefficients and the plurality of pivot points, a second subset of coefficients associated with the plurality of piecewise segments, wherein the second subset of coefficients are calculated using a continuity relation based on a left hand endpoint of one or more of the plurality of piecewise segments;

generate, an inverse reshaping model using the plurality of pivot points, the first subset of coefficients, and the second subset of coefficients; and

apply inverse reshaping to a high dynamic range (HDR) video using the inverse reshaping model.

9. The video coding device of claim 8 , wherein the plurality of pivot points are determined based on an indication received via a message.

10. The video coding device of claim 8 , wherein the first subset of coefficients comprises a first slope coefficient associated with a first piecewise segment of the plurality of piecewise segments and a plurality of constant coefficients associated with the plurality of piecewise segments.

11. The video coding device of claim 10 , wherein the second subset of coefficients comprises a plurality of slope coefficients associated with the remaining piecewise segments of the plurality of piecewise segments and a plurality of curvature coefficients.

12. The video coding device of claim 10 , wherein being configured to determine the plurality of pivot points comprises being configured to determine a location for each of the plurality of pivot points.

13. The video coding device of claim 10 , wherein the plurality of pivot points are evenly spaced on the inverse reshaping model.

14. The video coding device of claim 10 , wherein the processor is further configured to:

receive an indication that a first piecewise segment of the plurality of piecewise segments is flat;

modify a first constant coefficient of the first piecewise segment of the inverse reshaping model to a value signaled for a second constant coefficient of a second piecewise segment of the inverse reshaping model; and

set a first slope coefficient and a first curvature coefficient associated with the first piecewise segment to zero.

15. A video coding device comprising:

a processor configured to:

determine a plurality of pivot points associated with a plurality of piecewise segments, wherein each of the plurality of piecewise segments is defined by a plurality of coefficients that comprise a constant coefficient, a slope coefficient, and a curvature coefficient;

receive a first indication of a first subset of coefficients associated with the plurality of piecewise segments;

calculate, based on the first subset of coefficients and the plurality of pivot points, a second subset of coefficients associated with the plurality of piecewise segments;

generate, an inverse reshaping model using the plurality of pivot points, the first subset of coefficients, and the second subset of coefficients;

receive a second indication that a first piecewise segment of the plurality of piecewise segments is flat;

modify a first constant coefficient of the first piecewise segment of the inverse reshaping model to a value signaled for a second constant coefficient of a second piecewise segment of the inverse reshaping model;

set a first slope coefficient and a first curvature coefficient associated with the first piecewise segment to zero; and

apply inverse reshaping to a high dynamic range (HDR) video using the inverse reshaping model.

16. The video coding device of claim 15 , wherein the plurality of pivot points are determined based on an indication received via a message.

17. The video coding device of claim 15 , wherein the first subset of coefficients comprises a first slope coefficient associated with a first piecewise segment of the plurality of piecewise segments and a plurality of constant coefficients associated with the plurality of piecewise segments.

18. The video coding device of claim 17 , wherein the second subset of coefficients comprises a plurality of slope coefficients associated with the remaining piecewise segments of the plurality of piecewise segments and a plurality of curvature coefficients.

19. The video coding device of claim 17 , wherein being configured to determine the plurality of pivot points comprises being configured to determine a location for each of the plurality of pivot points.

20. The video coding device of claim 17 , wherein the plurality of pivot points are evenly spaced on the inverse reshaping model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2020
From: VID SCALE, INC.
To: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
Reel/Frame 053048/0815 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2019
From: KEROFSKY, LOUIS; HE, YUWEN; YE, YAN; VOSOUGHI, ARASH
To: VID SCALE, INC.
Reel/Frame 049939/0154 →
Continuity (5)
Provisional Application 62221585 · Sep 21, 2015
Provisional Application 62233422 · Sep 27, 2015
Provisional Application 62242761 · Oct 16, 2015
Provisional Application 62248242 · Oct 29, 2015
Related Publication 20180278967A1 · Sep 27, 2018
Cited By (4)
US 12,238,305 US 12,301,845 US 12,368,841 US 12,445,653