IP Library Granted Patent US 10,467,735
Granted Patent B2
US 10,467,735 · App. 15/755,052 · Granted Nov 5, 2019

Inverse tone mapping based on luminance zones

Inventors: Tania Pouli (Le Rheu, FR); Laurent Cauvin (Chevaigné, FR); Jonathan Kervec (Paimpont, FR)
Assignee: INTERDIGITAL VC HOLDINGS, INC.
G06T5/009G06T5/008G06T7/90G06T2207/10024G06T2207/10028G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,467,735
App. No.
15/755,052
Granted
Nov 5, 2019
Kind
B2
Abstract

Inverse tone mapping based on luminance zones is provided. A digital image can be obtained and luminance values of pixels of the digital image can be determined. One or more values of luminance zone boundaries can be determined. A zone expansion exponent map based on the luminance values and the one or more luminance zone boundaries can be determined. The one or more luminance zone boundaries divide the zone expansion exponent map into a plurality of luminance zones. The luminance values of the image can be inverse tone mapped based on the zone expansion exponent map. An expanded dynamic range image can be provided based on the inverse tone mapped luminance values.

Claims (50)

1. A method for providing an expanded dynamic range image from a digital image defined by pixels associated with colors represented in a color space separating luminance (Y) from chrominance, comprising:

determining a plurality of luminance zones in which luminance values representing said colors of pixels are distributed,

for each of said plurality of luminance zones, defining an expansion exponent quadratic function of low-pass filtered luminance determining an expansion exponent value E(p) for each pixel (p) of said luminance zone,

inverse tone mapping luminance value of each pixel by applying an expansion exponent value E(p) to said luminance value, wherein said expansion exponent value E(p) is obtained by applying to a low-pass filtered luminance value of said luminance value the expansion exponent quadratic function of the luminance zone to which said luminance value belongs, and

providing the expanded dynamic range image based on the inverse tone mapped luminance values,

wherein said plurality of luminance zones comprises at least three luminance zones, a low zone for luminances of low values, a high zone for luminances of high values, and a middle zone for luminances comprised between luminances of low values and luminances of high values,

wherein said expansion exponent quadratic functions are defined by one set of three parameters a′, b′, c′ and by the position of at least five expansion exponent control points such that:

said expansion exponent quadratic function determining expansion exponent values in middle zone passes through the second, third, fourth of these five expansion exponent control points,

said expansion exponent quadratic function determining expansion exponent values in low zone passes through the first and second of these five expansion exponent control points, and

said expansion exponent quadratic function determining expansion exponent values in high zone passes through the fourth and fifth of these five expansion exponent control points.

2. The method for providing an expanded dynamic range image according to claim 1 , comprising interpolating a global expansion exponent curve from the different expansion exponent quadratic functions, using a spline interpolation method.

3. The method for providing an expanded dynamic range image according to claim 1 , comprising determining a contrast value for each pixel (p) of said digital image, wherein inverse tone mapping luminance value Y(p) of said pixel comprises multiplying luminance value obtained by the application of said expansion exponent value E(p) by said determined contrast value.

4. The method for providing an expanded dynamic range image according to claim 3 , wherein determining a contrast value for each pixel (p) is performed according to the luminance zone to which luminance value Y(p) of said pixel belongs.

5. The method for providing an expanded dynamic range image according to claim 1 , comprising determining a lift value for each pixel (p) of said digital image, wherein inverse tone mapping luminance value Y(p) of said pixel comprises shifting luminance value obtained by the application of said expansion exponent value E(p) by said lift value.

6. The method for providing an expanded dynamic range image according to claim 5 , wherein determining a lift value for each pixel (p) is performed according to the luminance zone to which luminance value Y(p) of said pixel belongs.

7. The method for providing an expanded dynamic range image according to claim 6 , wherein determining a lift value for each pixel of said digital image is performed according to a lift quadratic function of said luminance values which depends on the luminance zone to which luminance value Y(p) of said pixel belongs, wherein said lift quadratic functions are defined through at least five lift control points such that:

said lift quadratic function determining lift values in middle zone passes through the second, third, fourth of these five lift control points,

said lift quadratic function determining lift values in low zone passes through the first and second of these five lift control points, and

said lift quadratic function determining lift values in high zone passes through the fourth and fifth of these five lift control points, and

wherein said method comprises interpolating a global lift curve from the different lift quadratic functions using a spline interpolation method.

8. An apparatus for providing an expanded dynamic range image from a digital image defined by pixels associated with colors represented in a color space separating luminance (Y) from chrominance, comprising a processing unit configured to:

determine a plurality of luminance zones in which luminance values representing said colors of pixels are distributed,

for each of said plurality of luminance zones, define an expansion exponent quadratic function of low-pass filtered luminance determining an expansion exponent value E(p) for each pixel (p) of said luminance zone,

inverse tone map luminance value of each pixel by applying an expansion exponent value E(p) to said luminance value, wherein said expansion exponent value E(p) is obtained by applying to a low-pass filtered luminance value of said luminance value the expansion exponent quadratic function of the luminance zone to which said luminance value belongs, and

provide the expanded dynamic range image based on the inverse tone mapped luminance values,

wherein said plurality of luminance zones comprises at least three luminance zones, a low zone for luminances of low values, a high zone for luminances of high values, and a middle zone for luminances comprised between luminances of low values and luminances of high values,

wherein said expansion exponent quadratic functions are defined by one set of three parameters a′, b′, c′ and by the position of at least five expansion exponent control points such that:

said expansion exponent quadratic function determining expansion exponent values in middle zone passes through the second, third, fourth of these five expansion exponent control points,

said expansion exponent quadratic function determining expansion exponent values in low zone passes through the first and second of these five expansion exponent control points, and

said expansion exponent quadratic function determining expansion exponent values in high zone passes through the fourth and fifth of these five expansion exponent control points.

9. The apparatus of claim 8 , wherein the processing unit is further configured to interpolate a global expansion exponent curve from the different expansion exponent quadratic functions, using a spline interpolation method.

10. The apparatus of claim 8 , wherein the processing unit is further configured to determine a contrast value for each pixel (p) of said digital image, wherein inverse tone mapping luminance value Y(p) of said pixel comprises multiplying luminance value obtained by the application of said expansion exponent value E(p) by said determined contrast value.

11. The apparatus of claim 10 , wherein determining a contrast value for each pixel (p) is performed according to the luminance zone to which luminance value Y(p) of said pixel belongs.

12. The apparatus of claim 8 , wherein the processing unit is further configured to determine a lift value for each pixel (p) of said digital image, wherein inverse tone mapping luminance value Y(p) of said pixel comprises shifting luminance value obtained by the application of said expansion exponent value E(p) by said lift value.

13. The apparatus of claim 12 , wherein determining a lift value for each pixel (p) is performed according to the luminance zone to which luminance value Y(p) of said pixel belongs.

14. The apparatus of claim 13 , wherein determining a lift value for each pixel of said digital image is performed according to a lift quadratic function of said luminance values which depends on the luminance zone to which luminance value Y(p) of said pixel belongs, wherein said lift quadratic functions are defined through at least five lift control points such that:

said lift quadratic function determining lift values in middle zone passes through the second, third, fourth of these five lift control points,

said lift quadratic function determining lift values in low zone passes through the first and second of these five lift control points, and

said lift quadratic function determining lift values in high zone passes through the fourth and fifth of these five lift control points, and

wherein said processing unit is further configured to interpolate a global lift curve from the different lift quadratic functions using a spline interpolation method.

15. A non-transitory computer-readable medium storing computer-executable instructions executable to provide an expanded dynamic range image from a digital image defined by pixels associated with colors represented in a color space separating luminance (Y) from chrominance, by:

determining a plurality of luminance zones in which luminance values representing said colors of pixels are distributed,

for each of said plurality of luminance zones, defining an expansion exponent quadratic function of low-pass filtered luminance determining an expansion exponent value E(p) for each pixel (p) of said luminance zone,

inverse tone mapping luminance value of each pixel by applying an expansion exponent value E(p) to said luminance value, wherein said expansion exponent value E(p) is obtained by applying to a low-pass filtered luminance value of said luminance value the expansion exponent quadratic function of the luminance zone to which said luminance value belongs, and

providing the expanded dynamic range image based on the inverse tone mapped luminance values,

wherein said plurality of luminance zones comprises at least three luminance zones, a low zone for luminances of low values, a high zone for luminances of high values, and a middle zone for luminances comprised between luminances of low values and luminances of high values,

wherein said expansion exponent quadratic functions are defined by one set of three parameters a′, b′, c′ and by the position of at least five expansion exponent control points such that:

said expansion exponent quadratic function determining expansion exponent values in middle zone passes through the second, third, fourth of these five expansion exponent control points,

said expansion exponent quadratic function determining expansion exponent values in low zone passes through the first and second of these five expansion exponent control points, and

said expansion exponent quadratic function determining expansion exponent values in high zone passes through the fourth and fifth of these five expansion exponent control points.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2020
From: INTERDIGITAL VC HOLDINGS, INC.
To: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
Reel/Frame 053048/0181 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2019
From: THOMSON LICENSING SAS
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 051169/0022 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2019
From: CAUVIN, LAURENT; POULI, TANIA; KERVEC, JONATHAN
To: THOMSON LICENSING
Reel/Frame 050479/0329 →
Priority Claims (1)
EP 15306313.6 · Aug 25, 2015 · regional
Continuity (1)
Related Publication 20180247396A1 · Aug 30, 2018
Cited By (3)
US 12,518,362 US 12,602,841 US 12,666,158