IP Library Granted Patent US 12,524,855
Granted Patent B2
US 12,524,855 · App. 17/908,090 · Granted Jan 13, 2026

Method and apparatus for inverse tone mapping

Inventors: Laurent Cauvin (Chevaigne, FR); Marie-Jean Colaitis (Cesson-Sévigné, FR); Frederic Plissonneau (Thorigné-Fouillard, FR); Guillaume Poirier (Rennes, FR)
Assignee: InterDigital CE Patent Holdings, SAS
G06T5/92G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,524,855
App. No.
17/908,090
Granted
Jan 13, 2026
Kind
B2
Abstract

A method for inverse tone mapping includes obtaining a histogram of a low dynamic range image, called LDR image and obtaining an ITMO function, allowing obtaining a pixel value of a High Dynamic Range image, called HDR image, from a pixel value of the LDR image and a gain function depending on said pixel value of the LDR image. A search process is applied using the obtained histogram to identify areas of the LDR image producing bright areas in the HDR image when the ITMO function is applied on said LDR image. Information representative of the bright areas is used to determine when modifying the gain function to ensure the HDR image respects at least one predefined light energy constraint.

Claims (41)

1 . A method comprising:

obtaining a gain function used for obtaining an inverse tone mapping operator function, allowing obtaining a High Dynamic Range image, from a low dynamic range image by applying a search process to identify areas of the low dynamic range image producing bright areas in the high dynamic range image when the inverse tone mapping operator function is applied on the low dynamic range image, the search process comprising:

defining bands representing subparts of a histogram of the low dynamic range image and obtaining a contribution and a population representing a number of pixels of each band, each contribution being representative of a light energy after application of the inverse tone mapping operator function emitted by pixels represented by the band;

creating at least one candidate from at least one local maximum in the contributions and at least one local maximum in the populations;

selecting at least one final candidate from the at least one candidate in function of information representative of each candidate comprising an information representative of a light energy emitted by pixels represented by the candidate and of the number of pixels represented by the candidate; and

applying a determination process comprising:

determining a final pixel value representative of the at least one final candidate;

computing a value representative of an expanded pixel value from the final pixel value using the inverse tone mapping operator function; and

executing a modification process adapted to modify the gain function responsive to determining that the expanded pixel value is higher than a light energy constraint representing a predefined diffuse white constraint value.

2 . The method of claim 1 , wherein creating at least one candidate from at least one local maximum in the contributions and at least one local maximum in the populations comprises:

identifying at least one local maximum in the contributions and for each local maximum, aggregating the corresponding band with neighboring bands to create a candidate;

identifying at least one local maximum in the populations and for each local maximum, aggregating the corresponding band with neighboring bands to create a candidate population; and

creating a candidate from each candidate population that is independent of any candidate.

3 . The method of claim 1 , wherein the at least one light energy constraint comprises a MaxFall constraint.

4 . The method of claim 1 , wherein selecting at least one final candidate comprises:

selecting a subset of candidates associated with a highest value of information representative of a light energy, the at least one final candidate being selected from the candidates of the subset representing a highest number of pixels.

5 . The method of claim 1 , wherein the low dynamic range image is a current image of a sequence of images and the final pixel value is temporally filtered using at least one final pixel value computed for at least one image preceding the current image in the sequence of images.

6 . The method of claim 1 , wherein the determination process comprises:

executing a modification process adapted to modify the gain function responsive to determining that a value representative of a MaxFall of the high dynamic range image is higher than a light energy constraint representing a predefined MaxFall constraint.

7 . The method of claim 6 , wherein the value representative of the MaxFall of the high dynamic range image is a sum of the contributions.

8 . A non-transitory computer readable medium storing program code instructions for implementing the method according to claim 1 .

9 . A device comprising electronic circuitry adapted for:

obtaining a gain function used for obtaining an inverse tone mapping operator function, allowing obtaining a High Dynamic Range image from a low dynamic range image by applying a search process to identify areas of the low dynamic range image producing bright areas in the high dynamic range image when the inverse tone mapping operator function is applied on the low dynamic range image, the search process comprising:

defining bands corresponding to subparts of an histogram of the low dynamic range image and obtaining a contribution and a population representing a number of pixels of each band, each contribution being representative of a light energy after application of the inverse tone mapping operator function emitted by pixels represented by the band;

creating at least one candidate from at least one local maximum in the contributions and at least one local maximum in the populations;

selecting at least one final candidate from the at least one candidate in function of information representative of each candidate comprising an information representative of a light energy emitted by pixels represented by the candidate and of the number of pixels represented by the candidate; and

applying a determination process comprising:

determining a final pixel value representative of the at least one final candidate;

computing a value representative of an expanded pixel value from the final pixel value using the inverse tone mapping operator function; and

executing a modification process adapted to modify the gain function responsive to determining that the expanded pixel value is higher than a light energy constraint representing a predefined diffuse white constraint value.

10 . The device of claim 9 , wherein creating at least one candidate from at least one local maximum in the contributions and at least one local maximum in the populations comprises:

identifying at least one local maximum in the contributions and for each local maximum, aggregating the corresponding band with neighboring bands to create a candidate;

identifying at least one local maximum in the populations and for each local maximum, aggregating the corresponding band with neighboring bands to create a candidate population; and

creating a candidate from each candidate population that is independent of any candidate.

11 . The device of claim 9 , wherein the at least one light energy constraint comprises a MaxFall constraint.

12 . The device of claim 9 , wherein for selecting at least one final candidate, the electronic circuitry is further adapted for:

selecting a subset of candidates associated with a highest value of information representative of a light energy, the at least one final candidate being selected from the candidates of the subset representing a highest number of pixels.

13 . The device of claim 9 , wherein the low dynamic range image is a current image of a sequence of images and the final pixel value is temporally filtered using at least one final pixel value computed for at least one image preceding the current image in the sequence of images.

14 . The device of claim 9 , wherein for applying the determination process, the device is further configured for:

executing a modification process adapted to modify the gain function when a value representative of a MaxFall of the high dynamic range image is higher than a light energy constraint representing a predefined MaxFall constraint.

15 . The device of claim 14 , wherein the value representative of a MaxFall of the high dynamic range image is a sum of the contributions.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2023
From: INTERDIGITAL VC HOLDINGS FRANCE, SAS
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 064460/0921 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2023
From: POIRIER, GUILLAUME; CAUVIN, LAURENT; COLAITIS, MARIE-JEAN; PLISSONNEAU, FREDERIC
To: INTERDIGITAL VC HOLDINGS FRANCE
Reel/Frame 062300/0180 →
Priority Claims (1)
EP 20305220 · Mar 2, 2020 · regional
Continuity (1)
Related Publication 20230017160A1 · Jan 19, 2023
References Cited (24)
US 10397576B2 · Kadu et al. · 2019 [cited by applicant]
US 11263731B2 · Thebault · 2022 [cited by examiner]
US 20170193639A1 · Dai et al. · 2017 [cited by applicant]
US 20170374262A1 · Nagano · 2017 [cited by examiner]
US 20180007356A1 · Kadu et al. · 2018 [cited by applicant]
US 20180082661A1 · Kang et al. · 2018 [cited by applicant]
US 20180247396A1 · Pouli · 2018 [cited by examiner]
US 20180300921A1 · Aiba · 2018 [cited by examiner]
US 20180374202A1 · Cauvin · 2018 [cited by examiner]
US 20190147572A1 · Colaitis · 2019 [cited by examiner]
US 20190208173A1 · Kadu · 2019 [cited by examiner]
US 20190236761A1 · Cauvin et al. · 2019 [cited by applicant]
US 20200302659A1 · Urabe · 2020 [cited by examiner]
US 20210360253A1 · Ferrara · 2021 [cited by examiner]
US 20220092749A1 · Johnson · 2022 [cited by examiner]
CN 106603941A · 2017 [cited by applicant]
EP 3249605A1 · 2017 [cited by applicant]
EP 3306563A1 · 2018 [cited by applicant]
JP 2000101840A · 2000 [cited by applicant]
JP 2019165434A · 2019 [cited by applicant]
KR 20180032750A · 2018 [cited by applicant]
WO WO2019125857A1 · 2019 [cited by applicant]
Banterle, Francesco, et al. “High dynamic range imaging and low dynamic range expansion for generating HDR content.” Computer graphics forum. vol. 28. No. 8. Oxford, UK: Blackwell Publishing Ltd, 2009. (Year: 2009). [cited by examiner]
Enhong, Zhu, et al., “Method of Generating High Dynamic Range Image from a Single Image”, Journal of Computer-Aided Design & Computer Graphics, vol. 28 No. 10, Oct. 2016, 10 pages. [cited by applicant]