IP Library Granted Patent US 12,335,495
Granted Patent B2
US 12,335,495 · App. 17/922,688 · Granted Jun 17, 2025

Chroma boost on SDR and HDR display adapted signals for SL-HDRx systems

Inventors: David Touze (Rennes, FR); Marie-Jean Colaitis (Cesson-Sévigné, FR); Catherine Serre (Saint Gregoire, FR)
Assignee: InterDigital CE Patent Holdings, SAS
H04N19/186H04N19/117H04N19/142H04N19/182
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,495
App. No.
17/922,688
Granted
Jun 17, 2025
Kind
B2
Abstract

A method comprising obtaining a current RGB image; classifying colors of pixels of the current RGB image in a plurality of classes; for each color class, determining data representative of said color class, comprising a dominant luminance value representative of a luminance at which a color in said class is predominant and determining from said data representative of said color class a value representative of a gain of chrominance representative of a margin for increasing a chrominance component in said color class; and, encoding the dominant luminance value and the value representative of the gain corresponding to each class as metadata representative of a Saturation Gain Function in a bitstream, said function defining a color correction to apply to a pixel in function of a luminance of said pixel.

Claims (37)

1. A method comprising:

obtaining a current multi-components image;

obtaining a chrominance plane representative of a color gamut and dividing the chrominance plane in a plurality of chrominance sectors;

using tone mapped luma component and corrected normalized chrominance components derived from the current multi-components image to classify colors of pixels of the current multi-components image in the plurality of chrominance sectors;

for each chrominance sector, determining data representative of said chrominance sector, comprising a dominant luminance value representative of a luminance at which a color in said chrominance sector is predominant and determining from said data representative of said chrominance sector a value representative of a gain of chrominance representative of a maximum allowed chroma value for a chrominance component in said chrominance sector; and

encoding the dominant luminance value and the value representative of the gain corresponding to each chrominance sector as metadata representative of a Saturation Gain Function in a bitstream, said function defining a color correction to apply to a pixel of the current multi-components image in function of a luminance of said pixel.

2. The method of claim 1 , wherein the tone mapped luma component and the corrected normalized chrominance components of pixels of the current multi-components image are obtained by analyzing chrominance components of the current multi-components image, the analysis comprising for each pixel of at least a subset of pixels of the current multi-components image:

deriving a luma component from the components of said pixel;

applying a tone mapping to the derived luma component to obtain a tone mapped luma component;

deriving chrominance components from the components of said pixel; and

applying a joint normalization and color correction to the chrominance components to obtain corrected normalized chrominance components.

3. The method of claim 1 , wherein the current multi-components image is comprised in a video sequence and a temporal filtering is applied to the information representative of the chroma gain based on information representative of chroma gains computed for images of the video sequence preceding the current multi-components image.

4. The method of claim 3 , wherein the temporal filtering is reinitialized at a beginning of the video sequence or when a scene cut is identified in the video sequence.

5. The method of claim 1 , wherein the chrominance sectors are chrominance sectors around a pure primary and/or secondary color in the chrominance plane.

6. The method of claim 5 , wherein a combination of the chrominance sectors covers integrally the chrominance plane.

7. The method of claim 1 , wherein determining data representative of said chrominance sector comprises obtaining a histogram of luminance values of pixels of the current multi-components image in function of luminance values for the said chrominance sector.

8. The method of claim 7 , wherein only pixels corresponding to luminance values comprised in a predefined range of luminance values are used for obtaining the histogram.

9. The method of claim 7 , wherein the dominant luminance value corresponds to a luminance value for which there is a maximum of pixels in the histogram or a luminance value for which there is a maximum chrominance energy, a chrominance energy being computed for a bin of the histogram by multiplying a number of pixels corresponding to that bin by a maximum chroma value found at that bin or a luminance value for which there is a maximum average chrominance energy, an average chrominance energy being computed for a bin of the histogram by multiplying a number of pixels corresponding to that bin by a maximum chroma value found at that bin.

10. A device comprising electronic circuitry configured for:

obtaining a current multi-components image;

obtaining a chrominance plane representative of a color gamut and dividing the chrominance plane in a plurality of chrominance sectors;

using tone mapped luma component and corrected normalized chrominance components derived from the current multi-components image to classify colors of pixels of the current multi-components image in the plurality of chrominance sectors;

determining, for each chrominance sector, data representative of said chrominance sector, comprising a dominant luminance value representative of a luminance at which a color in said chrominance sector is predominant and determining from said data representative of said chrominance sector a value representative of a gain of chrominance representative of a maximum allowed chroma value for a chrominance component in said chrominance sector; and

encoding the dominant luminance value and the value representative of the gain corresponding to each chrominance sector as metadata representative of a Saturation Gain Function in a bitstream, said function defining a color correction to apply to a pixel of the current multi-components image in function of a luminance of said pixel.

11. The device of claim 10 , wherein the electronic circuitry is further configured for analyzing the chrominance components of the current multi-components image applied for each pixel of at least a subset of pixels of the current multi-components image to obtain the tone mapped luma component and the corrected normalized chrominance components of pixels of the current multi-components image, the analyzing comprising:

deriving a luma component from the components of said pixel;

applying a tone mapping to the derived luma component to obtain a tone mapped luma component;

deriving chrominance components from the components of said pixel; and

applying a joint normalization and color correction to the chrominance components to obtain corrected normalized chrominance components.

12. The device of claim 10 , wherein the current multi-components image is comprised in a video sequence and the electronic circuitry is further configured for applying a temporal filtering to the information representative of the chroma gain based on information representative of chroma gains computed for images of the video sequence preceding the current multi-components image.

13. The device of claim 12 , wherein the temporal filtering is reinitialized at a beginning of the video sequence or when a scene cut is identified in the video sequence.

14. The device of claim 10 , wherein the chrominance sectors are chrominance sectors around a pure primary and/or secondary color in the chrominance plane.

15. The device of claim 14 , wherein a combination of the chrominance sectors covers integrally the chrominance plane.

16. The device of claim 10 , wherein determining data representative of said chrominance sector comprises obtaining a histogram of luminance values of pixels of the current multi-components image in function of luminance values for the said chrominance sector.

17. The device of claim 16 , wherein only pixels corresponding to luminance values comprised in a predefined range of luminance values are used for obtaining the histogram.

18. The device of claim 16 , wherein the dominant luminance value corresponds to a luminance value for which there is a maximum of pixels in the histogram or a luminance value for which there is a maximum chrominance energy, a chrominance energy being computed for a bin of the histogram by multiplying a number of pixels corresponding to that bin by a maximum chroma value found at that bin or a luminance value for which there is a maximum average chrominance energy, an average chrominance energy being computed for a bin of the histogram by multiplying a number of pixels corresponding to that bin by a maximum chroma value found at that bin.

19. A non-transitory information storage medium storing program code instructions for implementing the method of claim 1 .

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2024
From: INTERDIGITAL VC HOLDINGS FRANCE
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 066017/0692 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2023
From: INTERDIGITAL VC HOLDINGS FRANCE, SAS
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 064396/0118 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2022
From: TOUZE, DAVID; COLAITIS, MARIE-JEAN; SERRE, CATHERINE
To: INTERDIGITAL VC HOLDINGS FRANCE
Reel/Frame 061615/0040 →
Priority Claims (1)
EP 20305440 · May 5, 2020 · regional
Continuity (1)
Related Publication 20240187616A1 · Jun 6, 2024
References Cited (32)
US 11257195B2 · Andrivon et al. · 2022 [cited by applicant]
US 20040120576A1 · Kim · 2004 [cited by applicant]
US 20060285768A1 · Chen · 2006 [cited by applicant]
US 20140132769A1 · Kido · 2014 [cited by examiner]
US 20190058886A1 · Chen et al. · 2019 [cited by applicant]
US 20190156468A1 · Olivier et al. · 2019 [cited by applicant]
US 20190325567A1 · Jones · 2019 [cited by examiner]
US 20200184612A1 · Marais · 2020 [cited by examiner]
US 20210092461A1 · Gadgil · 2021 [cited by examiner]
CN 102223547A · 2011 [cited by applicant]
JP 2018191269A · 2018 [cited by applicant]
JP 2019097013A · 2019 [cited by applicant]
TW I588777B · 2017 [cited by applicant]
WO WO2019169174A1 · 2019 [cited by applicant]
WO 2020014034A1 · 2020 [cited by applicant]
WO 2020018331A1 · 2020 [cited by applicant]
WO 2020048790A1 · 2020 [cited by applicant]
High-Performance Single Layer High Dynamic Range (HDR) System for use In Consumer Electronics devices; Part 1: Directly Standard Dynamic Range (SDR) Compatible HDR System (SL-HDR1), EBU Operating Eurovision, European Br… [cited by examiner]
Anonymous, “Parameter values for the HDTV standards for production and international programme exchange” International Telecommunication Union (ITU), ITU-R Radiocommunication Sector of ITU, BT Series, Broadcasting servi… [cited by applicant]
Anonymous, “High-Performance Single Layer High Dynamic Range (HDR) System for use in Consumer Electronics devices; Part 1: Directly Standard Dynamic Range (SDR) Compatible HDR System (SL-HDR1)”, ETSI and European Broadc… [cited by applicant]
Salih et al., “Tone Mapping of HDR Images: A Review”, 2012 4th International Conference on Intelligent and Advanced Systems (ICIAS 2012), Kuala Lumpur, Malaysia, Jun. 12, 2012, 6 pages. [cited by applicant]
Anonymous, “Information technology—Coding of audio-visual objects—Part 10: Advanced Video Coding”, International Standard, ISO/IEC 14496-10, Second Edition, Dec. 15, 2005, 20 pages. [cited by applicant]
Anonymous, “High-Performance Single Layer High Dynamic Range (HDR) System for use in Consumer Electronics devices; Part 3: Enhancements for Hybrid Log Gamma (HLG) transfer function based High Dynamic Range (HDR) Systems… [cited by applicant]
Anonymous, “High-Performance Single Layer High Dynamic Range (HDR) System for use in Consumer Electronics devices; Part 1: Directly Standard Dynamic Range (SDR) Compatible HDR System (SL-HDR1)”, EBU Operating Eurovision… [cited by applicant]
Anonymous, “Information Technology—High efficiency Coding and Media Delivery in Heterogeneous Environments—Part 2: High Efficiency Video Coding”, International Organization for Standardization, ISO/IEC JTC 1/SC 29/WG 11… [cited by applicant]
Kotera et al. “Object to object color matchings by image clustering”, IS&T's NIP Conference, International Conference on Digital Printing Technologies, Oct. 1, 1998, 5 pages. [cited by applicant]
Anonymous, “Parameter values for ultra-high definition television systems for production and international programme exchange”, International Telecommunication Union (ITU), ITU-R Radiocommunication Sector of ITU, BT Ser… [cited by applicant]
Anonymous, “High-Performance Single Layer High Dynamic Range (HDR) System for use in Consumer Electronics devices; Part 2: Enhancements for Perceptual Quantization (PQ) transfer function based High Dynamic Range (HDR) S… [cited by applicant]
Anonymous, “High-Performance Single Layer High Dynamic Range (HDR) System for use in Consumer Electronics devices; Part 2: Enhancements for Perceptual Quantization (PQ) transfer function based High Dynamic Range (HDR) S… [cited by applicant]
“3rd Revised Edition H.264/AVC Textbook”, supervised by Okubo Sakae, Ed. 1, Impress R&D Corporation, ISBN: 978-4-8443-2664-9, Jan. 1, 2009, pp. 13-15. [cited by applicant]
Haan et al., “Indication of SMPTE ST 2094-20 metadata in HEV C”, Document: JCTVC-X0075, [online], JCTVC-X0075 (version 2), Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG … [cited by applicant]
Lachine et al., “Local Adaptive Tone Mapping for Video Enhancement”, Proceedings of SPIE, vol. 9411, 94110V, <DOI: 10.1117/12.2087624>, Mar. 11, 2015, 6 pages. [cited by applicant]