IP Library › Granted Patent US 12,348,781
Granted Patent B2
US 12,348,781 · App. 18/486,697 · Granted Jul 1, 2025

Source color volume information messaging

Inventors: Tao Chen (Palo Alto, CA); Peng Yin (Ithaca, NY); Taoran Lu (Santa Clara, CA); Walter J. Husak (Simi Valley, CA)
Assignee: Dolby Laboratories Licensing Corporation
H04N19/70H04N19/14H04N19/186H04N19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,781
App. No.
18/486,697
Granted
Jul 1, 2025
Kind
B2
Abstract

Methods are described to communicate source color volume information in a coded bitstream using SEI messaging. Such data include at least the minimum, maximum, and average luminance values in the source data plus optional data that may include the color volume x and y chromaticity coordinates for the input color primaries (e.g., red, green, and blue) of the source data, and the color x and y chromaticity coordinates for the color primaries corresponding to the minimum, average, and maximum luminance values in the source data. Messaging data signaling an active region in each picture may also be included.

Claims (28)

1. A non-transitory medium storing one or more processor-executable instructions that, when executed by the processor, causes the processor to process a video bitstream comprising one or more coded pictures and source color volume metadata to extract information about the source color volume of the video bitstream for generating an output video signal, wherein the metadata comprises:

a source color volume cancel flag, which when set to 1 indicates that the source color volume metadata cancels any persistence of previous source color volume metadata,

source color x and y chromaticity coordinates for one or more color primary components, wherein for a color primary component c of the video bitstream, the source color x and y chromaticity coordinates define, respectively, its normalized x and y chromaticity coordinates, and

a minimum, a maximum, and an average luminance value specifying, respectively, minimum, maximum, and average luminance values of pixel values in the video bitstream.

2. The non-transitory medium of claim 1 , wherein the x and y chromaticity coordinates are specified in increments of 0.00002, according to the CIE 1931 definition of x and y as specified in ISO 11664-1.

3. The non-transitory medium of claim 1 , wherein for describing color volumes that use red, green, and blue color primaries, c=0 corresponds to the green color primary, c=1 corresponds to the blue color primary, and c=2 corresponds to the red color primary.

4. The non-transitory medium of claim 1 , wherein the minimum, the maximum, and the average luminance value are specified in units of 0.0001 candelas per square meter (nits).

5. An apparatus to extract source color volume information, the apparatus comprising:

an input and memory to receive a coded bitstream including a video bitstream and source color volume metadata;

a processor to extract, from the coded bitstream, the video bitstream and the source color volume metadata, wherein the metadata comprise:

a source color volume cancel flag, which when set to 1 indicates that the source color volume metadata cancels any persistence of previous source color volume metadata,

source color x and y chromaticity coordinates for one or more color primary components, wherein for a color primary component c of the video bitstream, the source color x and y chromaticity coordinates define, respectively, its normalized x and y chromaticity coordinates, and

a minimum, a maximum, and an average luminance value specifying, respectively, minimum, maximum, and average luminance values of pixel values in the video bitstream; and

an output to transmit the extracted video bitstream and the extracted source color volume metadata for generating an output video signal.

6. The apparatus of claim 5 , wherein the output video signal is generated based on the extracted video bitstream, the x and y chromaticity coordinates for the one or more color primary components, and the minimum, the maximum, and the average luminance values.

7. The apparatus of claim 5 , wherein the x and y chromaticity coordinates are specified in increments of 0.00002, according to the CIE 1931 definition of x and y as specified in ISO 11664-1.

8. The apparatus of claim 5 , wherein for describing color volumes that use red, green, and blue color primaries, c=0 corresponds to the green color primary, c=1 corresponds to the blue color primary, and c=2 corresponds to the red color primary.

9. The apparatus of claim 5 , wherein the minimum, the maximum, and the average luminance value are specified in units of 0.0001 candelas per square meter (nits).

10. An apparatus comprising:

an input and memory to receive a video bitstream and source color volume metadata, wherein the metadata comprise:

a source color volume cancel flag, which when set to 1 indicates that the source color volume metadata cancels any persistence of previous source color volume metadata,

source color x and y chromaticity coordinates for one or more color primary components, wherein for a color primary component c of the video bitstream, the source color x and y chromaticity coordinates define, respectively, its normalized x and y chromaticity coordinates, and

a minimum, a maximum, and an average luminance value specifying, respectively, minimum, maximum, and average luminance values of pixel values in the video bitstream;

a processor to generate a coded bitstream based on the video bitstream and the metadata; and

an output to transmit the coded bitstream.

11. The apparatus of claim 10 , wherein the x and y chromaticity coordinates are specified in increments of 0.00002, according to the CIE 1931 definition of x and y as specified in ISO 11664-1.

12. The apparatus of claim 10 , wherein for describing color volumes that use red, green, and blue color primaries, c=0 corresponds to the green color primary, c=1 corresponds to the blue color primary, and c=2 corresponds to the red color primary.

13. The apparatus of claim 10 , wherein the minimum, the maximum, and the average luminance value are specified in units of 0.0001 candelas per square meter (nits).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2024
From: CHEN, TAO; YIN, PENG; LU, TAORAN; HUSAK, WALTER J.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 066012/0351 →
Continuity (6)
Continuation 18162492 · Jan 31, 2023
Continuation 17009584 · Sep 1, 2020
Continuation 16339992
Provisional Application 62427677 · Nov 29, 2016
Provisional Application 62404302 · Oct 5, 2016
Related Publication 20240056610A1 · Feb 15, 2024
References Cited (97)
US 6018366A · Asai · 2000 [cited by applicant]
US 8837907B2 · Date · 2014 [cited by applicant]
US 9024961B2 · Longhurst · 2015 [cited by examiner]
US 9111330B2 · Messmer · 2015 [cited by applicant]
US 9628808B2 · Su · 2017 [cited by examiner]
US 10080026B2 · Su · 2018 [cited by examiner]
US 10129558B2 · Ramasubramonian · 2018 [cited by applicant]
US 10171849B1 · Hwang · 2019 [cited by applicant]
US 20030122845A1 · Lee · 2003 [cited by examiner]
US 20040113875A1 · Miller · 2004 [cited by examiner]
US 20040222999A1 · Choi · 2004 [cited by applicant]
US 20070160128A1 · Tian · 2007 [cited by applicant]
US 20080186413A1 · Someya · 2008 [cited by applicant]
US 20080291476A1 · Higuchi · 2008 [cited by examiner]
US 20090052858A1 · Date · 2009 [cited by applicant]
US 20100020242A1 · Lammers · 2010 [cited by examiner]
US 20100073338A1 · Miller · 2010 [cited by examiner]
US 20100128055A1 · Blonde · 2010 [cited by examiner]
US 20120315011A1 · Messmer · 2012 [cited by applicant]
US 20130076763A1 · Messmer · 2013 [cited by applicant]
US 20130120656A1 · Wilson · 2013 [cited by applicant]
US 20130155330A1 · Longhurst · 2013 [cited by applicant]
US 20130328907A1 · Ballestad · 2013 [cited by examiner]
US 20140002478A1 · Ballestad · 2014 [cited by applicant]
US 20140098896A1 · Wang · 2014 [cited by applicant]
US 20140192149A1 · Wang · 2014 [cited by applicant]
US 20140333660A1 · Ballestad · 2014 [cited by applicant]
US 20150003749A1 · Kim · 2015 [cited by applicant]
US 20150201222A1 · Mertens · 2015 [cited by examiner]
US 20160005349A1 · Atkins et al. · 2016 [cited by applicant]
US 20160037019A1 · Xue · 2016 [cited by applicant]
US 20160080716A1 · Atkins · 2016 [cited by applicant]
US 20160112714A1 · Hattori · 2016 [cited by applicant]
US 20160227227A1 · Deshpande · 2016 [cited by applicant]
US 20160286226A1 · Ridge · 2016 [cited by applicant]
US 20160286241A1 · Ridge · 2016 [cited by applicant]
US 20160358584A1 · Greenebaum · 2016 [cited by examiner]
US 20170078724A1 · Wilson · 2017 [cited by examiner]
US 20170085880A1 · Minoo · 2017 [cited by applicant]
US 20170085887A1 · Rosewarne · 2017 [cited by examiner]
US 20170085896A1 · Ramasubramonian · 2017 [cited by applicant]
US 20170171576A1 · Oh · 2017 [cited by examiner]
US 20170171578A1 · Joong · 2017 [cited by applicant]
US 20170332085A1 · Ramasubramonian · 2017 [cited by examiner]
US 20170339418A1 · Ramasubramonian · 2017 [cited by examiner]
US 20170374313A1 · Oh · 2017 [cited by examiner]
US 20180007363A1 · Oh · 2018 [cited by examiner]
US 20180048913A1 · Sole Rojals · 2018 [cited by applicant]
US 20180063500A1 · Rusanovskyy · 2018 [cited by examiner]
US 20180070107A1 · Ramasubramonian · 2018 [cited by applicant]
US 20180077453A1 · Oh · 2018 [cited by examiner]
US 20180152721A1 · Rusanovskyy · 2018 [cited by applicant]
US 20180176609A1 · Oh · 2018 [cited by examiner]
US 20180205975A1 · Oh · 2018 [cited by examiner]
US 20180219764A1 · Oh · 2018 [cited by examiner]
US 20180262731A1 · Oh · 2018 [cited by examiner]
US 20180302663A1 · Yoshizawa · 2018 [cited by examiner]
US 20190007709A1 · Oh · 2019 [cited by examiner]
US 20190045209A1 · Ramasubramonian · 2019 [cited by applicant]
US 20190215566A1 · Shimizu · 2019 [cited by examiner]
US 20200043125A1 · Yeung · 2020 [cited by examiner]
US 20200053334A1 · Oh · 2020 [cited by examiner]
US 20200296428A1 · Andrivon · 2020 [cited by applicant]
US 20240214611A1 · Chen · 2024 [cited by examiner]
CN 101132472A · 2008 [cited by applicant]
CN 103098453A · 2013 [cited by applicant]
CN 103180891A · 2013 [cited by applicant]
CN 103873738A · 2014 [cited by applicant]
CN 105594215A · 2016 [cited by applicant]
EP 1784024A1 · 2007 [cited by applicant]
EP 2187337A1 · 2010 [cited by applicant]
EP 3010231 · 2016 [cited by applicant]
EP 3010231A1 · 2016 [cited by examiner]
EP 3059937 · 2016 [cited by applicant]
EP 3059937A1 · 2016 [cited by examiner]
JP 2006222790A · 2006 [cited by applicant]
JP 2019208275A · 2019 [cited by examiner]
KR 20160054039A · 2016 [cited by applicant]
WO 2012166382A2 · 2012 [cited by applicant]
WO 2016080754A1 · 2016 [cited by applicant]
WO 2016118395A1 · 2016 [cited by applicant]
WO WO2018067552A1 · 2018 [cited by examiner]
“High Dynamic Range and Wide Color Gamut Video Coding in HEVC: Status and Potential Future Enhancements”—Francois et al., IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, No. 1, Jan. 2016 (Year: … [cited by examiner]
“HEVC Screen Content Coding Draft Text 6”, JCTVC-W1005, Mar. 2016, San Diego, USA. [cited by applicant]
A.K. Ramasubramonian, “Content colour volume SEI message ”, JCTVC-X0069, May 2016, Geneva, CH. [cited by applicant]
A.M. Tourapis, “Improvements to the Effective Colour Volume SEI”, JCTVC-X0052, May 2016, Geneva, CH. [cited by applicant]
H.M. Oh et al., “Content colour gamut SEI message”, JCTVC-X0040, May 2016, Geneva, CH. [cited by applicant]
Rec. ITU-T H.265, “Series H: Audiovisual and Multimedia systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding,” ITU, Oct. 2014. [cited by applicant]
SMPTE ST 2094-1:2016: “Dynamic Metadata for Color Volume Transform—Core Components” May 18, 2016. [cited by applicant]
SMPTE Standard “Dynamic Metadata for Color vol. Transform—Application #1” SMPTE ST 2094-10:2016, May 18, 2016, pp. 1-15. [cited by applicant]
Tao Chen et al., “AHG 7: On Content Colour Volume SEI Message”, (JCTVC-Y0032), JCT-VC of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 25th Meeting: Chengdu, CN, (Oct. 15, 2016). [cited by applicant]
Smith, “Ultra HD Blu-ray Format Video Characteristics,” Digital Object Identifier, 10.5594/JMI.2016.2563078; Date of publication: Jul. 6, 2016 (Year: 2016), pp. 14-27, 14 pages. [cited by applicant]
Carreira et al., Automatic letter/pillarbox detection for optimized display of digital TV, 2014 International Conference on Signal Processing and Multimedia Applications (SIGMAP), Vienna, Austria, 2014, pp. 281-288, 8 p… [cited by applicant]
SMPTE “Study Group Report High-Dynamic-Range (HDR) Imaging Ecosystem”, Sep. 19, 2015, XP055250336, pp. 1-53, 53 pages. [cited by applicant]
Andrivon et al., “Reference-based Color vol. Remapping” SMPTE 2015 Annual Technical Conference and Exhibition, Oct. 26-29, 2015, pp. 1-14, 14 pages. [cited by applicant]
Lu et al., “Compression Efficiency Improvement over HEVC Main 10 Profile for HDR and WCG Content” 2016 Data Compression Conference (DCC), Mar. 30-Apr. 1, 2016, pp. 279-288, 10 pages. [cited by applicant]
Mahmalat et al., “Luminance Independent Chromaticity Preprocessing for HDR Video Coding” Disney Research; 978-1-4673-9961-6/16/$31.00 © 2016 IEEE., Sep. 2016, pp. 1389-1393, 5 pages. [cited by applicant]