IP Library › Granted Patent US 12,542,929
Granted Patent B2
US 12,542,929 · App. 18/567,333 · Granted Feb 3, 2026

Signaling of priority processing order for metadata messaging in video coding

Inventors: Peng Yin (Ithaca, NY); Sean Thomas McCarthy (San Francisco, CA); Walter J. Husak (Simi Valley, CA); Konstantinos Konstantinides (Saratoga, CA)
Assignee: Dolby Laboratories Licensing Corporation
H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,542,929
App. No.
18/567,333
Granted
Feb 3, 2026
Kind
B2
Abstract

Methods, systems, and bitstream syntax are described for determining the processing order of metadata messaging, such as supplemental enhancement information (SEI) messaging in MPEG video coding.

Claims (27)

1 . A method to determine priority processing among multiple metadata messages, the method comprising:

receiving an input video bitstream and corresponding input metadata messages defining supplemental processing to be applied to decoded video pictures of the input video bitstream;

parsing the input metadata messages to identify a processing order of metadata messaging (POM) message defining a preferred processing order of selected input metadata messages; and upon detecting the POM message:

extracting information determining a total number of the selected input metadata messages with a priority processing order;

extracting identity information and a corresponding priority information for each one of the selected input metadata messages defining the preferred processing order, wherein the priority information comprises an integer value with either smaller or larger numbers causing earlier processing in the preferred processing order, and wherein the integer value either expresses the priority of a selected input message in an absolute priority processing order among the selected input metadata messages or in a processing order relative to a second selected input metadata message among the selected input metadata messages; and

for a decoded video picture of the input video bitstream, applying two or more of the selected input metadata messages with their determined priority processing order.

2 . The method of claim 1 , wherein the POM message is part of at least one of a slice header, a picture header, a sequence parameter set, a picture parameter set, a network abstraction layer unit header, and a supplemental enhancement information (SEI) message.

3 . The method of claim 2 , wherein the POM message is part of an SEI manifest message.

4 . The method of claim 1 , wherein extracting the identity and priority information of the selected input metadata messages with a priority processing order comprises reading a list of the total number of the selected input metadata messages with an implied decreasing priority processing order or an implied increasing priority processing order.

5 . The method of claim 1 , wherein the messaging identity information comprises a payloadType information in SEI messaging.

6 . A method for transmitting a video bitstream from an encoder to a decoder, wherein generating the video bitstream in the encoder comprises:

receiving video pictures and generating encoded video pictures;

receiving input metadata messages defining supplemental processing to be applied to decoded video pictures of the video bitstream; and

combining the encoded video pictures and the input metadata messages to generate the video bitstream, wherein the input metadata messages comprise

a processing order of metadata messaging (POM) message defining a preferred processing order of selected input metadata messages, wherein the POM message comprises:

information determining a total number of the selected input metadata messages with a priority processing order;

identity information and a corresponding priority information for each one of the selected input metadata messages defining the preferred processing order, wherein the priority information comprises an integer value with either smaller or larger numbers causing earlier processing in the preferred processing order, and wherein the integer value either expresses the priority of a selected input message in an absolute priority processing order among the selected input metadata messages or in a processing order relative to a second selected input metadata message among the selected input metadata messages.

7 . The method of claim 6 , wherein the POM message is part of an SEI manifest message or an SEI processing order of metadata message.

8 . The method of claim 7 , wherein the identity information comprises a payloadType information in SEI messaging.

9 . A method to specify priority processing among multiple metadata messages, the method comprising:

generating a video bitstream and corresponding metadata messages defining supplemental processing to be applied to decoded video pictures of the video bitstream;

generating a processing order of metadata (POM) message defining a preferred processing order of selected metadata messages, wherein the POM message comprises:

information determining a total number of selected input metadata messages with a priority processing order;

identity information and a corresponding priority information for each one of the selected input metadata messages defining the priority processing order, wherein the priority information comprises an integer value with either smaller or larger numbers causing earlier processing in the preferred processing order, and wherein the integer value either expresses the priority of a selected input message in an absolute priority processing order among the selected input metadata messages or in a processing order relative to a second selected input metadata message among the selected input metadata messages; and

generating an output stream that includes the video bitstream, the metadata messages, and the processing order of metadata message.

10 . A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing with one or more processors a method in accordance with claim 1 .

11 . An apparatus comprising a processor and configured to perform the method recited in claim 1 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2026
From: YIN, PENG; MCCARTHY, SEAN THOMAS; HUSAK, WALTER J.; KONSTANTINIDES, KONSTANTINOS
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 074028/0516 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2024
From: YIN, PENG; CARTER, SEAN THOMAS; HUSAK, WALTER J.; KONSTANTINIDES, KONSTANTINOS
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 066137/0406 →
Continuity (2)
Provisional Application 63216318 · Jun 29, 2021
Related Publication 20240283978A1 · Aug 22, 2024
References Cited (26)
US 9241158B2 · Wang · 2016 [cited by applicant]
US 9270989B2 · Hannuksela · 2016 [cited by applicant]
US 9380317B2 · Wang · 2016 [cited by applicant]
US 9479782B2 · Wang · 2016 [cited by applicant]
US 9521393B2 · Wang · 2016 [cited by applicant]
US 9648322B2 · Wang · 2017 [cited by applicant]
US 10244249B2 · Ramasubramonian · 2019 [cited by applicant]
US 10397595B2 · Fröjdh · 2019 [cited by applicant]
US 20220060752A1 · Pettersson · 2022 [cited by examiner]
RU 2633100C2 · 2017 [cited by applicant]
WO 2014011569A1 · 2014 [cited by applicant]
WO 2014058598W · 2014 [cited by applicant]
WO 2017044740A2 · 2017 [cited by applicant]
WO 2020130922A1 · 2020 [cited by applicant]
WO 20230278302W · 2023 [cited by applicant]
Husak et al., “AHG9: Thoughts on SEI messages,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 , JVET-V0113 , 22nd Meeting, by teleconference , Apr. 20-28, 2021 , pp. 1-2. [cited by applicant]
Yin et al. , “AHG9: SEI processing order SEI message,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 , JVET-AA0102-v2 , 27th Meeting, by teleconference , Jul. 13-22, 2022 , pp. 1-8. [cited by applicant]
Bross B. et al., “Versatile Video Coding (Draft 10),” JVET-S2001, 131. MPEG Meeting, Jun. 29, 2020-Jul. 3, 2020, Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11, retrieved on http://phenix.int-evry.fr/mpeg/ doc_en… [cited by applicant]
Y-K Wang et al., “AHG9: On the scalability dimension information SEI message,” 22. JVET meeting; Apr. 20, 2021-Apr. 28, 2021, Teleconference, The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16, A… [cited by applicant]
Advanced Video Coding, Rec. ITU-T H.264, Jun. 2019, ITU. [cited by applicant]
High Efficiency Video Coding, Rec. ITU-T H.265, Nov. 2019, ITU. [cited by applicant]
H-M Oh (LGE) et al: “Supplemental enhancement information set SEI message,” 28. JCT-VC Meeting; Jul. 15, 2017-Jul. 21, 2017; Torino; (Joint Collaborative Team on Video Coding of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ),… [cited by applicant]
JVET-V0113, “Thoughts on SEI messages”, JVET online meeting, Apr. 2021. [cited by applicant]
Rickard Sjoberg et al., “Overview of HEVC High-Level Syntax and Reference Picture Management,” IEEE Transactions on Circuits and Systems for Video Technology ( vol. 22, Issue: 12, Dec. 2012), pp. 1858-1870, Oct. 5, 2012. [cited by applicant]
Versatile supplemental enhancement information messages for coded video bitstreams, Rec. ITU-T H.274, Aug. 2020, ITU. [cited by applicant]
Versatile Video Coding, Rec. ITU-T H.266, Aug. 2020, ITU. [cited by applicant]