IP Library › Granted Patent US 12,621,491
Granted Patent B2
US 12,621,491 · App. 17/848,507 · Granted May 5, 2026

Decoding parameter sets in video coding

Inventor: Ye-kui Wang (San Diego, CA)
Assignee: Bytedance Inc.
H04N19/70H04N19/188H04N19/30H04N19/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,621,491
App. No.
17/848,507
Granted
May 5, 2026
Kind
B2
Abstract

Devices, systems and methods for specifying the syntax and semantics of the decoding parameter set (DPS) are described. One example method of video processing includes performing a conversion between a video and a bitstream of the video, wherein the bitstream conforms to a format rule specifying a data structure is in a first access unit (AU) of the bitstream, wherein the first AU is located at a start of the bitstream, wherein the data structure is a type of network abstraction layer (NAL) unit.

Claims (39)

1 . A method of video processing, comprising:

performing a conversion between a video and a bitstream of the video,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies (a) that a plurality of network abstraction layer (NAL) units related to decoding parameters that indicate decoding capability information are included in the bitstream, and all of the plurality of NAL units related to the decoding parameters that indicate the decoding capability information have a same content, and (b) that a NAL unit related to the decoding parameters that indicate the decoding capability information is in a first access unit (AU) of the bitstream, and wherein the first AU is located at a start of the bitstream,

wherein the format rule further specifies that a plurality of profile-tier-level (PTL) syntax structures is included in a raw byte sequence payload of a NAL unit comprising the decoding capability information, and

wherein a syntax element profile_tier_level, representing a PTL syntax structure, has an input parameter, and wherein the input parameter is specified equal to zero indicative of an exclusion of sublayer level information.

2 . The method of claim 1 , wherein the NAL unit related to the decoding parameters that indicate the decoding capability information is a decoding capability information NAL unit.

3 . The method of claim 1 , wherein the NAL unit related to the decoding parameters that indicate the decoding capability information is a supplemental enhancement information (SEI) NAL unit comprising a decoding capability information SEI message.

4 . The method of claim 1 , wherein the format rule further specifies that the decoding capability information excludes a first syntax element indicative of an identifier of the decoding capability information due to the decoding capability information being included in the NAL unit comprising the decoding capability information.

5 . The method of claim 1 , wherein the format rule further specifies that a sequence parameter set (SPS) does not reference the decoding capability information through inclusion of a second syntax element indicative of an identifier of the decoding capability information referenced by the SPS due to the decoding capability information being included in the NAL unit comprising the decoding capability information.

6 . The method of claim 1 , wherein the conversion comprises decoding the video from the bitstream.

7 . The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

8 . An apparatus for processing video data, comprising:

a processor; and

a non-transitory memory with instructions thereon,

wherein the instructions, upon execution by the processor, cause the processor to: perform a conversion between a video and a bitstream of the video,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies (a) that a plurality of network abstraction layer (NAL) units related to decoding parameters that indicate decoding capability information are included in the bitstream, and all of the plurality of NAL units related to the decoding parameters that indicate the decoding capability information have a same content, and (b) that a NAL unit related to the decoding parameters that indicate the decoding capability information is in a first access unit (AU) of the bitstream, and wherein the first AU is located at a start of the bitstream,

wherein the format rule further specifies that a plurality of profile-tier-level (PTL) syntax structures is included in a raw byte sequence payload of a NAL unit comprising the decoding capability information, and

wherein a syntax element profile_tier_level, representing a PTL syntax structure, has an input parameter, and wherein the input parameter is specified equal to zero indicative of an exclusion of sublayer level information.

9 . The apparatus of claim 8 , wherein the format rule further specifies that the decoding capability information excludes a first syntax element indicative of an identifier of the decoding capability information due to the decoding capability information is included in a NAL unit.

10 . The apparatus of claim 8 , wherein the format rule further specifies that a sequence parameter set (SPS) does not reference the decoding capability information through inclusion of a second syntax element indicative of an identifier of the decoding capability information referenced by the SPS due to the decoding capability information is included in a NAL unit.

11 . A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video and a bitstream of the video,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies (a) that a plurality of network abstraction layer (NAL) units related to decoding parameters that indicate decoding capability information are included in the bitstream, and all of the plurality of NAL units related to the decoding parameters that indicate the decoding capability information have a same content, and (b) that a NAL unit related to the decoding parameters that indicate the decoding capability information is in a first access unit (AU) of the bitstream, and wherein the first AU is located at a start of the bitstream,

wherein the format rule further specifies that a plurality of profile-tier-level (PTL) syntax structures is included in a raw byte sequence payload of a NAL unit comprising the decoding capability information, and

wherein a syntax element profile_tier_level, representing a PTL syntax structure, has an input parameter, and wherein the input parameter is specified equal to zero indicative of an exclusion of sublayer level information.

12 . The non-transitory computer-readable storage medium of claim 11 , wherein the format rule further specifies that the decoding capability information excludes a first syntax element indicative of an identifier of the decoding capability information due to the decoding capability information is included in a NAL unit.

13 . The non-transitory computer-readable storage medium of claim 11 , wherein the format rule further specifies that a sequence parameter set (SPS) does not reference the decoding capability information through inclusion of a second syntax element indicative of an identifier of the decoding capability information referenced by the SPS due to the decoding capability information is included in a NAL unit.

14 . A method for storing bitstream of a video, comprising:

generating the bitstream of the video; and

storing the bitstream in a non-transitory computer-readable recording medium,

wherein the bitstream conforms to a format rule,

wherein the format rule specifies (a) that a plurality of network abstraction layer (NAL) units related to decoding parameters that indicate decoding capability information are included in the bitstream, and all of the plurality of NAL units related to the decoding parameters that indicate the decoding capability information have a same content, and (b) that a NAL unit related to the decoding parameters that indicate the decoding capability information is in a first access unit (AU) of the bitstream, and wherein the first AU is located at a start of the bitstream,

wherein the format rule further specifies that a plurality of profile-tier-level (PTL) syntax structures is included in a raw byte sequence payload of a NAL unit comprising the decoding capability information, and

wherein a syntax element profile_tier_level, representing a PTL syntax structure, has an input parameter, and wherein the input parameter is specified equal to zero indicative of an exclusion of sublayer level information.

15 . The method of claim 14 , wherein the format rule further specifies that the decoding capability information excludes a first syntax element indicative of an identifier of the decoding capability information due to the decoding capability information is included in a NAL unit.

16 . The method of claim 14 , wherein the format rule further specifies that a sequence parameter set (SPS) does not reference the decoding capability information through inclusion of a second syntax element indicative of an identifier of the decoding capability information referenced by the SPS due to the decoding capability information is included in a NAL unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2022
From: WANG, YE-KUI
To: BYTEDANCE INC.
Reel/Frame 060305/0627 →
Continuity (3)
Continuation PCTUS2020067077 · Dec 26, 2020
Provisional Application 62953862 · Dec 26, 2019
Related Publication 20220329870A1 · Oct 13, 2022
References Cited (61)
US 8163193B2 · He et al. · 2012 [cited by applicant]
US 8288723B2 · Zhang et al. · 2012 [cited by applicant]
US 9387279B2 · Wu et al. · 2016 [cited by applicant]
US 9562490B2 · Haskara et al. · 2017 [cited by applicant]
US 9577315B2 · Li et al. · 2017 [cited by applicant]
US 9650376B2 · Resnick et al. · 2017 [cited by applicant]
US 9667959B2 · Wang · 2017 [cited by applicant]
US 9723305B2 · Wang · 2017 [cited by applicant]
US 10542440B2 · Fang et al. · 2020 [cited by applicant]
US 10666953B2 · Ye et al. · 2020 [cited by applicant]
US 12407867B2 · Wang · 2025 [cited by applicant]
US 20070058718A1 · Shen et al. · 2007 [cited by applicant]
US 20120002728A1 · Eleftheriadis et al. · 2012 [cited by applicant]
US 20120230431A1 · Boyce et al. · 2012 [cited by applicant]
US 20130182755A1 · Chen et al. · 2013 [cited by applicant]
US 20140092955A1 · Wang · 2014 [cited by examiner]
US 20140092994A1 · Wang · 2014 [cited by examiner]
US 20140168362A1 · Hannuksela et al. · 2014 [cited by applicant]
US 20150319449A1 · Ramasubramonian et al. · 2015 [cited by applicant]
US 20160212437A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20170111661A1 · Boyce · 2017 [cited by applicant]
US 20180139465A1 · Tsukuba · 2018 [cited by examiner]
US 20200244962A1 · Li et al. · 2020 [cited by applicant]
US 20220086497A1 · Wang · 2022 [cited by applicant]
US 20220086499A1 · Wang · 2022 [cited by applicant]
US 20220141495A1 · Kim et al. · 2022 [cited by applicant]
US 20220201308A1 · Hendry · 2022 [cited by applicant]
US 20220217392A1 · Hendry · 2022 [cited by examiner]
US 20220329870A1 · Wang · 2022 [cited by applicant]
US 20220360821A1 · Wang · 2022 [cited by applicant]
US 20230040376A1 · Samuelsson · 2023 [cited by examiner]
US 20230060709A1 · Ouedraogo · 2023 [cited by examiner]
CN 104604236A · 2015 [cited by applicant]
CN 104704843A · 2015 [cited by applicant]
CN 106464919A · 2017 [cited by applicant]
JP 2022542851A · 2022 [cited by applicant]
JP 2022550718A · 2022 [cited by applicant]
JP 2022553599A · 2022 [cited by applicant]
WO 2015053120A1 · 2015 [cited by applicant]
WO 2021061283A1 · 2021 [cited by applicant]
WO 2021122956A1 · 2021 [cited by applicant]
Drugeon (“AHG9: On DPS identifier”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020; JVET-Q0045) (Year: 2020). [cited by examiner]
Ouedraogo et al. (US 2023/0060709) in view of Drugeon (“AHG9: On DPS identifier”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020; JVET-Q004… [cited by examiner]
Drugeon (“AHG9: On DPS identifier”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020; JVET-Q0045; Date Saved: Dec. 18, 2019) (Year: 2019). [cited by examiner]
Non-Final Office Action from U.S. Appl. No. 17/849,232 dated Jan. 4, 2023. [cited by applicant]
Boyce et al. “BoG Report on General High Level Syntax,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting, Geneva, CH, Mar. 19-27, 2019, JVET-N0724, 2019. [cited by applicant]
Drugeon et al. “AHG9: On DPS Identifier,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting, Brussels, BE, Jan. 7-17, 2020, document JVET-Q0045, 2020. [cited by applicant]
Skupin et al. “AHG17: On VVC HLS,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, document JVET-M0101, 2019. [cited by applicant]
Wang et al. “AHG9: Cleanups on Parameter Sets,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting, Brussels, BE, Jan. 7-17, 2020, document JVET-Q0117, 2020. [cited by applicant]
Extended European Search Report from European Patent Application No. 20905928.6 dated Dec. 20, 2022 (14 pages). [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P2001, 2019.http://phenix.it-su… [cited by applicant]
Chen et al. “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017, document J… [cited by applicant]
Chen et al. “Algorithm Description for Versatile Video Coding and Test Model 7 (VTM 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, docum… [cited by applicant]
“High Efficiency Video Coding,” Series H: Audiovisual and Multimedia Systems: Infrastructure of Audiovisual Services—Coding of Moving Video, ITU-T Telecommunication Standardization Sector of ITU, H.265, Feb. 2018. [cited by applicant]
Schwarz et al. “Overview of the Scalable Video Coding Extension of H.264/AVC Standard,” IEEE Transactions on Circuits and Systems for Video Technology, Sep. 9, 2007, 17(9): 1103-1120. [cited by applicant]
VTM software: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM.git. [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/US2020/067077 dated Mar. 23, 2021 (38 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/US2020/067078 dated Mar. 30, 2021 (9 pages). [cited by applicant]
Deshpande, Sachin, “Comments on High-Level Syntax of VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, document JVET-00181, 2019. [cited by applicant]
Chinese Notice of Allowance from Chinese Patent Application No. 202080090814.2 dated May 22, 2025, 11 pages. [cited by applicant]
Chinese Notice of Allowance from Chinese Patent Application No. 202080090763.3 dated Apr. 4, 2025, 12 pages. [cited by applicant]