IP Library Granted Patent US 12,342,000
Granted Patent B2
US 12,342,000 · App. 18/510,269 · Granted Jun 24, 2025

Profile tier level parameter set in video coding

Inventor: Ye-Kui Wang (San Diego, CA)
Assignee: Bytedance Inc.
H04N19/70H04N19/188H04N19/30H04N19/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,342,000
App. No.
18/510,269
Granted
Jun 24, 2025
Kind
B2
Abstract

Devices, systems and methods for specifying the syntax and semantics of the decoding parameter set (DPS) are described. One example method of video processing includes determining, for a conversion between a video and a bitstream of the video, that each output layer set (OLS) in a coded video sequence (CVS) in the bitstream conforms to at least one profile-tier-level (PTL) syntax structure included in a data structure associated with decoding parameter semantics in the bitstream, and performing, based on the determining, the conversion, wherein the PTL syntax structure indicates a profile, a tier, and a level of the bitstream.

Claims (32)

1. A method of video processing, comprising:

performing a conversion between a video and a bitstream of the video,

wherein the bitstream conforms to a format rule, and

wherein the format rule specifies that decoding capability information excludes a first syntax element indicating an identifier of the decoding capability information when the decoding capability information is included in a network abstraction layer (NAL) unit.

2. The method of claim 1 , wherein the format rule further specifies that each of a plurality of network abstraction layer (NAL) units comprising decoding capability information in the bitstream has a same content.

3. The method of claim 2 , wherein the format rule specifies that the NAL unit including decoding capability information is in a first access unit (AU) of the bitstream, wherein the first AU is located at a start of the bitstream.

4. The method of claim 3 , wherein the NAL unit including decoding capability information is a decoding capability information NAL unit.

5. The method of claim 3 , wherein the NAL unit including decoding capability information is a supplemental enhancement information (SEI) NAL unit comprising a decoding capability information SEI message.

6. The method of claim 1 , wherein the format rule further specifies that a sequence parameter set (SPS) does not reference the decoding capability information through inclusion of a second syntax element indicating the identifier of the decoding capability information referenced by the SPS when the decoding capability information is included in the NAL unit.

7. The method of claim 1 , wherein the format rule further specifies an exclusion of a sublayer level information from a plurality of profile-tier-level (PTL) syntax structures in decoding capability information of the bitstream, and wherein each of the plurality of PTL syntax structures indicates a profile, a tier, and a level of the bitstream.

8. The method of claim 7 , wherein the plurality of PTL syntax structures are included in raw byte sequence payload of the NAL unit comprising the decoding capability information.

9. The method of claim 8 , wherein the PTL syntax structures comprise a flag indicating an inclusion or an exclusion of the sublayer level information.

10. The method of claim 9 , wherein the flag is zero for the PTL syntax structures included in the raw byte sequence payload of the NAL unit comprising the decoding capability information.

11. The method of claim 7 , wherein each output layer set (OLS) in a coded video sequence (CVS) in the bitstream conforms to at least one of the plurality of PTL syntax structures.

12. The method of claim 1 , wherein the conversion comprises decoding the video from the bitstream.

13. The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

14. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a video and a bitstream of the video,

wherein the bitstream conforms to a format rule, and

wherein the format rule specifies that decoding capability information excludes a first syntax element indicating an identifier of the decoding capability information when the decoding capability information is included in a network abstraction layer (NAL) unit.

15. The apparatus of claim 14 , wherein the format rule further specifies that each of a plurality of network abstraction layer (NAL) units comprising decoding capability information in the bitstream has a same content.

16. The apparatus of claim 14 , wherein the format rule further specifies that a sequence parameter set (SPS) does not reference the decoding capability information through inclusion of a second syntax element indicating the identifier of the decoding capability information referenced by the SPS when the decoding capability information is included in the NAL unit.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video and a bitstream of the video,

wherein the bitstream conforms to a format rule, and

wherein the format rule specifies that decoding capability information excludes a first syntax element indicating an identifier of the decoding capability information when the decoding capability information is included in a network abstraction layer (NAL) unit.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the format rule further specifies that each of a plurality of network abstraction layer (NAL) units comprising decoding capability information in the bitstream has a same content.

19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream of the video,

wherein the bitstream conforms to a format rule, and

wherein the format rule specifies that decoding capability information excludes a first syntax element indicating an identifier of the decoding capability information when the decoding capability information is included in a network abstraction layer (NAL) unit.

20. The non-transitory computer-readable recording medium of claim 19 , wherein the format rule further specifies that each of a plurality of network abstraction layer (NAL) units comprising decoding capability information in the bitstream has a same content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2023
From: WANG, YE-KUI
To: BYTEDANCE INC.
Reel/Frame 065781/0885 →
Continuity (4)
Continuation 17849232 · Jun 24, 2022
Continuation PCTUS2020067078 · Dec 26, 2020
Provisional Application 62953862 · Dec 26, 2019
Related Publication 20240080493A1 · Mar 7, 2024
References Cited (57)
US 8163193B2 · He · 2012 [cited by applicant]
US 8288723B2 · Zhang · 2012 [cited by applicant]
US 9387279B2 · Wu · 2016 [cited by applicant]
US 9562490B2 · Haskara · 2017 [cited by applicant]
US 9577315B2 · Li · 2017 [cited by applicant]
US 9650376B2 · Resnick · 2017 [cited by applicant]
US 9667959B2 · Wang · 2017 [cited by applicant]
US 9723305B2 · Wang · 2017 [cited by applicant]
US 10542440B2 · Fang · 2020 [cited by applicant]
US 10666953B2 · Ye · 2020 [cited by applicant]
US 20070058718A1 · Shen · 2007 [cited by applicant]
US 20120002728A1 · Eleftheriadis · 2012 [cited by applicant]
US 20120230431A1 · Boyce · 2012 [cited by applicant]
US 20130182755A1 · Chen · 2013 [cited by applicant]
US 20140092994A1 · Wang · 2014 [cited by applicant]
US 20140168362A1 · Hannuksela · 2014 [cited by applicant]
US 20150319449A1 · Ramasubramonian · 2015 [cited by applicant]
US 20160212437A1 · Tsukuba · 2016 [cited by applicant]
US 20170111661A1 · Boyce · 2017 [cited by applicant]
US 20200244962A1 · Li · 2020 [cited by applicant]
US 20220086497A1 · Wang · 2022 [cited by applicant]
US 20220086499A1 · Wang · 2022 [cited by applicant]
US 20220141495A1 · Kim · 2022 [cited by applicant]
US 20220201308A1 · Hendry · 2022 [cited by applicant]
US 20220217392A1 · Hendry · 2022 [cited by applicant]
US 20220329870A1 · Wang · 2022 [cited by applicant]
US 20230040376A1 · Samuelsson et al. · 2023 [cited by applicant]
US 20230060709A1 · Ouedraogo · 2023 [cited by applicant]
JP 2022542851A · 2022 [cited by applicant]
JP 2022550718A · 2022 [cited by applicant]
JP 2022553599A · 2022 [cited by applicant]
JP 7568350B2 · 2024 [cited by applicant]
JP 7596494B2 · 2024 [cited by applicant]
WO 2015053120A1 · 2015 [cited by applicant]
WO 2021061283A1 · 2021 [cited by applicant]
WO 2021122956A1 · 2021 [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/848,507 dated Oct. 28, 2024, 10 pages. [cited by applicant]
JVET-P2001-v14-BROSS et al. ““Versatile Video Coding (Draft 7),”” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, document JVET-P2001,2019.htt… [cited by applicant]
“High Efficiency Video Coding”, Series H: Audiovisual and Multimedia Systems: Infrastructure of Audiovisual Services—Coding of Moving Video, ITU-T Telecommunication Standardization Sector of ITU, H.265, Feb. 2018. [cited by applicant]
Chen et al., “Algorithm description of Joint Exploration Test Model 7 (JEM7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting, Torino, IT, Jul. 13-21, 2017, document JVET-G… [cited by applicant]
B. Bross, J. Chen, S. Liu, Y.-K. Wang (editors), “Versatile Video Coding (Draft 7),” JVET-P2001, Oct. 2019. [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 7 (VTM 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, docu… [cited by applicant]
VTM software: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM.git, Sep. 16, 2022. [cited by applicant]
Schwarz et al. “Overview of the scalable video coding extension of the H. 264/AVC standard,” IEEE Transactions on Circuits and Systems for Video Technology, Sep. 9, 2007, 17(9): 1103-1120. [cited by applicant]
JVET-M0101-SKUPIN et al. “AHG17: On VVC HLS,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, document JVET-M0101, 2019. [cited by applicant]
JVET-Q0045-DRUGEON et al. “AHG9: On DPS Identifier,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting, Brussels, BE, Jan. 7-17, 2020, document JVET-Q0045, 2020. [cited by applicant]
JVET-N0724-BOYCE et al. “BoG Report on General High Level Syntax,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting, Geneva, CH, Mar. 19-27, 2019, JVET-N0724, 2019. [cited by applicant]
JVET-Q0117-WANG et al. “AHG9: Cleanups on Parameter Sets,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting, Brussels, BE, Jan. 7-17, 2020, document JVET-Q0117, 2020. [cited by applicant]
JVET-O0181-JVET-00181 Deshpande, Sachin, “Comments on High-Level Syntax of VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, document … [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/848,507 dated Jul. 24, 2023. [cited by applicant]
Extended European Search Report from European Patent Application No. 20905928.6 dated Dec. 20, 2022 (14 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/US2020/067077 dated Mar. 23, 2021 (38 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/US2020/067078 dated Mar. 30, 2021 (9 pages). [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/849,232 dated Jan. 4, 2023. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/848,507 dated Nov. 20, 2023. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/849,232 dated May 4, 2023. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/849,232 dated Aug. 25, 2023. [cited by applicant]