IP Library Granted Patent US 12,439,063
Granted Patent B2
US 12,439,063 · App. 18/339,038 · Granted Oct 7, 2025

Video decoder initialization information

Inventors: Ye-Kui Wang (San Diego, CA); Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Yang Wang (Beijing, CN); Jizheng Xu (San Diego, CA); Zhipin Deng (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BEIJING INC.
H04N19/197H04N7/014H04N19/184H04N19/44H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,439,063
App. No.
18/339,038
Granted
Oct 7, 2025
Kind
B2
Abstract

A mechanism for processing video data is disclosed. Video decoder initialization information is signaled between an encoder to a decoder. The video decoder initialization information contains a range of initialization parameters. A conversion is performed between a visual media data and a visual media data file based on the range of initialization parameters.

Claims (32)

1. A method for processing video data comprising:

receiving a bitstream that signals video decoder initialization information containing a range of initialization parameters; and

performing a conversion between a visual media data and a visual media data file based on the range of initialization parameters;

wherein the method is performed by a decoder, and wherein the decoder is reinitialized when at least one of a general timing parameter and a hypothetical reference decoder (HRD) parameter is changed.

2. The method of claim 1 , wherein the video decoder initialization information is signaled in at least one Decoding Capability Information (DCI) Network Abstraction Layer (NAL) unit in at least one bitstream.

3. The method of claim 1 , wherein the video decoder initialization information is signaled in at least one decoder initialization information (DII) supplemental enhancement information (SEI) message in at least one bitstream.

4. The method of claim 3 , wherein the DII SEI message is required to be present in a first access unit (AU) of a corresponding bitstream.

5. The method of claim 1 , wherein the video decoder initialization information is signaled in an International Organization for Standardization (ISO) base media file format (ISOBMFF) file in a file-level box, a movie-level box, at least one track-level box, or combinations thereof.

6. The method of claim 1 , wherein the video decoder initialization information is signaled in a file-level metadata box, a movie-level metadata box, a movie header box, a sample description box, a track header box, a track group box, a track-level metadata box, or combinations thereof.

7. The method of claim 1 , wherein the video decoder initialization information is signaled in a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH) Media Presentation Description (MPD).

8. The method of claim 1 , wherein the video decoder initialization information is signaled in an adaptation set, a representation, or combinations thereof.

9. The method of claim 1 , wherein the video decoder initialization information is signaled in a real-time transport protocol (RTP) header extension.

10. The method of claim 1 , wherein the video decoder initialization information is signaled as part of a session description protocol (SDP) offer, an SDP answer, or combinations thereof.

11. The method of claim 1 , wherein the video decoder initialization information comprises a maximum number of decoded pictures (maxDecPics) stored in a decoded picture buffer (DPB) when decoding the bitstream, a maximum decoded picture width (maxDecPicW) of coded pictures in the bitstream, a maximum decoded picture height (maxDecPicH) of coded pictures in the bitstream, or combinations thereof, or

the video decoder initialization information comprises an indication of usage of inter-layer prediction, reference picture resampling, wrap around motion compensation, motion vector prediction from reference pictures, palette coding mode, adaptive color transform, intra block copy, adaptive loop filter (ALF) adaptation parameter set (APS) NAL unit, luma mapping with chroma scaling (LMCS) APS NAL unit, scaling list APS NAL unit, or combinations thereof in a corresponding bitstream.

12. The method of claim 1 , wherein the video decoder initialization information comprises an indication of a maximum picture order count between a current picture and a corresponding reference picture; or

the video decoder initialization information comprises an indication of maximum color format, maximum bit depth, maximum coded picture buffer size, minimum coding unit (CU) size, scaling ratio calculation information, or combinations thereof.

13. The method of claim 1 , wherein the video decoder initialization information comprises an indication of usage of deblocking, padding, sub-picture partitioning, slice partitioning, tile partitioning, wrap-around motion compensation, reference picture resampling, long term reference pictures, or combinations thereof, or

the video decoder initialization information comprises a maximum tier to which all coded video sequences (CVSs) of a corresponding bitstream conform, a maximum level to which all CVSs of a corresponding bitstream conform, or combinations thereof.

14. The method of claim 1 , wherein the video decoder initialization information comprises an indication of a video codec used to perform the conversion between the visual media data and the visual media data file; or

the video decoder initialization information comprises a profile to which all bitstreams conform.

15. The method of claim 1 , wherein the decoder is reinitialized when profile, tier, and level (PTL) information is changed.

16. The method of claim 1 , wherein the conversion comprises generating the visual media data file according to the visual media data.

17. The method of claim 1 , wherein the conversion comprises parsing the visual media data file to obtain the visual media data.

18. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

receive a bitstream that signals video decoder initialization information containing a range of initialization parameters; and

perform a conversion between a visual media data and a visual media data file based on the range of initialization parameters;

wherein the apparatus is a decoder, and wherein the decoder is reinitialized when at least one of a general timing parameter and a hypothetical reference decoder (HRD) parameter is changed.

19. A non-transitory computer readable medium storing instructions that cause a processor to:

receive a bitstream that signals video decoder initialization information containing a range of initialization parameters; and

perform a conversion between a visual media data and a visual media data file based on the range of initialization parameters;

wherein the processor operates on a decoder, and wherein the decoder is reinitialized when at least one of a general timing parameter and a hypothetical reference decoder (HRD) parameter is changed.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2023
From: WANG, YE-KUI; ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 064372/0904 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2023
From: WANG, YANG
To: BEIJING OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.,
Reel/Frame 064372/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2023
From: DENG, ZHIPIN
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 064372/0948 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2023
From: BEIJING OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 064373/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2023
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 064373/0053 →
Continuity (2)
Continuation PCTCN2021140741 · Dec 23, 2021
Related Publication 20230336753A1 · Oct 19, 2023
References Cited (76)
US 7773121B1 · Huntsberger et al. · 2010 [cited by applicant]
US 9786077B2 · Adsumilli et al. · 2017 [cited by applicant]
US 10063792B1 · Brailovskiy et al. · 2018 [cited by applicant]
US 10282814B2 · Lin et al. · 2019 [cited by applicant]
US 10368067B2 · Lin et al. · 2019 [cited by applicant]
US 10375371B2 · Xu et al. · 2019 [cited by applicant]
US 10432856B2 · Chang et al. · 2019 [cited by applicant]
US 10484621B2 · Adsumilli et al. · 2019 [cited by applicant]
US 10547879B2 · Lai et al. · 2020 [cited by applicant]
US 11032568B2 · Liu et al. · 2021 [cited by applicant]
US 11818189B2 · Sodagar · 2023 [cited by applicant]
US 20060055710A1 · Lo et al. · 2006 [cited by applicant]
US 20070014347A1 · Prechtl et al. · 2007 [cited by applicant]
US 20080008458A1 · Gudipaty et al. · 2008 [cited by applicant]
US 20090003714A1 · Subramaniam · 2009 [cited by applicant]
US 20090092191A1 · Otsuka · 2009 [cited by applicant]
US 20100001997A1 · Kajikawa et al. · 2010 [cited by applicant]
US 20130071012A1 · Leichsenring et al. · 2013 [cited by applicant]
US 20130106855A1 · Urbach · 2013 [cited by applicant]
US 20140086333A1 · Wang · 2014 [cited by examiner]
US 20140104376A1 · Chen · 2014 [cited by applicant]
US 20140300693A1 · Hirata et al. · 2014 [cited by applicant]
US 20140348227A1 · Lee · 2014 [cited by applicant]
US 20150341552A1 · Chen et al. · 2015 [cited by applicant]
US 20160234536A1 · Stockhammer · 2016 [cited by examiner]
US 20160314610A1 · Lee et al. · 2016 [cited by applicant]
US 20160337706A1 · Hwang et al. · 2016 [cited by applicant]
US 20170195615A1 · Han et al. · 2017 [cited by applicant]
US 20170295356A1 · Abbas et al. · 2017 [cited by applicant]
US 20170347084A1 · Boyce · 2017 [cited by applicant]
US 20180075635A1 · Choi et al. · 2018 [cited by applicant]
US 20180077451A1 · Yip et al. · 2018 [cited by applicant]
US 20180103199A1 · Hendry et al. · 2018 [cited by applicant]
US 20180213202A1 · Kopeinigg et al. · 2018 [cited by applicant]
US 20180278964A1 · Wang · 2018 [cited by examiner]
US 20180376125A1 · Wang et al. · 2018 [cited by applicant]
US 20190045222A1 · Yip et al. · 2019 [cited by applicant]
US 20190104326A1 · Stockhammer · 2019 [cited by examiner]
US 20190238888A1 · Kim · 2019 [cited by applicant]
US 20190260930A1 · Van Hoff · 2019 [cited by applicant]
US 20190297132A1 · Wang et al. · 2019 [cited by applicant]
US 20200053392A1 · Hannuksela · 2020 [cited by examiner]
US 20200112761A1 · Stockhammer et al. · 2020 [cited by applicant]
US 20200221159A1 · Stockhammer · 2020 [cited by examiner]
US 20210037237A1 · Hsiang · 2021 [cited by applicant]
CN 106464891A · 2017 [cited by applicant]
CN 107750462A · 2018 [cited by applicant]
CN 108370450A · 2018 [cited by applicant]
CN 109803141A · 2019 [cited by applicant]
CN 111194551A · 2020 [cited by applicant]
WO WO2022136313A2 · 2022 [cited by examiner]
“A Seamless Web Integration of Adaptive HTTP Streaming”—Rainer et al., 20th European Signal Processing Conference (EUSIPCO 2012); Bucharest, Romania, Aug. 27-31, 2012 (Year: 2012). [cited by examiner]
“Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 2: High Efficiency Video Coding,” ISO/IEC JTC1/SC 29/WG 11 N 17661 ISO/IEC DIS 23008-2:201x (4th Ed.), Apr. 20, 2018, … [cited by applicant]
Document: JVET-G1001-v1, Chen, J., et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting: Torino, IT… [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Versatile video coding,” ITU-T, H.266, Aug. 2020, 516 pages. [cited by applicant]
Document: JVET-S2001-vH, Bross, B., et al., “Versatile Video Coding (Draft 10),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 19th Meeting: by teleconference, Jun. 22-Jul. 1, 2020, 5… [cited by applicant]
“Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video, Versatile supplemental enhancement information messages for coded video bitstreams”, ITU-T, H.274, Aug. 2020, … [cited by applicant]
Document: JVET-S2007-v7, Boyce, J., et al., “Versatile supplemental enhancement information messages for coded video bitstreams (Draft 5),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG … [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 12: ISO base media file format, Technical Corrigendum 1,” ISO/IEC JTC 1/SC 29 N, ISO/IEC 14496-12:2015/Cor.1, Jun. 3, 2016, 303 pages. [cited by applicant]
Stockhammer, T., “Editor's Version of DASH IS 4th Edition,” ISO/IEC JTC1/SC29/WG11 MPEG2019/m52458, Jan. 2020, 287 pages. [cited by applicant]
“Draft text of ISO/IEC 14496-15:2019 FDAM 2 Carriage of VVC and EVC in ISOBMFF,” ISO/IEC JTC 1/SC 29/WG 03 N00149, Feb. 26, 2021, 284 pages. [cited by applicant]
“Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 12: Image File Format—Amendment 2: Support for VVC, EVC, slideshows and other improvements,” ISO/IEC 23008-12:2017/DAM… [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 15: Carriage of network abstraction layer (NAL) unit structured video in the ISO base media file format—Amendment 2: Carriage of VVC and EVC in ISOBMFF,” ISO/I… [cited by applicant]
“Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 12: Image File Format—Amendment 2: Support for VVC, EVC, slideshows and other improvements,” ISO/IEC 23008-12:2017/CDA… [cited by applicant]
Schulzrinne, H., et al., “RTP: A Transport Protocol for Real-Time Applications,” Network Working Group, RFC 3550, Jul. 2003, 104 pages. [cited by applicant]
Handley, M., et al., “SDP: Session Description Protocol,” Network Working Group, RFC 4566, Jul. 2006, 49 pages. [cited by applicant]
Yang, Y., et al., “RTP Payload Format for H.264 Video,” Internet Engineering Task Force (IETF), RFC 6184, May 2011, 101 pages. [cited by applicant]
Wenger, S., et al., “RTP Payload Format for Scalable Video Coding,” Internet Engineering Task Force (IETF), RFC 6190, May 2011, 100 pages. [cited by applicant]
Yang, Y., et al., “RTP Payload Format for High Efficiency Video Coding (HEVC),” Internet Engineering Task Force (IETF), RFC 7798, Mar. 2016, 86 pages. [cited by applicant]
Zhao, S., et al., “RTP Payload Format for Versatile Video Coding (VVC),” draft-ietf-avtcore-rtp-vvc-06, avtcore, Dec. 8, 2020, 121 pages. [cited by applicant]
Document: JVET-T0066, Skupin, R., et al., “AHG9: IRAP only HRD SEI message,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 20th Meeting, by teleconference, Oct. 7-16, 2020, 16 pages. [cited by applicant]
Document: JVET-S0163-v2, Hannuksela, M., et al., “AHG9: On target OLS and sublayers for decoding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 19th Meeting: by teleconference, Jun. … [cited by applicant]
Document: JVET-Q0485-v1, Wan, W., et al., “Profile and Level Definitions,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 5 pages. [cited by applicant]
Foreign Communication From A Related Counterpart Application, International Application No. PCT/CN2021/140741, International Search Report dated Mar. 2, 2022, 10 pages. [cited by applicant]
Foreign Communication From A Related Counterpart Application, International Application No. PCT/CN2021/140742, International Search Report dated Mar. 22, 2022, 6 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/339,012, mailed Nov. 29, 2024, 21 pages. [cited by applicant]