IP Library Granted Patent US 12,200,263
Granted Patent B2
US 12,200,263 · App. 17/713,995 · Granted Jan 14, 2025

Avoidance of redundant signaling in multi-layer video bitstreams

Inventor: Ye-Kui Wang (San Diego, CA)
Assignee: Huawei Technologies Co., Ltd.
H04N19/70H04N19/105H04N19/136H04N19/159H04N19/172H04N19/174H04N19/187H04N19/188H04N19/30H04N19/423H04N19/46H04N19/463H04N19/50H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,263
App. No.
17/713,995
Granted
Jan 14, 2025
Kind
B2
Abstract

A method of decoding is provided. The method includes receiving a sub-bitstream having a sequence parameter set (SPS) with a decoded picture buffer (DPB) syntax structure for an output layer set (OLS) with only one layer; setting a number of layers in the OLS equal to one based on the OLS having the only one layer; obtaining the DPB syntax structure for the OLS with the one layer from the SPS when the number of layers in the OLS has been set equal to one; and decoding a picture from the only one layer using the DPB syntax structure to obtain a decoded picture. A corresponding method of encoding is also provided.

Claims (22)

1. A method of decoding implemented by a video decoder, comprising:

receiving a sub-bitstream having a decoded picture buffer (DPB) syntax structure, wherein output layer sets (OLSs) to which the DPB syntax structure applies are specified by a video parameter set (VPS) when the DPB syntax structure is included in the VPS, and wherein the DPB syntax structure applies to an output layer set (OLS) that includes only one layer when the DPB syntax structure is included in a sequence parameter set (SPS);

obtaining the DPB syntax structure for the OLS with the only one layer from the SPS or obtaining the DPB syntax structure for the OLSs from the VPS; and

decoding a picture from the OLS with the only one layer or the OLSs using the DPB syntax structure to obtain a decoded picture.

2. The method of claim 1 , wherein the DPB syntax structure is designated dpb_parameters( ).

3. The method of claim 1 , wherein the only one layer is an i-th layer, and wherein the OLS is an i-th OLS.

4. The method of claim 1 , wherein the DPB syntax structure is present in an i-th dpb_parameters( ) syntax structure in the SPS.

5. The method of claim 1 , wherein the sub-bitstream does not include the VPS when the DPB syntax structure is included in the SPS.

6. The method of claim 1 , further comprising storing the decoded picture in a DPB prior to being displayed.

7. The method of claim 1 , wherein the SPS is referred to by the only one layer in the OLS.

8. The method of claim 1 , further comprising displaying the decoded picture on a display of an electronic device.

9. A decoding device, comprising:

a receiver configured to receive a sub-bitstream having a decoded picture buffer (DPB) syntax structure, wherein output layer sets (OLSs) to which the DPB syntax structure applies are specified by a video parameter set (VPS) when the DPB syntax structure is included in the VPS, and wherein the DPB syntax structure applies to an output layer set (OLS) that includes only one layer when the DPB syntax structure is included in a sequence parameter set (SPS);

a memory coupled to the receiver and storing instructions; and

one or more processors coupled to the memory, the one or more processors configured to execute the instructions to cause the decoding device to:

obtain the DPB syntax structure for the OLS with the only one layer from the SPS or obtaining the DPB syntax structure for the OLSs from the VPS; and

decode a picture from the OLS with the only one layer or the OLSs using the DPB syntax structure to obtain a decoded picture.

10. The decoding device of claim 9 , wherein the DPB syntax structure is designated dpb_parameters( ) wherein the only one layer is the i-th layer, and wherein the OLS is the i-th OLS.

11. The decoding device of claim 9 , wherein the DPB syntax structure is present in an i-th dpb_parameters( ) syntax structure in the SPS.

12. The decoding device of claim 9 , wherein the sub-bitstream does not include the VPS when the DPB syntax structure is included in the SPS.

13. The decoding device of claim 9 , wherein the SPS is referred to by the only one layer in the OLS.

14. The decoding device of claim 9 , further comprising a display configured to display the decoded picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 065479/0473 →
Continuity (3)
Continuation PCTUS2020054450 · Oct 6, 2020
Provisional Application 62911808 · Oct 7, 2019
Related Publication 20220232259A1 · Jul 21, 2022
References Cited (125)
US 8693549B2 · Choi et al. · 2014 [cited by applicant]
US 9699480B2 · Deshpande · 2017 [cited by applicant]
US 9712871B2 · Ramasubramonian et al. · 2017 [cited by applicant]
US 9819948B2 · Wang · 2017 [cited by applicant]
US 9918091B2 · Wang et al. · 2018 [cited by applicant]
US 9992493B2 · Chen et al. · 2018 [cited by applicant]
US 10404990B2 · Hendry et al. · 2019 [cited by applicant]
US 10432951B2 · Wang · 2019 [cited by applicant]
US 20090010332A1 · Jeon et al. · 2009 [cited by applicant]
US 20120230431A1 · Boyce et al. · 2012 [cited by applicant]
US 20130077681A1 · Chen et al. · 2013 [cited by applicant]
US 20140003491A1 · Chen et al. · 2014 [cited by applicant]
US 20140086303A1 · Wang · 2014 [cited by applicant]
US 20140086331A1 · Wang · 2014 [cited by applicant]
US 20140086333A1 · Wang · 2014 [cited by applicant]
US 20140086336A1 · Wang · 2014 [cited by applicant]
US 20140092996A1 · Wang · 2014 [cited by applicant]
US 20140185691A1 · Kwon et al. · 2014 [cited by applicant]
US 20140218473A1 · Hannuksela et al. · 2014 [cited by applicant]
US 20140294062A1 · Chen et al. · 2014 [cited by applicant]
US 20140301441A1 · Wang et al. · 2014 [cited by applicant]
US 20140301477A1 · Deshpande · 2014 [cited by applicant]
US 20140301484A1 · Wang · 2014 [cited by examiner]
US 20150016545A1 · Ramasubramonian et al. · 2015 [cited by applicant]
US 20150103884A1 · Ramasubramonian et al. · 2015 [cited by applicant]
US 20150103886A1 · He et al. · 2015 [cited by applicant]
US 20150103928A1 · Seregin et al. · 2015 [cited by applicant]
US 20150189322A1 · He et al. · 2015 [cited by applicant]
US 20150264366A1 · Hendry et al. · 2015 [cited by applicant]
US 20150304666A1 · Seregin et al. · 2015 [cited by applicant]
US 20150319448A1 · Ramasubramonian et al. · 2015 [cited by applicant]
US 20150365702A1 · Deshpande · 2015 [cited by examiner]
US 20150373333A1 · Wang et al. · 2015 [cited by applicant]
US 20150373346A1 · Wang · 2015 [cited by examiner]
US 20150373361A1 · Wang · 2015 [cited by examiner]
US 20160044324A1 · Deshpande · 2016 [cited by applicant]
US 20160119632A1 · Lee et al. · 2016 [cited by applicant]
US 20160173887A1 · Deshpande · 2016 [cited by applicant]
US 20160191926A1 · Deshpande et al. · 2016 [cited by applicant]
US 20160249056A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20160255373A1 · Deshpande · 2016 [cited by applicant]
US 20160261878A1 · Deshpande · 2016 [cited by applicant]
US 20160301895A1 · Lu et al. · 2016 [cited by applicant]
US 20160366428A1 · Deshpande · 2016 [cited by examiner]
US 20170006300A1 · Tsukuba · 2017 [cited by examiner]
US 20170019673A1 · Tsukuba · 2017 [cited by examiner]
US 20170026655A1 · Deshpande · 2017 [cited by applicant]
US 20170134742A1 · Despande · 2017 [cited by applicant]
US 20180167637A1 · Yin et al. · 2018 [cited by applicant]
US 20190052910A1 · Deshpande · 2019 [cited by applicant]
US 20190058895A1 · Deshpande · 2019 [cited by applicant]
US 20210092426A1 · Choi · 2021 [cited by examiner]
US 20210092451A1 · Choi · 2021 [cited by examiner]
US 20220109865A1 · Deshpande · 2022 [cited by applicant]
US 20220345745A1 · Deshpande · 2022 [cited by applicant]
US 20230085717A1 · Wang · 2023 [cited by applicant]
CN 104641648A · 2015 [cited by applicant]
CN 104662914A · 2015 [cited by applicant]
CN 105075262A · 2015 [cited by applicant]
CN 105519119A · 2016 [cited by applicant]
CN 105556975A · 2016 [cited by applicant]
CN 105637878A · 2016 [cited by applicant]
CN 105637883A · 2016 [cited by applicant]
CN 105706451A · 2016 [cited by applicant]
CN 106105217A · 2016 [cited by applicant]
CN 107852511A · 2018 [cited by applicant]
JP 2015529439A · 2015 [cited by applicant]
JP 2015195543A · 2015 [cited by applicant]
JP 2016518759A · 2016 [cited by applicant]
JP 2016518763A · 2016 [cited by applicant]
JP 2016528806A · 2016 [cited by applicant]
JP 2016530734A · 2016 [cited by applicant]
JP 2016539545A · 2016 [cited by applicant]
JP 2017522792A · 2017 [cited by applicant]
JP 2017523683A · 2017 [cited by applicant]
RU 2612577C2 · 2017 [cited by applicant]
RU 2649297C2 · 2018 [cited by applicant]
RU 2653299C2 · 2018 [cited by applicant]
RU 2656827C2 · 2018 [cited by applicant]
WO 2013162450A1 · 2013 [cited by applicant]
WO 2014047613A1 · 2014 [cited by applicant]
WO 2015053330A1 · 2015 [cited by applicant]
WO 2015196034A1 · 2015 [cited by applicant]
WO 2021057869A1 · 2021 [cited by applicant]
“Line Transmission of Non-Telephone Signals Video Codec for Audiovisual Services At p×64 kbits,” ITU-T Recommendation H.261, Mar. 1993, 29 pages. [cited by applicant]
“Transmission of Non-Telephone Signals; Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” ITU-T Recommendation H.262, Jul. 1995, 211 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Video coding for low bit rate communication,” ITU-T Recommendation H.263, Jan. 2005, 226 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services,” Recommendation ITU-T H.264, Jun. 2019, 836 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; High efficiency video coding” Recommendation ITU-T H.265, Apr. 2013, 317 pages. [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 6),” Document: JVET-O2001-vE, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
Wang, Y.K., “AHG8: Scalability—output layer sets,” Document: JVET-P0115-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 5 pages. [cited by applicant]
Wang, Y.K., “AHG8: Scalability—random access,” Document: JVET-P0116-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 5 pages. [cited by applicant]
Wang, Y.K., “AHG8: Scalability—PTL and decoder capability,” Document: JVET-P0117-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 4 pages. [cited by applicant]
Wang, Y.K., “AHG8: Scalability—HRD,” Document: JVET-P0118-v3, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 3 pages. [cited by applicant]
Wang, Y.K., “AHG8/AHG17: Miscellaneous HLS topics,” Document: JVET-P0125-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 3 pages. [cited by applicant]
Wang, Y.K., “AHGB/AHG17: On buffering period, picture timing, and decoding unit information SEI messages,” Document: JVET-P0189-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th … [cited by applicant]
Wang, Y.K., “AHG8/AHG17: Scalable nesting SEI message,” Document: JVET-P0190-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 4 pages. [cited by applicant]
Sjoberg, R., et al., “Overview of HEVC High-Level Syntax and Reference Picture Management,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012, 13 pages. [cited by applicant]
Document: JVET-P0125-v1, Wang, Y., “AHG8/AHG17: Miscellaneous HLS topics,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 3 pages. [cited by applicant]
Document: JCTVC-M0209, WG 11 No. m28663, Deshpande, S., “On Design for Signaling Inter-layer Prediction,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/ SC29/WG11, 13th Meeting: In… [cited by applicant]
Document: JVET-R2001-vA, Bross, B., et al., “Versatile Video Coding (Draft 9),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC I/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, 526 p… [cited by applicant]
Document: JCTVC-Q0154, Ramasubramonian, A., et al., “MV-HEVC/SHVC HLS: On picture flushing and DPB parameters,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 17th Me… [cited by applicant]
Document: JVET-R0193-r1, Hendry et al., “AHG8/AHG9: On signalling of syntax element max_tid_il_ref_pics_plusl,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 18th Meeting: by teleconf… [cited by applicant]
Document: JVET-P0097, Hannuksela, M, “AHG8/AHG17: Removing dependencies on VPS from the decoding process of a non-scalable bitstream,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 16… [cited by applicant]
Dong, L., et al., “Implementation of HEVC Network Abstraction Layer Unit Based on FPGA,” Electrical Switches (2019. No. 2), 2019, with an English Abstract, 4 pages. [cited by applicant]
Yan, Z., et al., “Flexible prediction structure for multi-view video coding,” Journal of Image and Graphics, vol. 17, No., 6, Jun. 2012, with an English Abstract, 6 pages. [cited by applicant]
Xu, T., et al., “A video stitching method based on compressed domain,” Video engineering, 2017, 41(11/12), with an English Abstract, 6 pages. [cited by applicant]
Document: JVET-P0117-v2, Wang, Y., “AHG8: Scalability—PTL and decoder capability,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 4 pages, XP… [cited by applicant]
Document: JVET-P2001-v9, Bross, B., et al., “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 495 pages. [cited by applicant]
Document: JVET-O2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages… [cited by applicant]
Document: JVET-Q0197-v1, Wang, B., et al., “Miscellaneous fixes for HLS in Specification,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 2… [cited by applicant]
Document: JVET-P0115-v1, Wang, Y., “AHG8: Scalability—output layer sets,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 5 pages. [cited by applicant]
Document: JVET-P2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 491 pages, XP0… [cited by applicant]
Document: JCTVC-M0450_v3, Wang, Y., “Report of the joint BoG on high-level syntax,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 13th Meeting: Incheon, KR, Apr. 18-2… [cited by applicant]
Document: JVET-P0117-v1, Wang, Y., “AHG8: Scalability—PTL and decoder capability,” Joint Video Experts Team (JVET) of ITU-Y SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 7 pages. [cited by applicant]
Document: JVET-P0118-version 3 Wang, Y., “AHG8: Scalability—HRD,” JVET-P0118-v3_SpecText.docx, Oct. 1, 2019, pp. 49, 57, 120, 134-135, 160-162. [cited by applicant]
Document: JVET-O2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 6)” Joint Video Experts Team (JVET) of ITU-Y SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, pp. 4-6, 85… [cited by applicant]
Document: JVET-O0148-v1, Wang, Y., et al., “AHG17: On reference picture list signalling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019,… [cited by applicant]
Document: JVET-P0205, Drugeon, V., et al., “AHG17: Presence of Video Parameter Set in bitstreams,” Joint Video Experts Team (JVET) of ITU-Y SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2… [cited by applicant]
Document: JVET-P0185-v1, Deshpande, S., “On Video Parameter Set and Highest Temporal Sub-layer,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 201… [cited by applicant]
Document: JCTVC-O0260, Misra, K., et al., “Inter Predictions Signalling and Picture Marking,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Geneva, CH,… [cited by applicant]
Document: JVET-S0152-v6, Wang, Y.K., “AHG2: Editorial input of a text integration for the May 2020 HLS AHG meeting outcome,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 19th Meeting… [cited by applicant]
Document: JVET-N1001-v10, B.Bross, et al., “Versatile Video Coding (Draft 5),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 407 pages. [cited by applicant]
Document: JVET-P0274WD, Tsui-Shan Chang, et al., “Non-CE1:WD of enabling TMVP in RPR,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Jul. 3-12, 2019, 445 pa… [cited by applicant]
Document: JVET-P0221-v2, B. Choi et al., “AHG8: On signaling interlayer reference picture list,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 20… [cited by applicant]