IP Library Granted Patent US 12,301,853
Granted Patent B2
US 12,301,853 · App. 18/512,962 · Granted May 13, 2025

Indication of max sublayer numbers in multilayered video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Shan Liu (San Jose, CA); Stephan Wenger (Hillsborough, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04L65/75H04N19/136H04N19/184H04N19/187H04N19/31
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,853
App. No.
18/512,962
Granted
May 13, 2025
Kind
B2
Abstract

A method and device identify a maximum number of temporal sublayers that is allowed in a coded video sequence referring to a parameter set. A coded video sequence is decoded based on the identified maximum number of temporal sublayers that is allowed in the coded video sequence referring to the parameter set.

Claims (30)

1. A method, performed by at least one processor, of encoding video data and comprising:

identifying a maximum number of temporal sublayers that is allowed in a video sequence referring to a parameter set in a video parameter set (VPS) field and a sequence parameter set (SPS) field respectively, wherein when a SPS identifier field, which an identifier for an SPS for reference by other syntax elements is greater than 0, and when a first syntax element of a VPS indicates that a number of temporal sublayers is the same for all layers in each coded video sequence referring to the VPS, a value of the VPS field is equal to a value of the SPS field; and

encoding the video sequence based on the identified maximum number of temporal sublayers that is allowed in the video sequence referring to the parameter set.

2. The method of claim 1 , wherein the temporal sublayers indicate temporal scalable layers of a temporal scalable bitstream.

3. The method of claim 1 , further comprising:

identifying a maximum number of allowed layers in the video sequence; and

encoding the video sequence based on the identified maximum number of allowed layers.

4. The method of claim 1 , wherein the maximum number of temporal sublayers that is allowed in the video sequence is set in a field of a VPS raw byte sequence payload (RBSP).

5. The method of claim 4 , wherein the VPS RBSP includes a VPS field comprising vps_max_layers_minus1.

6. The method of claim 1 , wherein the maximum number of temporal sublayers that is allowed in the video sequence is set in a field of an SPS raw byte sequence payload (RBSP).

7. The method of claim 6 , wherein the SPS RBSP includes the SPS field comprising sps_max_sublayers_minus1.

8. A device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

identifying code configured to cause the at least one processor to identify a maximum number of temporal sublayers that is allowed in a video sequence referring to a parameter set in a video parameter set (VPS) field and a sequence parameter set (SPS) field respectively, wherein when a SPS identifier field, which an identifier for an SPS for reference by other syntax elements is greater than 0, and when a first syntax element of a VPS indicates that a number of temporal sublayers is the same for all layers in each video sequence referring to the VPS, a value of the VPS field is equal to a value of the SPS field; and

encoding code that is configured to cause the at least one processor to encode the coded video sequence based on the identified maximum number of temporal sublayers that is allowed in the video sequence referring to the parameter set.

9. The device of claim 8 , wherein the temporal sublayers indicate temporal scalable layers of a temporal scalable bitstream.

10. The device of claim 8 , wherein the identifying code is further configured to cause the at least one processor to identify a maximum number of allowed layers in the video sequence, and wherein the encoding code is further configured to cause the at least one processor to encode the coded video sequence based on the identified maximum number of allowed layers.

11. The device of claim 8 , wherein the maximum number of temporal sublayers that is allowed in the video sequence is set in a field of a VPS raw byte sequence payload (RBSP).

12. The device of claim 11 , wherein the VPS RBSP includes a VPS field comprising vps_max_layers_minus1.

13. The device of claim 8 , wherein the maximum number of temporal sublayers that is allowed in the video sequence is set in a field of an SPS raw byte sequence payload (RBSP).

14. The device of claim 13 , wherein the SPS RBSP includes the SPS field comprising sps_max_sublayers_minus1.

15. A method of processing visual media data, the method comprising:

performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule,

wherein the conversion is based on identifying a maximum number of temporal sublayers that is allowed in a video sequence referring to a parameter set in a video parameter set (VPS) field and a sequence parameter set (SPS) field respectively, wherein when a SPS identifier field, which an identifier for an SPS for reference by other syntax elements is greater than 0, and when a first syntax element of a VPS indicates that a number of temporal sublayers is the same for all layers in each coded video sequence referring to the VPS, a value of the VPS field is equal to a value of the SPS field.

16. The method of claim 15 , wherein the temporal sublayers indicate temporal scalable layers of a temporal scalable bitstream.

17. The method of claim 15 , wherein the conversion further comprises identifying a maximum number of allowed layers in the coded video sequence.

18. The method of claim 15 , wherein the maximum number of temporal sublayers that is allowed in the video sequence is set in a field of a VPS raw byte sequence payload (RBSP).

19. The method of claim 18 wherein the VPS RBSP includes a VPS field comprising vps_max_layers_minus1.

20. The method of claim 15 , wherein the maximum number of temporal sublayers that is allowed in the video sequence is set in a field of an SPS raw byte sequence payload (RBSP).

Continuity (4)
Continuation 17957651 · Sep 30, 2022
Continuation 16994004 · Aug 14, 2020
Provisional Application 63000936 · Mar 27, 2020
Related Publication 20240089481A1 · Mar 14, 2024
References Cited (17)
US 20130182755A1 · Chen et al. · 2013 [cited by applicant]
US 20160323592A1 · Choi et al. · 2016 [cited by applicant]
US 20160366428A1 · Deshpande · 2016 [cited by examiner]
US 20170026655A1 · Deshpande · 2017 [cited by applicant]
US 20170171563A1 · Deshpande · 2017 [cited by examiner]
US 20190014314A1 · Haque et al. · 2019 [cited by applicant]
US 20190158880A1 · Deshpande · 2019 [cited by applicant]
US 20210076073A1 · Deshpande et al. · 2021 [cited by applicant]
US 20210360289A1 · He · 2021 [cited by examiner]
US 20220232259A1 · Wang · 2022 [cited by examiner]
CN 114846457A · 2022 [cited by applicant]
CN 114902674A · 2022 [cited by applicant]
CN 115349260A · 2022 [cited by applicant]
Xuewei Meng, et al., “CE5-related: on CC-ALF slice and picture header syntax”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q0326-v1, Jan. 7-17, 2020, pp. 1-4. [cited by applicant]
International Search Report from the International Searching Authority in Application No. PCT/US20/53718 dated Jan. 6, 2021. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 20/WG 11 17th Meeting: Brussels, BE, Jan. 7-17, 2020. [cited by applicant]
Written Opinion from the International Searching Authority in Application No. PCT/US20/53718 dated Jan. 6, 2021. [cited by applicant]