IP Library Granted Patent US 12,262,037
Granted Patent B2
US 12,262,037 · App. 18/216,192 · Granted Mar 25, 2025

Method for adaptation parameter set reference and constraints in coded video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Shan Liu (San Jose, CA); Stephan Wenger (Hillsborough, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04N19/105H04N19/174H04N19/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,037
App. No.
18/216,192
Granted
Mar 25, 2025
Kind
B2
Abstract

A method of decoding an encoded video bitstream using at least one processor, including: obtaining from the encoded video bitstream a coded video sequence including a picture unit corresponding to a coded picture; obtaining a picture header (PH) network abstraction layer (NAL) unit included in the picture unit; obtaining at least one video coding layer (VCL) network abstraction layer (NAL) unit included in the picture unit; decoding the coded picture based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the APS NAL unit is available to the at least one processor before the at least one VCL NAL unit.

Claims (39)

1. A method of generating an encoded video bitstream using at least one processor, the method comprising:

obtaining video data corresponding to a picture unit;

generating a picture header (PH) network abstraction layer (NAL) unit corresponding to the picture unit;

generating at least one video coding layer (VCL) NAL unit corresponding to the picture unit;

generating a coded video sequence (CVS) based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit; and

outputting the encoded video bitstream including the coded video sequence,

wherein the APS NAL unit is available to the at least one processor before at least one video coding layer (VCL) NAL unit included in the picture unit, and

wherein the APS NAL unit is available to a decoder of the encoded video bitstream prior to being referenced by one or more picture headers (PHs) or one or more coded slice NAL units included in the CVS.

2. The method of claim 1 , wherein a temporal identifier of the at least one VCL NAL unit is greater than or equal to a temporal identifier of the APS NAL unit.

3. The method of claim 1 , wherein a picture order count (POC) of the at least one VCL NAL unit is greater than or equal to a POC of the APS NAL unit.

4. The method of claim 1 , wherein a layer identifier of the PH NAL unit and a layer identifier of the at least one VCL NAL unit are greater than or equal to a layer identifier of the APS NAL unit.

5. The method of claim 1 , wherein the CVS further comprises a step-wise temporal sublayer access (STSA) NAL unit corresponding to an STSA picture, and

wherein the STSA NAL unit is not located between the APS NAL unit and the at least one VCL NAL unit.

6. The method of claim 5 , wherein the PH NAL unit, the at least one VCL NAL unit, the APS NAL unit, and the STSA NAL unit are included in a single access unit.

7. The method of claim 5 , wherein a temporal identifier of the APS NAL unit is greater than or equal to a temporal identifier of the STSA NAL unit.

8. The method of claim 5 , wherein a picture order count (POC) of the APS NAL unit is greater than or equal to a POC of the STSA NAL unit.

9. A method for video decoding using at least one processor, the method comprising:

obtaining video data corresponding to a picture unit;

obtaining a picture header (PH) network abstraction layer (NAL) unit corresponding to the picture unit;

obtaining at least one video coding layer (VCL) NAL unit corresponding to the picture unit;

determining a coded video sequence (CVS) based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit; and

reconstructing the coded video sequence,

wherein the APS NAL unit is available to the at least one processor before at least one video coding layer (VCL) NAL unit included in the picture unit, and

wherein the APS NAL unit is available to a decoder of the encoded video bitstream prior to being referenced by one or more picture headers (PHs) or one or more coded slice NAL units included in the CVS.

10. The method of claim 9 , wherein a temporal identifier of the at least one VCL NAL unit is greater than or equal to a temporal identifier of the APS NAL unit.

11. The method of claim 9 , wherein a picture order count (POC) of the at least one VCL NAL unit is greater than or equal to a POC of the APS NAL unit.

12. The method of claim 9 , wherein a layer identifier of the PH NAL unit and a layer identifier of the at least one VCL NAL unit are greater than or equal to a layer identifier of the APS NAL unit.

13. The method of claim 9 , wherein the CVS further comprises a step-wise temporal sublayer access (STSA) NAL unit corresponding to an STSA picture, and

wherein the STSA NAL unit is not located between the APS NAL unit and the at least one VCL NAL unit.

14. The method of claim 13 , wherein the PH NAL unit, the at least one VCL NAL unit, the APS NAL unit, and the STSA NAL unit are included in a single access unit.

15. The method of claim 13 , wherein a temporal identifier of the APS NAL unit is greater than or equal to a temporal identifier of the STSA NAL unit.

16. The method of claim 13 , wherein a picture order count (POC) of the APS NAL unit is greater than or equal to a POC of the STSA NAL unit.

17. A method of processing a video bitstream using at least one processor, the method comprising:

performing a conversion between video data corresponding to a picture unit and the video bitstream,

wherein the video bitstream includes a picture header (PH) network abstraction layer (NAL) unit corresponding to the picture unit,

wherein the video bitstream includes at least one video coding layer (VCL) NAL unit corresponding to the picture unit,

wherein the video bitstream includes a coded video sequence (CVS) based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit, and

wherein the APS NAL unit is available to the at least one processor before at least one video coding layer (VCL) NAL unit included in the picture unit, and

wherein the APS NAL unit is available to a decoder of the encoded video bitstream prior to being referenced by one or more picture headers (PHs) or one or more coded slice NAL units included in the CVS.

Continuity (4)
Continuation 17733311 · Apr 29, 2022
Continuation 17038541 · Sep 30, 2020
Provisional Application 62954096 · Dec 27, 2019
Related Publication 20240048743A1 · Feb 8, 2024
References Cited (24)
US 9451252B2 · Chen · 2016 [cited by examiner]
US 10313685B2 · Lee · 2019 [cited by examiner]
US 10880565B2 · Hendry · 2020 [cited by examiner]
US 11765371B2 · Choi et al. · 2023 [cited by applicant]
US 20140218473A1 · Hannuksela · 2014 [cited by examiner]
US 20150341643A1 · Xu et al. · 2015 [cited by applicant]
US 20150373361A1 · Wang · 2015 [cited by examiner]
US 20170026641A1 · Lai · 2017 [cited by examiner]
US 20170324981A1 · Deshpande · 2017 [cited by examiner]
US 20170339421A1 · Wang · 2017 [cited by examiner]
US 20190182504A1 · Lainema · 2019 [cited by examiner]
JP 7297919B2 · 2023 [cited by applicant]
Vietnamese Office Action dated Sep. 11, 2023 in Vietnamese Application No. 60296/SHTT-SC. [cited by applicant]
Extended European Search Report issued Nov. 28, 2023 in European Application No. 20905106.9. [cited by applicant]
Karsten Suehring, et al., “AHG17: Low-delay ALF syntax”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P0452-v2, Oct. 1-11, 2019, 16th Meeting, Geneva, CH (13 pages total). [cited by applicant]
Vadim Seregin et al., “AHG17: APS for low latency ALF”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P0588, Oct. 1-11, 2019, 16th Meeting, Geneva, CH (2 pages total). [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P2001, Oct. 1-11, 2019, 16th Meeting, Geneva, CH (489 pages total). [cited by applicant]
Written Opinion of the International Searching Authority dated Jan. 26, 2021 in International Application No. PCT/US20/54244. [cited by applicant]
Office Action dated Oct. 3, 2022 issued by the Japanese Patent Office in Japanese Application No. 2021-556291. [cited by applicant]
International Search Report dated Jan. 26, 2021 in International Application No. PCT/US2054244. [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 3, 2019-Jul. 12, 2019, 455pages. [cited by applicant]
Hendry et al., “AHG17: On access unit delimiter and picture header”, WG 05 MPEG Joint Video Coding Team(s) with ITU-T SG 16, 2019, JVET-P0120 for Geneva meeting (version 1—date Sep. 25, 2019 05:01:37) (15 pages total). [cited by applicant]
Office Action issued Mar. 8, 2024 in Korean Application No. 10-2021-7036344. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P2001-vE, Oct. 1-11, 2019, 16th Meeting, Geneva, CH (489 pages total). [cited by applicant]
Cited By (1)
US 12,506,900