IP Library Granted Patent US 11,765,371
Granted Patent B2
US 11,765,371 · App. 17/733,311 · Granted Sep 19, 2023

Method for adaptation parameter set reference and constraints in coded video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Shan Liu (San Jose, CA); Stephan Wenger (Hillsborough, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04N19/105H04N19/174H04N19/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,765,371
App. No.
17/733,311
Granted
Sep 19, 2023
Kind
B2
Abstract

A method of decoding an encoded video bitstream using at least one processor, including: obtaining from the encoded video bitstream a coded video sequence including a picture unit corresponding to a coded picture; obtaining a picture header (PH) network abstraction layer (NAL) unit included in the picture unit; obtaining at least one video coding layer (VCL) network abstraction layer (NAL) unit included in the picture unit; decoding the coded picture based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the APS NAL unit is available to the at least one processor before the at least one VCL NAL unit.

Claims (48)

1. A method of generating an encoded video bitstream using at least one processor, the method comprising:

obtaining video data corresponding to a picture unit;

generating a picture header (PH) network abstraction layer (NAL) unit corresponding to the picture unit;

generating at least one video coding layer (VCL) NAL unit corresponding to the picture unit;

generating a coded video sequence (CVS) based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit; and

outputting the encoded video bitstream including the coded video sequence,

wherein the APS NAL unit is available to a decoder of the encoded video bitstream before the at least one VCL NAL unit,

wherein the APS NAL unit is available to the decoder of the encoded video bitstream prior to being referenced by one or more picture headers (PHs) or one or more coded slice NAL units included in the CVS, and

wherein the APS NAL unit is included in at least one prediction unit (PU) having a nuh_layer_id value that is equal to a lowest nuh_layer_id value of the more or more coded slice NAL units that refer to the APS NAL unit.

2. The method of claim 1 , wherein a temporal identifier of the at least one VCL NAL unit is greater than or equal to a temporal identifier of the APS NAL unit.

3. The method of claim 1 , wherein a picture order count (POC) of the at least one VCL NAL unit is greater than or equal to a POC of the APS NAL unit.

4. The method of claim 1 , wherein a layer identifier of the PH NAL unit and a layer identifier of the at least one VCL NAL unit are greater than or equal to a layer identifier of the APS NAL unit.

5. The method of claim 1 , wherein the PH NAL unit, the at least one VCL NAL unit, and the APS NAL unit are included in a single access unit.

6. The method of claim 1 , wherein the CVS further comprises a step-wise temporal sublayer access (STSA) NAL unit corresponding to an STSA picture, and

wherein the STSA NAL unit is not located between the APS NAL unit and the at least one VCL NAL unit.

7. The method of claim 6 , wherein the PH NAL unit, the at least one VCL NAL unit, the APS NAL unit, and the STSA NAL unit are included in a single access unit.

8. The method of claim 6 , wherein a temporal identifier of the APS NAL unit is greater than or equal to a temporal identifier of the STSA NAL unit.

9. The method of claim 6 , wherein a picture order count (POC) of the APS NAL unit is greater than or equal to a POC of the STSA NAL unit.

10. A device for generating an encoded video bitstream, the device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

first obtaining code configured to cause the at least one processor to obtain video data corresponding to a picture unit;

first generating code configured to cause the at least one processor to generate a picture header (PH) network abstraction layer (NAL) unit included in the picture unit;

second generating code configured to cause the at least one processor to generate at least one video coding layer (VCL) NAL unit corresponding to the picture unit;

third generating code configured to cause the at least one processor to generate a coded video sequence (CVS) based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit; and

output code configured to cause the at least one processor to output the encoded video bitstream including the coded video sequence,

wherein the APS NAL unit is available to a decoder of the encoded video bitstream before the at least one VCL NAL unit,

wherein the APS NAL unit is available to the decoder of the encoded video bitstream prior to being referenced by one or more picture headers (PHs) or one or more coded slice NAL units included in the CVS, and

wherein the APS NAL unit is included in at least one prediction unit (PU) having a nuh_layer_id value that is equal to a lowest nuh_layer_id value of the more or more coded slice NAL units that refer to the APS NAL unit.

11. The device of claim 10 , wherein a temporal identifier of the at least one VCL NAL unit is greater than or equal to a temporal identifier of the APS NAL unit.

12. The device of claim 10 , wherein a picture order count (POC) of the at least one VCL NAL unit is greater than or equal to a POC of the APS NAL unit.

13. The device of claim 10 , wherein a layer identifier of the PH NAL unit and a layer identifier of the at least one VCL NAL unit are greater than or equal to a layer identifier of the APS NAL unit.

14. The device of claim 10 , wherein the PH NAL unit, the at least one VCL NAL unit, and the APS NAL unit are included in a single access unit.

15. The device of claim 10 , wherein the coded video sequence further comprises a step-wise temporal sublayer access (STSA) NAL unit corresponding to an STSA picture, and

wherein the STSA NAL unit is not located between the APS NAL unit and the at least one VCL NAL unit.

16. The device of claim 15 , wherein the PH NAL unit, the at least one VCL NAL unit, the APS NAL unit, and the STSA NAL unit are included in a single access unit.

17. The device of claim 15 , wherein a temporal identifier of the APS NAL unit is greater than or equal to a temporal identifier of the STSA NAL unit.

18. The device of claim 15 , wherein a picture order count (POC) of the APS NAL unit is greater than or equal to a POC of the STSA NAL unit.

19. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for generating an encoded video bitstream, cause the one or more processors to:

obtain video data corresponding to a picture unit;

generate a picture header (PH) network abstraction layer (NAL) unit corresponding to the picture unit;

generate at least one video coding layer (VCL) NAL unit corresponding to the picture unit;

generate a coded video sequence (CVS) based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit; and

output the encoded video bitstream including the coded video sequence,

wherein the APS NAL unit is available to a decoder of the encoded video bitstream before the at least one VCL NAL unit,

wherein the APS NAL unit is available to the decoder of the encoded video bitstream prior to being referenced by one or more picture headers (PHs) or one or more coded slice NAL units included in the CVS, and

wherein the APS NAL unit is included in at least one prediction unit (PU) having a nuh_layer_id value that is equal to a lowest nuh_layer_id value of the more or more coded slice NAL units that refer to the APS NAL unit.

20. The non-transitory computer-readable medium of claim 19 , wherein a temporal identifier of the at least one VCL NAL unit is greater than or equal to a temporal identifier of the APS NAL unit.

Continuity (3)
Continuation 17038541 · Sep 30, 2020
Provisional Application 62954096 · Dec 27, 2019
Related Publication 20220256182A1 · Aug 11, 2022
Cited By (2)
US 12,262,037 US 12,634,459