Granted Patent B2

US 12,219,162 · App. 18/196,073 · Granted Feb 4, 2025

Inventors: Byeongdoo Choi (Palo Alto, CA); Shan Liu (Palo Alto, CA); Stephan Wenger (Palo Alto, CA)

Assignee: TENCENT AMERICA LLC

H04N19/44H04N19/172H04N19/188H04N19/46

Abstract

Claims (54)

1. A method of encoding a video bitstream using at least one processor, the method comprising:

determining whether a video coding layer (VCL) network abstraction layer (NAL) unit is to be a first VCL NAL unit of a picture unit (PU) containing the VCL NAL unit;

based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, determining whether the VCL NAL unit is to be a first VCL NAL unit of an access unit (AU) containing the PU; and

based on determining that the VCL NAL unit is to be the first VCL NAL unit of the AU, encoding the AU based on the VCL NAL unit,

wherein based on a value of all_pic_coding_info_present_in_ph_flag indicating that all picture coding information is to be present in a picture header, a plurality of flags corresponding to the picture coding information are determined to not be signaled in a picture parameter set corresponding to the picture header, and

wherein the plurality of flags comprise an rpl_info_in_ph_flag, an_wp_info_in_ph_flag, and at least one of a dbf_info_in_ph_flag, an sao_info_in_ph_flag, an alf_info_in_ph_flag, and a qp_delta_info_in_ph_flag.

2. The method of claim 1 , the method further comprising determining, based on determining that the VCL NAL unit is to be the first VCL NAL unit of the AU, that one or more conditions of a plurality of conditions are true, the plurality of conditions comprising:

(1) a first value of nuh_layer_id of the VCL NAL unit is to be less than or equal to a second value of nuh_layer_id of a previous picture in decoding order,

(2) a first value of ph_pic_order_cnt_lsb of the VCL NAL unit is to differ from a second value of ph_pic_order_cnt_lsb of the previous picture in decoding order, and

(3) a first picture order count value derived for the VCL NAL unit is to differ from a second picture order count value of the previous picture in decoding order; and

based on the determining that the one or more conditions are true, encoding the AU based on the VCL NAL unit.

3. The method of claim 1 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the PU is based on at least one of:

determining that the VCL NAL unit is to be a first VCL NAL unit following a picture header NAL unit, and

determining that a flag in the VCL NAL unit is to be set to indicate that a picture header is included in a slice header included in the VCL NAL unit.

4. The method of claim 1 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a layer identifier of the VCL NAL unit is to be less than another layer identifier.

5. The method of claim 1 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a picture order count of the VCL NAL unit is to be different from another picture order count.

6. The method of claim 1 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a least significant bit of a picture order count of the VCL NAL unit is to be different from another least significant bit of another picture order count.

7. A device for encoding a video bitstream, the device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

first determining code configured to cause the at least one processor to determine whether a video coding layer (VCL) network abstraction layer (NAL) unit is to be a first VCL NAL unit of a picture unit (PU) containing the VCL NAL unit;

second determining code configured to cause the at least one processor to, based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, determine whether the VCL NAL unit is to be a first VCL NAL unit of an access unit (AU) containing the PU; and

encoding code configured to cause the at least one processor to, based on determining that the VCL NAL unit is to be the first VCL NAL unit of the AU, encode the AU based on the VCL NAL unit,

wherein based on a value of all_pic_coding_info_present_in_ph_flag indicating that all picture coding information is to be present in a picture header, a plurality of flags corresponding to the picture coding information are determined to not be signaled in a picture parameter set corresponding to the picture header, and

wherein the plurality of flags comprise an rpl_info_in_ph_flag, an_wp_info_in_ph_flag, and at least one of a dbf_info_in_ph_flag, an sao_info_in_ph_flag, an alf_info_in_ph_flag, and a qp_delta_info_in_ph_flag.

8. The device of claim 7 , wherein the program code further includes:

third determining code configured to cause the at least one processor to, based on determining that the VCL NAL unit is to be the first VCL NAL unit of the AU, determine that one or more conditions of a plurality of conditions are true, the plurality of conditions comprising:

(1) a first value of nuh_layer_id of the VCL NAL unit is to be less than or equal to a second value of nuh_layer_id of a previous picture in decoding order,

(2) a first value of ph_pic_order_cnt_lsb of the VCL NAL unit is to differ from a second value of ph_pic_order_cnt_lsb of the previous picture in decoding order, and

(3) a first picture order count value derived for the VCL NAL unit is to differ from a second picture order count value of the previous picture in decoding order; and

the decoding code is further configured to cause the at least one processor to, based on the determining that the one or more conditions are true, encode the AU based on the VCL NAL unit.

9. The device of claim 7 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the PU is based on at least one of:

determining that the VCL NAL unit is to be a first VCL NAL unit following a picture header NAL unit, and

determining that a flag in the VCL NAL unit is to be set to indicate that a picture header is included in a slice header included in the VCL NAL unit.

10. The device of claim 7 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a layer identifier of the VCL NAL unit is to be less than another layer identifier.

11. The device of claim 7 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a picture order count of the VCL NAL unit is to be different from another picture order count.

12. The device of claim 7 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a least significant bit of a picture order count of the VCL NAL unit is to be different from another least significant bit of another picture order count.

13. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for encoding a video bitstream, cause the one or more processors to:

determine whether a VCL NAL unit is to be a first VCL NAL unit of a picture unit (PU) containing the VCL NAL unit;

based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, determine whether the VCL NAL unit is to be a first VCL NAL unit of an access unit (AU) containing the PU; and

based on determining that the VCL NAL unit is to be the first VCL NAL unit of the AU, encode the AU based on the VCL NAL unit,

wherein based on a value of all_pic_coding_info_present_in_ph_flag indicating that all picture coding information is to be present in a picture header, a plurality of flags corresponding to the picture coding information are determined to not be signaled in a picture parameter set corresponding to the picture header, and

wherein the plurality of flags comprise an rpl_info_in_ph_flag, an_wp_info_in_ph_flag, and at least one of a dbf_info_in_ph_flag, an sao_info_in_ph_flag, an alf_info_in_ph_flag, and a qp_delta_info_in_ph_flag.

14. The non-transitory computer-readable medium of claim 13 , wherein the one or more instructions that, when executed by one or more processors of the device for encoding the video bitstream, further cause the one or more processors to:

based on determining that the VCL NAL unit is to be the first VCL NAL unit of the AU, determine that one or more conditions of the a plurality of conditions are true, the plurality of conditions comprising:

(1) a first value of nuh_layer_id of the VCL NAL unit is to be less than or equal to a second value of nuh_layer_id of a previous picture in decoding order,

(2) a first value of ph_pic_order_cnt_lsb of the VCL NAL unit is to differ from a second value of ph_pic_order_cnt_lsb of the previous picture in decoding order, and

(3) a first picture order count value derived for the VCL NAL unit is to differ from a second picture order count value of the previous picture in decoding order; and

based on the determining that the one or more conditions are true, encode the AU based on the VCL NAL unit.

15. The non-transitory computer-readable medium of claim 13 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the PU is based on at least one of:

determining that the VCL NAL unit is to be a first VCL NAL unit following a picture header NAL unit, and

determining that a flag in the VCL NAL unit is to be set to indicate that a picture header is included in a slice header included in the VCL NAL unit.

16. The non-transitory computer-readable medium of claim 13 , wherein determining that the VCL NAL unit is to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a layer identifier of the VCL NAL unit is to be less than another layer identifier.

17. The non-transitory computer-readable medium of claim 13 , wherein determining that the VCL NAL unit to be the first VCL NAL unit of the AU is based on determining that the VCL NAL unit is to be the first VCL NAL unit of the PU, and determining that a picture order count of the VCL NAL unit is to be different from another picture order count.

Continuity (3)

References Cited (39)