Pictures with mixed NAL unit types
A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a plurality of sub-pictures associated with a picture and a flag. The sub-pictures are contained in a plurality of video coding layer (VCL) network abstraction layer (NAL) units. A NAL unit type value is the same for all VCL NAL units associated with the picture when the flag is set to a first value. When the flag is set to a second value, a first NAL unit type value for VCL NAL units containing one or more of the sub-pictures of the picture is different than a second NAL unit type value for VCL NAL units containing one or more of the sub-pictures of the picture. The sub-pictures are decoded based on the NAL unit type values. The sub-pictures are forwarded for display as part of a decoded video sequence.
1. A method implemented in a decoder, the method comprising:
receiving a bitstream comprising a picture and a flag, wherein the picture is associated with a plurality of video coding layer (VCL) network abstraction layer (NAL) units, and wherein the flag is a mixed_nalu_types_in_pic_flag;
determining a NAL unit type value is the same for all of the VCL NAL units of the picture when the flag is set to a first value;
determining the VCL NAL units of the picture have a plurality of different NAL unit type values when the flag is set to a second value; and
decoding the picture based on the flag.
2. The method of claim 1 , wherein the bitstream includes a picture parameter set (PPS) including the flag.
3. The method of claim 1 , wherein the different NAL unit type values indicate the picture contains an intra-random access point (IRAP) VCL NAL unit and a non-IRAP VCL NAL unit.
4. The method of claim 1 , wherein the different NAL unit type values include a first NAL unit type value equal to Instantaneous Decoding Refresh (IDR) with random access decodable leading picture (IDR_W_RADL), IDR with no leading pictures (IDR_N_LP), or clean random access (CRA) NAL unit type (CRA_NUT).
5. The method of claim 4 , wherein the different NAL unit type values include a second NAL unit type value equal to trailing picture NAL unit type (TRAIL_NUT).
6. The method of claim 2 , wherein the mixed_nalu_types_in_pic_flag is equal to one when specifying that each picture referring to the PPS has more than one VCL NAL unit and the VCL NAL units do not have the same value of NAL unit type (nal_unit_type), and wherein mixed_nalu_types_in_pic_flag is equal to zero when specifying that each picture referring to the PPS has one or more VCL NAL units and the VCL NAL units have the same value of nal_unit_type.
7. A method implemented in an encoder, the method comprising:
determining whether a picture contains a plurality of sub-pictures of different types;
encoding the sub-pictures of the picture into a plurality of video coding layer (VCL) network abstraction layer (NAL) units in a bitstream;
encoding into the bitstream a flag set to a first value when a first NAL unit type value is the same for all VCL NAL units associated with the picture and set to a second value when the first NAL unit type value for VCL NAL units containing one or more of the sub-pictures of the picture is different than a second NAL unit type value for VCL NAL units containing one or more of the sub-pictures of the picture, wherein the flag is a mixed_nalu_types_in_pic_flag; and
storing the bitstream for communication toward a decoder.
8. The method of claim 7 , further comprising encoding a picture parameter set (PPS) into the bitstream, wherein the flag is encoded into the PPS.
9. The method of claim 7 , wherein the first NAL unit type value indicates the picture contains an intra-random access point (IRAP) sub-picture, and wherein the second NAL unit type value indicates the picture contains a non-IRAP sub-picture.
10. The method of claim 7 , wherein the first NAL unit type value is equal to Instantaneous Decoding Refresh (IDR) with random access decodable leading picture (IDR_W_RADL), IDR with no leading pictures (IDR_N_LP), or clean random access (CRA) NAL unit type (CRA_NUT).
11. The method of claim 7 , wherein the second NAL unit type value is equal to trailing picture NAL unit type (TRAIL_NUT), random access decodable leading picture NAL unit type (RADL_NUT), or random access skipped leading picture (RASL) NAL unit type (RASL_NUT).
12. The method of claim 8 , wherein the mixed_nalu_types_in_pic_flag is equal to one when specifying that the picture referring to the PPS has more than one of the VCL NAL units and the VCL NAL units do not have the same value of NAL unit type (nal_unit_type), and wherein mixed_nalu_types_in_pic_flag is equal to zero when specifying the picture referring to the PPS has one or more of the VCL NAL units and the VCL NAL units have the same value of nal_unit_type.
13. A decoder comprising:
a receiver configured to receive a bitstream comprising a picture and a flag, wherein the picture is associated with a plurality of video coding layer (VCL) network abstraction layer (NAL) units, wherein the flag is a mixed_nalu_types_in_pic_flag; and
a processor coupled to the receiver and configured to:
determine a NAL unit type value is the same for all of the VCL NAL units of the picture when the flag is set to a first value;
determine the VCL NAL units of the picture have a plurality of different NAL unit type values when the flag is set to a second value; and
decode the picture based on the flag.
14. The decoder of claim 13 , wherein the bitstream includes a picture parameter set (PPS) including the flag.
15. The decoder of claim 13 , wherein the different NAL unit type values include a first NAL unit type value equal to Instantaneous Decoding Refresh (IDR) with random access decodable leading picture (IDR_W_RADL), IDR with no leading pictures (IDR_N_LP), or clean random access (CRA) NAL unit type (CRA_NUT).
16. The decoder of claim 15 , wherein the different NAL unit type values include a second NAL unit type value equal to trailing picture NAL unit type (TRAIL NUT).
17. The decoder of claim 14 , wherein the mixed_nalu_types_in_pic_flag is equal to one when specifying that each picture referring to the PPS has more than one VCL NAL unit and the VCL NAL units do not have the same value of NAL unit type (nal_unit_type), and wherein mixed_nalu_types_in_pic_flag is equal to zero when specifying that each picture referring to the PPS has one or more VCL NAL units and the VCL NAL units have the same value of nal_unit_type.
18. A method implemented in a decoder, the method comprising:
receiving, by a receiver of the decoder, a bitstream comprising a plurality of sub-pictures associated with a picture and a flag, wherein the sub-pictures are contained in a plurality of video coding layer (VCL) network abstraction layer (NAL) units, wherein the flag is a mixed_nalu_types_in_pic_flag;
determining, by a processor of the decoder, that a first NAL unit type value that is the same for all of the VCL NAL units associated with the picture when the flag is set to a first value;
determining, by the processor, that a first NAL unit type value for a first set of the VCL NAL units containing one or more of the sub-pictures of the picture is different than a second NAL unit type value for a second set of the VCL NAL units containing one or more of the sub-pictures of the picture when the flag is set to a second value; and
decoding, by the processor, one or more of the sub-pictures based on the first NAL unit type value or the second NAL unit type value.
19. The method of claim 18 , wherein the bitstream includes a picture parameter set (PPS) including the flag.
20. The method of claim 18 , wherein the first NAL unit type value is equal to
Instantaneous Decoding Refresh (IDR) with random access decodable leading picture (IDR_W_RADL), IDR with no leading pictures (IDR_N_LP), or clean random access (CRA) NAL unit type (CRA_NUT).
21. The method of claim 18 , wherein the different NAL unit type values include a second NAL unit type value equal to trailing picture NAL unit type (TRAIL_NUT).
22. The method of claim 19 , wherein the mixed_nalu_types_in_pic_flag is equal to one when specifying that each picture referring to the PPS has more than one VCL NAL unit and the VCL NAL units do not have the same value of NAL unit type (nal_unit_type), and wherein mixed_nalu_types_in_pic_flag is equal to zero when specifying that each picture referring to the PPS has one or more VCL NAL units and the VCL NAL units have the same value of nal_unit_type.