Granted Patent B2

US 12,309,429 · App. 17/949,074 · Granted May 20, 2025

Inventor: Ye-kui Wang (San Diego, CA)

Assignee: BYTEDANCE INC.

H04N19/70H04N19/103H04N19/105H04N19/136H04N19/157H04N19/172H04N19/174H04N19/176H04N19/188H04N19/46H04N19/88

Abstract

Claims (57)

1. A method of processing video data, comprising:

performing a conversion between a video comprising a picture comprising two neighboring subpictures and a bitstream of the video,

wherein a first syntax element is related to one or more video coding layer (VCL) network abstraction layer (NAL) units in each picture referring to a picture parameter set,

wherein a second syntax element indicates whether a corresponding subpicture in a coded layer video sequence is treated as a picture,

wherein the bitstream conforms to a format rule that specifies that when the first syntax element for the picture is equal to 1, values of the second syntax elements for the two neighboring subpictures with different types of NAL units are equal to 1,

wherein the two neighboring subpictures comprise at least one of P slices, B slices, or I slices;

wherein the first syntax element equal to 1 indicates that each picture referring to a picture parameter set contains more than one VCL NAL unit and the more than one VCL NAL unit of each picture referring to the picture parameter set do not have a same NAL unit type, and

wherein the second syntax element equal to 1 indicates that a corresponding subpicture in a coded layer video sequence is treated as a picture; and

wherein the format rule further specifies that a trailing subpicture that is associated with an intra random access point subpicture or a gradual decoding refresh subpicture follows the intra random access point subpicture or the gradual decoding refresh subpicture in a decoding order.

2. The method of claim 1 , wherein when the two neighboring subpictures have second syntax elements with a same value, the two neighboring subpictures have a same type of NAL unit.

3. The method of claim 1 , wherein the first syntax element is included in the bitstream, and

wherein the first syntax element equal to 0 indicates that each picture referring to the picture parameter set contains one or more VCL NAL units and the one or more VCL NAL units of each picture referring to the picture parameter set have a same NAL unit type.

4. The method of claim 3 , wherein when the first syntax element is equal to 1, values of the second syntax elements for all the subpictures that are in the picture and contain at least one of P slices, B slices or I slices are equal to 1.

5. The method of claim 3 , wherein when the first syntax element is equal to 0, a picture is referred to as having the same NAL unit type as the coded slice NAL units of the picture.

6. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

7. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

8. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a video comprising a picture comprising two neighboring subpictures and a bitstream of the video,

wherein a first syntax element is related to one or more video coding layer (VCL) network abstraction layer (NAL) units in each picture referring to a picture parameter set,

wherein a second syntax element indicates whether a corresponding subpicture in a coded layer video sequence is treated as a picture,

wherein the bitstream conforms to a format rule that specifies that when the first syntax element for the picture is equal to 1, values of the second syntax elements for the two neighboring subpictures with different types of NAL units are equal to 1,

wherein the two neighboring subpictures comprise at least one of P slices, B slices, or I slices;

wherein the first syntax element equal to 1 indicates that each picture referring to a picture parameter set contains more than one VCL NAL unit and the more than one VCL NAL unit of each picture referring to the picture parameter set do not have a same NAL unit type, and

wherein the second syntax element equal to 1 indicates that a corresponding subpicture in a coded layer video sequence is treated as a picture; and

wherein the format rule further specifies that a trailing subpicture that is associated with an intra random access point subpicture or a gradual decoding refresh subpicture follows the intra random access point subpicture or the gradual decoding refresh subpicture in a decoding order.

9. The apparatus of claim 8 , wherein when the two neighboring subpictures have second syntax elements with a same value, the two neighboring subpictures have a same type of NAL unit.

10. The apparatus of claim 8 , wherein the first syntax element is included in the bitstream, and

wherein the first syntax element equal to 0 indicates that each picture referring to the picture parameter set contains one or more VCL NAL units and the one or more VCL NAL units of each picture referring to the picture parameter set have a same NAL unit type.

11. The apparatus of claim 10 , wherein when the first syntax element is equal to 1, values of the second syntax elements for all the subpictures that are in the picture and contain at least one of P slices, B slices or I slices are equal to 1.

12. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video comprising a picture comprising two neighboring subpictures and a bitstream of the video,

wherein a first syntax element is related to one or more video coding layer (VCL) network abstraction layer (NAL) units in each picture referring to a picture parameter set,

wherein a second syntax element indicates whether a corresponding subpicture in a coded layer video sequence is treated as a picture,

wherein the bitstream conforms to a format rule that specifies that when the first syntax element for the picture is equal to 1, values of the second syntax elements for the two neighboring subpictures with different types of NAL units are equal to 1,

wherein the two neighboring subpictures comprise at least one of P slices, B slices, or I slices;

wherein the first syntax element equal to 1 indicates that each picture referring to a picture parameter set contains more than one VCL NAL unit and the more than one VCL NAL unit of each picture referring to the picture parameter set do not have a same NAL unit type, and

wherein the second syntax element equal to 1 indicates that a corresponding subpicture in a coded layer video sequence is treated as a picture; and

wherein the format rule further specifies that a trailing subpicture that is associated with an intra random access point subpicture or a gradual decoding refresh subpicture follows the intra random access point subpicture or the gradual decoding refresh subpicture in a decoding order.

13. The non-transitory computer-readable storage medium of claim 12 , wherein when the two neighboring subpictures have second syntax elements with a same value, the two neighboring subpictures have a same type of NAL unit.

14. The non-transitory computer-readable storage medium of claim 12 ,

wherein the first syntax element is included in the bitstream, and

wherein the first syntax element equal to 0 indicates that each picture referring to the picture parameter set contains one or more VCL NAL units and the one or more VCL NAL units of each picture referring to the picture parameter set have a same NAL unit type.

15. The non-transitory computer-readable storage medium of claim 14 , wherein when the first syntax element is equal to 1, values of the second syntax elements for all the subpictures that are in the picture and contain at least one of P slices, B slices or I slices are equal to 1.

16. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream of the video, the video comprising a picture comprising two neighboring subpictures,

wherein a first syntax element is related to one or more video coding layer (VCL) network abstraction layer (NAL) units in each picture referring to a picture parameter set,

wherein a second syntax element indicates whether a corresponding subpicture in a coded layer video sequence is treated as a picture,

wherein the bitstream conforms to a format rule that specifies that when the first syntax element for the picture is equal to 1, values of the second syntax elements for the two neighboring subpictures with different types of NAL units are equal to 1,

wherein the two neighboring subpictures comprise at least one of P slices, B slices, or I slices;

wherein the first syntax element equal to 1 indicates that each picture referring to a picture parameter set contains more than one VCL NAL unit and the more than one VCL NAL unit of each picture referring to the picture parameter set do not have a same NAL unit type, and

wherein the second syntax element equal to 1 indicates that a corresponding subpicture in a coded layer video sequence is treated as a picture; and

wherein the format rule further specifies that a trailing subpicture that is associated with an intra random access point subpicture or a gradual decoding refresh subpicture follows the intra random access point subpicture or the gradual decoding refresh subpicture in a decoding order.

17. The non-transitory computer-readable recording medium of claim 16 , wherein when the two neighboring subpictures have second syntax elements with a same value, the two neighboring subpictures have a same type of NAL unit.

18. The non-transitory computer-readable recording medium of claim 16 , wherein the first syntax element is included in the bitstream, and

wherein the first syntax element equal to 0 indicates that each picture referring to the picture parameter set contains one or more VCL NAL units and the one or more VCL NAL units of each picture referring to the picture parameter set have a same NAL unit type.

19. The non-transitory computer-readable recording medium of claim 18 , wherein when the first syntax element is equal to 1, values of the second syntax elements for all the subpictures that are in the picture and contain at least one of P slices, B slices or I slices are equal to 1.

20. The non-transitory computer-readable recording medium of claim 18 , wherein when the first syntax element is equal to 0, a picture is referred to as having the same NAL unit type as the coded slice NAL units of the picture.

Assignments (1)

Continuity (3)

References Cited (110)