Granted Patent B2

US 12,316,879 · App. 18/517,283 · Granted May 27, 2025

Inventor: Ye-kui Wang (San Diego, CA)

Assignee: BYTEDANCE INC.

H04N19/70H04N19/136H04N19/184H04N19/188H04N19/30H04N19/433H04N19/46

Abstract

Claims (68)

1. A method of processing video data, comprising:

performing a conversion between a video and a bitstream of the video,

wherein the bitstream comprises one or more output layer sets comprising one or more video layers according to a first rule,

wherein the first rule specifies that, when a subpicture level information (SLI) supplemental enhancement information (SEI) message and a buffering period (BP) SEI message that apply to a particular output layer set are present within an access unit, the SLI SEI message precedes the BP SEI message in a decoding order,

wherein the first rule specifies that a first syntax field indicating information of sublayer representation for which an initial coded picture buffer (CPB) removal delay related syntax elements are present is omitted in response to a particular value of a second syntax field indicative of a maximum number of temporal sublayers for which an initial CPB removal delay is indicated in the buffering period SEI message,

wherein the particular value is 0, and

wherein the second syntax field with the particular value specifies that the maximum number of temporal sublayers is 1.

2. The method of claim 1 , wherein the first syntax field being equal to a first value specifies that the initial CPB removal delay related syntax elements are present for the sublayer representation in a range of 0 to the second syntax field, inclusive,

wherein the first value is 1,

wherein the first syntax field being equal to a second value specifies that the initial CPB removal delay related syntax elements are present for the sublayer representation corresponding to the second syntax field, and

wherein the second value is 0.

3. The method of claim 1 , wherein the first rule further specifies to infer a value of the first syntax field to be equal to 0 in response to the particular value of the second syntax field.

4. The method of claim 1 , wherein the bitstream comprises one or more SEI network abstraction layer (NAL) units according to a second rule,

wherein the second rule specifies that, when an SEI NAL unit contains a non-scalable-nested SEI message of a first payload type, the SEI NAL unit is disallowed to contain another SEI message of a second payload type, and

wherein the second rule further specifies that, when an SEI NAL unit contains a scalable-nested SEI message of a third payload type, the SEI NAL unit is disallowed to contain another SEI message of a fourth payload type.

5. The method of claim 4 , wherein the non-scalable-nested SEI message of the first payload type corresponds to a BP SEI message, a picture timing (PT) SEI message, a decoding unit information (DUI) SEI message, or an SLI SEI message, and

wherein the first payload type is equal to 0, 1, 130 or 203.

6. The method of claim 5 , wherein the SEI message of the second payload type does not correspond to any of a BP SEI message, a PT SEI message, a DUI SEI message, and an SLI SEI message, and

wherein the second payload type is not equal to any of 0, 1, 130 and 203.

7. The method of claim 4 , wherein the scalable-nested SEI message of the third payload type corresponds to a BP SEI message, a picture timing (PT) SEI message, a decoding unit information (DUI) SEI message, or an SLI SEI message,

wherein the third payload type is equal to 0, 1, 130 or 203,

wherein the SEI message of the fourth payload type does not correspond to any of a BP SEI message, a PT SEI message, a DUI SEI message, an SLI SEI message, and a scalable nesting SEI message,

wherein the fourth payload type is not equal to any of 0, 1, 130, 203, and 133, and

wherein the third payload type is not the same as the fourth payload type.

8. The method of claim 4 , wherein the second rule further specifies that, when an SEI NAL unit contains an SEI message with a payload type of filler payload, the SEI NAL unit is disallowed to contain any other SEI message with a payload type not equal to filler payload, and

wherein the second rule further specifies that, an SEI message that has a payload type of filler payload is disallowed to be contained in a scalable nesting SEI message.

9. The method of claim 1 , wherein the conversion is performed according to a third rule, and

wherein the third rule specifies that an SEI network abstraction layer (NAL) unit that includes a scalable-nested SEI message with a payload type of picture timing (PT) is not included when a flag included in the bitstream named general_same_pic_timing_in_all_ols_flag has a value of 1.

10. The method of claim 9 , wherein the scalable-nested SEI message with the payload type of PT carries picture timing information,

wherein the scalable-nested SEI message with the payload type of PT has a payload type equal to 1,

wherein the third rule further specifies that when the flag included in the bitstream named general_same_pic_timing_in_all_ols_flag has a value of 1, same picture timing in all output layer sets is used, and

wherein the third rule further specifies that when the flag included in the bitstream named general_same_pic_timing_in_all_ols_flag has a value of 1, non-scalable-nested SEI messages with the payload type of PT apply to all output layer sets.

11. The method of claim 1 , wherein the conversion is performed according to a fourth rule, and

wherein the fourth rule specifies that a value of layer identifier for an SEI network abstraction layer (NAL) unit that includes a non-scalable-nested SEI message is not constrained.

12. The method of claim 11 , wherein the non-scalable-nested SEI message is an SEI message that is not contained in a scalable nesting SEI message,

wherein the fourth rule further specifies that a non-scalable-nested SEI message that includes information regarding hypothetical reference decoder (HRD) is applicable to all output layer sets that include all layers in a current coded video sequence in the bitstream, and

wherein the fourth rule further specifies that a non-scalable-nested hypothetical reference decoder (HRD)-related SEI message is omitted responsive to a condition that there does not exist an output layer set that includes the all layers in the current coded video sequence in the bitstream.

13. The method of claim 12 , wherein the non-scalable-nested SEI message is a BP SEI message, a picture timing (PT) SEI message, a decoding unit information (DUI) SEI message, or an SLI SEI message,

wherein the non-scalable-nested SEI message has a payload type that is equal to 0, 1, 130 or 203,

wherein the fourth rule further specifies that a particular payload type value corresponding to subpicture level information is disallowed from a list that includes allowable SEI payload type values, and

wherein the particular payload type value is 203.

14. The method of claim 13 , wherein the allowable SEI payload type values include filler payload, film grain characteristics, frame packing arrangement, parameter sets inclusion indication, mastering display color volume, content light level information, dependent rap indication, alternative transfer characteristics, ambient viewing environment, content color volume, equirectangular projection, generalized cube map projection, sphere rotation, region-wise packing, omni viewport, frame field information and sample aspect ratio information,

wherein the allowable SEI payload type values include 3, 19, 45, 129, 137, 144, 145, 147 to 150, 153 to 156, 168, and 204, and

wherein the SEI messages corresponding the allowable SEI payload type values of the list infer constraints on NAL unit header of the SEI NAL unit on the basis of the NAL unit header of associated video coding layer (VCL) NAL unit when non-scalable-nested.

15. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

16. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

17. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a video and a bitstream of the video,

wherein the bitstream comprises one or more output layer sets comprising one or more video layers according to a first rule,

wherein the first rule specifies that, when a subpicture level information (SLI) supplemental enhancement information (SEI) message and a buffering period (BP) SEI message that apply to a particular output layer set are present within an access unit, the SLI SEI message precedes the BP SEI message in a decoding order,

wherein the first rule specifies that a first syntax field indicating information of sublayer representation for which an initial coded picture buffer (CPB) removal delay related syntax elements are present is omitted in response to a particular value of a second syntax field indicative of a maximum number of temporal sublayers for which an initial CPB removal delay is indicated in the buffering period SEI message,

wherein the particular value is 0, and

wherein the second syntax field with the particular value specifies that the maximum number of temporal sublayers is 1.

18. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video and a bitstream of the video,

wherein the bitstream comprises one or more output layer sets comprising one or more video layers according to a first rule,

wherein the first rule specifies that, when a subpicture level information (SLI) supplemental enhancement information (SEI) message and a buffering period (BP) SEI message that apply to a particular output layer set are present within an access unit, the SLI SEI message precedes the BP SEI message in a decoding order,

wherein the first rule specifies that a first syntax field indicating information of sublayer representation for which an initial coded picture buffer (CPB) removal delay related syntax elements are present is omitted in response to a particular value of a second syntax field indicative of a maximum number of temporal sublayers for which an initial CPB removal delay is indicated in the buffering period SEI message,

wherein the particular value is 0, and

wherein the second syntax field with the particular value specifies that the maximum number of temporal sublayers is 1.

19. A method for storing a bitstream of a video, comprising:

generating the bitstream of the video; and

storing the bitstream in a non-transitory computer-readable recording medium,

wherein the bitstream comprises one or more output layer sets comprising one or more video layers according to a first rule,

wherein the first rule specifies that, when a subpicture level information (SLI) supplemental enhancement information (SEI) message and a buffering period (BP) SEI message that apply to a particular output layer set are present within an access unit, the SLI SEI message precedes the BP SEI message in a decoding order,

wherein the first rule specifies that a first syntax field indicating information of sublayer representation for which an initial coded picture buffer (CPB) removal delay related syntax elements are present is omitted in response to a particular value of a second syntax field indicative of a maximum number of temporal sublayers for which an initial CPB removal delay is indicated in the buffering period SEI message,

wherein the particular value is 0, and

wherein the second syntax field with the particular value specifies that the maximum number of temporal sublayers is 1.

Assignments (1)

Continuity (4)

References Cited (96)

Cited By (1)

US 12,713,071