IP Library › Granted Patent US 11,991,352
Granted Patent B2
US 11,991,352 · App. 17/887,275 · Granted May 21, 2024

Subpicture information signaling in video bitstreams

Inventors: Zhipin Deng (Beijing, CN); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Ye-kui Wang (San Diego, CA); Kui Fan (San Diego, CA)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/117H04N19/119H04N19/132H04N19/139H04N19/167H04N19/172H04N19/174H04N19/184H04N19/196H04N19/30H04N19/52H04N19/547H04N19/573H04N19/70H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,991,352
App. No.
17/887,275
Granted
May 21, 2024
Kind
B2
Abstract

Methods, apparatus, systems for video processing, including video encoding or video decoding are described. One example method includes performing a conversion between a video including a video picture that includes one or more subpictures and a bitstream of the video. The bitstream conforms to a format rule specifying that a first syntax element indicating whether an operation is performed across a boundary of a subpicture in the coded layer video sequence is selectively included responsive to a number of subpictures in the video picture.

Claims (62)

1. A method for processing video data, comprising:

performing a conversion between a video comprising a video picture that includes one or more subpictures and a bitstream of the video;

wherein the bitstream conforms to a format rule;

wherein the format rule specifies that a first syntax element is selectively present in a sequence parameter set of the bitstream based on a number of subpictures in the video picture; and

wherein the first syntax element indicates whether an in-loop filtering operation is allowed to be performed across subpicture boundaries in a coded layer video sequence (CLVS) and whether all subpicture boundaries in the CLVS are treated as picture boundaries.

2. The method of claim 1 , wherein the format rule specifies that in case the number of subpictures in the video picture is 1, the first syntax element is not present in the sequence parameter set, and a value of the first syntax element is inferred to be equal to 1, and

wherein in case the value of the first syntax element is inferred to be equal to 1, all subpicture boundaries in the CLVS are treated as picture boundaries and no in-loop filtering operation is performed across subpicture boundaries.

3. The method of claim 1 , wherein the first syntax element comprises sps_independent_subpics_flag.

4. The method of claim 1 , wherein the number of subpictures in the video picture is indicated by a second syntax element in the sequence parameter set, which plus 1 specifies the number of subpictures in each video picture in the CLVS.

5. The method of claim 1 , wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a third syntax element, which indicates whether a subpicture of each video picture in the CLVS is treated as a picture in the conversion excluding the in-loop filtering operation.

6. The method of claim 5 , wherein in case the number of subpictures in the video picture is 1, a value of the third syntax element is inferred to be equal to 1, and

wherein in case the value of the third syntax element is equal to 1, a subpicture of each video picture in the CLVS is treated as a picture in the conversion excluding the in-loop filtering operation.

7. The method of claim 1 , wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a fourth syntax element, which indicates whether the in-loop filtering operation is allowed to be performed across subpicture boundaries.

8. The method of claim 7 , wherein in case the number of subpictures in the video picture is 1, a value of the fourth syntax element is inferred to be equal to 0, and

wherein in case the value of the fourth syntax element is equal to 0, the in-loop filtering operation across subpicture boundaries is disabled.

9. The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

10. The method of claim 1 , wherein the conversion comprises decoding the video from the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a video comprising a video picture that includes one or more subpictures and a bitstream of the video;

wherein the bitstream conforms to a format rule;

wherein the format rule specifies that a first syntax element is selectively present in a sequence parameter set of the bitstream based on a number of subpictures in the video picture; and

wherein the first syntax element indicates whether an in-loop filtering operation is allowed to be performed across subpicture boundaries in a coded layer video sequence (CLVS) and whether all subpicture boundaries in the CLVS are treated as picture boundaries.

12. The apparatus of claim 11 , wherein the format rule specifies that in case the number of subpictures in the video picture is 1, the first syntax element is not present in the sequence parameter set, and a value of the first syntax element is inferred to be equal to 1, and

wherein in case the value of the first syntax element is inferred to be equal to 1, all subpicture boundaries in the CLVS are treated as picture boundaries and no in-loop filtering operation is performed across subpicture boundaries.

13. The apparatus of claim 11 , wherein the first syntax element comprises sps_independent_subpics_flag.

14. The apparatus of claim 11 , wherein the number of subpictures in the video picture is indicated by a second syntax element in the sequence parameter set, which plus 1 specifies the number of subpictures in each video picture in the CLVS.

15. The apparatus of claim 11 , wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a third syntax element, which indicates whether a subpicture of each video picture in the CLVS is treated as a picture in the conversion excluding the in-loop filtering operation; and

wherein in case the number of subpictures in the video picture is 1, a value of the third syntax element is inferred to be equal to 1, and

wherein in case the value of the third syntax element is equal to 1, a subpicture of each video picture in the CLVS is treated as a picture in the conversion excluding the in-loop filtering operation.

16. The apparatus of claim 11 , wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a fourth syntax element, which indicates whether the in-loop filtering operation is allowed to be performed across subpicture boundaries; and

wherein in case the number of subpictures in the video picture is 1, a value of the fourth syntax element is inferred to be equal to 0, and

wherein in case the value of the fourth syntax element is equal to 0, the in-loop filtering operation across subpicture boundaries is disabled.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video comprising a video picture that includes one or more subpictures and a bitstream of the video;

wherein the bitstream conforms to a format rule;

wherein the format rule specifies that a first syntax element is selectively present in a sequence parameter set of the bitstream based on a number of subpictures in the video picture; and

wherein the first syntax element indicates whether an in-loop filtering operation is allowed to be performed across subpicture boundaries in a coded layer video sequence (CLVS) and whether all subpicture boundaries in the CLVS are treated as picture boundaries.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the format rule specifies that in case the number of the subpictures in the video picture is 1, the first syntax element is not present in the sequence parameter set, and a value of the first syntax element is inferred to be equal to 1, and

wherein in case the value of the first syntax element is inferred to be equal to 1, all subpicture boundaries in the CLVS are treated as picture boundaries and no in-loop filtering operation is performed across subpicture boundaries;

wherein the first syntax element comprises sps_independent_subpics_flag;

wherein the number of subpictures in the video picture is indicated by a second syntax element in the sequence parameter set, which plus 1 specifies the number of subpictures in each video picture in the CLVS;

wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a third syntax element, which indicates whether a subpicture of each video picture in the CLVS is treated as a picture in the conversion excluding the in-loop filtering operation;

wherein in case the number of subpictures in the video picture is 1, a value of the third syntax element is inferred to be equal to 1, and

wherein in case the value of the third syntax element is equal to 1, a subpicture of each video picture in the CLVS is treated as a picture in the conversion excluding the in-loop filtering operation;

wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a fourth syntax element, which indicates whether the in-loop filtering operation is allowed to be performed across subpicture boundaries; and

wherein in case the number of subpictures in the video picture is 1, a value of the fourth syntax element is inferred to be equal to 0, and

wherein in case the value of the fourth syntax element is equal to 0, the in-loop filtering operation across subpicture boundaries is disabled.

19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream of the video comprising a video picture that includes one or more subpictures,

wherein the bitstream conforms to a format rule;

wherein the format rule specifies that a first syntax element is selectively present in a sequence parameter set of the bitstream based on a number of subpictures in the video picture; and

wherein the first syntax element indicates whether an in-loop filtering operation is allowed to be performed across subpicture boundaries in a coded layer video sequence (CLVS) and whether all subpicture boundaries in the CLVS are treated as picture boundaries.

20. The non-transitory computer-readable recording medium of claim 19 , wherein the format rule specifies that in case the number of subpictures in the video picture is 1, the first syntax element is not present in the sequence parameter set, and a value of the first syntax element is inferred to be equal to 1, and

wherein in case the value of the first syntax element is inferred to be equal to 1, all subpicture boundaries in the CLVS are treated as picture boundaries and no in-loop filtering operation is performed across subpicture boundaries;

wherein the first syntax element comprises sps_independent_subpics_flag;

wherein the number of subpictures in the video picture is indicated by a second syntax element in the sequence parameter set, which plus 1 specifies the number of subpictures in each video picture in the CLVS;

wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a third syntax element, which indicates whether a subpicture of each video picture in the CLVS is treated as a picture in a conversion excluding the in-loop filtering operation;

wherein in case the number of subpictures in the video picture is 1, a value of the third syntax element is inferred to be equal to 1, and

wherein in case the value of the third syntax element is equal to 1, a subpicture of each video picture in the CLVS is treated as a picture in the conversion excluding the in-loop filtering operation;

wherein the format rule further specifies that the number of subpictures in the video picture determines a manner of indicating a fourth syntax element, which indicates whether the in-loop filtering operation is allowed to be performed across subpicture boundaries; and

wherein in case the number of subpictures in the video picture is 1, a value of the fourth syntax element is inferred to be equal to 0, and

wherein in case the value of the fourth syntax element is equal to 0, the in-loop filtering operation across subpicture boundaries is disabled.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2023
From: ZHANG, LI; ZHANG, KAI; WANG, YE-KUI; FAN, KUI
To: BYTEDANCE INC.
Reel/Frame 062620/0450 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2023
From: DENG, ZHIPIN
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062620/0474 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2023
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062620/0484 →
Continuity (2)
Continuation PCTCN2021076546 · Feb 10, 2021
Related Publication 20220394304A1 · Dec 8, 2022