IP Library Granted Patent US 11,546,593
Granted Patent B2
US 11,546,593 · App. 17/711,294 · Granted Jan 3, 2023

Syntax for subpicture signaling in a video bitstream

Inventors: Kai Zhang (San Diego, CA); Zhipin Deng (Beijing, CN); Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Jizheng Xu (San Diego, CA)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/119H04N19/174H04N19/176H04N19/1883H04N19/46H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,546,593
App. No.
17/711,294
Granted
Jan 3, 2023
Kind
B2
Abstract

An example method of video processing includes performing a conversion between a picture of a video that comprises one or more sub-pictures and a bitstream representation of the video. The bitstream representation conforms to a format rule that specifies that information about a sub-picture is included in the bitstream representation based on at least one of: (1) one or more corner positions of the sub-picture, or (2) a dimension of the sub-picture. The format rule further specifies that the information about the sub-picture is positioned after information about a coding tree block in the bitstream representation.

Claims (57)

1. A method of video processing, comprising:

partitioning, for a conversion between a picture of a video and a bitstream of the video, the picture into one or more subpictures; and

performing the conversion at least based on the partitioning,

wherein the bitstream includes a first syntax element indicating a number of the one or more subpictures,

wherein the first syntax element is coded using a scheme having a descriptor of ue(v),

wherein a subpicture of the one or more subpictures is indicated by including a second syntax element indicating a horizontal position of top left coding tree block (CTB) of the subpicture in unit of CtbSizeY, a third syntax element indicating a vertical position of top left CTB of the subpicture in unit of CtbSizeY, a fourth syntax element indicating a width of the subpicture in units of CtbSizeY, and a fifth syntax element indicating a height of the subpicture in units of CtbSizeY in the bitstream, and

wherein CtbSizeY denotes a size of a coding tree block.

2. The method of claim 1 , wherein the number of the one or more subpictures is denoted as N, a value of the first syntax element is denoted as (N−1), and N is an integer.

3. The method of claim 1 , wherein an allowed maximum value of the first syntax element for the picture is a fixed value.

4. The method of claim 1 , wherein when the subpicture is a first subpicture within the picture, the second syntax element and the third syntax element are not included in the bitstream, and values of the second syntax element and the third syntax element are inferred to be 0.

5. The method of claim 1 , wherein the second syntax element is coded with fixed length coding,

wherein a length of the second syntax element is derived based on Ceil(Log2(V1)), and

wherein V1 is determined based on a variable relating to a width of the picture and CtbSizeY, and

wherein Ceil(x) denotes a smallest integer greater than or equal to x.

6. The method of claim 1 , wherein the third syntax element is coded with fixed length coding,

wherein a length of the third syntax element is derived based on Ceil(Log2(V2)),

wherein V2 is determined based on a variable relating to a height of the picture and CtbSizeY, and

wherein Ceil(x) denotes a smallest integer greater than or equal to x.

7. The method of claim 1 , wherein the fourth syntax element is coded with fixed length coding,

wherein a length of the fourth syntax element is derived based on Ceil(Log2(V1)),

wherein V1 is determined based on a variable relating to a width of the picture and CtbSizeY, and

wherein Ceil(x) denotes a smallest integer greater than or equal to x.

8. The method of claim 1 , wherein the fifth syntax element is coded with fixed length coding,

wherein a length of the fifth syntax element is derived based on Ceil(Log2(V2)),

wherein V2 is determined based on a variable relating to a height of the picture and CtbSizeY, and

wherein Ceil(x) denotes a smallest integer greater than or equal to x.

9. The method of claim 1 , wherein the first syntax element, the second syntax element, the third syntax element, the fourth syntax element, and the fifth syntax element are included in the bitstream after a sixth syntax element being included, and

wherein a value of the sixth syntax element plus 5 relates to a coding tree unit size.

10. The method of claim 9 , wherein a subpicture-treated-as-picture flag indicating whether the subpicture is treated as a picture in a process excluding in-loop filtering operations is included in the bitstream after the first syntax element, the second syntax element, the third syntax element, the fourth syntax element, and the fifth syntax element being included.

11. The method of claim 9 , wherein a loop-filter-across-subpicture-enabled flag indicating whether in-loop filtering operations may be performed across boundaries of the subpicture is included in the bitstream after the first syntax element, the second syntax element, the third syntax element, the fourth syntax element, and the fifth syntax element being included.

12. The method of claim 1 , wherein the scheme having a descriptor of ue(v) is a 0-th order Exp-Golomb coding scheme.

13. The method of claim 1 , wherein the conversion includes encoding the picture into the bitstream.

14. The method of claim 1 , wherein the conversion includes decoding the picture from the bitstream.

15. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

partition, for a conversion between a picture of a video and a bitstream of the video, the picture into one or more subpictures; and

perform the conversion at least based on the partitioning,

wherein the bitstream includes a first syntax element indicating a number of the one or more subpictures,

wherein the first syntax element is coded using a scheme having a descriptor of ue(v),

wherein a subpicture of the one or more subpictures is indicated by including a second syntax element indicating a horizontal position of top left coding tree block (CTB) of the subpicture in unit of CtbSizeY, a third syntax element indicating a vertical position of top left CTB of the subpicture in unit of CtbSizeY, a fourth syntax element indicating a width of the subpicture in units of CtbSizeY, and a fifth syntax element indicating a height of the subpicture in units of CtbSizeY in the bitstream, and

wherein CtbSizeY denotes a size of a coding tree block.

16. The apparatus of claim 15 , wherein the number of the one or more subpictures is denoted as N, a value of the first syntax element is denoted as (N−1), and N is an integer.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

partition, for a conversion between a picture of a video and a bitstream of the video, the picture into one or more subpictures; and

perform the conversion at least based on the partitioning,

wherein the bitstream includes a first syntax element indicating a number of the one or more subpictures,

wherein the first syntax element is coded using a scheme having a descriptor of ue(v),

wherein a subpicture of the one or more subpictures is indicated by including a second syntax element indicating a horizontal position of top left coding tree block (CTB) of the subpicture in unit of CtbSizeY, a third syntax element indicating a vertical position of top left CTB of the subpicture in unit of CtbSizeY, a fourth syntax element indicating a width of the subpicture in units of CtbSizeY, and a fifth syntax element indicating a height of the subpicture in units of CtbSizeY in the bitstream, and

wherein CtbSizeY denotes a size of a coding tree block.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the number of the one or more subpictures is denoted as N, a value of the first syntax element is denoted as (N−1), and N is an integer.

19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

partitioning, for a picture of a video, the picture into one or more subpictures; and

generating the bitstream at least based on the partitioning,

wherein the bitstream includes a first syntax element indicating a number of the one or more subpictures,

wherein the first syntax element is coded using a scheme having a descriptor of ue(v),

wherein a subpicture of the one or more subpictures is indicated by including a second syntax element indicating a horizontal position of top left coding tree block (CTB) of the subpicture in unit of CtbSizeY, a third syntax element indicating a vertical position of top left CTB of the subpicture in unit of CtbSizeY, a fourth syntax element indicating a width of the subpicture in units of CtbSizeY, and a fifth syntax element indicating a height of the subpicture in units of CtbSizeY in the bitstream, and

wherein CtbSizeY denotes a size of a coding tree block.

20. The non-transitory computer-readable recording medium of claim 19 , wherein the number of the one or more subpictures is denoted as N, a value of the first syntax element is denoted as (N−1), and N is an integer.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2022
From: ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 059487/0294 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2022
From: DENG, ZHIPIN; LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059487/0353 →
Priority Claims (1)
WO PCT/CN2019/109809 · Oct 2, 2019 · international
Continuity (2)
Continuation PCTCN2020119932 · Oct 9, 2020
Related Publication 20220256195A1 · Aug 11, 2022
Cited By (7)
US 12,192,459 US 12,301,799 US 12,348,761 US 12,388,989 US 12,413,714 US 12,513,291 US 12,621,450