Granted Patent B2

US 12,238,346 · App. 17/389,157 · Granted Feb 25, 2025

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Jizheng Xu (San Diego, CA); Yue Wang (Beijing, CN)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.

H04N19/96H04N19/119H04N19/12H04N19/122H04N19/13H04N19/132H04N19/136H04N19/157H04N19/172H04N19/176H04N19/184H04N19/186H04N19/46H04N19/70

Abstract

Claims (121)

1. A method for processing video, comprising:

determining characteristics regarding a current video block;

determining an operational state regarding unsymmetrical quad-tree (UQT) splitting based on determining the characteristics, wherein the operational state indicates at least one of: whether the UQT splitting is enabled or disabled, or how to split the current video block into four partitions using the UQT splitting; and

performing a conversion between the current video block and a bitstream of the current video block based on the operational state of the UQT splitting,

wherein the characteristics include at least one of: information regarding color format, or color components of the current video block;

wherein the UQT splitting is disabled for the current video block when a width W or a height H of the current video block satisfies a first set of conditions, where W and H are integers, and the UQT splitting is enabled for the current video block when the width W or the height H of the current video block satisfies a second set of conditions,

wherein the first set of conditions includes at least one of:

W≥T1 and H≥T2, where T1 represents a first threshold, T2 represents a second threshold, and T1 and T2 are integers;

W≥T1 or H≥T2;

W≤T1 and H≤T2;

W≤T1 or H≤T2;

W×H≤T, where T represents a third threshold, and T is an integer; or

W×H≥T,

or

wherein the second set of conditions includes at least one of:

W≥T1 and H≥T2;

W≥T1 or H≥T2;

W≤T1 and H≤T2;

W≤T1 or H≤T2;

W×H≤T; or

W×H≥T; and

wherein at least one of the first threshold, the second threshold, or the third threshold depends on picture or slice types.

2. The method of claim 1 , wherein at least one of whether and how to use UQT splitting is dependent on whether luma and chroma coding trees are separated; and wherein when it is determined from the characteristics that luma and chrome coding trees are separated, the operational state regarding UQT splitting is enabled for the current video block.

3. The method of claim 1 , wherein the operational state is signaled from an encoder to a decoder.

4. The method of claim 3 , wherein the operational state is signaled in a sequence parameter set (SPS), a view parameter set (VPS), a picture parameter set (PPS), a picture header, a slice header, a tile group header, or a tile header;

wherein a type of UQT splitting to be applied is signaled in a sequence parameter set (SPS), a view parameter set (VPS), a picture parameter set (PPS), a picture header, a slice header, a tile group header, or a tile header;

wherein the operational state is signaled in the current video block; and

wherein the type of UQT splitting to be applied is signaled in the current video block.

5. The method of claim 3 , wherein an index of splitting type indicating whether the current video block is split by UQT splitting, QT splitting, or no splitting is to be performed is signaled in the current video block; or wherein an index of splitting type indicating whether the current video block is split by BT, or TT, or UQT splitting is signaled in the current video block.

6. The method of claim 5 , wherein at least one of a splitting direction and a splitting type are further signaled in the current video block, and preferably, wherein an indication of splitting direction is firstly signaled, followed by a splitting type.

7. The method of claim 1 , wherein UQT splitting is disabled if a split child block crosses more than one virtual pipeline data units (VPDUs), wherein VPDU is a largest coding block that allows UQT splitting.

8. The method of claim 1 , wherein horizontal UQT splitting is enabled if TP1≤H≤TP2 and/or vertical UQT splitting is enabled if TP1≤W≤TP2 on a P-slice/P-picture or a B-slice/B-picture, and the horizontal UQT splitting is enabled if TI1≤H≤TI2 and/or the vertical UQT splitting is enabled if TI1≤W≤TI2 on an I-slice/I-picture, and wherein TP1, TP2, TI1 and TI2 are integers.

9. The method of claim 8 , wherein TP1 is larger than TI1.

10. The method of claim 8 , wherein TP2 is smaller than TI2.

11. The method of claim 1 , wherein characteristics comprises a depth of the current video block;

wherein UQT splitting is disabled for the current video block when the split depth of the current video block satisfies a third set of conditions with respect a threshold T, where Tis an integer, wherein the depth represents at least one of QT split depth, BT split depth, TT split depth, UQT split depth and MTT split depth; and

wherein UQT splitting is enabled for the current video block when the depth of the current video block satisfies a fourth set of conditions with respect the threshold T, wherein the third set of conditions includes at least one of:

the split depth <=T;

the split depth >=T;

the QT split depth <=T;

the QT split depth >=T;

the BT split depth >=T;

the BT split depth <=T;

the TT split depth >=T;

the TT split depth <=T;

the UQT split depth <=T;

the UQT split depth >=T;

the MTT split depth <=T;

the MTT split depth >=T, and

wherein the fourth set of conditions includes at least one of:

the split depth <=T;

the split depth >=T;

the QT split depth <=T;

the QT split depth >=T;

the BT split depth >=T;

the BT split depth <=T;

the TT split depth >=T;

the TT split depth <=T;

the UQT split depth <=T;

the UQT split depth >=T;

the MTT split depth <=T;

the MTT split depth >=T.

12. The method of claim 11 , wherein the threshold T is signaled from an encoder to a decoder in a sequence parameter set (SPS), a view parameter set (VPS), a picture parameter set (PPS), a picture header, a slice header, a tile group header, or a tile header;

wherein the threshold T depends on color components of the current video block;

wherein the threshold T is different for luma and chroma components of the current video block;

wherein the threshold T depends on whether luma coding tree and chroma coding tree are separated; and

wherein the threshold T is different for luma and chroma components if luma coding tree and chroma coding tree are separated.

13. The method of claim 1 , wherein at least one of whether to enable UQT splitting and how to use UQT splitting on the current video block is determined according to position information of the current video block, and wherein the position information includes whether the current video block crosses a picture/sub-picture border, or a tile border, or a tile group border.

14. The method of claim 13 , wherein at least one of the following applies to the current video block:

vertical UQT splitting is disabled if the current video block crosses the picture/sub-picture border, or the tile border, or a tile group bottom border;

horizontal UQT splitting is disabled if the current video block crosses the picture/sub-picture border, or the tile border, or a tile group bottom border;

vertical UQT splitting is disabled if the current video block crosses the picture/sub-picture border, or the tile border, or a tile group right border;

horizontal UQT splitting is disabled if the current video block crosses the picture/sub-picture border, or the tile border, or a tile group right border.

15. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.

16. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.

17. The method of claim 9 , wherein TI1=32, TP1=64, TI2=TP2=64.

18. The method of claim 10 , wherein TI2=64, TP2=32, TI1=TP1=32.

19. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determining characteristics regarding a current video block;

determining an operational state regarding unsymmetrical quad-tree (UQT) splitting based on determining the characteristics, wherein the operational state indicates at least one of: whether the UQT splitting is enabled or disabled, or how to split the current video block into four partitions using the UQT splitting; and

performing a conversion between the current video block and a bitstream of the current video block based on the operational state of the UQT splitting,

wherein the characteristics include at least one of: information regarding color format, or color components of the current video block;

wherein the UQT splitting is disabled for the current video block when a width W or a height H of the current video block satisfies a first set of conditions, where W and H are integers, and the UQT splitting is enabled for the current video block when the width W or the height H of the current video block satisfies a second set of conditions,

wherein the first set of conditions includes at least one of:

W≥T1 and H≥T2, where T1 represents a first threshold, T2 represents a second threshold, and T1 and T2 are integers;

W≥T1 or H≥T2;

W≤T1 and H≤T2;

W≤T1 or H≤T2;

W×H≤T, where T represents a third threshold, and T is an integer; or

W×H≥T,

or

wherein the second set of conditions includes at least one of:

W≥T1 and H≥T2;

W≥T1 or H≥T2;

W≤T1 and H≤T2;

W≤T1 or H≤T2;

W×H≤T; or

W×H≥T; and

wherein at least one of the first threshold, the second threshold, or the third threshold depends on picture or slice types.

20. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine characteristics regarding a current video block;

determine an operational state regarding unsymmetrical quad-tree (UQT) splitting based on determining the characteristics, wherein the operational state indicates at least one of: whether the UQT splitting is enabled or disabled, or how to split the current video block into four partitions using the UQT splitting; and

perform a conversion between the current video block and a bitstream of the current video block based on the operational state of the UQT splitting,

wherein the characteristics include at least one of: information regarding color format, or color components of the current video block;

wherein the UQT splitting is disabled for the current video block when a width W or a height H of the current video block satisfies a first set of conditions, where W and H are integers, and the UQT splitting is enabled for the current video block when the width W or the height H of the current video block satisfies a second set of conditions,

wherein the first set of conditions includes at least one of:

W≥T1 and H≥T2, where T1 represents a first threshold, T2 represents a second threshold, and T1 and T2 are integers;

W≥T1 or H≥T2;

W≤T1 and H≤T2;

W≤T1 or H≤T2;

W×H≤T, where T represents a third threshold, and T is an integer; or

W×H≥T,

or

wherein the second set of conditions includes at least one of:

W≥T1 and H≥T2;

W≥T1 or H≥T2;

W≤T1 and H≤T2;

W≤T1 or H≤T2;

W×H≤T; or

W×H≥T; and

wherein at least one of the first threshold, the second threshold, or the third threshold depends on picture or slice types.

Assignments (2)

Priority Claims (4)

Continuity (2)

References Cited (167)