Granted Patent B2

US 12,375,690 · App. 18/187,318 · Granted Jul 29, 2025

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Deigo, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.

H04N19/176H04N19/105H04N19/119H04N19/137H04N19/139H04N19/159H04N19/184H04N19/1883H04N19/196H04N19/46H04N19/51H04N19/52H04N19/521H04N19/583H04N19/70G06T7/223G06T9/40

Abstract

Claims (81)

1. A method of processing video data, comprising:

determining, for a conversion between a current block of a video and a bitstream of the video, whether use of a geometric partitioning mode is enabled for the current block based on a rule that uses a characteristic of the current block; and

performing the conversion according to the determining;

wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a specific size in width or height;

wherein when the current block is coded with the geometric partitioning mode, the method further comprises:

determining one or more motion candidates for the current block, wherein each of the one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

deriving motion information for the current block based on the one or more motion candidates; and

performing the conversion based on the derived motion information;

wherein the conversion comprises deriving, based on the derived motion information, multiple sub-block motion information for P*Q sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein the index of sub-block weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates; and

wherein P and Q are integers.

2. The method of claim 1 , wherein the specific size in width or height is smaller than a first threshold L or is greater than a second threshold M, where L is an integer and M is an integer.

3. The method of claim 2 , wherein L is equal to 8.

4. The method of claim 2 , wherein M is equal to 64.

5. The method of claim 1 , wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a height-width ratio or a width-height ratio greater than a third threshold, where the third threshold is an integer.

6. The method of claim 1 , wherein the index of weighting factors of BCW is set to 0.

7. The method of claim 1 , wherein a bi-prediction is enabled for sample positions in a non-weighted area of the current block.

8. The method of claim 1 , wherein the geometric partitioning mode being enabled for the current block further depends on a syntax rule being satisfied;

wherein the syntax rule specifies that a first flag at a sequence parameter set level specifies that the geometric partitioning mode is enabled for a picture sequence comprising the current block; and

wherein the syntax rule further specifies that a second flag at a coding unit level specifies that a merge mode is not applied to the current block, wherein the merge mode allows inheriting motion vector information from neighboring blocks of the current block.

9. The method of claim 8 , wherein the bitstream includes multiple syntax elements among which one syntax element indicating a splitting pattern of the geometric partitioning mode for the current block and other syntax elements indicating multiple merge indices for the current block.

10. The method of claim 9 , wherein a prediction among the multiple merge indices is utilized.

11. The method of claim 9 , wherein the syntax elements indicating multiple merge indices are coded separately in the bitstream.

12. The method of claim 9 , wherein number of multiple merge indices is equal to number of partitions of the current block according to the splitting pattern of the geometric partitioning mode.

13. The method of claim 1 , wherein the specific size in width or height is N×X or Y×N where X, Y, N are integers different from each other, wherein N is equal to 4 or 128.

14. The method of claim 9 , wherein, in case that it is determined that the geometric partitioning mode is disabled for the current block, then the conversion includes skipping geometric partitioning and deriving a prediction block for the current block using derived motion information from a motion information of the current block.

15. The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

16. The method of claim 1 , wherein the conversion comprises decoding the video from the bitstream.

17. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, whether use of a geometric partitioning mode is enabled for the current block based on a rule that uses a characteristic of the current block; and

perform the conversion according to the determining;

wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a specific size in width or height;

wherein when the current block is coded with the geometric partitioning mode, the instructions upon execution by the processor further cause the processor to:

determine one or more motion candidates for the current block, wherein each of the one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

derive motion information for the current block based on the one or more motion candidates; and

perform the conversion based on the derived motion information;

wherein the conversion comprises deriving, based on the derived motion information, multiple sub-block motion information for P*Q sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein the index of sub-block weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates; and

wherein P and Q are integers.

18. The apparatus of claim 17 , wherein the specific size in width or height is smaller than a first threshold L or is greater than a second threshold M, wherein L is equal to 8, and M is equal to 64, or

wherein the specific size in width or height is N×X or Y×N where X, Y, N are integers different from each other, wherein N is equal to 4 or 128.

19. The apparatus of claim 17 , wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a height-width ratio or a width-height ratio greater than a third threshold, where the third threshold is an integer.

20. The apparatus of claim 17 ,

wherein the index of weighting factors of BCW is set to 0.

21. The apparatus of claim 17 , wherein a bi-prediction is enabled for sample positions in a non-weighted area of the current block, or

wherein the geometric partitioning mode being enabled for the current block further depends on a syntax rule being satisfied, wherein the syntax rule specifies that a first flag at a sequence parameter set level specifies that the geometric partitioning mode is enabled for a picture sequence comprising the current block, and wherein the syntax rule further specifies that a second flag at a coding unit level specifies that a merge mode is not applied to the current block, wherein the merge mode allows inheriting motion vector information from neighboring blocks of the current block, wherein the bitstream includes multiple syntax elements among which one syntax element indicating a splitting pattern of the geometric partitioning mode for the current block and other syntax elements indicating multiple merge indices for the current block, and a prediction among the multiple merge indices is utilized, the other syntax elements indicating multiple merge indices are coded separately in the bitstream, number of multiple merge indices is equal to number of partitions of the current block according to the splitting pattern of the geometric partitioning mode.

22. The apparatus of claim 17 , wherein, in case that it is determined that the geometric partitioning mode is disabled for the current block, then the conversion includes skipping geometric partitioning and deriving a prediction block for the current block using derived motion information from a motion information of the current block.

23. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, whether use of a geometric partitioning mode is enabled for the current block based on a rule that uses a characteristic of the current block; and

perform the conversion according to the determining;

wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a specific size in width or height;

wherein when the current block is coded with the geometric partitioning mode, the instructions cause the processor to:

determine one or more motion candidates for the current block, wherein each of the one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

derive motion information for the current block based on the one or more motion candidates; and

perform the conversion based on the derived motion information;

wherein the conversion comprises deriving, based on the derived motion information, multiple sub-block motion information for P*Q sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein the index of sub-block weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates; and

wherein P and Q are integers.

24. The non-transitory computer-readable storage medium of claim 23 , wherein the specific size in width or height is smaller than a first threshold L or is greater than a second threshold M, wherein L is equal to 8, and M is equal to 64, or wherein the specific size in width or height is N×X or Y×N where X, Y, N are integers different from each other, wherein N is equal to 4 or 128; or

wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a height-width ratio or a width-height ratio greater than a third threshold, where the third threshold is an integer;

wherein the index of weighting factors of BCW is set to 0,

wherein a bi-prediction is enabled for sample positions in a non-weighted area of the current block; or

wherein the geometric partitioning mode being enabled for the current block further depends on a syntax rule being satisfied, wherein the syntax rule specifies that a first flag at a sequence parameter set level specifies that the geometric partitioning mode is enabled for a picture sequence comprising the current block, and wherein the syntax rule further specifies that a second flag at a coding unit level specifies that a merge mode is not applied to the current block, wherein the merge mode allows inheriting motion vector information from neighboring blocks of the current block, wherein the bitstream includes multiple syntax elements among which one syntax element indicating a splitting pattern of the geometric partitioning mode for the current block and other syntax elements indicating multiple merge indices for the current block, and a prediction among the multiple merge indices is utilized, the other syntax elements indicating multiple merge indices are coded separately in the bitstream, number of multiple merge indices is equal to number of partitions of the current block according to the splitting pattern of the geometric partitioning mode; and

wherein, in case that it is determined that the geometric partitioning mode is disabled for the current block, then the conversion includes skipping geometric partitioning and deriving a prediction block for the current block using derived motion information from a motion information of the current block.

25. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining whether use of a geometric partitioning mode is enabled for a current block of the video based on a rule that uses a characteristic of the current block; and

generating the bitstream based on the determining;

wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a specific size in width or height;

wherein when the current block is coded with the geometric partitioning mode, the method further comprises:

determining one or more motion candidates for the current block, wherein each of the one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

deriving motion information for the current block based on the one or more motion candidates; and

generating the bitstream based on the derived motion information;

wherein the generating comprises deriving, based on the derived motion information, multiple sub-block motion information for P*Q sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein the index of sub-block weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates; and

wherein P and Q are integers.

26. The non-transitory computer-readable recording medium of claim 25 , wherein the specific size in width or height is smaller than a first threshold L or is greater than a second threshold M, wherein L is equal to 8, and M is equal to 64, or wherein the specific size in width or height is N×X or Y×N where X, Y, N are integers different from each other, wherein N is equal to 4 or 128; or

wherein the rule specifies that the geometric partitioning mode for the current block is disabled in case that the current block has a height-width ratio or a width-height ratio greater than a third threshold, where the third threshold is an integer;

wherein the index of weighting factors of BCW is set to 0,

wherein a bi-prediction is enabled for sample positions in a non-weighted area of the current block; or

wherein the geometric partitioning mode being enabled for the current block further depends on a syntax rule being satisfied, wherein the syntax rule specifies that a first flag at a sequence parameter set level specifies that the geometric partitioning mode is enabled for a picture sequence comprising the current block, and wherein the syntax rule further specifies that a second flag at a coding unit level specifies that a merge mode is not applied to the current block, wherein the merge mode allows inheriting motion vector information from neighboring blocks of the current block, wherein the bitstream includes multiple syntax elements among which one syntax element indicating a splitting pattern of the geometric partitioning mode for the current block and other syntax elements indicating multiple merge indices for the current block, and a prediction among the multiple merge indices is utilized, the syntax elements indicating multiple merge indices are coded separately in the bitstream, number of multiple merge indices is equal to number of partitions of the current block according to the splitting pattern of the geometric partitioning mode; and

wherein, in case that it is determined that the geometric partitioning mode is disabled for the current block, then the generating includes skipping geometric partitioning and deriving a prediction block for the current block using derived motion information from a motion information of the current block.

Assignments (2)

Priority Claims (4)

Continuity (3)

References Cited (223)