IP Library Granted Patent US 11,159,808
Granted Patent B2
US 11,159,808 · App. 17/071,210 · Granted Oct 26, 2021

Using inter prediction with geometric partitioning for video processing

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/176H04N19/105H04N19/119H04N19/159H04N19/184H04N19/1883H04N19/46H04N19/51H04N19/52H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,159,808
App. No.
17/071,210
Granted
Oct 26, 2021
Kind
B2
Abstract

A method for processing a video includes performing a determination, by a processor, that a first video block is partitioned to include a first prediction portion that is non-rectangular and non-square; adding a first motion vector (MV) prediction candidate associated with the first prediction portion to a motion candidate list associated with the first video block, wherein the first MV prediction candidate is derived from a sub-block MV prediction candidate; and performing further processing of the first video block using the motion candidate list.

Claims (47)

1. A method of processing video data, comprising:

determining, for a conversion between a current block of a video and a bitstream of the video, one or more motion candidates for the current block, wherein the current block is coded with a geometric partitioning mode, wherein each of one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

deriving motion information for the current block based on the one or more motion candidates; and

performing the conversion based on the derived motion information;

wherein the conversion comprises deriving, based on the derived motion information, multiple sub-block motion information for M*N sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein, the index of subblock weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates; and

wherein M and N are integers.

2. The method of claim 1 , wherein the index of weighting factors of BCW is set to 0.

3. The method of claim 1 , wherein during the conversion, a bi-prediction is enabled at least at some sample positions of the current block.

4. The method of claim 3 , wherein the bi-prediction is enabled for sample positions in a non-weighted area of the current block.

5. The method of claim 1 , wherein an indication which specifies whether the geometric partitioning mode is enabled is included in the bitstream.

6. The method of claim 5 , wherein the indication is at a sequence parameter set level or a picture parameter set level or a video parameter set level or a picture header or a slice header or a tile group header or a coding tree unit level.

7. The method of claim 1 , wherein the geometric partitioning mode is disabled for the current block due to the current block satisfying a size condition.

8. The method of claim 7 , wherein the size condition specifies not to use the geometric partitioning mode for the current block due to the current block having a size greater than a first threshold, wherein the first threshold is equal to 64.

9. The method of claim 7 , wherein the size condition specifies not to use the geometric partitioning mode for the current block due to the current block having a size less than a second threshold, wherein the second threshold is equal to 8.

10. The method of claim 7 , wherein the geometric partitioning mode is disabled for the current block due to the current block having a pre-defined width to height ratio.

11. The method of claim 1 , wherein the geometric partitioning mode includes multiple splitting patterns and at least one splitting pattern divides the current block into two or more partitions, at least one of which is non-square and non-rectangular.

12. The method of claim 1 , wherein at most one of two or more partitions of the current block is inter coded.

13. The method of claim 1 , wherein the geometric partitioning mode comprises a triangular partitioning mode.

14. The method of claim 1 , wherein the current block is coded using a multi-hypothesis technique.

15. The method of claim 1 , wherein the conversion is further based on an overlapped block motion compensation (OBMC) rule that specifies whether use of OBMC coding is enabled at sample positions of the current block.

16. The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

17. The method of claim 1 , wherein the conversion comprises decoding the bitstream to generate pixel values of the video.

18. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, one or more motion candidates for the current block, wherein the current block is coded with a geometric partitioning mode, wherein each of one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

derive a motion information for the current block based on the one or more motion candidates; and

perform the conversion based on the derived motion information;

wherein the processor is further caused to derive, based on the derived motion information, multiple sub-block motion information for M*N sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein, the index of subblock weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates and

wherein M and N are integers.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, one or more motion candidates for the current block, wherein the current block is coded with a geometric partitioning mode, wherein each of one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

derive a motion information for the current block based on the one or more motion candidates; and

perform the conversion based on the derived motion information;

wherein the processor is further caused to derive, based on the derived motion information, multiple sub-block motion information for M*N sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein, the index of subblock weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates; and

wherein M and N are integers.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining one or more motion candidates for a current block of the video, wherein the current block is coded with a geometric partitioning mode, wherein each of one or more motion candidates is associated with an index of weighting factors of bi-prediction with CU-level weights (BCW);

deriving a motion information for the current block based on the one or more motion candidates; and

generating the bitstream of the video based on the derived motion information;

wherein the conversion comprises deriving, based on the derived motion information, multiple sub-block motion information for M*N sub-blocks of the current block, the sub-block motion information including an index of sub-block weighting factors of BCW,

wherein, the index of subblock weighting factors of BCW is not inherited from the index of weighting factors of BCW of the one or more motion candidates; and

wherein M and N are integers.

21. The apparatus of claim 18 , wherein the sub-block motion information is based on a first motion information and a second motion information; and wherein the instructions upon execution by the processor, further cause the processor to:

store, in response to the first motion information being from a first reference picture list LX and the second motion information being from a second reference picture list L(1−X), a single set of motion information for a M*N sub-block within a weighted area of the current block, and wherein the single set of motion information comprises bi-prediction motion information, wherein X=0 or X=1.

22. The apparatus of claim 18 , wherein M=4 or 8, and N=4 or 8.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2020
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 054071/0135 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2020
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 054071/0163 →
Priority Claims (4)
WO PCT/CN2018/114099 · Nov 6, 2018 · international
WO PCT/CN2018/125956 · Dec 30, 2018 · international
WO PCT/CN2019/071160 · Jan 10, 2019 · international
WO PCT/CN2019/071747 · Jan 15, 2019 · international
Continuity (2)
Continuation PCTCN2019115958 · Nov 6, 2019
Related Publication 20210029366A1 · Jan 28, 2021
Cited By (4)
US 12,375,690 US 12,489,892 US 12,519,951 US 12,587,636