IP Library Granted Patent US 11,910,004
Granted Patent B2
US 11,910,004 · App. 17/534,968 · Granted Feb 20, 2024

Difference calculation based on partial position

Inventors: Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Jizheng Xu (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/52H04N19/105H04N19/119H04N19/159H04N19/176H04N19/184H04N19/577H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,910,004
App. No.
17/534,968
Filed
Nov 24, 2021
Granted
Feb 20, 2024
Kind
B2
Art Unit
2481
USPC
375/240.15
Abstract

Difference calculation based on partial position is described. In a representative aspect, a method of video processing comprising: calculating, during a conversion between a current block of video and a bitstream representation of the current block, differences between two reference blocks associated with the current block or differences between two reference sub-blocks associated with a sub-block within the current block based on representative positions of the reference blocks or representative positions of the reference sub-blocks; and performing the conversion based on the differences.

Claims (56)

1. A method of video processing, comprising:

determining whether to enable a first tool, for a conversion between a current block and a bitstream based on a rule, wherein the rule indicates that the first tool and a second tool are not both used by the current block; and

performing, based on the determining, a conversion between the current block and the bitstream;

wherein one of the first tool and the second tool is a decoder side motion vector derivation tool to derive a refinement of motion information related to the current block, and

the other of the first tool and the second tool comprises:

 a merge mode with motion vector differences which comprises motion vector expression comprising a first parameter representing a motion vector difference and a second parameter indicating a base candidate, wherein the first parameter comprises a motion magnitude and a motion direction,

wherein the decoder side motion vector derivation tool is disabled upon a determination that the current block is coded with the merge mode with motion vector differences.

2. The method of claim 1 , wherein the other of the first tool and the second tool further comprises:

a combined inter and intra prediction tool, wherein a weight pair is determined for the combined inter and intra prediction tool, and the weight pair comprising a first weight for an inter prediction signal of a block and a second weight for an intra prediction signal of the block, wherein a prediction signal of the block is generated at least based on weighted sum of the intra prediction signal and the inter prediction signal.

3. The method of claim 2 , wherein the decoder side motion vector derivation tool is disabled upon a determination that the combined inter and intra prediction tool is used for the current block.

4. The method of claim 1 , wherein the other of the first tool and the second tool further comprises:

a geometric partitioning tool comprising a partition scheme which divides a block in to two partitions, at least one of which is non-square and non-rectangular.

5. The method of claim 4 , wherein the geometric partitioning tool is a triangular prediction tool.

6. The method of claim 1 , wherein the decoder side motion vector derivation tool comprises a decoder side motion vector refinement tool.

7. The method of claim 1 , wherein the decoder side motion vector derivation tool comprises a bi-directional optical flow tool.

8. The method of claim 1 , wherein the first tool is the decoder side motion vector derivation tool, and the conversion comprises:

dividing the current block into at least one subblock;

calculating differences between two reference subblocks associated with a subblock within the current block based on representative positions of the reference subblocks;

deriving the refinement of the motion information based on the differences.

9. The method of claim 8 , wherein the differences are calculated in an early termination stage of the first tool, wherein the differences are used to determine whether to terminate the first tool.

10. The method of claim 8 , wherein calculating differences comprises:

calculating differences of specific rows of two reference subblocks.

11. The method of claim 10 , wherein the specific rows are composed of one row of every N rows, wherein N is greater than 1.

12. The method of claim 10 , wherein N is equal to 2.

13. The method of claim 8 , wherein deriving the refinement of the motion information based on the differences comprises:

summing up the differences calculated for the representative positions of the reference sub blocks to obtain the difference for the subblock;

deriving the refinement of the motion information using the difference for the subblock.

14. The method of claim 13 , wherein the difference for the subblock include sum of absolute differences (SAD) of the representative positions.

15. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine whether to enable a first tool, for a conversion between a current block and a bitstream based on a rule, wherein the rule indicates that the first tool and a second tool are not both used by the current block; and

perform, based on the determining, a conversion between the current block and the bitstream;

wherein one of the first tool and the second tool is a decoder side motion vector derivation tool to derive a refinement of motion information related to the current block, and

the other of the first tool and the second tool comprises:

a merge mode with motion vector differences which comprises motion vector expression comprising a first parameter representing a motion vector difference and a second parameter indicating a base candidate, wherein the first parameter comprises a motion magnitude and a motion direction,

wherein the decoder side motion vector derivation tool is disabled upon a determination that the current block is coded with the merge mode with motion vector differences.

16. The apparatus of claim 15 , wherein the other of the first tool and the second tool further comprises:

a combined inter and intra prediction tool, wherein a weight pair is determined for the combined inter and intra prediction tool, and the weight pair comprising a first weight for an inter prediction signal of a block and a second weight for an intra prediction signal of the block, wherein a prediction signal of the block is generated at least based on weighted sum of the intra prediction signal and the inter prediction signal.

17. The apparatus of claim 15 , wherein the decoder side motion vector derivation tool is disabled upon a determination that a combined inter and intra prediction tool is used for the current block.

18. The apparatus of claim 15 , wherein the other of the first tool and the second tool further comprises:

a geometric partitioning tool comprising a partition scheme which divides a block in to two partitions, at least one of which is non-square and non-rectangular.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine whether to enable a first tool, for a conversion between a current block and a bitstream based on a rule, wherein the rule indicates that the first tool and a second tool are not both used by the current block; and

perform, based on the determining, a conversion between the current block and the bitstream;

wherein one of the first tool and the second tool is a decoder side motion vector derivation tool to derive a refinement of motion information related to the current block, and

the other of the first tool and the second tool comprises:

 a merge mode with motion vector differences which comprises motion vector expression comprising a first parameter representing a motion vector difference and a second parameter indicating a base candidate, wherein the first parameter comprises a motion magnitude and a motion direction,

wherein the decoder side motion vector derivation tool is disabled upon a determination that the current block is coded with the merge mode with motion vector differences.

20. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining whether to enable a first tool, for a conversion between a current block and a bitstream based on a rule, wherein the rule indicates that the first tool and a second tool are not both used by the current block; and

generating the bitstream from the current block based on the determining;

wherein one of the first tool and the second tool is a decoder side motion vector derivation tool to derive a refinement of motion information related to the current block, and

the other of the first tool and the second tool comprises:

 a merge mode with motion vector differences which comprises motion vector expression comprising a first parameter representing a motion vector difference and a second parameter indicating a base candidate, wherein the first parameter comprises a motion magnitude and a motion direction,

wherein the decoder side motion vector derivation tool is disabled upon a determination that the current block is coded with the merge mode with motion vector differences.

21. The method of claim 1 , wherein the performing of the conversion includes encoding the current block into the bitstream.

22. The method of claim 1 , wherein the performing of the conversion includes decoding the current block from the bitstream.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2021
From: ZHANG, LI; ZHANG, KAI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 058206/0467 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 058206/0507 →
Priority Claims (3)
WO PCT/CN2018/116371 · Nov 20, 2018 · international
WO PCT/CN2019/070062 · Jan 2, 2019 · international
WO PCT/CN2019/072060 · Jan 16, 2019 · international
Continuity (3)
Continuation 17154485 · Jan 21, 2021
Continuation PCTCN2019119634 · Nov 20, 2019
Related Publication 20220086481A1 · Mar 17, 2022