Restrictions on decoder side motion vector derivation
Devices, systems and methods for digital video coding, which include decoder side motion vector derivation (DMVD) tools, are described. An exemplary method for video processing includes making a decision, based on a determination that a current block of a video is coded using a multi-hypothesis prediction mode, regarding a selective enablement of a DMVD tool for the current block, wherein the DMVD tool derives a refinement of motion information signaled in a bitstream representation of the video; and performing, based on the decision, a conversion between the current block and the bitstream representation.
1. A method for video processing, comprising:
making, based on a coding mode associated with a current block, a decision regarding whether a bi-directional optical flow tool is enabled for the current block; and
performing, based on the decision, a conversion between the current block and the bitstream,
wherein the bi-directional optical flow tool is disabled upon a determination that the coding mode of the current block is a generalized bi-prediction (GBI) mode in which asymmetric weighting factors in coding unit (CU)-level are applied to two reference blocks of the current block.
2. The method of claim 1 , wherein the bi-directional optical flow tool is used to refine a motion vector based on at least one gradient value corresponding to a sample in a reference block of the current block.
3. The method of claim 1 , wherein making the decision regarding whether the bi-directional optical flow tool is enabled for the current block is further based on a size of the current block, and wherein the size comprises at least one of a width of the current block, a height of the current block, or a number of luma samples in the current block.
4. The method of claim 3 , wherein the bi-directional optical flow tool is disabled upon a determination that either a height of the current block is smaller than tH or a width of the current block is smaller than tW, and wherein tH and tW are positive integers.
5. The method of claim 4 , wherein tH=8 and tW=8.
6. The method of claim 3 , wherein the bi-directional optical flow tool is disabled upon a determination that the number of luma samples in the current block is less than K,
wherein K is a positive integer.
7. The method of claim 3 , wherein the bi-directional optical flow tool is enabled upon a determination that the number of luma samples in the current block is greater than K, wherein K is a positive integer.
8. The method of claim 6 , wherein K=16, 32, 64, or 128.
9. The method of claim 1 , wherein whether the bi-directional optical flow tool is enabled is further based on motion information, a slice type, reference blocks, a picture type or a tile type associated with the current block.
10. The method of claim 1 , wherein the bi-directional optical flow tool is disabled upon a determination that the coding mode of the current block is an advanced motion vector prediction (AMVP) mode.
11. The method of claim 1 , wherein the bi-directional optical flow tool is disabled upon a determination that the coding mode of the current block is a skip mode or a multi-hypothesis inter prediction mode.
12. The method of claim 9 , wherein the current block comprises at least one sub-block, wherein the bi-directional optical flow tool is disabled for a sub-block upon a determination that an absolute mean difference of two reference blocks associated with a current sub-block is greater than a threshold.
13. The method of claim 9 , wherein the bi-directional optical flow tool is disabled upon a determination that an absolute mean difference of two reference blocks associated with the current block is greater than a threshold.
14. The method of claim 1 , wherein the conversion generates the bitstream from the current block.
15. The method of claim 1 , wherein the conversion generates the current block from the bitstream.
16. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
make, based on a coding mode associated with a current block, a decision regarding whether a bi-directional optical flow tool is enabled for the current block; and
perform, based on the decision, a conversion between the current block and the bitstream,
wherein the bi-directional optical flow tool is disabled upon a determination that the coding mode of the current block is a generalized bi-prediction (GBI) mode in which asymmetric weighting factors in coding unit (CU)-level are applied to two reference blocks of the current block.
17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
make, based on a coding mode associated with a current block, a decision regarding whether a bi-directional optical flow tool is enabled for the current block; and
perform, based on the decision, a conversion between the current block and the bitstream,
wherein the bi-directional optical flow tool is disabled upon a determination that the coding mode of the current block is a generalized bi-prediction (GBI) mode in which asymmetric weighting factors in coding unit (CU)-level are applied to two reference blocks of the current block.
18. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:
making, based on a coding mode associated with a current block, a decision regarding whether a bi-directional optical flow tool is enabled for the current block; and
generating, based on the decision, the bitstream from the current block,
wherein the bi-directional optical flow tool is disabled upon a determination that the coding mode of the current block is a generalized bi-prediction (GBI) mode in which asymmetric weighting factors in coding unit (CU)-level are applied to two reference blocks of the current block.