Inter prediction with refinement in video processing
Devices, systems and methods for digital video coding, which includes inter prediction with refinement, are described. An exemplary method of video processing includes determining to use, for a conversion between a current block of a video and a bitstream representation of the video, a first linear optimization model for the conversion using a first coding mode, the first linear optimization model being derived from a second linear optimization model that is used for the conversion using a second coding mode, and performing, based on the determining, the conversion. Another exemplary method of video processing includes determining to use, for a conversion between a current block of a video and a bitstream representation of the video, a gradient value computation algorithm for a bi-directional optical flow tool, and performing, based on the determining, the conversion.
1. A method of processing video data, comprising:
determining, based on one or more picture order count (POC) parameters associated with a picture of a current video block of a video, whether a first prediction mode can be applied, wherein in the first prediction mode, prediction samples of the current video block is refined at least based on gradients in different directions; and
performing, based on the determining, a conversion between the current video block and a bitstream of the video.
2. The method of claim 1 , wherein a first reference picture (R 0 ) and a second reference picture (R 1 ) are associated with a current picture comprising the current video block, wherein τ 0 is a difference between a picture order count of the current picture and a picture order count of the first reference picture (τ 0 =POC(current)−POC(R 0 )), and wherein τ 1 is a difference between a picture order count of the second reference picture and the picture order count of the current picture (τ 1 =POC(R 1 )−POC(current)).
3. The method of claim 2 , further comprising:
refraining from enabling the first prediction mode in response to abs(abs(τ 0 )−abs(τ 1 ))≥T 0 , wherein T 0 is an integer, and To is larger than 0.
4. The method of claim 2 , further comprising:
refraining from enabling the first prediction mode in response to abs(τ 0 )≥abs(τ 1 )×T 0 or abs(τ 1 )≥abs(τ 0 )×T 0 , wherein T 0 is an integer.
5. The method of claim 4 , wherein T 0 =1.
6. The method of claim 3 , wherein T 0 is signaled in a video parameter set (VPS), a sequence parameter set (SPS), a picture parameter set (PPS), a slice header, a tile group header, a tile, a coding unit (CU) or a coding tree unit (CTU).
7. The method of claim 1 , wherein the first prediction mode is a bi-directional optical flow (BDOF) prediction mode.
8. The method of claim 1 , wherein the conversion comprises decoding the current video block from the bitstream.
9. The method of claim 1 , wherein the conversion comprises encoding the current video block into the bitstream.
10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
make a determination, based on one or more picture order count (POC) parameters associated with a picture of a current video block of a video, whether a first prediction mode can be applied, wherein in the first prediction mode, prediction samples of the current video block is refined at least based on gradients in different directions; and
perform, based on the determination, a conversion between the current video block and a bitstream of the video.
11. The apparatus of claim 10 , wherein a first reference picture (R 0 ) and a second reference picture (R 1 ) are associated with a current picture comprising the current video block, wherein τ 0 is a difference between a picture order count of the current picture and a picture order count of the first reference picture (τ 0 =POC(current)−POC(R 0 )), and wherein τ 1 is a difference between a picture order count of the second reference picture and the picture order count of the current picture (τ 1 =POC(R 1 )−POC(current)).
12. The apparatus of claim 11 , wherein the processor is further caused to:
refrain from enabling the first prediction mode in response to abs(abs(τ 0 ) −abs(τ 1 ))≥T 0 , wherein T 0 is an integer, and T 0 is larger than 0.
13. The apparatus of claim 11 , wherein the processor is further caused to:
refrain from enabling the first prediction mode in response to abs(τ 0 ) abs(τ 1 ) ×T 0 or abs(τ 1 )≥abs(τ 0 )×T 0 , wherein T 0 is an integer.
14. The apparatus of claim 13 , wherein T 0 =1.
15. The apparatus of claim 12 , wherein T 0 is signaled in a video parameter set (VPS), a sequence parameter set (SPS), a picture parameter set (PPS), a slice header, a tile group header, a tile, a coding unit (CU) or a coding tree unit (CTU).
16. The apparatus of claim 10 , wherein the first prediction mode is a bi-directional optical flow (BDOF) prediction mode.
17. The apparatus of claim 10 , wherein the conversion comprises decoding the current video block from the bitstream.
18. The apparatus of claim 10 , wherein the conversion comprises encoding the current video block into the bitstream.
19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
make a determination, based on one or more picture order count (POC) parameters associated with a picture of a current video block of a video, whether a first prediction mode can be applied, wherein in the first prediction mode, prediction samples of the current video block is refined at least based on gradients in different directions; and
perform, based on the determination, a conversion between the current video block and a bitstream of the video.
20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, the method comprising:
make a determination, based on one or more picture order count (POC) parameters associated with a picture of a current video block of a video, whether a first prediction mode can be applied, wherein in the first prediction mode, prediction samples of the current video block is refined at least based on gradients in different directions; and
generate, based on the determination, the bitstream.