Interaction between IBC and affine
Devices, systems and methods for applying intra-block copy (IBC) in video coding are described. In general, methods for integrating IBC with existing motion compensation algorithms for video encoding and decoding are described. In a representative aspect, a method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using a motion compensation algorithm, and encoding, based on the determining, the current block by selectively applying an intra-block copy to the current block. In a representative aspect, another method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using an intra-block copy, and encoding, based on the determining, the current block by selectively applying a motion compensation algorithm to the current block.
1. A method of processing video data, comprising:
determining, for a conversion between a current video block of a video and a bitstream of the video, that a first technique is applied for the current video block; and
performing the conversion by applying the first technique and by excluding applying a second technique,
wherein one of the first and the second techniques corresponds to an intra-block copy (IBC) technique, and the other of the first and the second techniques corresponds to a Decoder-side Motion Vector Refinement (DMVR) technique,
wherein in response to the DMVR technique being applied during the conversion, a refined motion vector for the current video block is derived based on a cost calculation between prediction samples of the current video block in different reference pictures of the current video block, and
wherein the method further comprises, in response to at least one of reference pictures of the current video block being a current picture which includes the current video block, excluding applying the DMVR technique for the current video block during the conversion.
2. The method of claim 1 , wherein in response to the IBC technique being applied during the conversion, a prediction of the current video block is derived based on sample values from a same video slice with the current video block, and wherein the sample values are determined by block vectors.
3. The method of claim 1 , wherein the cost calculation is based on a sum of absolute difference (SAD).
4. The method of claim 1 , wherein the first technique corresponds to the IBC technique, and the second technique corresponds to the DMVR technique.
5. The method of claim 1 , wherein the first technique corresponds to the DMVR technique, and the second technique corresponds to the IBC technique.
6. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.
7. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.
8. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, for a conversion between a current video block of a video and a bitstream of the video, that a first technique is applied for the current video block; and
perform the conversion by applying the first technique and by excluding applying a second technique,
wherein one of the first and the second techniques corresponds to an intra-block copy (IBC) technique, and the other of the first and the second techniques corresponds to a Decoder-side Motion Vector Refinement (DMVR) technique,
wherein in response to the DMVR technique being applied during the conversion, a refined motion vector for the current video block is derived based on a cost calculation between prediction samples of the current video block in different reference pictures of the current video block, and
wherein the instructions upon execution by the processor, further cause the processor to, in response to at least one of reference pictures of the current video block being a current picture which includes the current video block, exclude applying the DMVR technique for the current video block during the conversion.
9. The apparatus of claim 8 , wherein in response to the IBC technique being applied during the conversion, a prediction of the current video block is derived based on sample values from a same video slice with the current video block, and wherein the sample values are determined by block vectors.
10. The apparatus of claim 8 , wherein the cost calculation is based on a sum of absolute difference (SAD).
11. The apparatus of claim 8 , wherein the first technique corresponds to the IBC technique, and the second technique corresponds to the DMVR technique.
12. The apparatus of claim 8 , wherein the first technique corresponds to the DMVR technique, and the second technique corresponds to the IBC technique.
13. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine, for a conversion between a current video block of a video and a bitstream of the video, that a first technique is applied for the current video block; and
perform the conversion by applying the first technique and by excluding applying a second technique,
wherein one of the first and the second techniques corresponds to an intra-block copy (IBC) technique, and the other of the first and the second techniques corresponds to a Decoder-side Motion Vector Refinement (DMVR) technique,
wherein in response to the DMVR technique being applied during the conversion, a refined motion vector for the current video block is derived based on a cost calculation between prediction samples of the current video block in different reference pictures of the current video block, and
wherein the instructions further cause the processor to, in response to at least one of reference pictures of the current video block being a current picture which includes the current video block, exclude applying the DMVR technique for the current video block during the conversion.
14. The non-transitory computer-readable storage medium of claim 13 ,
wherein in response to the IBC technique being applied during the conversion, a prediction of the current video block is derived based on sample values from a same video slice with the current video block, and wherein the sample values are determined by block vectors,
wherein the cost calculation is based on a sum of absolute difference (SAD), and
wherein the first technique corresponds to the IBC technique, and the second technique corresponds to the DMVR technique, or wherein the first technique corresponds to the DMVR technique, and the second technique corresponds to the IBC technique.
15. A method of storing a bitstream of a video, comprising:
determining, for a current video block of the video, that a first technique is applied for the current video block;
generating the bitstream from the current video block by using the first technique and by excluding applying a second technique, and
storing the bitstream in a non-transitory computer-readable recording medium,
wherein one of the first and the second techniques corresponds to an intra-block copy (IBC) technique, and the other of the first and the second techniques corresponds to a Decoder-side Motion Vector Refinement (DMVR) technique,
wherein in response to the DMVR technique being applied during the conversion, a refined motion vector for the current video block is derived based on a cost calculation between prediction samples of the current video block in different reference pictures of the current video block, and
wherein the method further comprises, in response to at least one of reference pictures of the current video block being a current picture which includes the current video block, excluding applying the DMVR technique for the current video block during the conversion.
16. The method of claim 15 , wherein in response to the IBC technique being applied during the generating, a prediction of the current video block is derived based on sample values from a same video slice with the current video block, and wherein the sample values are determined by block vectors,
wherein the cost calculation is based on a sum of absolute difference (SAD), and
wherein the first technique corresponds to the IBC technique, and the second technique corresponds to the DMVR technique, or wherein the first technique corresponds to the DMVR technique, and the second technique corresponds to the IBC technique.