Interaction between IBC and BIO
Devices, systems and methods for applying intra-block copy (IBC) in video coding are described. In general, methods for integrating IBC with existing motion compensation algorithms for video encoding and decoding are described. In a representative aspect, a method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using a motion compensation algorithm, and encoding, based on the determining, the current block by selectively applying an intra-block copy to the current block. In a representative aspect, another method for video encoding using IBC includes determining whether a current block of the current picture is to be encoded using an intra-block copy, and encoding, based on the determining, the current block by selectively applying a motion compensation algorithm to the current block.
1. A method of processing video data, comprising:
determining, for a conversion between a current video block of a video and a bitstream of the video, whether a Bi-directional Optical Flow (BDOF) technique is applied to the current video block at least based on τ 0 and τ 1 , wherein τ 0 is a difference between a picture order count of the current picture (current) and a picture order count (POC) of a first reference picture R 0 (τ 0 =POC(current)−POC(R 0 )), τ 1 is a difference between a picture order count of a second reference picture R 1 and the picture order count of the current picture (τ 1 =POC(R 1 )−POC(current)), wherein when a product of τ 0 and τ 1 is less than zero, the BDOF is disabled for the current video block;
determining, in response to the BDOF technique being applied for the current video block, that an intra block copy (IBC) technique is disabled; and
performing the conversion,
wherein the BDOF technique comprises:
dividing the current video block into at least one subblock based on a size of the current video block, wherein a width and a length of the at least one subblock are both greater than or equal to 1;
obtaining a first plurality of prediction samples associated with the first reference picture and a second plurality of prediction samples associated with the second reference picture for each of the at least one subblock;
deriving the at least one gradient based on the first plurality of prediction samples and the second plurality of prediction samples;
generating at least one refined offset based on the at least one gradient; and
generating at least one refined prediction sample for each of the at least one subblock at least based on the at least one refined offset.
2. The method of claim 1 , wherein the first reference picture is different from the current picture, and the second reference picture is different from the current picture.
3. The method of claim 1 , wherein the first reference picture is behind the current picture in displaying order, and the second reference picture is ahead of the current picture in displaying order.
4. The method of claim 1 , further comprising:
determining an indicator of use of the IBC technique is excluded in the bitstream in response to the BDOF technique being applied for the current video block.
5. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.
6. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.
7. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, for a conversion between a current video block of a video and a bitstream of the video, whether a Bi-directional Optical Flow (BDOF) technique is applied to the current video block at least based on τ 0 and τ 1 , wherein τ 0 is a difference between a picture order count of the current picture (current) and a picture order count (POC) of a first reference picture R 0 (τ 0 =POC(current)−POC(R 0 )), τ 1 is a difference between a picture order count of a second reference picture R 1 and the picture order count of the current picture (τ 1 =POC(R 1 )−POC(current)), wherein when a product of τ 0 and τ 1 is less than zero, the BDOF is disabled for the current video block;
determine, in response to the BDOF technique being applied for the current video block, that an intra block copy (IBC) technique is disabled; and
perform the conversion,
wherein the BDOF technique comprising:
dividing the current video block into at least one subblock based on a size of the current video block, wherein a width and a length of the at least one subblock are both greater than or equal to 1;
obtaining a first plurality of prediction samples associated with the first reference picture and a second plurality of prediction samples associated with the second reference picture for each of the at least one subblock;
deriving the at least one gradient based on the first plurality of prediction samples and the second plurality of prediction samples;
generating at least one refined offset based on the at least one gradient; and
generating at least one refined prediction sample for each of the at least one subblock at least based on the at least one refined offset.
8. The apparatus of claim 7 , wherein the first reference picture is different from the current picture, and the second reference picture is different from the current picture.
9. The apparatus of claim 7 , wherein the first reference picture is behind the current picture in displaying order, and the second reference picture is ahead of the current picture in displaying order.
10. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine, for a conversion between a current video block of a video and a bitstream of the video, whether a Bi-directional Optical Flow (BDOF) technique is applied to the current video block at least based on τ 0 and τ 1 , wherein τ 0 is a difference between a picture order count of the current picture (current) and a picture order count (POC) of a first reference picture R 0 (τ 0 =POC(current)−POC(R 0 )), τ 1 is a difference between a picture order count of a second reference picture R 1 and the picture order count of the current picture (τ 1 =POC(R 1 )−POC(current)), wherein when a product of τ 0 and τ 1 is less than zero, the BDOF is disabled for the current video block;
determine, in response to the BDOF technique being applied for the current video block, that an intra block copy (IBC) technique is disabled; and
perform the conversion,
wherein the BDOF technique comprising:
dividing the current video block into at least one subblock based on a size of the current video block, wherein a width and a length of the at least one subblock are both greater than or equal to 1;
obtaining a first plurality of prediction samples associated with the first reference picture and a second plurality of prediction samples associated with the second reference picture for each of the at least one subblock;
deriving the at least one gradient based on the first plurality of prediction samples and the second plurality of prediction samples;
generating at least one refined offset based on the at least one gradient; and
generating at least one refined prediction sample for each of the at least one subblock at least based on the at least one refined offset.
11. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:
determining, for a conversion between a current video block of a video and a bitstream of the video, whether a Bi-directional Optical Flow (BDOF) technique is applied to the current video block at least based on τ 0 and τ 1 , wherein τ 0 is a difference between a picture order count of the current picture (current) and a picture order count (POC) of a first reference picture R 0 (τ 0 =POC(current)−POC(R 0 )), τ 1 is a difference between a picture order count of a second reference picture R 1 and the picture order count of the current picture (τ 1 =POC(R 1 )−POC(current)), wherein when a product of τ 0 and τ 1 is less than zero, the BDOF is disabled for the current video block;
determining, in response to the BDOF technique being applied for the current video block, that an intra block copy (IBC) technique is disabled; and
generating the bitstream from the current video block,
wherein the BDOF technique comprising:
dividing the current video block into at least one subblock based on a size of the current video block, wherein a width and a length of the at least one subblock are both greater than or equal to 1;
obtaining a first plurality of prediction samples associated with the first reference picture and a second plurality of prediction samples associated with the second reference picture for each of the at least one subblock;
deriving the at least one gradient based on the first plurality of prediction samples and the second plurality of prediction samples;
generating at least one refined offset based on the at least one gradient; and
generating at least one refined prediction sample for each of the at least one subblock at least based on the at least one refined offset.
12. The apparatus of claim 7 , wherein the instructions upon execution by the processor, cause the processor to:
determine an indicator of use of the IBC technique is excluded in the bitstream in response to the BDOF technique being applied for the current video block.
13. The apparatus of claim 7 , wherein the conversion includes encoding the current video block into the bitstream.
14. The apparatus of claim 7 , wherein the conversion includes decoding the current video block from the bitstream.