Motion candidate list construction using neighboring block information
A visual media processing method includes determining, for a conversion between a first video block of a visual media data and a bitstream representation of the visual media data, an availability of a second video block of the visual media data using a rule; and performing the conversion based on the determining, wherein the rule is at least based on a coding mode used for coding the first video block into the bitstream representation, wherein the rule specifies disallowing motion information of the second video block from being used in a merge list construction of the first block by treating the second video block as unavailable.
1. A method of processing video data, comprising:
making a first decision, for a conversion between a first block of a video and a bitstream of the video, on an availability of a neighboring block for deriving one or more weights for predicting the first block by an availability checking process based on a rule, wherein the first block is coded with a first prediction mode and in the first prediction mode a prediction of the first block is generated at least based on an inter prediction and an intra prediction; and
performing the conversion based on the first decision,
wherein the one or more weights include a first weight which is assigned to the inter prediction of the first block and a second weight which is assigned to an intra prediction of the first block,
wherein the rule excludes use of a comparison of a coding mode of the first block and a coding mode of the neighboring block, wherein a value of an input parameter of the availability checking process is set to false, and wherein the value of the input parameter being false indicates that the availability checking process does not depend on the coding mode of the neighboring block,
wherein the neighboring block is allowed to be determined as available even when the coding mode of the neighboring block is an intra mode, an intra block copy mode, or a palette mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors.
2. The method of claim 1 , wherein when the neighboring block is available, the one or more weights are assigned depending on the coding mode of the neighboring block.
3. The method of claim 1 , further comprising:
making a second decision, for a conversion between a second block of the video and the bitstream of the video, an availability of a third block of the video based on a coding mode of the second block and a coding mode of the third block by the availability checking process, wherein the third block is determined as unavailable in response to the coding mode of the second block being different from the coding mode of the third block; and
performing the conversion between the second block and the bitstream based on the second decision.
4. The method of claim 3 , wherein the coding mode of the second block corresponds to an inter prediction mode and the coding mode of the third block corresponds to an intra block copy mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors.
5. The method of claim 3 , wherein the coding mode of the second block corresponds to an intra block copy mode and the coding mode of the third block corresponds to an inter prediction mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors.
6. The method of claim 3 , wherein motion information of the third block is disallowed from being used in a list construction of the second block in response to the third block being determined as unavailable.
7. The method of claim 3 , wherein the coding mode of the second block is used as another input parameter of the availability checking process.
8. The method of claim 1 , wherein the conversion includes encoding the first block into the bitstream.
9. The method of claim 1 , wherein the conversion includes decoding the first block from the bitstream.
10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
make a first decision, for a conversion between a first block of a video and a bitstream of the video, on an availability of a neighboring block for deriving one or more weights for predicting the first block by an availability checking process based on a rule, wherein the first block is coded with a first prediction mode and in the first prediction mode a prediction of the first block is generated at least based on an inter prediction and an intra prediction; and
perform the conversion based on the first decision,
wherein, the one or more weights include a first weight which is assigned to the inter prediction of the first block and a second weight which is assigned to an intra prediction of the first block,
wherein the rule excludes use of a comparison of a coding mode of the first block and a coding mode of the neighboring block, wherein a value of an input parameter of the availability checking process is set to false, and wherein the value of the input parameter being false indicates that the availability checking process does not depend on the coding mode of the neighboring block,
wherein the neighboring block is allowed to be determined as available even when the coding mode of the neighboring block is an intra mode, an intra block copy mode, or a palette mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors.
11. The apparatus of claim 10 , wherein when the neighboring block is available, the one or more weights are assigned depending on the coding mode of the neighboring block.
12. The apparatus of claim 10 , wherein the instructions further cause the processor to:
make a second decision, for a conversion between a second block of the video and the bitstream of the video, an availability of a third block of the video based on a coding mode of the second block and a coding mode of the third block by the availability checking process, wherein the third block is determined as unavailable in response to the coding mode of the second block being different from the coding mode of the third block; and
perform the conversion between the second block and the bitstream based on the second decision,
wherein the coding mode of the second block corresponds to an inter prediction mode and the coding mode of the third block corresponds to an intra block copy mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors, or alternatively, wherein the coding mode of the second block corresponds to an intra block copy mode and the coding mode of the third block corresponds to an inter prediction mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors;
wherein motion information of the third block is disallowed from being used in a list construction of the second block in response to the third block being determined as unavailable;
and
wherein the coding mode of the second block is used as another input parameter of the availability checking process.
13. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
make a first decision, for a conversion between a first block of a video and a bitstream of the video, on an availability of a neighboring block for deriving one or more weights for predicting the first block by an availability checking process based on a rule, wherein the first block is coded with a first prediction mode and in the first prediction mode a prediction of the first block is generated at least based on an inter prediction and an intra prediction; and
perform the conversion based on the first decision,
wherein the one or more weights include a first weight which is assigned to the inter prediction of the first block and a second weight which is assigned to an intra prediction of the first block,
wherein the rule excludes use of a comparison of a coding mode of the first block and a coding mode of the neighboring block, wherein a value of an input parameter of the availability checking process is set to false, and wherein the value of the input parameter being false indicates that the availability checking process does not depend on the coding mode of the neighboring block,
wherein the neighboring block is allowed to be determined as available even when the coding mode of the neighboring block is an intra mode, an intra block copy mode, or a palette mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors.
14. The non-transitory computer-readable storage medium of claim 13 , wherein when the neighboring block is available, the one or more weights are assigned depending on the coding mode of the neighboring block.
15. The non-transitory computer-readable storage medium of claim 13 , wherein the instructions further cause the processor to:
make a second decision, for a conversion between a second block of the video and the bitstream of the video, an availability of a third block of the video based on a coding mode of the second block and a coding mode of the third block by the availability checking process, wherein the third block is determined as unavailable in response to the coding mode of the second block being different from the coding mode of the third block; and
perform the conversion between the second block and the bitstream based on the second decision,
wherein the coding mode of the second block corresponds to an inter prediction mode and the coding mode of the third block corresponds to an intra block copy mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors, or alternatively, wherein the coding mode of the second block corresponds to an intra block copy mode and the coding mode of the third block corresponds to an inter prediction mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors;
wherein motion information of the third block is disallowed from being used in a list construction of the second block in response to the third block being determined as unavailable;
and
wherein the coding mode of the second block is used as another input parameter of the availability checking process.
16. A non-transitory computer-readable storage medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
making a first decision on an availability of a neighboring block for deriving one or more weights for predicting a first block of a video by an availability checking process based on a rule, wherein the first block is coded with a first prediction mode and in the first prediction mode a prediction of the first block is generated at least based on an inter prediction and an intra prediction; and
generating the bitstream of the video based on the first decision,
wherein the one or more weights include a first weight which is assigned to the inter prediction of the first block and a second weight which is assigned to an intra prediction of the first block,
wherein the rule excludes use of a comparison of a coding mode of the first block and a coding mode of the neighboring block, wherein a value of an input parameter of the availability checking process is set to false, and wherein the value of the input parameter being false indicates that the availability checking process does not depend on the coding mode of the neighboring block,
wherein the neighboring block is allowed to be determined as available even when the coding mode of the neighboring block is an intra mode, an intra block copy mode, or a palette mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors.
17. The non-transitory computer-readable storage medium of claim 16 , wherein when the neighboring block is available, the one or more weights are assigned depending on the coding mode of the neighboring block.
18. The non-transitory computer-readable storage medium of claim 16 , wherein the method further comprises:
making a second decision, for a second block of the video, an availability of a third block of the video based on a coding mode of the second block and a coding mode of the third block by the availability checking process, wherein the third block is determined as unavailable in response to the coding mode of the second block being different from the coding mode of the third block; and
generating the bitstream of the video based on the second decision,
wherein the coding mode of the second block corresponds to an inter prediction mode and the coding mode of the third block corresponds to an intra block copy mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors, or alternatively, wherein the coding mode of the second block corresponds to an intra block copy mode and the coding mode of the third block corresponds to an inter prediction mode, and wherein in the intra block copy mode, prediction samples are derived from blocks of sample values of a same decoded video region as determined by block vectors;
wherein motion information of the third block is disallowed from being used in a list construction of the second block in response to the third block being determined as unavailable;
and
wherein the coding mode of the second block is used as another input parameter of the availability checking process.