Interactions among multiple intra coding methods
A video processing method includes determining, for a conversion between a block of a video and a bitstream representation of the video, a manner in which information for a Matrix-based Intra Prediction (MIP) coding technique is coded in the bitstream representation. A prediction block of the block is determined using the MIP coding technique based on performing a matrix vector multiplication operation on previously coded samples of the video. The method also includes performing the conversion based on the determining.
1. A method of processing video data, comprising:
determining, for a conversion between a block of a video and a bitstream of the video, only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, wherein only one of the first coding mode or the second coding mode is applicable to the block; and
performing the conversion based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation, wherein coding the first information is based on whether abs(Log 2(cbWidth)−Log 2(cbHeight) is greater than a fixed value, wherein cb Width denotes a width of the block, cbHeight denotes a height of the block, and abs is an algorithmic symbol for absolute value, and
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of the block and predictors of the quantized residuals are included in the bitstream.
2. The method of claim 1 , wherein in the second coding mode, a transform operation is skipped.
3. The method of claim 2 , wherein in the second coding mode, prediction samples are derived based on a horizontal intra coding mode or a vertical intra coding mode.
4. The method of claim 3 , wherein in the second coding mode, differences between the quantized residuals and the predictors of the quantized residuals are represented in the bitstream using a pulse coding modulation representation.
5. The method of claim 1 , wherein in response to the second information being included in the bitstream, the first information is excluded from the bitstream.
6. The method of claim 5 , wherein the first coding mode is not applied to the block.
7. The method of claim 1 , wherein the first coding mode includes a plurality of types, and one of the plurality of types is determined to be used without constructing a candidate list.
8. The method of claim 1 , wherein in the first coding mode, a boundary down-sampling operation is determined to apply on neighboring samples of the block based on a size of the block before the matrix vector multiplication operation, and an up-sampling operation is selectively performed after the matrix vector multiplication operation.
9. The method of claim 1 , wherein the conversion includes encoding the block into the bitstream.
10. The method of claim 1 , wherein the conversion includes decoding the block from the bitstream.
11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, for a conversion between a block of a video and a bitstream of the video, only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, wherein only one of the first coding mode or the second coding mode is applicable to the block; and
perform the conversion based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation, wherein coding the first information is based on whether abs(Log 2(cbWidth)−Log 2(cbHeight) is greater than a fixed value, wherein cbWidth denotes a width of the block, cbHeight denotes a height of the block, and abs is an algorithmic symbol for absolute value, and
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of the block and predictors of the quantized residuals are included in the bitstream.
12. The apparatus of claim 11 , wherein in the second coding mode, a transform operation is skipped, wherein in the second coding mode, prediction samples are derived based on a horizontal intra coding mode or a vertical intra coding mode, and differences between the quantized residuals and the predictors of the quantized residuals are represented in the bitstream using a pulse coding modulation representation.
13. The apparatus of claim 11 , wherein in response to the second information being included in the bitstream, the first information is excluded from the bitstream, and the first coding mode is not applied to the block.
14. The apparatus of claim 11 , wherein the first coding mode includes a plurality of types, and one of the plurality of types is determined to be used without constructing a candidate list.
15. The apparatus of claim 11 , wherein in the first coding mode, a boundary down-sampling operation is determined to apply on neighboring samples of the block based on a size of the block before the matrix vector multiplication operation, and an up-sampling operation is selectively performed after the matrix vector multiplication operation.
16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine, for a conversion between a block of a video and a bitstream of the video, only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, wherein only one of the first coding mode or the second coding mode is applicable to the block; and
perform the conversion based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation, wherein coding the first information is based on whether abs(Log 2 (cbWidth)−Log 2(cbHeight) is greater than a fixed value, wherein cbWidth denotes a width of the block, cbHeight denotes a height of the block, and abs is an algorithmic symbol for absolute value, and
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of the block and predictors of the quantized residuals are included in the bitstream.
17. The non-transitory computer-readable storage medium of claim 16 , wherein in the second coding mode, a transform operation is skipped, wherein in the second coding mode, prediction samples are derived based on a horizontal intra coding mode or a vertical intra coding mode, and differences between the quantized residuals and the predictors of the quantized residuals are represented in the bitstream using a pulse coding modulation representation.
18. The non-transitory computer-readable storage medium of claim 16 , wherein in response to the second information being included in the bitstream, the first information is excluded from the bitstream, and the first coding mode is not applied to the block.
19. The non-transitory computer-readable storage medium of claim 16 , wherein the first coding mode includes a plurality of types, and one of the plurality of types is determined to be used without constructing a candidate list.
20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
determining only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, wherein only one of the first coding mode or the second coding mode is applicable to a block of the video; and
generating the bitstream based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation, wherein coding the first information is based on whether abs(Log 2(cbWidth)−Log 2(cbHeight) is greater than a fixed value, wherein cbWidth denotes a width of the block, cbHeight denotes a height of the block, and abs is an algorithmic symbol for absolute value, and
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of a block of the video and predictors of the quantized residuals are included in the bitstream.