Interactions among multiple intra coding methods
Techniques, devices, and systems for video processing are described. In one example aspect, a video processing method includes determining, for a conversion between a block of a video and a bitstream representation of the video, a manner in which information for a Matrix-based Intra Prediction (MIP) coding technique is coded in the bitstream representation. A prediction block of the block is determined using the MIP coding technique based on performing a matrix vector multiplication operation on previously coded samples of the video. The method also includes performing the conversion based on the determining.
1. A method of processing video data, comprising:
determining, for a conversion between a block of a video and a bitstream of the video, only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, and
performing the conversion based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation,
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of the block and predictors of the quantized residuals are presented in the bitstream, and
wherein in the first coding mode, a boundary down-sampling operation is determined to apply on neighboring samples of the block based on a size of the block before the matrix vector multiplication operation, and an up-sampling operation is selectively performed after the matrix vector multiplication operation.
2. The method of claim 1 , wherein in the second coding mode, a transform operation is skipped.
3. The method of claim 2 , wherein in the second coding mode, prediction samples are derived based on a horizontal intra coding mode or a vertical intra coding mode.
4. The method of claim 3 , wherein in the second coding technique, differences between quantized residuals and predictors of the quantized residuals are represented in the bitstream using a pulse coding modulation representation.
5. The method of claim 1 , wherein in response to the second information being included in the bitstream, the first information is excluded from the bitstream.
6. The method of claim 5 , wherein the first coding mode is not applied to the block.
7. The method of claim 1 , wherein only one of the first coding technique or the second coding technique is applicable to the block.
8. The method of claim 1 , wherein the first coding code includes multiple types, and which type to be used is determined without constructing a candidate list.
9. The method of claim 1 , wherein how to code the second information is based on abs(Log 2(cbWidth)−Log 2(cbHeight), wherein cbWidth denotes a width of the block, cbHeight denotes a height of the block, and abs is a algorithmic symbol for absolute value.
10. The method of claim 9 , wherein how to code the second information is based on whether abs(Log 2(cbWidth)−Log 2(cbHeight) is greater than a fixed value.
11. The method of claim 1 , wherein the conversion includes encoding the block into the bitstream.
12. The method of claim 1 , wherein the conversion includes decoding the block from the bitstream.
13. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, for a conversion between a block of a video and a bitstream of the video, only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, and
perform the conversion based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation,
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of the block and predictors of the quantized residuals are presented in the bitstream, and
wherein in the first coding mode, a boundary down-sampling operation is determined to apply on neighboring samples of the block based on a size of the block before the matrix vector multiplication operation, and an up-sampling operation is selectively performed after the matrix vector multiplication operation.
14. The apparatus of claim 13 , wherein in the second coding mode, a transform operation is skipped, wherein in the second coding mode, prediction samples are derived based on a horizontal intra coding mode or a vertical intra coding mode, and wherein in the second coding technique, differences between quantized residuals and predictors of the quantized residuals are represented in the bitstream using a pulse coding modulation representation.
15. The apparatus of claim 13 , wherein in response to the second information being included in the bitstream, the first information is excluded from the bitstream, and the first coding mode is not applied to the block.
16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine, for a conversion between a block of a video and a bitstream of the video, only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, and
perform the conversion based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation,
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of the block and predictors of the quantized residuals are presented in the bitstream, and
wherein in the first coding mode, a boundary down-sampling operation is determined to apply on neighboring samples of the block based on a size of the block before the matrix vector multiplication operation, and an up-sampling operation is selectively performed after the matrix vector multiplication operation.
17. The non-transitory computer-readable storage medium of claim 16 , wherein in the second coding mode, a transform operation is skipped, wherein in the second coding mode, prediction samples are derived based on a horizontal intra coding mode or a vertical intra coding mode, and wherein in the second coding technique, differences between quantized residuals and predictors of the quantized residuals are represented in the bitstream using a pulse coding modulation representation.
18. The non-transitory computer-readable storage medium of claim 16 , wherein in response to the second information being included in the bitstream, the first information is excluded from the bitstream, and the first coding mode is not applied to the block.
19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
determining only one of first information related to a first coding mode and second information related to a second coding mode being included in the bitstream, and
generating the bitstream based on the determining,
wherein in the first coding mode, prediction samples are derived based on performing a matrix vector multiplication operation,
wherein in the second coding mode, differences between quantized residuals derived with an intra prediction of the block and predictors of the quantized residuals are presented in the bitstream, and
wherein in the first coding mode, a boundary down-sampling operation is determined to apply on neighboring samples of the block based on a size of the block before the matrix vector multiplication operation, and an up-sampling operation is selectively performed after the matrix vector multiplication operation.
20. The non-transitory computer-readable recording medium of claim 19 , wherein in the second coding mode, a transform operation is skipped, wherein in the second coding mode, prediction samples are derived based on a horizontal intra coding mode or a vertical intra coding mode, and wherein in the second coding technique, differences between quantized residuals and predictors of the quantized residuals are represented in the bitstream using a pulse coding modulation representation.