Signaling for decoder-side intra mode derivation
Example implementations include a method and of video processing, comprising determining, during a conversion between a current video unit of a video and a bitstream of the video, to apply a prediction mode derivation tool to the current video unit, wherein in the prediction mode derivation tool, at least one intra prediction mode (IPM) is derived for the current video unit based on cost calculations between reconstructed samples and prediction samples of a template region related the current video unit. The implementations further include performing the conversion based on the determining.
1. A method for video processing, comprising:
determining, during a conversion between a current video block of a current video unit of a video and a bitstream of the video, to apply a prediction mode derivation tool to the current video block; and
performing the conversion based on the determining;
wherein in the prediction mode derivation tool, an intra prediction mode (IPM) candidate set comprising at least one IPM is constructed, a derived IPM is derived from the IPM candidate set for the current video block based on cost calculations between reconstructed samples and prediction samples of a template region related the current video block, and one or more syntax elements specifying the derived IPM is omitted from the bitstream; and
wherein the template region related to the current video block locates outside the current video block.
2. The method of claim 1 , wherein the current video unit includes a first color component and a second color component which is the current video block, and the derived IPM is derived from the first color component.
3. The method of claim 2 , wherein an indication of an application of the derived IPM to the second color component is related to a syntax element presented in the bitstream.
4. The method of claim 2 , wherein the first color component and the second color component are of a different color component type in RGB format or YCbCr format.
5. The method of claim 1 , wherein the current video unit includes a chroma block and a corresponding luma block which is the current video block, and a chroma derived mode is applied to the chroma block based on the derived IPM being derived from luma component and/or the derived IPM being applied to the corresponding luma block.
6. The method of claim 1 , wherein the current video unit includes a chroma block and a corresponding luma block which is the current video block, and a chroma derived mode is not applied to the chroma block in response to an application of the derived IPM to the corresponding luma block.
7. The method of claim 1 , wherein the current video unit includes a first color component which is the current video block and a second color component, and wherein the IPM candidate set for the first color component is different from a second IPM candidate set for the second color component.
8. The method of claim 7 , wherein a size of the IPM candidate set is different from a size of the second IPM candidate set, or the size of the IPM candidate set is a same size as the size of the second IPM candidate set but has at least one different IPM candidate different from candidates in the second IPM candidate set.
9. The method of claim 1 , wherein the derived IPM is applied to the current video block based at least in part on coded information, wherein the coded information includes one or more of: a dimension or a shape of the current video block, a slice type of a slice related to the current video block, a temporal layer, and a syntax element presented in the bitstream.
10. The method of claim 1 , wherein the derived IPM is derived further based on a plurality of IPMs corresponding to a plurality of previously-coded blocks.
11. The method of claim 10 , wherein the plurality of previously-coded blocks are neighbouring blocks of the current video block, and the derived IPM is equal to a most used intra mode from the neighbouring blocks.
12. The method of claim 1 , wherein the derived IPM is derived further based on a gradient value of a neighbouring sample of the current video block.
13. The method of claim 12 , wherein the derived IPM is derived from a direction having a largest amplitude.
14. The method of claim 12 , wherein the derived at least one IPM is to set a default mode based on a first number of directions having amplitudes within a predefined range.
15. The method of claim 14 , wherein the default mode is one of a DC mode, planar mode, horizontal degree mode, vertical degree mode, diagonal top-right degree mode, diagonal bottom-left mode, or diagonal top-left mode.
16. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.
17. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.
18. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, during a conversion between a current video block of a current video unit of a video and a bitstream of the video, to apply a prediction mode derivation tool to the current video block; and
perform the conversion based on the determining;
wherein in the prediction mode derivation tool, an intra prediction mode (IPM) candidate set comprising at least one IPM is constructed, a derived IPM is derived from the IPM candidate set for the current video block based on cost calculations between reconstructed samples and prediction samples of a template region related the current video block, and one or more syntax elements specifying the derived IPM is omitted from the bitstream; and
wherein the template region related to the current video block locates outside the current video block.
19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
determining, during a conversion between a current video block of a current video unit of a video and a bitstream of the video, to apply a prediction mode derivation tool to the current video block; and
generating the bitstream based on the determining;
wherein in the prediction mode derivation tool, an intra prediction mode (IPM) candidate set comprising at least IPM is constructed, a derived IPM is derived from the IPM candidate set for the current video block based on cost calculations between reconstructed samples and prediction samples of a template region related the current video block, and one or more syntax elements specifying the derived IPM is omitted from the bitstream; and
wherein the template region related to the current video block locates outside the current video block.
20. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine, during a conversion between a current video block of a current video unit of a video and a bitstream of the video, to apply a prediction mode derivation tool to the current video block; and
perform the conversion based on the determining;
wherein in the prediction mode derivation tool, an IPM candidate set comprising at least one intra prediction mode (IPM) is constructed, an IPM is derived from the IPM candidate set for the current video block based on cost calculations between reconstructed samples and prediction samples of a template region related the current video block, and one or more syntax elements specifying the derived IPM is omitted from the bitstream; and
wherein the template region related to the current video block locates outside the current video block.