Techniques for decoding or coding images based on multiple intra-prediction modes
Aspects of the present disclosure provide techniques for derive one or more intra prediction modes (IPMs) from a subset of IPM candidates in order to determine a predictor to use for decoding a block of an image. In some aspects, the subset of IPM candidates may include IPMs that are less than the number of IPMs in a full set of all available IPM candidates (e.g., 67 IPMs in VVC or 35 in HEVC). In some aspects, the subset of IPM candidates may be based on a most probable mode (MPM) list that can be used to determine or signal an IPM based on IPMs previously used in decoding other blocks.
1. A method of coding video data, comprising:
constructing, during a conversion between a current video block of a video and a bitstream of the video, at least one template set for the current video block from a plurality of sub-templates;
deriving, at least one intra-prediction mode (IPM) from a first set of candidate IPMs based on cost calculations, wherein the first set of candidate IPMs includes a number of IPMs that are less than a second set of candidate IPMs which includes allowed IPMs for intra-coded blocks, wherein at least one index for the at least one IPM is omitted from the bitstream, wherein the first set of candidate IPMs comprises at least one IPM selected from a list of most probable modes (MPMs) and at least one IPM selected from pre-configured IPMs that are excluded from the list of MPMs, and wherein the pre-configured IPMs comprises one or more of depth coding (DC), planar, horizontal mode, vertical mode, diagonal top-right mode, diagonal bottom-left mode, or diagonal top-left mode;
determining, based on the at least one IPM, a final predictor of the current video block; and
performing the conversion based on the final predictor.
2. The method of claim 1 , wherein deriving, at least one intra-prediction mode (IPM) from a first set of candidate IPMs based on cost calculations comprising:
calculating a cost between a prediction of reconstructed samples in the at least one template and the reconstructed samples in the at least one template for each IPM of multiple IPMs from the first set of candidate IPMs; and
selecting the at least one IPM from the multiple IPMs based on the cost calculations for each IPM of the first set of candidate IPMs.
3. The method of claim 1 , wherein the first set of candidate IPMs includes one or more of depth coding (DC), planar, or IPMs with mode numbers that are even or odd in the second set of candidate IPMs.
4. The method of claim 1 , wherein the first set of candidate IPMs includes one or more of depth coding (DC), planar, or IPMs with mode number equal to X in the second set of candidate IPMs, wherein X % m==0, and m is an integer.
5. The method of claim 1 , wherein the first set of candidate IPMs includes one or more of depth coding (DC), planar, horizontal mode, vertical mode, diagonal top-right mode, diagonal bottom-left mode, or diagonal top-left mode.
6. The method of claim 1 , wherein the first set of candidate IPMs are different according to coding information of the current video block, wherein the coding information includes one or more of block dimension, block shape, or slice type.
7. The method of claim 1 , wherein all IPMs of the first set of candidate IPMs are selected not from the second set of candidate IPMs.
8. The method of claim 7 , wherein the first set of candidate IPMs includes IPMs with denser directions than IPMs of the second set of candidate IPMs.
9. The method of claim 1 , wherein one or more IPMs of the first set of candidate IPMs are selected from the second set of candidate IPMs, and other IPMs of the first set of candidate IPMs are selected not from the second set of candidate IPMs.
10. The method of claim 1 , wherein IPMs of the first set of candidate IPMs are partial or all of IPMs from a list of most probable modes (MPMs).
11. The method of claim 1 , wherein the at least one IPM is derived from partial IPMs of the first set of candidate IPMs.
12. The method of claim 1 , wherein one or more IPMs of the second set of candidate IPMs are replaced by several IPMs, and the several IPMs includes wide-angle intra prediction modes, and wherein the at least one IPM is different from the several IPMs, or there are K identical IPMs in the at least one IPM and the several IPMs, and K is an integer greater than or equal to 1.
13. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.
14. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.
15. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
construct, during a conversion between a current video block of a video and a bitstream of the video, at least one template set for the current video block from a plurality of sub-templates;
derive, at least one intra-prediction mode (IPM) from a first set of candidate IPMs based on cost calculations, wherein the first set of candidate IPMs includes a number of IPMs that are less than a second set of candidate IPMs which includes allowed IPMs for intra-coded blocks, wherein at least one index for the at least one IPM is omitted from the bitstream, wherein the first set of candidate IPMs comprises at least one IPM selected from a list of most probable modes (MPMs) and at least one IPM selected from pre-configured IPMs that are excluded from the list of MPMs, and wherein the pre-configured IPMs comprises one or more of depth coding (DC), planar, horizontal mode, vertical mode, diagonal top-right mode, diagonal bottom-left mode, or diagonal top-left mode;
determine, based on the at least one IPM, a final predictor of the current video block; and
perform the conversion based on the final predictor.
16. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
constructing, during a conversion between a current video block of a video and a bitstream of the video, at least one template set for the current video block from a plurality of sub-templates;
deriving, at least one intra-prediction mode (IPM) from a first set of candidate IPMs based on cost calculations, wherein the first set of candidate IPMs includes a number of IPMs that are less than a second set of candidate IPMs which includes allowed IPMs for intra-coded blocks, wherein at least one index for the at least one IPM is omitted from the bitstream, wherein the first set of candidate IPMs comprises at least one IPM selected from a list of most probable modes (MPMs) and at least one IPM selected from pre-configured IPMs that are excluded from the list of MPMs, and wherein the pre-configured IPMs comprises one or more of depth coding (DC), planar, horizontal mode, vertical mode, diagonal top-right mode, diagonal bottom-left mode, or diagonal top-left mode;
determining, based on the at least one IPM, a final predictor of the current video block; and
generating the bitstream from the current block based on the final predictor.
17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
construct, during a conversion between a current video block of a video and a bitstream of the video, at least one template set for the current video block from a plurality of sub-templates;
derive, at least one intra-prediction mode (IPM) from a first set of candidate IPMs based on cost calculations, wherein the first set of candidate IPMs includes a number of IPMs that are less than a second set of candidate IPMs which includes allowed IPMs for intra-coded blocks, wherein at least one index for the at least one IPM is omitted from the bitstream, wherein the first set of candidate IPMs comprises at least one IPM selected from a list of most probable modes (MPMs) and at least one IPM selected from pre-configured IPMs that are excluded from the list of MPMs, and wherein the pre-configured IPMs comprises one or more of depth coding (DC), planar, horizontal mode, vertical mode, diagonal top-right mode, diagonal bottom-left mode, or diagonal top-left mode;
determine, based on the at least one IPM, a final predictor of the current video block; and
perform the conversion based on the final predictor.