Image coding method based on quadratic transform, and apparatus therefor
An image decoding method according to the present document comprises the steps of: receiving a quantized transform coefficient for a target block and a transform index for non-separable quadratic transform; deriving transform coefficients by inversely quantizing the quantized transform coefficient; deriving corrected transform coefficients on the basis of a transform kernel matrix in a predetermined transform set indicated by the transform index; and deriving residual samples for the target block on the basis of inverse linear transform for the corrected transform coefficients, wherein when the target block is divided into a predetermined number of sub-blocks and is coded by intra prediction, the corrected transform coefficients are derived in units of the sub-blocks, and the transform index is received for the target block.
1. An image decoding method performed by a decoding apparatus, the method comprising:
receiving quantized transform coefficients and a transform index for a non-separable secondary transform for a coding block;
deriving transform coefficients by dequantizing the quantized transform coefficients;
deriving modified transform coefficients based on a transform kernel matrix related to the transform index in a transform set; and
deriving residual samples based on an inverse primary transform of the modified transform coefficients,
wherein the coding block is partitioned into a plurality of sub-blocks based on an Intra Sub Partitions (ISP) mode including horizontal and vertical mode,
wherein the coding block is partitioned into a specific number of sub-blocks based on a shape of a coding unit,
wherein the transform index is signaled in unit of the coding block and applied to the plurality of sub-blocks,
wherein the same transform kernel matrix is applied to the sub-blocks in the non-separable secondary transform, and
wherein the modified transform coefficients are derived in unit of the sub-block.
2. The image decoding method of claim 1 , wherein each sub-block is a transform unit.
3. The image decoding method of claim 1 , wherein the coding block is partitioned into two sub: blocks when the coding block has a size (width x height) of 8×4, and
wherein the coding block is partitioned into two sub: blocks when the coding block has a size (width x height) of 4×8.
4. The image decoding method of claim 3 , wherein the coding block is horizontally or vertically partitioned into four sub: blocks when the coding block has a size (width x height) greater than 4×8 or 8×4.
5. An image encoding method performed by an image encoding apparatus, the method comprising:
deriving prediction samples based on an intra prediction mode applied to a coding block;
deriving residual samples for the coding block based on the prediction samples;
deriving transform coefficients by applying a primary transform to the residual samples;
deriving modified transform coefficients by performing a non-separable secondary transform on the transform coefficients using a transform set mapped to the intra prediction mode of the coding block and one transform kernel matrix comprised in the transform set;
deriving quantized transform coefficients by performing quantization based on the modified transform coefficients; and
encoding a transform index related to the transform kernel matrix and the quantized transform coefficients,
wherein the coding block is partitioned into a plurality of sub-blocks based on an Intra Sub Partitions (ISP) mode including horizontal and vertical mode,
wherein the coding block is partitioned into a specific number of sub-blocks based on a shape of a coding unit,
wherein the transform index is encoded in a unit of the coding block and applied to the plurality of sub-blocks,
wherein the same transform kernel matrix is applied to the sub-blocks in the non-separable secondary transform, and
wherein the modified transform coefficients are derived in unit of sub-block.
6. The image encoding method of claim 5 , wherein the coding block is partitioned into two sub-blocks when the coding block has a size (width x height) of 8×4, and
wherein the coding block is partitioned into two sub: blocks when the coding block has a size (width x height) of 4×8.
7. The image encoding method of claim 5 , wherein the coding block is horizontally or vertically partitioned into four sub: blocks when the coding block has a size (width x height) greater than 4×8 or 8×4.
8. The image encoding method of claim 5 , further comprising:
encoding flag information indicating whether the ISP mode is applied to the coding block.
9. A non-transitory computer-readable digital storage medium storing a bitstream generated by a method, the method comprising:
deriving prediction samples based on an intra prediction mode applied to a coding block;
deriving residual samples for the coding block based on the prediction samples;
deriving transform coefficients by applying a primary transform to the residual samples;
deriving modified transform coefficients by performing a non-separable secondary transform on the transform coefficients using a transform set mapped to the intra prediction mode of the coding block and one transform kernel matrix comprised in the transform set;
deriving quantized transform coefficients by performing quantization based on the modified transform coefficients; and
encoding image information including a transform index related to the transform kernel matrix and the quantized transform coefficients to generate the bitstream,
wherein the coding block is partitioned into a plurality of sub-blocks based on an Intra Sub Partitions (ISP) mode including horizontal and vertical mode,
wherein the coding block is partitioned into a specific number of sub: blocks based on a shape of a coding unit,
wherein the transform index is encoded in a unit of the coding block and applied to the plurality of sub-blocks,
wherein the same transform kernel matrix is applied to the sub-blocks in the non-separable secondary transform, and
wherein the modified transform coefficients are derived in unit of sub-block.