Encoder that determines an intra prediction mode used for a current block and performs quantization on first transform coefficients or second transform coefficients based on whether a primary transform basis is included in predetermined transform bases
An encoder that encodes a video includes a processor and memory. Using the memory, the processor: derives a prediction error of an image included in the video, by subtracting a prediction image of the image from the image; determines a secondary transform basis based on a primary transform basis, the primary transform basis being a transform basis for a primary transform to be performed on the prediction error, the secondary transform basis being a transform basis for a secondary transform to be performed on a result of the primary transform; performs the primary transform on the prediction error using the primary transform basis; performs the secondary transform on a result of the primary transform using the secondary transform basis; performs quantization on a result of the secondary transform; and encodes a result of the quantization as data of the image.
1. An encoder comprising:
a processor; and
memory,
wherein, using the memory, the processor:
derives a residual signal of a current block by subtracting a prediction signal from an input signal;
determines an intra prediction mode used for the current block;
performs a primary transform on the residual signal, using a primary transform basis, to generate first transform coefficients;
when the primary transform basis is different from predetermined transform bases, performs a quantization on the first transform coefficients without performing a secondary transform;
when the primary transform basis is included in the predetermined transform bases, (i) performs a secondary transform on the first transform coefficients, using a secondary transform basis selected from among one or more candidate secondary transform bases associated with the intra prediction mode, to generate second transform coefficients, and (ii) performs a quantization on the second transform coefficients; and
generates a bitstream by encoding a result of the quantization,
wherein the secondary transform is performed on a part of the first transform coefficients generated by the primary transform, and
wherein the primary transform is a separable transform.
2. A decoder comprising:
a processor; and
memory,
wherein, using the memory, the processor:
determines an intra prediction mode used for a current block;
determines an inverse primary transform basis used for an inverse primary transform;
performs an inverse quantization on quantized coefficient of the current block to generate second transform coefficients;
when the inverse primary transform basis is different from predetermined inverse transform bases, performs the inverse primary transform on the second transform coefficients using the inverse primary transform basis without performing an inverse secondary transform, to generate a residual signal of the current block; and
when the inverse primary transform basis is included in the predetermined inverse transform bases, (i) performs an inverse secondary transform on the second transform coefficients, using an inverse secondary transform basis selected from among one or more candidate inverse secondary transform bases associated with the intra prediction mode, to generate first transform coefficients and (ii) performs the inverse primary transform on the first transform coefficients, using the inverse primary transform basis, to generate a residual signal of the current block,
wherein the inverse secondary transform is performed on a part of the second transform coefficients generated by the inverse quantization, and
wherein the inverse primary transform is a separable transform.
3. An encoding method comprising:
deriving a residual signal of a current block by subtracting a prediction signal from an input signal;
determining an intra prediction mode used for the current block;
performing a primary transform on the residual signal, using a primary transform basis, to generate first transform coefficients;
when the primary transform basis is different from predetermined transform bases, performing a quantization on the first transform coefficients without performing a secondary transform;
when the primary transform basis is included in the predetermined transform bases, (i) performing a secondary transform on the first transform coefficients, using a secondary transform basis selected from among one or more candidate secondary transform bases associated with the intra prediction mode, to generate second transform coefficients, and (ii) performing a quantization on the second transform coefficients; and
generating a bitstream by encoding a result of the quantization,
wherein the secondary transform is performed on a part of the first transform coefficients generated by the primary transform, and
wherein the primary transform is a separable transform.
4. A decoding method comprising:
determining an intra prediction mode used for a current block;
determining an inverse primary transform basis used for an inverse primary transform;
performing an inverse quantization on quantized coefficient of the current block to generate second transform coefficients;
when the inverse primary transform basis is different from predetermined inverse transform bases, performing the inverse primary transform on the second transform coefficients using the inverse primary transform basis without performing an inverse secondary transform, to generate a residual signal of the current block; and
when the inverse primary transform basis is included in the predetermined inverse transform bases, (i) performing an inverse secondary transform on the second transform coefficients, using an inverse secondary transform basis selected from among one or more candidate inverse secondary transform bases associated with the intra prediction mode, to generate first transform coefficients and (ii) performing the inverse primary transform on the first transform coefficients, using the inverse primary transform basis, to generate a residual signal of the current block,
wherein the inverse secondary transform is performed on a part of the second transform coefficients generated by the inverse quantization, and
wherein the inverse primary transform is a separable transform.