IP Library › Granted Patent US 11,936,911
Granted Patent B2
US 11,936,911 · App. 17/689,277 · Granted Mar 19, 2024

Image coding method based on secondary transform, and device therefor

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/60H04N19/124H04N19/159H04N19/176H04N19/18H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,936,911
App. No.
17/689,277
Granted
Mar 19, 2024
Kind
B2
Abstract

An image decoding method comprises the steps of: deriving transform coefficients through inverse quantization on the basis of quantized transform coefficients for a target block; deriving modified transform coefficients on the basis of an inverse reduced secondary transform (RST) for the transform coefficients; and generating a restoration picture on the basis of residual samples for the target block, on the basis of an inverse primary transform for the modified transform coefficients, wherein the inverse RST is performed on the basis of: transform sets determined by a mapping relation according to an intra prediction mode applied to the target block; and a transform kernel matrix selected from among two transform kernel matrices included in each of the transform sets, and is performed on the basis of: whether the inverse RST is applied; and a transform index for indicating any one of the transform kernel matrices included in the transform sets.

Claims (56)

1. An image decoding method performed by a decoding apparatus, the method comprising:

obtaining prediction information and information on quantized transform coefficients from a bitstream;

deriving quantized transform coefficients for a target block based on the information on the quantized transform coefficients;

deriving transform coefficients for the target block based on a dequantization for the quantized transform coefficients;

deriving modified transform coefficients for the target block based on an inverse secondary transform for the transform coefficients;

deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients;

deriving prediction samples for the target block based on the prediction information; and

generating a reconstructed picture based on the residual samples and the prediction samples for the target block,

wherein the deriving of the modified transform coefficients comprises:

deriving a transform kernel matrix, and

performing a matrix operation of the transform coefficients and the transform kernel matrix,

wherein the transform kernel matrix is derived based on a transform index and a transform set,

wherein the transform index represents at least one of first index information, second index information, and third index information, the first index information indicating the inverse secondary transform being not applied to the target block, the second index information indicating a first transform kernel matrix as the transform kernel matrix for the inverse secondary transform, and the third index information indicating a second transform kernel matrix as the transform kernel matrix for the inverse secondary transform,

wherein the transform set is determined based on an intra prediction mode of the target block,

wherein the intra prediction mode of the target block is mapped to one of the four transform sets,

wherein the transform set is determined, based on the intra prediction mode being equal to 0 or 1, as a first transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 2 and smaller than or equal to 12, as a second transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 13 and smaller than or equal to 23, as a third transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 24 and smaller than or equal to 44, as a fourth transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 45 and smaller than or equal to 55, as the third transform set index value, and

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 56, as the second transform set index value.

2. An image encoding method performed by an image encoding apparatus, the method comprising:

deriving prediction samples based on an intra prediction mode applied to a target block;

deriving residual samples for the target block based on the prediction samples;

deriving transform coefficients for the target block based on a primary transform for the residual samples;

deriving modified transform coefficients based on a secondary transform of the transform coefficients;

deriving quantized transform coefficients based on a quantization of the modified transform coefficients; and

encoding prediction information, information on the quantized transform coefficients, and a transform index related to a transform kernel matrix,

wherein the deriving of the modified transform coefficients comprises:

determining a transform set and the transform kernel matrix; and

performing a matrix operation of the transform coefficients and the transform kernel matrix,

wherein the transform index that represents at least one of first index information, second index information, and third index information, the first index information indicating the inverse secondary transform being not applied to the target block, the second index information indicating a first transform kernel matrix as the transform kernel matrix for the inverse secondary transform, and the third index information indicating a second transform kernel matrix as the transform kernel matrix for the inverse secondary transform,

wherein the transform set is determined based on the intra prediction mode of the target block,

wherein the intra prediction mode of the target block is mapped to one of the four transform sets,

wherein the transform set is determined, based on the intra prediction mode being equal to 0 or 1, as a first transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 2 and smaller than or equal to 12, as a second transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 13 and smaller than or equal to 23, as a third transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 24 and smaller than or equal to 44, as a fourth transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 45 and smaller than or equal to 55, as the third transform set index value, and

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 56, as the second transform set index value.

3. A non-transitory computer readable storage medium storing a bitstream generated by the encoding method of claim 2 .

4. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on deriving prediction samples based on an intra prediction mode applied to a target block, deriving residual samples for the target block based on the prediction samples, deriving transform coefficients for the target block based on a primary transform for the residual samples, deriving modified transform coefficients based on a secondary transform of the transform coefficients, deriving quantized transform coefficients based on a quantization of the modified transform coefficients, and encoding prediction information, information on the quantized transform coefficients, and a transform index related to a transform kernel matrix; and

transmitting the data comprising the bitstream,

wherein the deriving of the modified transform coefficients comprises:

determining a transform set and the transform kernel matrix, and

performing a matrix operation of the transform coefficients and the transform kernel matrix,

wherein the transform index that represents at least one of first index information, second index information, and third index information, the first index information indicating the inverse secondary transform being not applied to the target block, the second index information indicating a first transform kernel matrix as the transform kernel matrix for the inverse secondary transform, and the third index information indicating a second transform kernel matrix as the transform kernel matrix for the inverse secondary transform,

wherein the transform set is determined based on the intra prediction mode of the target block,

wherein the intra prediction mode of the target block is mapped to one of the four transform sets,

wherein the transform set is determined, based on the intra prediction mode being equal to 0 or 1, as a first transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 2 and smaller than or equal to 12, as a second transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 13 and smaller than or equal to 23, as a third transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 24 and smaller than or equal to 44, as a fourth transform set index value,

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 45 and smaller than or equal to 55, as the third transform set index value, and

wherein the transform set is determined, based on the intra prediction mode being greater than or equal to 56, as the second transform set index value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2022
From: KOO, MOONMO; LIM, JAEHYUN; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 061123/0259 →
Continuity (4)
Continuation 17327242 · May 21, 2021
Continuation PCTKR2019017104 · Dec 5, 2019
Provisional Application 62775914 · Dec 6, 2018
Related Publication 20220191546A1 · Jun 16, 2022
Cited By (1)
US 12,701,217