IP Library › Granted Patent US 11,277,638
Granted Patent B2
US 11,277,638 · App. 17/329,749 · Granted Mar 15, 2022

Image coding method based on secondary transform, and device therefor

Inventors: Moonmo Koo (Seoul, KR); Seunghwan Kim (Seoul, KR); Jaehyun Lim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/61H04N19/11H04N19/124H04N19/132H04N19/159H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,277,638
App. No.
17/329,749
Granted
Mar 15, 2022
Kind
B2
Abstract

An image decoding method according to the present document comprises the steps of: deriving transform coefficients through inverse quantization on the basis of quantized transform coefficients for a target block; deriving modified transform coefficients on the basis of an inverse reduced secondary transform (RST) for the transform coefficients; and generating, on the basis of an inverse primary transform for the modified transform coefficients, a restoration picture based on residual samples for the target block, wherein the modified transform coefficients derived according to the inverse RST are two-dimensionally arranged according to the order of a row priority direction or a column priority direction according to an intra prediction mode to be applied to the target block.

Claims (33)

1. An image decoding method performed by a decoding apparatus, the method comprising:

deriving transform coefficients through dequantization based on quantized transform coefficients for a target block;

deriving modified transform coefficients based on an inverse reduced secondary transform (RST) using a preset transform kernel matrix for the transform coefficients;

deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients; and

generating a reconstructed picture based on the residual samples for the target block,

wherein the inverse RST is an inverse transform of a transform that derives a smaller number of transform coefficients than transform coefficients for a predetermined top-left area of the target block based on the transform coefficients for the top-left area,

wherein the modified transform coefficients in a two-dimensional array are derived, by applying the inverse RST, from the transform coefficients in a one-dimensional (1D) array according to one of a row-first direction or a column-first direction according to an intra prediction mode applied to the target block.

2. The image decoding method of claim 1 , wherein, when the intra prediction mode is a horizontal mode in a left direction with respect to a top-left diagonal direction, the modified transform coefficients are two-dimensionally arranged according to the row-first direction.

3. The image decoding method of claim 2 , wherein, when an intra prediction mode applicable to the target block is one of 65 directional modes, an intra prediction mode in the top-left diagonal direction is mode 34, and the intra prediction mode applied to the target block comprises mode 2 to mode 34, the modified transform coefficients are two-dimensionally arranged according to the row-first direction.

4. The image decoding method of claim 3 , wherein, when an intra prediction mode applicable to the target block is one of 65 directional modes, an intra prediction mode in the top-left diagonal direction is mode 34, and the intra prediction mode applied to the target block comprises mode 35 to mode 66, the modified transform coefficients are two-dimensionally arranged according to the column-first direction.

5. The image decoding method of claim 1 , wherein, when the intra prediction mode is a vertical mode in a right direction with respect to a top-left diagonal direction, the modified transform coefficients are two-dimensionally arranged according to the column-first direction.

6. The image decoding method of claim 1 , wherein, when the intra prediction mode applied to the target block is a planar mode or a DC mode, the modified transform coefficients are two-dimensionally arranged according to the row-first direction.

7. The image decoding method of claim 1 , wherein the inverse RST is performed based on a transform set determined based on a mapping relationship according to the intra prediction mode applied to the target block and a transform kernel matrix selected from among a plurality of transform kernel matrices comprised in each of the transform set, and is performed based on a transform index indicating whether the inverse RST is applied and one of the transform kernel matrices comprised in the transform set.

8. An image encoding method performed by an image encoding apparatus, the method comprising:

deriving prediction samples based on an intra prediction mode applied to a target block;

deriving residual samples for the target block based on the prediction samples;

deriving transform coefficients for the target block based on a primary transform for the residual samples;

deriving modified transform coefficients based on a reduced secondary transform (RST) for the transform coefficients; and

deriving quantized transform coefficients by performing quantization based on the modified transform coefficients,

wherein the RST is a transform that derives a smaller number of transform coefficients than transform coefficients for a predetermined top-left area of the target block based on the transform coefficients for the top-left area,

wherein the deriving of the modified transform coefficients comprises one-dimensionally arranging the transform coefficients according to one of a row-first direction or a column-first direction according to the intra prediction mode applied to the target block and applying the RST to the transform coefficients.

9. The image encoding method of claim 8 , wherein, when the intra prediction mode is a horizontal mode in a left direction with respect to a top-left diagonal direction, the transform coefficients are one-dimensionally arranged according to the row-first direction.

10. The image encoding method of claim 9 , wherein, when an intra prediction mode applicable to the target block is one of 65 directional modes, an intra prediction mode in the top-left diagonal direction is mode 34, and the intra prediction mode applied to the target block comprises mode 2 to mode 34, the transform coefficients are one-dimensionally arranged according to the row-first direction.

11. The image encoding method of claim 8 , wherein, when the intra prediction mode is a vertical mode in a right direction with respect to a top-left diagonal direction, the transform coefficients are one-dimensionally arranged according to the column-first direction.

12. The image encoding method of claim 11 , wherein, when an intra prediction mode applicable to the target block is one of 65 directional modes, an intra prediction mode in the top-left diagonal direction is mode 34, and the intra prediction mode applied to the target block comprises mode 35 to mode 66, the transform coefficients are one-dimensionally arranged according to the column-first direction.

13. The image encoding method of claim 8 , wherein, when the intra prediction mode applied to the target block is a planar mode or a DC mode, the 8 transform coefficients are one-dimensionally arranged according to the row-first direction.

14. A non-transitory computer readable storage medium storing encoded information causing a decoding apparatus to perform an image decoding method, the method comprising:

deriving transform coefficients through dequantization based on quantized transform coefficients for a target block;

deriving modified transform coefficients based on an inverse reduced secondary transform (RST) using a preset transform kernel matrix for the transform coefficients;

deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients; and

generating a reconstructed picture based on the residual samples for the target block,

wherein the inverse RST is an inverse transform of a transform that derives a smaller number of transform coefficients than transform coefficients for a predetermined top-left area of the target block based on the transform coefficients for the top-left area,

wherein the modified transform coefficients in a two-dimensional array are derived, by applying the inverse RST, from the transform coefficients in a one-dimensional (1D) array according to one of a row-first direction or a column-first direction according to an intra prediction mode applied to the target block.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S COUNTRY OF RECORD PREVIOUSLY RECORDED ON REEL 056390 FRAME 0561. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 17, 2021
From: KOO, MOONMO; KIM, SEUNGHWAN; LIM, JAEHYUN
To: LG ELECTRONICS INC.
Reel/Frame 058171/0331 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2021
From: KOO, MOONMO; KIM, SEUNGHWAN; LIM, JAEHYUN
To: LG ELECTRONICS INC.
Reel/Frame 056390/0561 →
Continuity (3)
Continuation PCTKR2019017892 · Dec 17, 2019
Provisional Application 62781594 · Dec 18, 2018
Related Publication 20210344959A1 · Nov 4, 2021
Cited By (1)
US 12,407,860