IP Library Granted Patent US 11,330,261
Granted Patent B2
US 11,330,261 · App. 17/476,190 · Granted May 10, 2022

Transform-based image coding method and device therefor

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Junghak Nam (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/12H04N19/132H04N19/159H04N19/61H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,330,261
App. No.
17/476,190
Granted
May 10, 2022
Kind
B2
Abstract

An image decoding method according to the present document comprises a step for performing inverse first-order transform and inverse non-separable transform on a residual sample. The inverse non-separable transform is performed on the basis of a transform index indicating a predetermined transform kernel matrix, the inverse first-order transform is performed on the basis of a multiple transform selection (MTS) index indicating MTS for a horizontal transform kernel and a vertical transform kernel, and a syntax element bin string for the transform index is derived on the basis of first context information when a tree type for a split structure of a target block is not a single tree type and is derived on the basis of second context information when the tree type is the single tree type.

Claims (45)

1. An image decoding method performed by a decoding apparatus, the method comprising:

receiving a bitstream comprising residual information;

deriving transform coefficients for a target block based on the residual information;

deriving modified transform coefficients based on an inverse non-separable transform of the transform coefficients;

deriving residual samples for the target block based on an inverse primary transform of the modified transform coefficients; and

generating a reconstructed picture based on the residual samples for the target block,

wherein the inverse non-separable transform is performed based on a transform index indicating a predetermined transform kernel matrix,

wherein the inverse primary transform is performed based on a multiple transform selection (MTS) index indicating an MTS of a horizontal transform kernel and a vertical transform kernel, and

wherein based on a tree type of a partition structure of the target block being not a single tree type, a syntax element bin string of the transform index is derived based on first context information, and based on the tree type being the single tree type, the syntax element bin string of the transform index is derived based on second context information.

2. The image decoding method of claim 1 , wherein based on a case where the MTS index has a value of 0 and the tree type is not the single tree type, the syntax element bin string of the transform index is derived based on the first context information.

3. The image decoding method of claim 2 , wherein, based on a case where the MTS index is not received, the MTS index is inferred to have a value of 0.

4. The image decoding method of claim 1 , wherein based on a case where the MTS index is not received and the tree type is not the single tree type, the syntax element bin string of the transform index is derived based on the first context information.

5. The image decoding method of claim 1 , wherein the transform kernel matrix is comprised in a transform set determined based on a mapping relationship according to an intra prediction mode applied to the target block, and

wherein the transform index indicates any one of whether the inverse non-separable transform is applied and the transform kernel matrix comprised in the transform set.

6. The image decoding method of claim 5 , further comprising:

decoding bins of the syntax element bin string of the transform index based on the first context information or the second context information; and

deriving a value of a syntax element of the transform index.

7. The image decoding method of claim 6 , wherein the value of the syntax element comprises any one of 0 indicating that the inverse non-separable transform is not applied to the target block, 1 indicating a first transform kernel matrix of the transform kernel matrix, and 2 indicating a second transform kernel matrix of the transform kernel matrix,

wherein the value of the syntax element is binarized into a truncated unary code, and

wherein the value of the syntax element of 0 is binarized into ‘0’, the value of the syntax element of 1 is binarized into ‘10’, and the value of the syntax element of 2 is binarized into ‘11’.

8. An image encoding method performed by an image encoding apparatus, the method comprising:

deriving prediction samples for a target block;

deriving residual samples for the target block based on the prediction samples;

deriving transform coefficients for the target block from the residual samples based on a multiple transform selection (MTS) of a horizontal transform kernel and a vertical transform kernel;

deriving modified transform coefficients from the transform coefficients based on a predetermined transform kernel matrix for a non-separable transform; and

encoding an MTS index indicating the MTS or a transform index indicating the transform kernel matrix,

wherein based on a tree type of a partition structure of the target block being not a single tree type, a syntax element bin string of the transform index is derived based on first context information, and based on the tree type being the single tree type, the syntax element bin string of the transform index is derived based on second context information, when the tree type is the single tree type.

9. The image encoding method of claim 8 , wherein based on a case where the MTS index has a value of 0 and the tree type is not the single tree type, the syntax element bin string of the transform index is derived based on the first context information.

10. The image encoding method of claim 9 , wherein, based on a case where the MTS index is not encoded, the MTS index is inferred to have a value of 0.

11. The image encoding method of claim 8 , wherein based on a case where the MTS index is not received and the tree type is not the single tree type, the syntax element bin string of the transform index is derived based on the first context information.

12. The image encoding method of claim 8 , wherein the transform kernel matrix is comprised in a transform set determined based on a mapping relationship according to an intra prediction mode applied to the target block, and

wherein the transform index indicates any one of whether the inverse non-separable transform is applied and the transform kernel matrix comprised in the transform set.

13. The image encoding method of claim 12 , further comprising:

deriving a value of a syntax element of the transform index; and

encoding bins of the syntax element bin string of the transform index based on the first context information or the second context information.

14. The image encoding method of claim 13 , wherein the value of the syntax element comprises any one of 0 indicating that the inverse non-separable transform is not applied to the target block, 1 indicating a first transform kernel matrix of the transform kernel matrix, and 2 indicating a second transform kernel matrix of the transform kernel matrix,

wherein the value of the syntax element is binarized into a truncated unary code, and

wherein the value of the syntax element of 0 is binarized into ‘0’, the value of the syntax element of 1 is binarized into ‘10’, and the value of the syntax element of 2 is binarized into ‘11’.

15. A non-transitory computer-readable digital storage medium storing a bitstream generated by a method, the method comprising:

deriving prediction samples for a target block;

deriving residual samples for the target block based on the prediction samples;

deriving transform coefficients for the target block from the residual samples based on a multiple transform selection (MTS) of a horizontal transform kernel and a vertical transform kernel;

deriving modified transform coefficients from the transform coefficients based on a predetermined transform kernel matrix for a non-separable transform; and

encoding an MTS index indicating the MTS or a transform index indicating the transform kernel matrix to generate the bitstream,

wherein based on a tree type of a partition structure of the target block being not a single tree type, a syntax element bin string of the transform index is derived based on first context information, and based on the tree type being the single tree type, the syntax element bin string of the transform index is derived based on second context information.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2021
From: KOO, MOONMO; LIM, JAEHYUN; NAM, JUNGHAK; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 057493/0574 →
Continuity (3)
Continuation PCTKR2020004090 · Mar 26, 2020
Provisional Application 62824243 · Mar 26, 2019
Related Publication 20220053189A1 · Feb 17, 2022