IP Library Granted Patent US 11,700,377
Granted Patent B2
US 11,700,377 · App. 17/535,095 · Granted Jul 11, 2023

Modified transform-based image coding method and device for same

Inventors: Moonmo Koo (Incheon, KR); Jaehyun Lim (Seoul, KR); Junghak Nam (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/132H04N19/176H04N19/18H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,700,377
App. No.
17/535,095
Filed
Nov 24, 2021
Granted
Jul 11, 2023
Kind
B2
Examiner
PHAM, NAM D
Art Unit
2487
USPC
375/240.02
Abstract

An image decoding method according to the present document is characterized by including: a step for receiving a bitstream including residual information; a step for deriving transform coefficients for a target block on the basis of the residual information; a step for deriving corrected transform coefficients on the basis of an inverse non-separable transform of the transform coefficients; and a step for deriving residual samples for the target block on the basis of an inverse primary transform of the corrected transform coefficients, wherein the inverse non-separable transform is performed when the size of the target block is equal to or smaller than the size of a prescribed maximum transform application block.

Claims (50)

1. An image decoding method performed by a decoding apparatus, the method comprising:

receiving a bitstream including residual information;

deriving transform coefficients for a target block based on the residual information;

deriving modified transform coefficients based on an inverse non-separable transform for the transform coefficients;

deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients; and

generating a reconstructed picture based on the residual samples for the target block,

wherein the target block is a coding block, and a transform block is partitioned from the coding block,

wherein the inverse non-separable transform is not performed when the size of the coding block is greater than the size of a predetermined maximum transform block,

wherein the target block includes a luma coding block and a chroma coding block, and

wherein based on the size of the luma coding block being equal to or smaller than the size of the maximum transform block and a color format being 4:2:0, the inverse non-separable transform is applied to the chroma coding block when the chroma coding block is less than or equal to ½ of the size of the maximum transform block.

2. The image decoding method of claim 1 , wherein information on the size of the maximum transform block is further received.

3. The image decoding method of claim 1 , wherein whether the inverse non-separable transform is performed is derived by comparing the larger of the width or height of the target block with the width or height of the maximum transform block.

4. The image decoding method of claim 1 , wherein the maximum transform block is 64×64.

5. The image decoding method of claim 1 , wherein when the size of the target block is larger than the size of the predetermined maximum transform block, Low Frequency Non-Separable Transform (LFNST) index indicating a predetermined transform kernel matrix used for the inverse non-separable transform is not derived.

6. An image encoding method performed by an image encoding apparatus, the method comprising:

deriving prediction samples for a target block;

deriving residual samples for the target block based on the prediction samples;

deriving transform coefficients for the target block based on a primary transform for the residual samples;

deriving modified transform coefficients from the transform coefficients based on a predetermined transform kernel matrix for a non-separable transform; and

encoding quantized residual information and a Low Frequency Non-Separable Transform (LFNST) index indicating the transform kernel matrix,

wherein the target block is a coding block, and a transform block is partitioned from the coding block,

wherein the non-separable transform is not performed when the size of the coding block is greater than the size of a predetermined maximum transform block,

wherein the target block includes a luma coding block and a chroma coding block, and

wherein based on the size of the luma coding block being equal to or smaller than the size of the maximum transform block and a color format being 4:2:0, the non-separable transform is applied to the chroma coding block when the chroma coding block is less than or equal to ½ of the size of the maximum transform block.

7. The image encoding method of claim 6 , wherein information on the size of the maximum transform block is further encoded.

8. The image encoding method of claim 6 , wherein whether the non-separable transform is performed is derived by comparing the larger of the width or height of the target block with the width or height of the maximum transform block.

9. The image encoding method of claim 6 , wherein the maximum transform block is 64×64.

10. The image encoding method of claim 6 , wherein based on the size of the target block being larger than the size of the predetermined maximum transform block, the LFNST index is not encoded.

11. A non-transitory computer-readable digital storage medium that stores instructions that when executed by one or more processors cause the one or more processors to perform operations comprising:

deriving prediction samples for a target block;

deriving residual samples for the target block based on the prediction samples;

deriving transform coefficients for the target block based on a primary transform for the residual samples;

deriving modified transform coefficients from the transform coefficients based on a predetermined transform kernel matrix for a non-separable transform; and

encoding quantized residual information and a Low Frequency Non-Separable Transform (LFNST) index indicating the transform kernel matrix to generate a bitstream,

wherein the target block is a coding block, and a transform block is partitioned from the coding block,

wherein the non-separable transform is not performed when the size of the coding block is greater than the size of a predetermined maximum transform applied block,

wherein the target block includes a luma coding block and a chroma coding block, and

wherein based on the size of the luma coding block being equal to or smaller than the size of the maximum transform block and a color format being 4:2:0, the non-separable transform is applied to the chroma coding block when the chroma coding block is less than or equal to ½ of the size of the maximum transform block.

12. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image;

wherein the bitstream is generated based on:

deriving prediction samples for a target block,

deriving residual samples for the target block based on the prediction samples, deriving transform coefficients for the target block based on a primary transform for the residual samples,

deriving modified transform coefficients from the transform coefficients based on a predetermined transform kernel matrix for a non-separable transform,

encoding quantized residual information and a Low Frequency Non-Separable Transform (LFNST) index indicating the transform kernel matrix to generate the bitstream, and

transmitting the data comprising the bitstream,

wherein the target block is a coding block, and a transform block is partitioned from the coding block,

wherein the non-separable transform is not performed when the size of the coding block is greater than the size of a predetermined maximum transform applied block,

wherein the target block includes a luma coding block and a chroma coding block, and

wherein based on the size of the luma coding block being equal to or smaller than the size of the maximum transform block and a color format being 4:2:0, the non-separable transform is applied to the chroma coding block when the chroma coding block is less than or equal to ½ of the size of the maximum transform block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2024
From: LG ELECTRONICS INC.
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 066384/0462 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2022
From: KOO, MOONMO; LIM, JAEHYUN; NAM, JUNGHAK; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 059999/0587 →
Continuity (4)
Continuation PCTKR2020007351 · Jun 5, 2020
Provisional Application 62870691 · Jul 4, 2019
Provisional Application 62858305 · Jun 6, 2019
Related Publication 20220086449A1 · Mar 17, 2022
Cited By (5)
US 12,425,654 US 12,701,256 US 12,701,257 US 12,713,053 US 12,713,054