IP Library Granted Patent US 12,200,257
Granted Patent B2
US 12,200,257 · App. 18/383,732 · Granted Jan 14, 2025

Transform in intra prediction-based image coding

Inventors: Junghak Nam (Seoul, KR); Jaehyun Lim (Seoul, KR); Moonmo Koo (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/60H04N19/122H04N19/159H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,257
App. No.
18/383,732
Granted
Jan 14, 2025
Kind
B2
Abstract

An image decoding method according to the present document comprises the steps of: acquiring prediction-related information and residual-related information for a current block; deriving transform coefficients for the current block on the basis of the residual-related information; and generating residual samples of the current block on the basis of the transform coefficients, wherein the residual-related information includes low-frequency non-separable transform (LFNST) index information indicating information relating to non-separable transform for a low-frequency transform coefficient of the current block on the basis of a matrix-based intra prediction (MIP) flag.

Claims (33)

1. An image decoding method performed by a decoding apparatus, the method comprising:

obtaining prediction related information and information on transform coefficients for a current block from a bitstream;

deriving transform coefficients for the current block based on the information on the transform coefficients;

deriving modified transform coefficients from the transform coefficients based on a transform kernel in a low frequency non-separable transform (LFNST) transform set for the current block;

generating residual samples of the current block based on the modified transform coefficients; and

generating reconstructed samples of the current block based on the residual samples,

wherein the information on the transform coefficients includes LFNST index information related to the transform kernel for the current block,

wherein the prediction related information includes a matrix based intra prediction (MIP) flag which is always parsed prior to the LFNST index information,

wherein an enabled flag is included in a sequence parameter set (SPS) and the SPS is included in the bitstream,

wherein based on the enabled flag representing that an LFNST is enabled and the MIP flag representing that an MIP is not applied, the LFNST index information is present, and

wherein based on the MIP flag representing that the MIP is applied, the LFNST index information is not present and a value of the LFNST index information is derived as 0.

2. An image encoding method performed by an encoding apparatus, the method comprising:

determining an intra prediction mode and an intra prediction type for a current block;

generating prediction related information for the current block based on the intra prediction mode and the intra prediction type;

deriving prediction samples of the current block based on the intra prediction mode and the intra prediction type;

generating residual samples of the current block based on the prediction samples;

deriving temporary transform coefficients for the current block based on the residual samples;

deriving transform coefficients for the current block from the temporary transform coefficients based on a transform kernel;

generating information on the transform coefficients; and

encoding the prediction related information and the information on the transform coefficients to output a bitstream,

wherein the information on the transform coefficients includes low frequency non-separable transform (LFNST) index information related to the transform kernel in an LFNST transform set for the current block,

wherein the prediction related information includes a matrix based intra prediction (MIP) flag which is always encoded prior to the LFNST index information,

wherein an enabled flag is included in a sequence parameter set (SPS) and the SPS is included in the bitstream,

wherein based on the enabled flag representing that the LFNST is enabled and the MIP flag representing that the MIP is not applied, the LFNST index information is present, and

wherein based on the MIP flag representing that the MIP is applied, the LFNST index information is not present and a value of the LFNST index information is equal to 0.

3. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image, the bitstream is generated based on determining an intra prediction mode and an intra prediction type for a current block, generating prediction related information for the current block based on the intra prediction mode and the intra prediction type, deriving prediction samples of the current block based on the intra prediction mode and the intra prediction type, generating residual samples of the current block based on the prediction samples, deriving temporary transform coefficients for the current block based on the residual samples, deriving transform coefficients for the current block from the temporary transform coefficients based on a transform kernel, generating information on the transform coefficients, and encoding the prediction related information and the information on the transform coefficients; and

transmitting the data comprising the bitstream,

wherein the information on the transform coefficients includes low frequency non-separable transform (LFNST) index information related to the transform kernel in an LFNST transform set for the current block,

wherein the prediction related information includes a matrix based intra prediction (MIP) flag which is always encoded prior to the LFNST index information,

wherein an enabled flag is included in a sequence parameter set (SPS) and the SPS is included in the bitstream,

wherein based on the enabled flag representing that the LFNST is enabled and the MIP flag representing that the MIP is not applied, the LFNST index information is present, and

wherein based on the MIP flag representing that the MIP is applied, the LFNST index information is not present and a value of the LFNST index information is equal to 0.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2023
From: NAM, JUNGHAK; LIM, JAEHYUN; KOO, MOONMO; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 065434/0096 →
Continuity (5)
Continuation 17970027 · Oct 20, 2022
Continuation 17503788 · Oct 18, 2021
Continuation PCTKR2020005077 · Apr 16, 2020
Provisional Application 62834951 · Apr 16, 2019
Related Publication 20240064333A1 · Feb 22, 2024
References Cited (3)
US 20200322623A1 · Chiang · 2020 [cited by examiner]
US 20210297672A1 · Deng · 2021 [cited by examiner]
WO WO2020211765A1 · 2020 [cited by examiner]