IP Library Granted Patent US 11,838,549
Granted Patent B2
US 11,838,549 · App. 17/970,027 · Granted Dec 5, 2023

Transform in intra prediction-based image coding

Inventors: Junghak Nam (Seoul, KR); Jaehyun Lim (Seoul, KR); Moonmo Koo (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/60H04N19/122H04N19/159H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,838,549
App. No.
17/970,027
Granted
Dec 5, 2023
Kind
B2
Abstract

An image decoding method according to the present document comprises the steps of: acquiring prediction-related information and residual-related information for a current block; deriving transform coefficients for the current block on the basis of the residual-related information; and generating residual samples of the current block on the basis of the transform coefficients, wherein the residual-related information includes low-frequency non-separable transform (LFNST) index information indicating information relating to non-separable transform for a low-frequency transform coefficient of the current block on the basis of a matrix-based intra prediction (MIP) flag.

Claims (50)

1. A decoding apparatus for an image decoding, the decoding apparatus comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

obtain prediction related information and information on transform coefficients for a current block from a bitstream;

derive transform coefficients for the current block based on the information on the transform coefficients; and

generate residual samples of the current block based on the transform coefficients,

wherein the information on the transform coefficients includes low frequency non-separable transform (LFNST) index information related to one of transform kernels in an LFNST transform set for the current block based on an enabled flag for LFNST and a matrix based intra prediction (MIP) flag,

wherein the at least one processor further configured to:

derive modified transform coefficients from the transform coefficients based on the LFNST index information; and

generate the residual samples based on the modified transform coefficients,

wherein the MIP flag represents whether MIP is applied to the current block,

wherein the MIP flag is included in the prediction related information,

wherein a parsing order of the MIP flag always precedes a parsing order of the LFNST index information,

wherein based on the enabled flag representing that the LFNST is enabled and the MIP flag representing that the MIP is not applied, the information on the transform coefficients includes the LFNST index information, and

wherein based on the MIP flag representing that the MIP is applied, the LFNST index information is not present and a value of the LFNST index information is derived as 0.

2. An encoding apparatus for image encoding, the encoding apparatus comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

determine an intra prediction mode and an intra prediction type for a current block;

generate prediction related information for the current block based on the intra prediction mode and the intra prediction type;

derive prediction samples of the current block based on the intra prediction mode and the intra prediction type;

generate residual samples of the current block based on the prediction samples;

generate information on transform coefficients for the current block based on the residual samples; and

encode the prediction related information and the information on the transform coefficients,

wherein the information on the transform coefficients includes low frequency non-separable transform (LFNST) index information related to one of transform kernels in an LFNST transform set for the current block based on an enabled flag for LFNST and a matrix based intra prediction (MIP) flag,

wherein the at least one processor further configured to:

derive temporary transform coefficients for the current block based on the residual samples;

derive transform coefficients for the current block from the temporary transform coefficients; and

generate the information on the transform coefficients,

wherein the LFNST index information is generated based on a transform kernel used to derive the transform coefficients,

wherein the MIP flag represents whether MIP is applied to the current block,

wherein the MIP flag is included in the prediction related information,

wherein a signaling order of the MIP flag always precedes a signaling order of the LFNST index information,

wherein based on the enabled flag representing that the LFNST is enabled and the MIP flag representing that the MIP is not applied, the information on the transform coefficients includes the LFNST index information, and

wherein based on the MIP flag representing that the MIP is applied, the LFNST index information is not present and a value of the LFNST index information is equal to 0.

3. A non-transitory computer-readable storage medium storing a bitstream generated by the encoding apparatus of claim 2 .

4. An apparatus for transmitting data for an image, the apparatus comprising:

at least one processor configured to obtain a bitstream for the image, the bitstream is generated based on determining an intra prediction mode and an intra prediction type for a current block, generating prediction related information for the current block based on the intra prediction mode and the intra prediction type, deriving prediction samples of the current block based on the intra prediction mode and the intra prediction type, generating residual samples of the current block based on the prediction samples, generating information on the transform coefficients for the current block based on the residual samples, and encoding the prediction related information and the information on the transform coefficients; and

a transmitter configured to transmit the data comprising the bitstream,

wherein the information on the transform coefficients includes low frequency non-separable transform (LFNST) index information related to one of transform kernels in an LFNST transform set for the current block based on an enabled flag for LFNST and a matrix based intra prediction (MIP) flag,

wherein generating the information on the transform coefficients comprises:

deriving temporary transform coefficients for the current block based on the residual samples;

deriving transform coefficients for the current block from the temporary transform coefficients; and

generating the information on the transform coefficients,

wherein the LFNST index information is generated based on a transform kernel used to derive the transform coefficients,

wherein the MIP flag represents whether MIP is applied to the current block,

wherein the MIP flag is included in the prediction related information,

wherein a signaling of the MIP flag always precedes a signaling order of the LFNST index information,

wherein based on the enabled flag representing that the LFNST is enabled and the MIP flag representing that the MIP is not applied, the information on the transform coefficients includes the LFNST index information, and

wherein based on the MIP flag representing that the MIP is applied, the LFNST index information is not present and a value of the LFNST index information is equal to 0.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2023
From: NAM, JUNGHAK; LIM, JAEHYUN; KOO, MOONMO; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 064649/0548 →
Continuity (4)
Continuation 17503788 · Oct 18, 2021
Continuation PCTKR2020005077 · Apr 16, 2020
Provisional Application 62834951 · Apr 16, 2019
Related Publication 20230054265A1 · Feb 23, 2023