IP Library › Granted Patent US 11,831,918
Granted Patent B2
US 11,831,918 · App. 17/503,792 · Granted Nov 28, 2023

Image coding using transform index

Inventors: Junghak Nam (Seoul, KR); Jaehyun Lim (Seoul, KR); Moonmo Koo (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/60H04N19/122H04N19/159H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,831,918
App. No.
17/503,792
Granted
Nov 28, 2023
Kind
B2
Abstract

An image decoding method according to the present document comprises the steps of: receiving image information including residual information for a current block; and generating residual samples of the current block on the basis of the residual information, wherein the residual information includes information on transform coefficients of the current block, and the residual samples are generated from the information on the transform coefficients on the basis of low-frequency non-separable transform (LFNST) index information.

Claims (55)

1. An image decoding method performed by a decoding apparatus, the method comprising:

receiving image information including residual information for a current block;

deriving prediction samples of the current block based on intra prediction;

generating residual samples of the current block based on the residual information; and

generating reconstructed samples for the current block based on the prediction samples and the residual samples,

wherein the image information includes intra prediction type information for the current block,

wherein based on a tree type of the current block being single tree or dual tree luma, the intra prediction type information includes a matrix based intra prediction (MIP) flag representing whether MIP is applied to the current block,

wherein in response to the MIP being applied to the current block as the value of the MIP flag is equal to 1, the prediction samples of the current block are derived by reducing neighboring reference samples of the current block, performing a matrix-multiplication on the reduced neighboring reference samples, and adding an offset to values on which the matrix-multiplication is performed,

wherein a size of the matrix used for the matrix-multiplication is determined in response to a size of the current block,

wherein the size of the matrix is 16×8 in response to the size of the current block being 8×8,

wherein based on an intra sub-partitions (ISP) being not applied to the current block, a width and height of the current block being more than 4, an intra mode being applied to the current block, and the MIP flag representing that the MIP is not applied, the image information includes low frequency non-separable transform (LFNST) index information related to one of transform kernels in an LFNST transform set for the current block,

wherein a parsing order of the MIP flag always precedes a parsing order of the LFNST index information,

wherein based on the MIP flag representing that the MIP is applied, the image information does not include the LFNST index information,

wherein based on the LFNST index information being not present as the image information does not include the LFNST index information, a value of the LFNST index information is derived as 0,

wherein the residual information includes information on quantized transform coefficients of the current block, and

wherein the residual samples are generated based on the information on the quantized transform coefficients by using the LFNST index information.

2. An image encoding method performed by an encoding apparatus, the method comprising:

generating prediction samples of a current block by performing intra prediction on the current block;

generating intra prediction type information for the current block based on the performed intra prediction;

generating residual samples of the current block based on the prediction samples;

generating residual information including information on quantized transform coefficients for the current block based on the residual samples; and

encoding image information including the intra prediction type information and the residual information,

wherein based on a tree type of the current block being single tree or dual tree luma, the intra prediction type information includes a matrix based intra prediction (MIP) flag representing whether MIP is applied to the current block,

wherein in response to the value of the MIP flag equal to 1 as the MIP is applied to the current block, prediction samples of the current block are derived by reducing neighboring reference samples of the current block, performing a matrix-multiplication on the reduced neighboring reference samples, and adding an offset to values on which the matrix-multiplication is performed,

wherein a size of the matrix used for the matrix-multiplication is determined in response to a size of the current block,

wherein the size of the matrix is 16×8 in response to the size of the current block being 8×8,

wherein based on an intra sub-partitions (ISP) being not applied to the current block, a width and height of the current block being more than 4, an intra mode being applied to the current block, and the MIP flag representing that the MIP is not applied the image information includes low frequency non-separable transform (LFNST) index information related to one of transform kernels in an LFNST transform set for the current block,

wherein a signaling order of the MIP flag always precedes a signaling order of the LFNST index information,

wherein based on the MIP flag representing that the MIP is applied, the image information does not include the LFNST index information, and

wherein based on the LFNST index information being not present as the image information does not include the LFNST index information, a value of the LFNST index information is equal to 0.

3. A non-transitory computer-readable storage medium storing a bitstream generated by an encoding method, the method comprising:

generating prediction samples of a current block by performing intra prediction on the current block;

generating intra prediction type information for the current block based on the performed intra prediction;

generating residual samples of the current block based on the prediction samples;

generating residual information including information on quantized transform coefficients for the current block based on the residual samples; and

encoding image information including the intra prediction type information and the residual information,

wherein based on a tree type of the current block being single tree or dual tree luma, the intra prediction type information includes a matrix based intra prediction (MIP) flag representing whether MIP is applied to the current block,

wherein in response to the value of the MIP flag equal to 1 as the MIP is applied to the current block, prediction samples of the current block are derived by reducing neighboring reference samples of the current block, performing a matrix-multiplication on the reduced neighboring reference samples, and adding an offset to values on which the matrix-multiplication is performed,

wherein a size of the matrix used for the matrix-multiplication is determined in response to a size of the current block,

wherein the size of the matrix is 16×8 in response to the size of the current block being 8×8,

wherein based on an intra sub-partitions (ISP) being not applied to the current block, a width and height of the current block being more than 4, an intra mode being applied to the current block, and the MIP flag representing that the MIP is not applied the image information includes low frequency non-separable transform (LFNST) index information related to one of transform kernels in an LFNST transform set for the current block,

wherein a signaling order of the MIP flag always precedes a signaling order of the LFNST index information,

wherein based on the MIP flag representing that the MIP is applied, the image information does not include the LFNST index information, and

wherein based on the LFNST index information being not present as the image information does not include the LFNST index information, a value of the LFNST index information is equal to 0.

4. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image, the bitstream is generated by performing determining an intra prediction type for a current block, generating prediction samples of a current block by performing intra prediction on the current block, generating intra prediction type information for the current block based on the performed intra prediction, generating residual samples of the current block based on the prediction samples, generating residual information including information on quantized transform coefficients for the current block based on the residual samples, and encoding image information including the intra prediction type information and the residual information to generate the bitstream; and

transmitting the data comprising the bitstream,

wherein based on a tree type of the current block being single tree or dual tree luma, the intra prediction type information includes a matrix based intra prediction (MIP) flag representing whether MIP is applied to the current block,

wherein in response to the value of the MIP flag equal to 1 as the MIP is applied to the current block, prediction samples of the current block are derived by reducing neighboring reference samples of the current block, performing a matrix-multiplication on the reduced neighboring reference samples, and adding an offset to values on which the matrix-multiplication is performed,

wherein a size of the matrix used for the matrix-multiplication is determined in response to a size of the current block,

wherein the size of the matrix is 16×8 in response to the size of the current block being 8×8,

wherein based on an intra sub-partitions (ISP) being not applied to the current block, a width and height of the current block being more than 4, an intra mode being applied to the current block and the MIP flag representing that the MIP is not applied the image information includes low frequency non-separable transform (LFNST) index information related to one of transform kernels in an LFNST transform set for the current block,

wherein a signaling order of the MIP flag always precedes a signaling order of the LFNST index information,

wherein based on the MIP flag representing that the MIP is applied, the image information does not include the LFNST index information, and

wherein based on the LFNST index information being not present as the image information does not include the LFNST index information, a value of the LFNST index information is equal to 0.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2021
From: NAM, JUNGHAK; LIM, JAEHYUN; KOO, MOONMO; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 057936/0706 →
Continuity (3)
Continuation PCTKR2020005079 · Apr 16, 2020
Provisional Application 62834950 · Apr 16, 2019
Related Publication 20220046281A1 · Feb 10, 2022
Cited By (2)
US 12,452,423 US 12,739,362