IP Library Granted Patent US 12,301,874
Granted Patent B2
US 12,301,874 · App. 18/469,158 · Granted May 13, 2025

Image coding method based on transform, and device therefor

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
H04N19/61H04N19/12H04N19/124H04N19/132H04N19/157H04N19/176H04N19/18H04N19/186H04N19/1883H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,874
App. No.
18/469,158
Granted
May 13, 2025
Kind
B2
Abstract

An image decoding method according to the present document comprises a step of deriving modified transform coefficients, wherein the step of deriving the modified transform coefficients comprises a step of setting an LFNST apply variable about whether to apply an LFNST on the basis of the tree type of the current block, a transform coefficient coding flag for each component of the current block, or a transform skip flag for each component of the current block, and can comprise a step of parsing an LFNST index on the basis of the value of the LFNST apply variable.

Claims (55)

1. An image decoding method performed by a decoding apparatus, comprising:

receiving residual information from a bitstream;

deriving transform coefficients for a first component of a current block by performing dequantization based on the residual information, the first component being representative of one of a luma component or a chroma component of the current block; and

deriving modified transform coefficients by applying a low-frequency non-separable transform (LFNST) to the transform coefficients,

wherein deriving the modified transform coefficients comprises:

setting an LFNST apply variable based on a tree type of the current block, a transform skip flag for the first component of the current block, and a transform coefficient coding flag for a second component of the current block, the second component being representative of the other of the luma component or the chroma component of the current block;

parsing, from the bitstream, an LFNST index based on the LFNST apply variable, the LFNST index indicating one of a plurality of LFNST matrices in an LFNST set; and

performing the LFNST on the transform coefficients based on the LFNST index,

wherein a value of the LFNST apply variable is set equal to 1 based on the tree type of the current block being a single tree, the transform skip flag for the first component being equal to 0, and the transform coefficient coding flag for the second component being equal to 0, and

wherein the LFNST index is parsed from the bitstream based on the value of the LFNST apply flag being equal to 1, and

wherein the first component of the current block is not coded in a block-based delta pulse code modulation (BDPCM) mode while the second component of the current block is coded in the BDPCM mode.

2. The image decoding method of claim 1 , wherein the value of the LFNST apply variable is set equal to 1 regardless of a transform coefficient coding flag for the first component of the current block.

3. The image decoding method of claim 2 , wherein a transform skip flag for the second component of the current block is inferred to 1.

4. An image encoding method performed by an encoding apparatus, comprising:

deriving prediction samples for a first component of a current block, the first component being representative of one of a luma component or a chroma component of the current block;

deriving residual samples for the first component of the current block based on the prediction samples;

deriving transform coefficients for the first component of the current block based on a primary transform of the residual samples; and

deriving modified transform coefficients from the transform coefficients by applying a low-frequency non-separable transform (LFNST),

wherein deriving the modified transform coefficients comprises:

setting an LFNST apply variable based on a tree type of the current block, a transform skip flag for the first component of the current block, and a transform coefficient coding flag for a second component of the current block, the second component being representative of the other of the luma component or the chroma component of the current block; and

applying the LFNST based on the LFNST apply variable,

wherein an LFNST index indicating one of a plurality of LFNST matrices in an LFNST set is encoded into a bitstream based on the LFNST apply variable,

wherein a value of the LFNST apply variable is set equal to 1 based on the tree type of the current block being a single tree, the transform skip flag for the first component being equal to 0, and the transform coefficient coding flag for the second component being equal to 0,

wherein the LFNST is applied based on the value of the LFNST apply variable being equal to 1, and

wherein the first component of the current block is not coded in a block-based delta pulse code modulation (BDPCM) mode while the second component of the current block is coded in the BDPCM mode.

5. The image encoding method of claim 4 , wherein the value of the LFNST apply variable is set equal to 1 regardless of a transform coefficient coding flag for the first component of the current block.

6. The image encoding method of claim 5 , wherein a transform skip flag for the second component of the current block is inferred to 1.

7. A non-transitory computer-readable digital storage medium for storing a bitstream generated by an image encoding method,

the image encoding method comprising:

deriving prediction samples for a first component of a current block, the first component being representative of one of a luma component or a chroma component of the current block;

deriving residual samples for the first component of the current block based on the prediction samples;

deriving transform coefficients for the first component of the current block based on a primary transform of the residual samples; and

deriving modified transform coefficients from the transform coefficients by applying a low-frequency non-separable transform (LFNST),

wherein deriving the modified transform coefficients comprises:

setting an LFNST apply variable based on a tree type of the current block, a transform skip flag for the first component of the current block, and a transform coefficient coding flag for a second component of the current block, the second component being representative of the other of the luma component or the chroma component of the current block; and

applying the LFNST based on the LFNST apply variable,

wherein an LFNST index indicating one of a plurality of LFNST matrices in an LFNST set is encoded into the bitstream based on the LFNST apply variable,

wherein a value of the LFNST apply variable is set equal to 1 based on the tree type of the current block being a single tree, the transform skip flag for the first component being equal to 0, and the transform coefficient coding flag for the second component being equal to 0,

wherein the LFNST is applied based on the value of the LFNST apply variable being equal to 1, and

wherein the first component of the current block is not coded in a block-based delta pulse code modulation (BDPCM) mode while the second component of the current block is coded in the BDPCM mode.

8. A method for transmitting data for image information, comprising:

deriving prediction samples for a first component of a current block, the first component being representative of one of a luma component or a chroma component of the current block;

deriving residual samples for the first component of the current block based on the prediction samples;

deriving transform coefficients for the first component of the current block based on a primary transform of the residual samples;

deriving modified transform coefficients from the transform coefficients by applying a low-frequency non-separable transform (LFNST);

deriving quantized transform coefficients by performing a quantization on the modified transform coefficients;

encoding residual information for the quantized transform coefficients to generate a bitstream; and

transmitting the data comprising the bitstream,

wherein deriving the modified transform coefficients comprises:

setting an LFNST apply variable based on a tree type of the current block, a transform skip flag for the first component of the current block, and a transform coefficient coding flag for a second component of the current block, the second component being representative of the other of the luma component or the chroma component of the current block; and

applying the LFNST based on the LFNST apply variable,

wherein an LFNST index indicating one of a plurality of LFNST matrices in an LFNST set is encoded into the bitstream based on the LFNST apply variable,

wherein a value of the LFNST apply variable is set equal to 1 based on the tree type of the current block being a single tree, the transform skip flag for the first component being equal to 0, and the transform coefficient coding flag for the second component being equal to 0,

wherein the LFNST is applied based on the value of the LFNST apply variable being equal to 1, and

wherein the first component of the current block is not coded in a block-based delta pulse code modulation (BDPCM) mode while the second component of the current block is coded in the BDPCM mode.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2023
From: KOO, MOONMO; LIM, JAEHYUN; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 064977/0627 →
Continuity (6)
Continuation 17892740 · Aug 22, 2022
Continuation PCTKR2021002182 · Feb 22, 2021
Provisional Application 63001456 · Mar 29, 2020
Provisional Application 62992098 · Mar 19, 2020
Provisional Application 62980082 · Feb 21, 2020
Related Publication 20240007674A1 · Jan 4, 2024
References Cited (4)
US 11812059B2 · Koo · 2023 [cited by examiner]
US 20140092983A1 · Joshi · 2014 [cited by examiner]
US 20200389666A1 · Zhao · 2020 [cited by examiner]
US 20220385946A1 · Chiang · 2022 [cited by examiner]