IP Library Granted Patent US 12,323,603
Granted Patent B2
US 12,323,603 · App. 18/614,112 · Granted Jun 3, 2025

Transform-based image coding method and device

Inventors: Moonmo Koo (Seoul, KR); Mehdi Salehifar (Seoul, KR); Seunghwan Kim (Seoul, KR); Jaehyun Lim (Seoul, KR)
Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
H04N19/18H04N19/11H04N19/122H04N19/124H04N19/129H04N19/159H04N19/176H04N19/184H04N19/593H04N19/61H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,323,603
App. No.
18/614,112
Granted
Jun 3, 2025
Kind
B2
Abstract

An image decoding method according to the present disclosure includes deriving transform coefficients through dequantization based on the quantized transform coefficients for the target block; deriving modified transform coefficients based on an inverse reduced secondary transform (RST) for the transform coefficients; deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients; and generating a reconstructed samples based on the residual samples, and prediction samples derived based on an intra prediction mode for the target block, wherein the inverse RST is performed based on a transform kernel matrix selected from a transform set including a plurality of transform kernel matrices, the transform set is determined based on a mapping relationship according to the intra prediction mode applied to the target block, and a plurality of intra prediction modes including the intra prediction mode of the target block are mapped to one transform set.

Claims (44)

1. An image decoding method performed by a decoding apparatus, comprising:

deriving secondary transform coefficients for a target block from residual information;

deriving primary transform coefficients based on an inverse non-separable secondary transform of primary transform coefficients, wherein the inverse non-separable secondary transform derives the primary transform coefficients through a matrix operation of the secondary transform coefficients and a transform kernel matrix, a number of the primary transform coefficients is greater than a number of the secondary transform coefficients, the secondary transform coefficients are derived from the a top-left 4×4 area of the target block;

deriving residual samples for the target block based on an inverse primary transform for the primary transform coefficients; and

generating a reconstructed picture based on the residual samples for the target block and prediction samples derived based on an intra prediction mode for the target block,

wherein the inverse non-separable secondary transform is performed based on the transform kernel matrix selected from a transform set including a plurality of transform kernel matrices,

wherein the transform set is determined according to a mapping relationship based on the intra prediction mode applied to the target block,

wherein five or more intra prediction modes are mapped to one non-separable secondary transform set, and

wherein the five or more intra prediction modes are directional modes.

2. The image decoding method of claim 1 , wherein:

a first intra prediction mode for a first target block to which the inverse non-separable secondary transform is applied and a second intra prediction mode for a second target block to which the inverse non-separable secondary transform is applied are different from each other, and

a transform sets mapped to the first intra prediction mode and a transform set mapped to the second intra prediction mode are same.

3. The image decoding method of claim 1 , wherein the primary transform coefficients are mapped into the target block based on one of a diagonal scan order, a horizontal scan order, or a vertical scan order.

4. The image decoding method of claim 1 , further comprising:

obtaining information on whether the inverse non-separable secondary transform is applied,

wherein the information is included in a sequence parameter set (SPS) in the bitstream.

5. An image encoding method performed by an image encoding apparatus, comprising:

deriving residual samples for a target block;

deriving primary transform coefficients for the target block based on a primary transform for the residual samples;

deriving secondary transform coefficients based on a non-separable secondary transform for the primary transform coefficients; and

generating residual information based on the secondary transform coefficients,

wherein the non-separable secondary transform derives the secondary transform coefficients through a matrix operation of the primary transform coefficients and a transform kernel matrix,

a number of the secondary transform coefficients is less than a number of the transform coefficients, and

the secondary transform coefficients are present in a top-left 4×4 area of the target block,

wherein the non-separable secondary transform is performed based on the transform kernel matrix selected from a transform set including a plurality of transform kernel matrices,

wherein the transform set is determined according to a mapping relationship based on the intra prediction mode applied to the target block,

wherein five or more intra prediction modes are mapped to one non-separable secondary transform set, and

wherein the five or more intra prediction modes are directional modes.

6. The image encoding method of claim 5 , wherein:

a first intra prediction mode for a first target block to which the non-separable secondary transform is applied and a second intra prediction mode for a second target block to which the non-separable secondary transform is applied are different from each other, and

a transform sets mapped to the first intra prediction mode and a transform set mapped to the second intra prediction mode are same.

7. The image encoding method of claim 5 , further comprising:

encoding information on whether the non-separable secondary transform is applied,

wherein the information is included in a sequence parameter set (SPS) in a bitstream.

8. A transmitting method of data for an image, comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on deriving residual samples for a target block, deriving primary transform coefficients for the target block based on a primary transform for the residual samples, deriving secondary transform coefficients based on a non-separable secondary transform for the primary transform coefficients, and generating residual information based on the secondary transform coefficients; and

transmitting the data comprising the bitstream,

wherein the non-separable secondary transform derives the secondary transform coefficients through a matrix operation of the primary transform coefficients and a transform kernel matrix,

a number of the secondary transform coefficients is less than a number of the transform coefficients, and

the secondary transform coefficients are present in a top-left 4×4 area of the target block,

wherein the non-separable secondary transform is performed based on the transform kernel matrix selected from a transform set including a plurality of transform kernel matrices,

wherein the transform set is determined according to a mapping relationship based on the intra prediction mode applied to the target block,

wherein five or more intra prediction modes are mapped to one transform set, and

wherein the five or more intra prediction modes are directional modes.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2024
From: KOO, MOONMO; SALEHIFAR, MEHDI; KIM, SEUNGHWAN; LIM, JAEHYUN
To: LG ELECTRONICS INC.
Reel/Frame 066939/0513 →
Continuity (6)
Continuation 18089100 · Dec 27, 2022
Continuation 17562923 · Dec 27, 2021
Continuation 17138662 · Dec 30, 2020
Continuation PCTKR2019008377 · Jul 8, 2019
Provisional Application 62694929 · Jul 6, 2018
Related Publication 20240244233A1 · Jul 18, 2024
References Cited (4)
US 10708164B2 · Seregin · 2020 [cited by examiner]
US 20170094314A1 · Zhao · 2017 [cited by examiner]
US 20200177889A1 · Kim · 2020 [cited by examiner]
EP 4007277A1 · 2022 [cited by examiner]