IP Library Granted Patent US 12,382,042
Granted Patent B2
US 12,382,042 · App. 18/529,817 · Granted Aug 5, 2025

Transform-based image coding method and device therefor

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Junghak Nam (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
H04N19/12H04N19/132H04N19/159H04N19/61H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,382,042
App. No.
18/529,817
Granted
Aug 5, 2025
Kind
B2
Abstract

An image decoding method according to the present document comprises a step for performing inverse first-order transform and inverse non-separable transform on a residual sample. The inverse non-separable transform is performed on the basis of a transform index indicating a predetermined transform kernel matrix, the inverse first-order transform is performed on the basis of a multiple transform selection (MTS) index indicating MTS for a horizontal transform kernel and a vertical transform kernel, and a syntax element bin string for the transform index is derived on the basis of first context information when a tree type for a split structure of a target block is not a single tree type and is derived on the basis of second context information when the tree type is the single tree type.

Claims (48)

1. An image decoding apparatus, comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

receive a bitstream comprising residual information,

derive transform coefficients for a target block based on the residual information,

derive modified transform coefficients based on an inverse non-separable transform of the transform coefficients,

derive residual samples for the target block based on an inverse primary transform of the modified transform coefficients, and

generate a reconstructed picture based on the residual samples for the target block,

wherein the inverse non-separable transform is performed based on a transform index indicating a predetermined transform kernel matrix,

wherein the inverse primary transform is performed based on a multiple transform selection (MTS) index indicating a horizontal transform kernel and a vertical transform kernel, and

wherein a syntax element for the transform index is context-decoded based on a context increment,

wherein based on a tree type of a partition structure of the target block being not a single tree type, a first bin among a bin string of the syntax element for the transform index is derived based on a first context increment, and

wherein based on the tree type being the single tree type, the first bin is derived based on a second context increment.

2. The image decoding apparatus of claim 1 , wherein based on a case where the MTS index has a value of 0 and the tree type is not the single tree type, the syntax element of the transform index is derived based on the first context increment.

3. The image decoding apparatus of claim 2 , wherein, based on a case where the MTS index is not received, the MTS index is inferred to have a value of 0.

4. The image decoding apparatus of claim 1 , wherein based on a case where the MTS index is not received and the tree type is not the single tree type, the syntax element of the transform index is derived based on the first context increment.

5. The image decoding apparatus of claim 1 , wherein the transform kernel matrix is comprised in a transform set determined based on a mapping relationship according to an intra prediction mode applied to the target block, and

wherein the transform index indicates any one of whether the inverse non-separable transform is applied and the transform kernel matrix comprised in the transform set.

6. The image decoding apparatus of claim 5 , wherein the at least one processor is further configured to decode bins of the syntax element of the transform index based on the first context increment or the second context increment and derive a value of the syntax element of the transform index.

7. The image decoding apparatus of claim 6 , wherein the value of the syntax element comprises any one of 0 indicating that the inverse non-separable transform is not applied to the target block, 1 indicating a first transform kernel matrix of the transform kernel matrix, and 2 indicating a second transform kernel matrix of the transform kernel matrix,

wherein the value of the syntax element is binarized into a truncated unary code, and

wherein the value of the syntax element of 0 is binarized into ‘0’, the value of the syntax element of 1 is binarized into ‘10’, and the value of the syntax element of 2 is binarized into ‘11’.

8. An image encoding apparatus, comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

derive prediction samples for a target block,

derive residual samples for the target block based on the prediction samples,

derive transform coefficients for the target block from the residual samples based on a horizontal transform kernel and a vertical transform kernel,

derive modified transform coefficients from the transform coefficients based on a predetermined transform kernel matrix for a non-separable transform, and

encode a multiple transform selection (MTS) index indicating the horizontal transform kernel and the vertical transform kernel or a transform index indicating the transform kernel matrix for the non-separable transform,

wherein a syntax element for the transform index is context-encoded based on a context increment,

wherein based on a tree type of a partition structure of the target block being not a single tree type, a first bin among a bin string of the syntax element for the transform index is derived based on a first context increment, and

wherein based on the tree type being the single tree type, the first bin is derived based on a second context increment.

9. The image encoding apparatus of claim 8 , wherein based on a case where the MTS index has a value of 0 and the tree type is not the single tree type, the syntax element of the transform index is derived based on the first context increment.

10. The image encoding apparatus of claim 9 , wherein, based on a case where the MTS index is not encoded, the MTS index is inferred to have a value of 0.

11. The image encoding apparatus of claim 8 , wherein based on a case where the MTS index is not encoded and the tree type is not the single tree type, the syntax element of the transform index is derived based on the first context increment.

12. The image encoding apparatus of claim 8 , wherein the transform kernel matrix is comprised in a transform set determined based on a mapping relationship according to an intra prediction mode applied to the target block, and

wherein the transform index indicates any one of whether an inverse non-separable transform is applied and the transform kernel matrix comprised in the transform set.

13. The image encoding apparatus of claim 12 , wherein the at least one processor is further configured to derive a value of the syntax element of the transform index and encode the bin string of the syntax element of the transform index based on the first context increment or the second context increment.

14. The image encoding apparatus of claim 13 , wherein the value of the syntax element comprises any one of 0 indicating that the inverse non-separable transform is not applied to the target block, 1 indicating a first transform kernel matrix of the transform kernel matrix, and 2 indicating a second transform kernel matrix of the transform kernel matrix,

wherein the value of the syntax element is binarized into a truncated unary code, and

wherein the value of the syntax element of 0 is binarized into ‘0’, the value of the syntax element of 1 is binarized into ‘10’, and the value of the syntax element of 2 is binarized into ‘11’.

15. A transmission apparatus of data for an image, comprising:

at least one processor configured to obtain a bitstream for the image, wherein the bitstream is generated based on deriving prediction samples for a target block, deriving residual samples for the target block based on the prediction samples, deriving transform coefficients for the target block from the residual samples based on a horizontal transform kernel and a vertical transform kernel, deriving modified transform coefficients from the transform coefficients based on a predetermined transform kernel matrix for a non-separable transform, and encoding a multiple transform selection (MTS) index indicating the horizontal transform kernel and the vertical transform kernel or a transform index indicating the transform kernel matrix; and

a transmitter configured to transmit the data comprising the bitstream,

wherein a syntax element for the transform index is context-encoded based on a context increment,

wherein based on a tree type of a partition structure of the target block being not a single tree type, a first bin among a bin string of the syntax element for the transform index is derived based on a first context increment, and

wherein based on the tree type being the single tree type, the first bin is derived based on a second context increment.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2023
From: KOO, MOONMO; LIM, JAEHYUN; NAM, JUNGHAK; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 065770/0682 →
Continuity (5)
Continuation 17719925 · Apr 13, 2022
Continuation 17476190 · Sep 15, 2021
Continuation PCTKR2020004090 · Mar 26, 2020
Provisional Application 62824243 · Mar 26, 2019
Related Publication 20240137512A1 · Apr 25, 2024
References Cited (8)
US 20180205949A1 · Hsiang · 2018 [cited by examiner]
US 20210084290A1 · Cho · 2021 [cited by examiner]
US 20210136395A1 · Jun · 2021 [cited by examiner]
US 20210160487A1 · Kim · 2021 [cited by examiner]
US 20210203933A1 · Rosewarne · 2021 [cited by examiner]
Puri et al., “CNN_Based Transform Index Prediction in Multiple Transforms Framework to Assist Entropy Coding,” 25th European Signal Processing Conference (EUSIPCO) 2017. [cited by examiner]
Kim et al. “EE2.3: NSST-PDPC Harmonization,” JVET-C0042, ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 6 pages, May 2016. [cited by applicant]
International Telecommunication Union, “High efficiency video coding,” Recommendation ITU-T H.265, 692 pages, dated Feb. 2018. [cited by applicant]