IP Library › Granted Patent US 12,407,860
Granted Patent B2
US 12,407,860 · App. 18/645,950 · Granted Sep 2, 2025

Image coding method based on secondary transform, and device therefor

Inventors: Moonmo Koo (Seoul, KR); Seunghwan Kim (Seoul, KR); Jaehyun Lim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/61H04N19/11H04N19/124H04N19/132H04N19/159H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,860
App. No.
18/645,950
Granted
Sep 2, 2025
Kind
B2
Abstract

An image decoding method according to the present document comprises the steps of: deriving transform coefficients through inverse quantization on the basis of quantized transform coefficients for a target block; deriving modified transform coefficients on the basis of an inverse reduced secondary transform (RST) for the transform coefficients; and generating, on the basis of an inverse primary transform for the modified transform coefficients, a restoration picture based on residual samples for the target block, wherein the modified transform coefficients derived according to the inverse RST are two-dimensionally arranged according to the order of a row priority direction or a column priority direction according to an intra prediction mode to be applied to the target block.

Claims (32)

1. An image decoding method performed by a decoding apparatus, the method comprising:

obtaining residual information from a bitstream;

deriving quantized transform coefficients for a target block based on the residual information;

deriving transform coefficients for the target block by dequantizing the quantized transform coefficients;

deriving modified transform coefficients for the target block based on an inverse non-separable transform for the transform coefficients;

deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients; and

generating a reconstructed picture based on the residual samples for the target block,

wherein the inverse non-separable transform is performed through a matrix operation of the transform coefficients for a top-left area of the target block and a transform kernel matrix,

wherein the transform kernel matrix is selected based on a transform index from a transform set,

wherein the transform set is derived based on a mapping relationship according to an intra prediction mode applied to the target block,

wherein the modified transform coefficients are two-dimensionally arranged according to a row-first direction based on the intra prediction mode being a horizontal mode in a left direction with respect to a top-left diagonal direction, and

wherein the modified transform coefficients are two-dimensionally arranged according to a column-first direction based on the intra prediction mode being a vertical mode in a right direction with respect to the top-left diagonal direction.

2. An image encoding method performed by an encoding apparatus, the method comprising:

deriving residual samples for a target block;

deriving transform coefficients for the target block based on a primary transform for the residual samples;

deriving modified transform coefficients for the target block based on a non-separable transform for the transform coefficients;

deriving quantized transform coefficients for the target block by quantizing the modified transform coefficients; and

encoding residual information based on the quantized transform coefficients,

wherein the non-separable transform is performed through a matrix operation of the transform coefficients for a top-left area of the target block and a transform kernel matrix,

wherein the transform kernel matrix is selected from a transform set,

wherein the transform set is derived based on a mapping relationship according to an intra prediction mode applied to the target block,

wherein the modified transform coefficients are two-dimensionally arranged according to a row-first direction based on the intra prediction mode being a horizontal mode in a left direction with respect to a top-left diagonal direction, and

wherein the modified transform coefficients are two-dimensionally arranged according to a column-first direction based on the intra prediction mode being a vertical mode in a right direction with respect to the top-left diagonal direction.

3. A non-transitory computer readable storage medium storing a bitstream generated by the image encoding method of the claim 2 .

4. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on deriving residual samples for a target block, deriving transform coefficients for the target block based on a primary transform for the residual samples, deriving modified transform coefficients for the target block based on a non-separable transform for the transform coefficients, deriving quantized transform coefficients for the target block by quantizing the modified transform coefficients, and encoding residual information based on the quantized transform coefficients; and

transmitting the data comprising the bitstream,

wherein the non-separable transform is performed through a matrix operation of the transform coefficients for a top-left area of the target block and a transform kernel matrix,

wherein the transform kernel matrix is selected from a transform set,

wherein the transform set is derived based on a mapping relationship according to an intra prediction mode applied to the target block,

wherein the modified transform coefficients are two-dimensionally arranged according to a row-first direction based on the intra prediction mode being a horizontal mode in a left direction with respect to a top-left diagonal direction, and

wherein the modified transform coefficients are two-dimensionally arranged according to a column-first direction based on the intra prediction mode being a vertical mode in a right direction with respect to the top-left diagonal direction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2024
From: KOO, MOONMO; KIM, SEUNGHWAN; LIM, JAEHYUN
To: LG ELECTRONICS INC.
Reel/Frame 067373/0024 →
Continuity (6)
Continuation 18198382 · May 17, 2023
Continuation 17592301 · Feb 3, 2022
Continuation 17329749 · May 25, 2021
Continuation PCTKR2019017892 · Dec 17, 2019
Provisional Application 62781594 · Dec 18, 2018
Related Publication 20240298031A1 · Sep 5, 2024
References Cited (16)
US 9124901B2 · Kim · 2015 [cited by examiner]
US 10142648B2 · Lee · 2018 [cited by examiner]
US 10778989B2 · He · 2020 [cited by examiner]
US 11240508B2 · Yoo · 2022 [cited by examiner]
US 11277638B2 · Koo · 2022 [cited by examiner]
US 11431902B2 · Kim · 2022 [cited by examiner]
US 11477456B2 · Zhao · 2022 [cited by examiner]
US 11677955B2 · Choi · 2023 [cited by examiner]
US 11689745B2 · Koo · 2023 [cited by examiner]
US 11743477B1 · Im · 2023 [cited by examiner]
US 12003774B2 · Koo · 2024 [cited by examiner]
US 20230276063A1 · Kim · 2023 [cited by examiner]
JP 2018506908A · 2018 [cited by applicant]
KR 1020180063186A · 2018 [cited by applicant]
Koo et al., “Description of SDR video coding technology proposal by LG Electronics,” JVET-J0017-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting, San Diego, CA, Apr. 10… [cited by applicant]
Office Action in Korean Appln. No. 10-2021-7014534, mailed on Jul. 16, 2024, 12 pages (with English translation). [cited by applicant]