IP Library › Granted Patent US 12,273,529
Granted Patent B2
US 12,273,529 · App. 18/369,015 · Granted Apr 8, 2025

Image coding method based on transform, and device therefor

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/132H04N19/176H04N19/18H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,273,529
App. No.
18/369,015
Granted
Apr 8, 2025
Kind
B2
Abstract

An image decoding method includes a step of deriving a modified transform coefficient, wherein the step of deriving the modified transform coefficient includes the steps of: deriving a first variable indicating whether the transform coefficient exists in an area excluding a DC location of the current block; parsing an LFNST index based on the derivation result; and deriving the modified transform coefficient based on the LFNST index and an LFNST matrix, and based on the fact that the current block is divided into a plurality of sub-partition blocks, the LFNST index can be parsed without deriving the first variable.

Claims (27)

1. An image decoding method performed by a decoding apparatus, the method comprising:

obtaining image information including a flag related to whether an Intra sub-partitions (ISP) mode is applied and information on transform coefficients from a bitstream;

deriving quantized transform coefficients for a current block based on the information on the transform coefficients;

deriving transform coefficients for the current block by performing a dequantization on the quantized transform coefficients;

deriving modified transform coefficients for the current block by applying a low-frequency non-separable transform (LFNST) to the transform coefficients based on an LFNST matrix;

deriving residual samples for the current block by applying an inverse primary transform on the modified transform coefficients; and

generating a reconstructed picture based on the residual samples and prediction samples for the current block,

wherein in case the flag represents that the ISP mode is not applied to the current block, based on a non-zero transform coefficient being present in a region other than a DC position of the current block, the image information includes an LFNST index related to the LFNST matrix,

wherein based on the flag representing that the ISP mode is applied to the current block, the image information includes the LFNST index related to the LFNST matrix without considering of whether the non-zero transform coefficient is present in the region other than the DC position of the current block, and

wherein based on a sub-partition block divided from the current block being a 4×4 block or a 8×8 block, the LFNST is applied from a top-left position of the sub-partition block up to 8th transform coefficients in a scan direction.

2. An image encoding method performed by an encoding apparatus, the method comprising:

determining whether to apply an Intra Sub-Partitions (ISP) mode to a current block;

deriving residual samples for the current block based on prediction samples for the current block;

deriving transform coefficients for the current block by applying a primary transform to the residual samples;

deriving modified transform coefficients for the current block by applying a low-frequency non-separable transform (LFNST) to the transform coefficients based on an LFNST matrix;

deriving quantized transform coefficients for the current block by performing a quantization on the modified transform coefficients; and

encoding image information including information related to the quantized transform coefficients and a flag related to whether the ISP mode is applied to the current block,

wherein in case the flag represents that the ISP mode is not applied to the current block, based on a non-zero transform coefficient being present in a region other than a DC position of the current block, the image information includes an LFNST index related to the LFNST matrix,

wherein based on the flag representing that the ISP mode is applied to the current block, the image information includes the LFNST index related to the LFNST matrix without considering of whether the non-zero transform coefficient is present in the region other than the DC position of the current block, and

wherein based on a sub-partition block divided from the current block being a 4×4 block or a 8×8 block, 8 modified transform coefficients are derived through the LENST.

3. A non-transitory computer-readable digital storage medium storing a bitstream generated by the image encoding method of claim 2 .

4. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on determining whether to apply an Intra Sub-Partitions (ISP) mode to a current block, deriving residual samples for the current block based on prediction samples for the current block, deriving transform coefficients for the current block by applying a primary transform to the residual samples, deriving modified transform coefficients for the current block by applying a low-frequency non-separable transform (LFNST) to the transform coefficients based on an LFNST matrix, deriving quantized transform coefficients for the current block by performing a quantization on the modified transform coefficients, and encoding image information including information related to the quantized transform coefficients and a flag related to whether the ISP mode is applied to the current block; and

transmitting the data comprising the bitstream,

wherein in case the flag represents that the ISP mode is not applied to the current block, based on a non-zero transform coefficient being present in a region other than a DC position of the current block, the image information includes an LFNST index related to the LFNST matrix,

wherein based on the flag representing that the ISP mode is applied to the current block, the image information includes the LFNST index related to the LFNST matrix without considering of whether the non-zero transform coefficient is present in the region other than the DC position of the current block, and

wherein based on a sub-partition block divided from the current block being a 4×4 block or a 8×8 block, 8 modified transform coefficients are derived through the LENST.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2023
From: KOO, MOONMO; LIM, JAEHYUN; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 064939/0310 →
Continuity (5)
Continuation 17699411 · Mar 21, 2022
Continuation PCTKR2020012695 · Sep 21, 2020
Provisional Application 62904627 · Sep 23, 2019
Provisional Application 62903821 · Sep 21, 2019
Related Publication 20240007642A1 · Jan 4, 2024
References Cited (8)
US 10855997B2 · Chiang · 2020 [cited by examiner]
US 11805257B2 · Koo · 2023 [cited by examiner]
US 20200389666A1 · Zhao · 2020 [cited by examiner]
US 20200396487A1 · Nalci · 2020 [cited by examiner]
WO WO2020256442A1 · 2020 [cited by applicant]
WO WO2020260313A1 · 2020 [cited by applicant]
De-Luxán-Hernández et al., “Non-CE6: Combination of ISP and LFNST,” JVET-P0392-v4, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 8 pages. [cited by applicant]
Office Action in Japanese Appln. No. 2023-098497, mailed on Jul. 30, 2024, 5 pages (with English translation). [cited by applicant]