IP Library Granted Patent US 12,262,015
Granted Patent B2
US 12,262,015 · App. 17/762,150 · Granted Mar 25, 2025

Transform-based image coding method and device

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/132H04N19/119H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,015
App. No.
17/762,150
Granted
Mar 25, 2025
Kind
B2
Abstract

An image decoding method includes a step of deriving a residual sample, wherein the step of deriving the residual sample includes the steps of: when a current block is divided into sub-partition blocks, deriving a transform kernel for an inverse primary transform applied to a sub-partition block based on a horizontal or a vertical length of the sub-partition block; and deriving the residual sample from transform coefficients based on the transform kernel.

Claims (18)

1. An image decoding method performed by a decoding apparatus, the method comprising:

obtaining, from a bitstream, residual information and a low-frequency non-separable transform (LFNST) index;

deriving transform coefficients for a current block based on the residual information;

deriving residual samples for the current block by applying an inverse primary transform to the transform coefficients using transform kernels for vertical and horizontal; and

generating a reconstructed picture based on the residual samples,

wherein based on the current block being divided into sub-partition blocks as an intra sub-partitions (ISP) is applied and the LFNST index being equal to 0, the transform kernel for vertical is determined by checking a vertical length of a sub-partition block divided from the current block, and the transform kernel for horizontal is determined by checking a horizontal length of the sub-partition block, and

wherein based on the current block being divided into the sub-partition blocks as the ISP is applied and the LFNST index being greater than 0, the transform kernels for vertical and horizontal are respectively determined as DCT-2.

2. An image encoding method performed by an encoding apparatus, the method comprising:

deriving residual samples for a current block;

deriving transform coefficients by applying a primary transform to the residual samples using transform kernels for vertical and horizontal; and

encoding an LFNST index and residual information including information on the transform coefficients,

wherein based on the current block being divided into sub-partition blocks as an intra sub-partitions (ISP) is applied and the LFNST index being equal to 0, the transform kernel for vertical is determined by checking a vertical length of a sub-partition block divided from the current block, and the transform kernel for horizontal is determined by checking a horizontal length of the sub-partition block, and

wherein based on the current block being divided into the sub-partition blocks as the ISP is applied and the LFNST index being greater than 0, the transform kernels for vertical and horizontal are respectively determined as DCT-2.

3. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on deriving residual samples for a current block, deriving transform coefficients by applying a primary transform to the residual samples using transform kernels for vertical and horizontal, and encoding an LFNST index and residual information including information on the transform coefficients; and

transmitting the data comprising the bitstream,

wherein based on the current block being divided into sub-partition blocks as an intra sub-partitions (ISP) is applied and the LFNST index being equal to 0, the transform kernel for vertical is determined by checking a vertical length of a sub-partition block divided from the current block, and the transform kernel for horizontal is determined by checking a horizontal length of the sub-partition block, and

wherein based on the current block being divided into the sub-partition blocks as the ISP is applied and the LFNST index being greater than 0, the transform kernels for vertical and horizontal are respectively determined as DCT-2.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2022
From: KOO, MOONMO; LIM, JAEHYUN; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 059975/0596 →
Continuity (3)
Provisional Application 62904636 · Sep 23, 2019
Provisional Application 62903823 · Sep 21, 2019
Related Publication 20220417518A1 · Dec 29, 2022
References Cited (45)
US 11539952B2 · Egilmez · 2022 [cited by examiner]
US 20130107950A1 · Guo et al. · 2013 [cited by applicant]
US 20190110061A1 · Park et al. · 2019 [cited by applicant]
US 20210099702A1 · Egilmez · 2021 [cited by examiner]
US 20220038741A1 · Nam · 2022 [cited by examiner]
US 20220150545A1 · Egilmez · 2022 [cited by examiner]
US 20220159259A1 · Fan · 2022 [cited by examiner]
US 20220345690A1 · Zhao · 2022 [cited by examiner]
US 20220394255A1 · Kang · 2022 [cited by examiner]
US 20230142928A1 · Koo · 2023 [cited by examiner]
US 20230269374A1 · Fan · 2023 [cited by examiner]
US 20240146966A1 · Koo · 2024 [cited by examiner]
CN 104244010 · 2014 [cited by applicant]
CN 105120272 · 2015 [cited by applicant]
CN 107071437A · 2017 [cited by applicant]
CN 109417636 · 2019 [cited by applicant]
CN 111615830 · 2020 [cited by applicant]
CN 111684809 · 2020 [cited by applicant]
KR 20100095992 · 2010 [cited by applicant]
KR 101617109 · 2016 [cited by applicant]
KR 20180136481 · 2018 [cited by applicant]
WO WO2018066990A1 · 2018 [cited by applicant]
WO WO2019009618 · 2019 [cited by applicant]
WO WO2019117639 · 2019 [cited by applicant]
WO WO2019125035 · 2019 [cited by applicant]
WO WO2020260313A1 · 2020 [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6),” JVET-O2001-vE, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
Zhou et al., “Non-CE6: Simplification with new LFNST transform basis,” JVET-O0620, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12,… [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5),” JVET-N1001-v10, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 406 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6),” JVET-O2001-v1, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 406 pages. [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 5 (VTM 5),” JVET-N1002-v2, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC I/SC 29/WG 11, 14th Meeting: Gene… [cited by applicant]
Extended European Search Report in European Appln. No. 20866694.1, dated Oct. 7, 2022, 11 pages. [cited by applicant]
Koo et al., “Low Frequency Non-Separable Transform (LFNST),” Picture Coding Symposium (PCS). IEEE, Nov. 2019, 5 pages. [cited by applicant]
Koo et al., “Non-CE6: Block size restriction of LFNST,” JVET-O0213, Presented at Joint Video Experts Team (JVET) ofITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 5 pages. [cited by applicant]
Office Action in Indian Appln. No. 202217021895, dated Aug. 23, 2022, 6 pages. [cited by applicant]
Tsukuba et al., “Non-CE6: TU/TB-level LFNST index coding,” JVET-O0352-v2, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 8 … [cited by applicant]
De-Luxan-Hernandez et al., “ Non-CE6: Combination of JVET-P0196 and JVET-P0392 on applying LFNST for ISP Blocks and simplifying the transform signalling,” JVET-P1026-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP… [cited by applicant]
De-Luxan-Hernandez et al., “Non-CE6: Combination of ISP and LFNST,” JVET-P0392-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Meeting #16, Oct. 1-11, 2019, 5 pages. [cited by applicant]
Lainema, “CE6-related: Latency reduction for LFNST signalling,” JVET-P0196-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Meeting #16, Oct. 1-11, 2019, 4 pages. [cited by applicant]
Notice of Allowance in European Appln. No. 20866694.1, mailed on Jan. 15, 2024, 8 pages. [cited by applicant]
Office Action in Chinese Appln. No. 202080072344.7, mailed on Apr. 11, 2024, 16 pages (with English translation). [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 3),” JVET-L1001-v9, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 238 pages. [cited by applicant]
De-Luxán-Hernández et al., “CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2),” JVET-M0102-v5, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, … [cited by applicant]
Notice of Allowance in Chinese Appln. No. 202080072344.7, mailed on Oct. 31, 2024, 5 pages. [cited by applicant]
Office Action in Korean Appln. No. 10-2022-7008836, mailed on Oct. 25, 2024, 7 pages. [cited by applicant]