IP Library Granted Patent US 12,273,562
Granted Patent B2
US 12,273,562 · App. 17/974,971 · Granted Apr 8, 2025

Image coding method based on transform, and device therefor

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/60H04N19/12H04N19/132H04N19/172H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,273,562
App. No.
17/974,971
Granted
Apr 8, 2025
Kind
B2
Abstract

An image decoding method according to the present document comprises a step of deriving a residual sample for a current block on the basis of a transform coefficient, wherein the step of deriving the transform coefficient can comprise the steps of: determining whether a sub block transform for performing a transform by dividing a coding unit is applied to the current block; determining whether a multiple transform selection (MTS), for which a plurality of transform kernels are used, is applied to the current block; and setting the size of a transform block to which the transform is to be applied, on the basis of whether the sub block transform is applied to the current block and whether the multiple transform selection is applied to the current block.

Claims (37)

1. An image decoding method performed by a decoding apparatus, comprising:

obtaining residual information from a bitstream;

deriving transform coefficients for a current block based on the residual information;

deriving residual samples for the current block based on the transform coefficients; and

generating a reconstructed picture based on the residual samples,

wherein deriving the transform coefficients comprises:

determining whether a multiple transform selection (MTS) using a plurality of transform kernels is enabled for the current block based on first flag information related to whether the MTS is enabled;

determining whether a subblock transform is used for a coding block including the current block based on second flag information related to whether the subblock transform is used for the coding block; and

setting a width and a height of a region where a non-zero transform coefficient can exist within the current block based on whether the MTS is enabled and whether the subblock transform is used for the coding block,

wherein based on the first flag information indicating the MTS is enabled and the second flag information indicating the subblock transform is used for the coding block, the width and the height of the region in the current block are set equal to 16, and

wherein based on the first flag information indicating the MTS is not enabled or the second flag information indicating the subblock transform is not used for the coding block, the width of the region in the current block is set equal to a minimum value of a width of the current block and 32, and the height of the region in the current block is set equal to a minimum value of a height of the current block and 32.

2. The image decoding method of claim 1 , wherein the second flag information is signaled at a coding unit level, and the coding unit includes the coding block.

3. The image decoding method of claim 1 , wherein the first flag information is signaled at a sequence parameter set level.

4. The image decoding method of claim 1 , wherein the residual information comprises last significant coefficient prefix information, and

wherein a maximum value of the last significant coefficient prefix information is derived based on the width and the height of the region.

5. An image encoding method performed by an image encoding apparatus, comprising:

deriving residual samples for a current block;

deriving transform coefficients based on the residual samples; and

encoding residual information comprising information on the transform coefficients,

wherein deriving the transform coefficients comprises:

determining whether a multiple transform selection (MTS) using a plurality of transform kernels is enabled for the current block;

determining whether a subblock transform is used for a coding block including the current block; and

setting a width and a height of a region where a non-zero transform coefficient can exist within the current block based on whether the MTS is enabled and whether the subblock transform is used for the coding block,

wherein based on first flag information indicating the MTS is enabled and second flag information indicating the subblock transform is used for the coding block, the width and the height of the region in the current block are set equal to 16, and

wherein based on the first flag information indicating the MTS is not enabled or the second flag information indicating the subblock transform is not used for the coding block, the width of the region in the current block is set equal to a minimum value of a width of the current block and 32, and the height of the region in the current block is set equal to a minimum value of a height of the current block and 32.

6. The image encoding method of claim 5 , wherein the residual information comprises last significant coefficient prefix information, and

wherein a maximum value of the last significant coefficient prefix information is derived based on the width and the height of the region.

7. A transmission method of data for an image, comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on deriving residual samples for a current block, deriving transform coefficients based on the

residual samples, and encoding residual information comprising information on the transform coefficients; and

transmitting the data comprising the bitstream,

wherein deriving the transform coefficients comprises;

determining whether a multiple transform selection (MTS) using a plurality of transform kernels is enabled for the current block;

determining whether a subblock transform is used for a coding block including the current block; and

setting a width and a height of a region where a non-zero transform coefficient can exist within the current block based on whether the MTS is enabled and whether the subblock transform is used for the coding block,

wherein based on first flag information indicating the MTS is enabled and second flag information indicating the subblock transform is used for the coding block, the width and the height of the region in the current block are set equal to 16, and

wherein based on the first flag information indicating the MTS is not enabled or the second flag information indicating the subblock transform is not used for the current block, the width of the region in the current block is set equal to a minimum value of a width of the current block and 32, and the height of the region in the current block is set equal to a minimum value of a height of the current block and 32.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2022
From: KOO, MOONMO; LIM, JAEHYUN; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 061563/0287 →
Continuity (4)
Continuation 17591431 · Feb 2, 2022
Continuation PCTKR2020010490 · Aug 7, 2020
Provisional Application 62884670 · Aug 8, 2019
Related Publication 20230076486A1 · Mar 9, 2023
References Cited (19)
US 11595656B2 · Chuang · 2023 [cited by examiner]
US 20150117520A1 · Zhou · 2015 [cited by applicant]
US 20170094314A1 · Zhao et al. · 2017 [cited by applicant]
US 20180103252A1 · Hsieh et al. · 2018 [cited by applicant]
US 20190014325A1 · Lin et al. · 2019 [cited by applicant]
US 20200099924A1 · Seregin · 2020 [cited by applicant]
US 20200366937A1 · Egilmez · 2020 [cited by applicant]
US 20200396487A1 · Nalci · 2020 [cited by applicant]
US 20220377337A1 · Zhang · 2022 [cited by examiner]
CN 105120272A · 2015 [cited by applicant]
CN 106664423A · 2017 [cited by applicant]
CN 108886613A · 2018 [cited by applicant]
KR 1020180048929A · 2018 [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 6)” JVETO2001-v6 (Year: 2019). [cited by examiner]
Moonmo Koo et al., “CE6: Reduced Secondary Transform (RST) (CE6-3.1)”, JVET-N0193, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, see pp. 3… [cited by applicant]
Moonmo Koo et al., “CE 6-1.1 (c,d): Fast DST-7/DCT-8 based on DFT and 32 point MTS based on skipping high frequency coefficients”, JVET-L0132, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/… [cited by applicant]
Karam Naser et al., “Non-CE6: Shape Adaptive Transform Selection for ISP, SBT and MTS”, JVET-N0388, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27… [cited by applicant]
Bross, et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2001-vE, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019. [cited by applicant]
FPGA, The Research and Design of Critical Algorithms in Video Codec Based on FPGA (Feb. 15, 2017). [cited by applicant]