IP Library › Granted Patent US 12,407,859
Granted Patent B2
US 12,407,859 · App. 17/430,496 · Granted Sep 2, 2025

Method for processing image on basis of transform and device therefor

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/61H04N19/176H04N19/46H04N19/625H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,859
App. No.
17/430,496
Granted
Sep 2, 2025
Kind
B2
Abstract

Embodiments of the present disclosure provide a method and apparatus for processing a video signal. A method for decoding a video signal according to an embodiment of the present disclosure includes obtaining a sub-block transform (SBT) flag indicating whether an SBT is applied, wherein the SBT represents a transform applied to one of sub-blocks split from a coding unit, determining a transform unit from the coding unit based on the SBT flag, determining a size value of the transform unit as a first reference value if DST-7 (Discrete Sine Transform type 7) or DCT-8 (Discrete Cosine Transform type 8) is applied and the size value of the transform unit is greater than the first reference value and less than a third reference value and determining the size value as a second reference value if DCT-2 (Discrete Cosine Transform type 2) is applied and the size value is equal to or greater than the third reference value, wherein the third reference value is greater than the second reference value and the second reference value is greater than the first reference value, obtaining transform coefficients based on the size value, and performing an inverse transform on the transform coefficients. A data processing time and the amount of data necessary for a transform can be reduced by performing coding in consideration of a region reduced according to a block size.

Claims (43)

1. A method for decoding a video signal, comprising:

obtaining a sub-block transform (SBT) flag indicating whether a SBT is applied, wherein the SBT represents a transform applied to a transform unit corresponding to one of subblocks split from a coding unit;

checking whether a condition related to a width and a height of the transform unit is satisfied;

determining a width variable and a height variable related to a transform target region based on the SBT flag and the condition; and

performing an inverse-transform on the transform target region based on the width variable and the height variable related to the transform target region,

wherein, based on the SBT flag indicating that the SBT is applied to the transform unit and the condition being satisfied, the width variable related to the transform target region is determined as a first reference value,

wherein, based on the SBT flag indicating that the SBT is not applied to the transform unit or the condition not being satisfied, the width variable related to the transform target region is determined as a smaller value among the width of the transform unit and a second reference value,

wherein, based on the SBT flag indicating that the SBT is applied to the transform unit and the condition being satisfied, the height variable related to the transform target region is determined as the first reference value,

wherein, based on the SBT flag indicating that the SBT is not applied to the transform unit or the condition not being satisfied, the height variable related to the transform target region is determined as a smaller value among the height of the transform unit and the second reference value,

wherein the inverse-transform on the transform target region comprises a horizontal direction transform and a vertical direction transform on a non-zero region in the transform unit,

wherein a horizontal transform kernel index indicating a type of a horizontal transform kernel for the horizontal direction transform is derived based on the SBT flag,

wherein a vertical transform kernel index indicating a type of a vertical transform kernel for the vertical direction transform is derived based on the SBT flag,

wherein a width of the non-zero region is determined as a smaller value among the width of the transform unit and 16, based on the horizontal transform kernel index being greater than zero, and

wherein a height of the non-zero region is determined as a smaller value among the height of the transform unit and 16, based on the vertical transform kernel index being greater than zero.

2. A method for encoding a video signal, the method comprising:

checking whether a condition related to a width and a height of a transform unit is satisfied;

determining a width variable and a height variable related to a transform target region based on whether a sub-block transform (SBT) is applied and the condition;

performing a transform on the transform unit based on the width variable and the height variable related to the transform target region; and

generating a SBT flag indicating whether the SBT is applied, wherein the SBT represents a transform applied to the transform unit corresponding to one of subblocks split from a coding unit,

wherein, based on the SBT being applied to the transform unit and the condition being satisfied, the width variable related to the transform target region is determined as a first reference value,

wherein, based on the SBT not being applied to the transform unit or the condition not being satisfied, the width variable related to the transform target region is determined as a smaller value among the width of the transform unit and a second reference value, and

wherein, based on the SBT being applied to the transform unit and the condition being satisfied, the height variable related to the transform target region is determined as the first reference value,

wherein, based on the SBT not being applied to the transform unit or the condition not being satisfied, the height variable related to the transform target region is determined as a smaller value among the height of the transform unit and the second reference value,

wherein the transform on the transform unit comprises a horizontal direction transform and a vertical direction transform on the transform unit,

wherein a horizontal transform kernel index indicating a type of a horizontal transform kernel for the horizontal direction transform is derived based on the SBT flag,

wherein a vertical transform kernel index indicating a type of a vertical transform kernel for the vertical direction transform is derived based on the SBT flag,

wherein a width of an area, in which a non-zero transform coefficient is present, is determined as a smaller value among the width of the transform unit and 16, based on the horizontal transform kernel index being greater than zero, and

wherein a height of the area, in which the non-zero transform coefficient is present, is determined as a smaller value among the height of the transform unit and 16, based on the vertical transform kernel index being greater than zero.

3. A method comprising:

generating a bitstream for image information including a sub-block transform (SBT) flag indicating whether a SBT is applied, wherein the SBT represents a transform applied to a transform unit corresponding to one of subblocks split from a coding unit; and

transmitting data including the bitstream,

wherein whether a condition related to a width and a height of the transform unit is satisfied is checked,

wherein a width variable and a height variable related to a transform target region is determined based on whether the SBT is applied and the condition,

wherein a transform on the transform unit is performed based on the width variable and the height variable related to the transform target region,

wherein, based on the SBT being applied to the transform unit and the condition being satisfied, the width variable related to the transform target region is determined as a first reference value,

wherein, based on the SBT not being applied to the transform unit or the condition not being satisfied, the width variable related to the transform target region is determined as a smaller value among the width of the transform unit and a second reference value, and

wherein, based on the SBT being applied to the transform unit and the condition being satisfied, the height variable related to the transform target region is determined as the first reference value,

wherein, based on the SBT not being applied to the transform unit or the condition not being satisfied, the height variable related to the transform target region is determined as a smaller value among the height of the transform unit and the second reference value,

wherein the transform on the transform unit comprises a horizontal direction transform and a vertical direction transform on the transform unit,

wherein a horizontal transform kernel index indicating a type of a horizontal transform kernel for the horizontal direction transform is derived based on the SBT flag,

wherein a vertical transform kernel index indicating a type of a vertical transform kernel for the vertical direction transform is derived based on the SBT flag,

wherein a width of an area, in which a non-zero transform coefficient is present, is determined as a smaller value among the width of the transform unit and 16, based on the horizontal transform kernel index being greater than zero, and

wherein a height of the area, in which the non-zero transform coefficient is present, is determined as a smaller value among the height of the transform unit and 16, based on the vertical transform kernel index being greater than zero.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S COUNTRY OF RECORD ON COVER SHEET PREVIOUSLY RECORDED AT REEL: 057232 FRAME: 0694. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 30, 2021
From: KOO, MOONMO; LIM, JAEHYUN; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 058945/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: KOO, MOONMO; LIM, JAEHYUN; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 057232/0694 →
Continuity (2)
Provisional Application 62804752 · Feb 12, 2019
Related Publication 20220086490A1 · Mar 17, 2022
References Cited (12)
US 20200186838A1 · Zhao · 2020 [cited by examiner]
US 20200228832A1 · Tsai · 2020 [cited by examiner]
US 20210227208A1 · Lee · 2021 [cited by examiner]
US 20210266581A1 · Jung · 2021 [cited by examiner]
US 20210360240A1 · Lee · 2021 [cited by examiner]
KR 20160038063 · 2016 [cited by applicant]
KR 20180096194 · 2018 [cited by applicant]
WO WO2018190594 · 2018 [cited by applicant]
Versatile Video Coding (Draft 4), JVET-M1001-v7 (Year: 2019). [cited by examiner]
PCT International Search Report in International Application No. PCT/KR2020/001986, dated May 26, 2020, 5 pages. [cited by applicant]
Zhao et al., “CE6: Sub-block transform for inter blocks (CE6.4.1),” JVET-M0140-v3, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, … [cited by applicant]
Koo et al., “CE6-related: 32 point MTS based on skipping high frequency coefficients,” JVET-M0297, Presented at Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech,… [cited by applicant]