IP Library Granted Patent US 12,335,526
Granted Patent B2
US 12,335,526 · App. 17/868,724 · Granted Jun 17, 2025

Video signal processing method and apparatus using multiple transform kernel

Inventors: Jaehong Jung (Seoul, KR); Juhyung Son (Uiwang-si, KR); Dongcheol Kim (Suwon-si, KR); Geonjung Ko (Seoul, KR); Jinsam Kwak (Uiwang-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/625G06T9/004G06T9/007H04N19/159H04N19/176H04N19/61H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,526
App. No.
17/868,724
Granted
Jun 17, 2025
Kind
B2
Abstract

A video signal processing method may comprise the steps of: confirming a prediction mode applied to a current coding unit; confirming whether a plurality of preset conditions are satisfied on the basis of at least one of the prediction mode of the current coding unit and a size of the current coding unit; parsing a first syntax element indicating a transform kernel applied to a transform unit included in the current coding unit when the plurality of preset conditions are satisfied; determining a transform kernel applied to horizontal and vertical directions of the current transform unit on the basis of the first syntax element; and generating a residual signal of the current transform unit by performing an inverse transform on the current transform unit using the determined transform kernel.

Claims (23)

1. A video signal decoding device comprising a processor,

wherein the processor is configured to:

when a preset condition for parsing a first syntax element is satisfied, parse the first syntax element from a bitstream, determine a value of the first syntax element to be a first value among a plurality of values, the first value being any one among the plurality of values, determine a first horizontal transform kernel indicated by the first value among a plurality of transform kernels to be applied to a horizontal direction of a transform block and a first vertical transform kernel indicated by the first value among the plurality of transform kernels to be applied to a vertical direction of the transform block, and obtain a residual signal of the transform block by inverse-transformation using the first horizontal transform kernel and the first vertical transform kernel, and

when the preset condition is not satisfied, determine the value of the first syntax element to be a second value among the plurality of values without parsing the first syntax element from the bitstream, determine a second horizontal transform kernel indicated by the second value among the plurality of transform kernels to be applied to the horizontal direction of the transform block and a second vertical transform kernel indicated by the second value among the plurality of transform kernels to be applied to the vertical direction of the transform block, and obtain a residual signal of the transform block by inverse-transformation using the second horizontal transform kernel and the second vertical transform kernel, the second horizontal transform kernel and the second vertical transform kernel being the same transform kernel,

wherein the preset condition includes whether prediction mode of a current coding block is an intra mode and a second syntax element is true, or whether the prediction mode of the current coding block is an inter mode and a third syntax element is true,

wherein the value of the first syntax element indicates a kernel set among a plurality of kernel sets, the kernel set comprising a horizontal transform kernel and a vertical transform kernel, the horizontal transform kernel being one of the plurality of transform kernels and the vertical transform kernel being one of the plurality of transform kernels,

wherein the second syntax element indicates whether the first syntax element exists or not in the bitstream for a coding block with an intra mode in a current sequence,

wherein the third syntax element indicates whether the first syntax element exists or not in the bitstream for a coding block with an inter mode in the current sequence,

wherein when the current coding block is split into a plurality of transform blocks including the transform block according to ISP (intra sub-partitions) mode, it is determined that the preset condition is not satisfied, and

wherein when the prediction mode of the current coding block is an Intra Block Copy (IBC) mode, it is determined that the preset condition is not satisfied.

2. A video signal encoding device comprising a processor,

wherein the processor is configured to:

generate a bitstream encoded by an encoder using an encoding method,

wherein the encoding method comprises:

when a preset condition for encoding a first syntax element is satisfied, perform transformation on a residual signal of a transform block of a current coding block using a first horizontal transform kernel applied to a horizontal direction of the transform block and a first vertical transform kernel applied to a vertical direction of the transform block, and encode a first syntax element into the bitstream, wherein a value of the first syntax element is determined to be a first value among a plurality of values, the first value being any one among the plurality of values, and the first value of the first syntax element indicates the first horizontal transform kernel among a plurality of transform kernels and the first vertical transform kernel among the plurality of transform kernels, and

when the preset condition is not satisfied, perform transformation on the residual signal of the transform block of the current coding block using a second horizontal transform kernel applied to the horizontal direction of the transform block and a second vertical transform kernel applied to the vertical direction of the transform block, and determine the value of the first syntax element to be a second value among the plurality of values without encoding the first syntax element, wherein the second value of the first syntax element indicates the second horizontal transform kernel among the plurality of transform kernels and the second vertical transform kernel among the plurality of transform kernels, and the second horizontal transform kernel and the second vertical transform kernel are the same transform kernel,

wherein the preset condition includes whether a prediction mode of a current coding block is an intra mode and a second syntax element is true, or whether the prediction mode of the current coding block is an inter mode and a third syntax element is true,

wherein the value of the first syntax element indicates a kernel set among a plurality of kernel sets, the kernel set comprising a horizontal transform kernel and a vertical transform kernel, the horizontal transform kernel being one of the plurality of transform kernels and the vertical transform kernel being one of the plurality of transform kernels,

wherein the second syntax element indicates whether the first syntax element exists or not in the bitstream for a coding block with an intra mode in a current sequence,

wherein the third syntax element indicates whether the first syntax element exists or not in the bitstream for a coding block with an inter mode in the current sequence,

wherein when the current coding block is split into a plurality of transform blocks including the transform block according to ISP (intra sub-partitions) mode, it is determined that the preset conditions is not satisfied, and

wherein when the prediction mode of the current coding block is an Intra Block Copy (IBC) mode, it is determined that the preset condition is not satisfied.

3. A method of storing a bitstream into a non-transitory computer-readable medium, the bitstream being generated by a video signal encoding device of claim 2 .

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 062226 FRAME 0233. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 9, 2023
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 062335/0335 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2022
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: SAMSUNG ELECTRONICS CO. LTD.
Reel/Frame 062226/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2022
From: JUNG, JAEHONG; SON, JUHYUNG; KIM, DONGCHEOL; KO, GEONJUNG; KWAK, JINSAM
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
Reel/Frame 060554/0885 →
Priority Claims (2)
KR 10-2019-0047006 · Apr 23, 2019 · national
KR 10-2019-0116474 · Sep 21, 2019 · national
Continuity (3)
Continuation 17348260 · Jun 15, 2021
Continuation PCTKR2020005402 · Apr 23, 2020
Related Publication 20220368949A1 · Nov 17, 2022
References Cited (15)
US 20190387241A1 · Kim · 2019 [cited by examiner]
US 20200177901A1 · Choi · 2020 [cited by examiner]
US 20210211729A1 · Koo · 2021 [cited by examiner]
US 20240292014A1 · Choi et al. · 2024 [cited by applicant]
KR 101640973B1 · 2016 [cited by applicant]
KR 1020180001485A · 2018 [cited by applicant]
KR 1020180085526A · 2018 [cited by applicant]
KR 1020190027815A · 2019 [cited by applicant]
WO 2019009584A1 · 2019 [cited by applicant]
International Search Report of International application No. PCT/KR2020/005402, dated Aug. 14, 2020. [cited by applicant]
Written Opinion of International application No. PCT/KR2020/005402, dated Aug. 14, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/348,260 from the USPTO dated Apr. 14, 2022. [cited by applicant]
Corrected Notice of Allowability for U.S. Appl. No. 17/348,260 from the USPTO dated Jul. 11, 2022. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 4)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 2019, 254 total pages. [cited by applicant]
Office Action dated Oct. 23, 2024, issued by Korean Patent Office in Korean Patent Application No. 10-2021-7017617. [cited by applicant]