IP Library › Granted Patent US 12,192,525
Granted Patent B2
US 12,192,525 · App. 18/352,796 · Granted Jan 7, 2025

Video signal processing method and apparatus using multiple transform kernels

Inventors: Jaehong Jung (Seoul, KR); Juhyung Son (Uiwang-Si, KR); Dongcheol Kim (Suwon-Si, KR); Geonjung Ko (Seoul, KR); Jinsam Kwak (Anyang-Si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/625H04N19/12H04N19/176H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,525
App. No.
18/352,796
Granted
Jan 7, 2025
Kind
B2
Abstract

A video signal processor is configured to: obtain at least one transform block for a residual signal of a current block from a video signal bitstream, wherein the transform block comprises a plurality of transform coefficients two-dimensionally arranged, determine, on the basis of length information of a first side of the transform block, a horizontal transform kernel for horizontal transformation of the transform block, regardless of a length of a second side of the transform block, which is orthogonal to the first side, determine, on the basis of length information of the second side, a vertical transform kernel for vertical transformation of the transform block, regardless of a length of the first side, obtain the residual signal of the current block by performing, on the transform block, inverse transformation using the horizontal transform kernel and the vertical transform kernel, and reconstruct the current block based on the residual signal.

Claims (52)

1. A video decoding method, the method performed by an apparatus and comprising:

obtaining flag information indicating whether index information indicating a horizontal transform kernel and a vertical transform kernel is signaled for an intra predicted block in a bitstream;

obtaining prediction mode information indicating whether a current block is the intra predicted block;

obtaining a plurality of transform coefficients for residual samples of the current block, wherein the plurality of transform coefficients are two-dimensionally arranged;

based on the flag information indicating that the index information is not signaled for the intra predicted block in the bitstream and the prediction mode information indicating that the current block is the intra predicted block:

determining, based on length information of a first side of the current block, the horizontal transform kernel for horizontal transformation of the plurality of transform coefficients, regardless of a length of a second side of the current block, wherein the second side is orthogonal to the first side, and

determining, based on length information of the second side of the current block, the vertical transform kernel for vertical transformation of the plurality of transform coefficients, regardless of a length of the first side of the current block;

obtaining the residual samples of the current block by performing, based on the plurality of transform coefficients, inverse transformation using the horizontal transform kernel and the vertical transform kernel; and

reconstructing the current block based on the obtained residual samples,

wherein, based on the length information of the second side having a value outside a preconfigured range and the length information of the first side having a value within the preconfigured range, the vertical transform kernel is determined to be a first transform kernel and the horizontal transform kernel is determined to be a second transform kernel, and

wherein the first transform kernel is a discrete cosine transform type 2 (DCT-2)-based transform kernel, and the second transform kernel is not the DCT-2-based transform kernel.

2. The method of claim 1 ,

wherein the second transform kernel is a discrete sine transform type 7 (DST-7)-based transform kernel.

3. The method of claim 1 ,

wherein the length of the first side is a width of the current block, and the length of the second side is a height of the current block.

4. The method of claim 1 ,

wherein the inverse transformation using the horizontal transform kernel and the vertical transform kernel comprises first inverse transformation using the vertical transform kernel and second inverse transformation using the horizontal transform kernel.

5. The method of claim 4 ,

wherein the first inverse transformation is performed prior to the second inverse transformation.

6. A video encoding method, the method performed by an apparatus and comprising:

obtaining a bitstream to be decoded by a decoder using a decoding method,

wherein the decoding method comprises:

obtaining flag information indicating whether index information indicating a horizontal transform kernel and a vertical transform kernel is signaled for an intra predicted block in the bitstream;

obtaining prediction mode information indicating whether a current block is the intra predicted block;

obtaining a plurality of transform coefficients for residual samples of the current block, wherein the plurality of transform coefficients are two-dimensionally arranged;

based on the flag information indicating that the index information is not signaled for the intra predicted block in the bitstream and the prediction mode information indicating that the current block is the intra predicted block:

determining, based on length information of a first side of the current block, the horizontal transform kernel for horizontal transformation of the plurality of transform coefficients, regardless of a length of a second side of the current block, wherein the second side is orthogonal to the first side, and

determining, based on length information of the second side of the current block, the vertical transform kernel for vertical transformation of the plurality of transform coefficients, regardless of a length of the first side of the current block;

obtaining the residual samples of the current block by performing, based on the plurality of transform coefficients, inverse transformation using the horizontal transform kernel and the vertical transform kernel; and

reconstructing the current block based on the obtained residual samples,

wherein, based on the length information of the second side having a value outside a preconfigured range and the length information of the first side having a value within the preconfigured range, the vertical transform kernel is determined to be a first transform kernel and the horizontal transform kernel is determined to be a second transform kernel, and

wherein the first transform kernel is a discrete cosine transform type 2 (DCT-2)-based transform kernel, and the second transform kernel is not the DCT-2-based transform kernel.

7. The method of claim 6 ,

wherein the second transform kernel is a discrete sine transform type 7 (DST-7)-based transform kernel.

8. The method of claim 6 ,

wherein the length of the first side is a width of the current block, and the length of the second side is a height of the current block.

9. The method of claim 6 ,

wherein the inverse transformation using the horizontal transform kernel and the vertical transform kernel comprises first inverse transformation using the vertical transform kernel and second inverse transformation using the horizontal transform kernel.

10. The method of claim 9 ,

wherein the first inverse transformation is performed prior to the second inverse transformation.

11. A non-transitory computer-readable medium storing a bitstream, the bitstream being decoded by a decoding method,

wherein the decoding method comprises:

obtaining flag information indicating whether index information indicating a horizontal transform kernel and a vertical transform kernel is signaled for an intra predicted block in the bitstream;

obtaining prediction mode information indicating whether a current block is the intra predicted block;

obtaining a plurality of transform coefficients for residual samples of the current block, wherein the plurality of transform coefficients are two-dimensionally arranged;

based on the flag information indicating that the index information is not signaled for the intra predicted block in the bitstream and the prediction mode information indicating that the current block is the intra predicted block:

determining, based on length information of a first side of the current block, the horizontal transform kernel for horizontal transformation of the plurality of transform coefficients, regardless of a length of a second side of the current block, wherein the second side is orthogonal to the first side, and

determining, based on length information of the second side of the current block, the vertical transform kernel for vertical transformation of the plurality of transform coefficients, regardless of a length of the first side of the current block;

obtaining the residual samples of the current block by performing, based on the plurality of transform coefficients, inverse transformation using the horizontal transform kernel and the vertical transform kernel; and

reconstructing the current block based on the obtained residual samples,

wherein, based on the length information of the second side having a value outside a preconfigured range and the length information of the first side having a value within the preconfigured range, the vertical transform kernel is determined to be a first transform kernel and the horizontal transform kernel is determined to be a second transform kernel, and

wherein the first transform kernel is a discrete cosine transform type 2 (DCT-2)-based transform kernel, and the second transform kernel is not the DCT-2-based transform kernel.

Priority Claims (3)
KR 10-2018-0107430 · Sep 7, 2018 · national
KR 10-2018-0119444 · Oct 6, 2018 · national
KR 10-2018-0121515 · Oct 12, 2018 · national
Continuity (5)
Continuation 18146597 · Dec 27, 2022
Continuation 17697811 · Mar 17, 2022
Continuation 17185683 · Feb 25, 2021
Continuation PCTKR2019011621 · Sep 9, 2019
Related Publication 20230362411A1 · Nov 9, 2023
References Cited (24)
US 8531544B2 · Alacoque · 2013 [cited by applicant]
US 11589066B2 · Choi · 2023 [cited by examiner]
US 11863798B2 · Lim · 2024 [cited by examiner]
US 20190281298A1 · Ohkawa · 2019 [cited by applicant]
US 20190356915A1 · Jang · 2019 [cited by applicant]
US 20190387241A1 · Kim · 2019 [cited by examiner]
US 20200322635A1 · Koo · 2020 [cited by examiner]
US 20210218996A1 · Koo · 2021 [cited by applicant]
US 20220182651A1 · Kim · 2022 [cited by examiner]
KR 101805531B1 · 2018 [cited by applicant]
WO 2017023152A1 · 2017 [cited by applicant]
WO 2018101288A1 · 2018 [cited by applicant]
WO 2018128323A1 · 2018 [cited by applicant]
International Search Report of International Application No. PCT/KR2019/011621, dated Dec. 20, 2019. [cited by applicant]
Written Opinion of International Application No. PCT/KR2019/011621, dated Dec. 20, 2019. [cited by applicant]
Jianle Chen et al. Algorithm description for Versatile Video Coding and Test Model 2 (VTM 2), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-KI002-v2, Jul. 18, 2018. [cited by applicant]
Office Action from Intellectual Property INDIA for Application No. 202127008805, dated Jan. 21, 2022. [cited by applicant]
Notice of Allowance of U.S. Appl. No. 17/697,811 from the USPTO dated Dec. 1, 2022. [cited by applicant]
Non-Final Rejection of U.S. Appl. No. 17/185,683 from the USPTO dated Sep. 1, 2021. [cited by applicant]
Notice of Allowance of U.S. Appl. No. 17/185,683 from the USPTO dated Dec. 22, 2021. [cited by applicant]
Communication issued Oct. 22, 2024 by the Korean Intellectual Property Office in KR Patent Application No. 10-2021-7005232. [cited by applicant]
Chen, Jianle et al, “Algorithm Description of Joint Exploration Test Model 3”, Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET-C1001 version 4 (Jul. 6, 2016). [cited by applicant]
Zhang et al, “Video coding using Variable Block-Size Spatially Varying Transforms”, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 905-908 (2009). [cited by applicant]
Lorcy et al, “Proposed improvements to the Adaptive multiple Core transform”, Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET-C0022 (May 27, 2016). [cited by applicant]