IP Library › Granted Patent US 12,192,503
Granted Patent B2
US 12,192,503 · App. 18/058,756 · Granted Jan 7, 2025

Method and device for processing video signal using multiple transform kernels

Inventors: Jaehong Jung (Seoul, KR); Juhyung Son (Uiwang-Si, KR); Dongcheol Kim (Suwon-Si, KR); Geonjung Ko (Seoul, KR); Jinsam Kwak (Anyang-Si, KR)
Assignee: HUMAX CO., LTD.
H04N19/46H04N19/119H04N19/159H04N19/176H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,503
App. No.
18/058,756
Granted
Jan 7, 2025
Kind
B2
Abstract

A method for processing a video signal comprises the steps of: obtaining, from the video signal, an intra sub-partitions (ISP) mode flag indicating whether the ISP mode is applied to a current block; when the ISP mode is applied to the current block, obtaining, from the video signal, an ISP partitioning flag indicating a partitioning direction of the current block; partitioning the current block into a plurality of transform blocks on the basis of the partitioning direction; generating residual blocks of the transform blocks by performing an inverse transformation on each of the transform blocks; and restoring the current block on the basis of the residual blocks.

Claims (98)

1. A non-transitory computer-readable medium storing a bitstream, the bitstream being decoded by a decoding method, the decoding method comprising:

obtaining an intra sub-partitions (ISP) mode flag indicating whether or not an ISP mode is applied to a current block;

if the ISP mode is applied to the current block, obtaining an ISP partitioning flag indicating a partitioning direction of the current block;

partitioning the current block into a plurality of transform blocks on the basis of the partitioning direction;

determining a horizontal transform kernel applied to a current transform block among the plurality of transform blocks,

wherein the horizontal transform kernel is applied to a horizontal direction of the current transform block;

determining a vertical transform kernel applied to the current transform block,

wherein the vertical transform kernel is applied to a vertical direction of the current transform block;

generating a residual block of the current transform block by performing inverse transform on the current transform block based on the horizontal transform kernel and the vertical transform kernel; and

reconstructing the current block on the basis of the residual block,

wherein when a width of the current transform block is less than a first threshold or greater than a second threshold, the horizontal transform kernel is determined to be a first transform kernel,

wherein when the width of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the horizontal transform kernel is determined to be a second transform kernel,

wherein when a height of the current transform block is less than the first threshold or greater than the second threshold, the vertical transform kernel is determined to be the first transform kernel,

wherein when the height of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the vertical transform kernel is determined to be the second transform kernel.

2. The non-transitory computer-readable medium storing the bitstream of claim 1 ,

wherein the first transform kernel is a transform kernel based on a discrete cosine transform type-2 (DCT-2), and the second transform kernel is a transform kernel based on a discrete sine transform type-7 (DST-7).

3. The non-transitory computer-readable medium storing the bitstream of claim 1 ,

wherein the first threshold is determined on the basis of a minimum transform block size of a luma component.

4. The non-transitory computer-readable medium storing the bitstream of claim 1 ,

wherein the second threshold is determined on the basis of a maximum size of the second transform kernel used in the ISP mode.

5. The non-transitory computer-readable medium storing the bitstream of claim 1 ,

wherein the first threshold is defined as 4, and the second threshold is defined as 16.

6. The non-transitory computer-readable medium storing the bitstream of claim 1 ,

wherein the horizontal transform kernel is determined regardless of the height of the current transform block, and

wherein the vertical transform kernel is determined regardless of the width of the current transform block.

7. The non-transitory computer-readable medium storing the bitstream of claim 1 ,

wherein the horizontal transform kernel is determined regardless of an intra prediction mode of the current block,

wherein the vertical transform kernel is determined regardless of the intra prediction mode of the current block.

8. A video signal decoding device comprising a processor,

wherein the processor is configured to:

obtain an intra sub-partitions (ISP) mode flag indicating whether or not an ISP mode is applied to a current block,

if the ISP mode is applied to the current block, obtain an ISP partitioning flag indicating a partitioning direction of the current block,

partition the current block into a plurality of transform blocks on the basis of the partitioning direction,

determine a horizontal transform kernel applied to a current transform block among the plurality of transform blocks,

wherein the horizontal transform kernel is applied to a horizontal direction of the current transform block,

determine a vertical transform kernel applied to the current transform block,

wherein the vertical transform kernel is applied to a vertical direction of the current transform block,

generate a residual block of the current transform block by performing inverse transform based on the horizontal transform kernel and the vertical transform kernel on the current transform block; and

reconstruct the current block on the basis of the residual block,

wherein when a width of the current transform block is less than a first threshold or greater than a second threshold, the horizontal transform kernel is determined to be a first transform kernel,

wherein when the width of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the horizontal transform kernel is determined to be a second transform kernel,

wherein when a height of the current transform block is less than the first threshold or greater than the second threshold, the vertical transform kernel is determined to be the first transform kernel,

wherein when the height of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the vertical transform kernel is determined to be the second transform kernel.

9. The video signal decoding device of claim 8 ,

wherein the first transform kernel is a transform kernel based on a discrete cosine transform type-2 (DCT-2), and the second transform kernel is a transform kernel based on a discrete sine transform type-7 (DST-7).

10. The video signal decoding device of claim 8

wherein the first threshold is determined on the basis of a minimum transform block size of a luma component.

11. The video signal decoding device of claim 8 ,

wherein the first threshold is defined as 4, and the second threshold is defined as 16.

12. The video signal decoding device of claim 8 ,

wherein the horizontal transform kernel is determined regardless of the height of the current transform block, and

wherein the vertical transform kernel is determined regardless of the width of the current transform block.

13. The video signal decoding device of claim 8 ,

wherein the horizontal transform kernel is determined regardless of an intra prediction mode of the current block,

wherein the vertical transform kernel is determined regardless of the intra prediction mode of the current block.

14. A video signal encoding device comprising a processor,

wherein the processor is configured to

obtain a bitstream to be decoded by a decoder using a decoding method,

wherein the decoding method comprising:

obtaining an intra sub-partitions (ISP) mode flag indicating whether or not an ISP mode is applied to a current block;

if the ISP mode is applied to the current block, obtaining an ISP partitioning flag indicating a partitioning direction of the current block;

partitioning the current block into a plurality of transform blocks on the basis of the partitioning direction;

determining a horizontal transform kernel applied to a current transform block among the plurality of transform blocks,

wherein the horizontal transform kernel is applied to a horizontal direction of the current transform block;

determining a vertical transform kernel applied to the current transform block,

wherein the vertical transform kernel is applied to a vertical direction of the current transform block;

generating a residual block of the current transform block by performing inverse transform on the current transform block based on the horizontal transform kernel and the vertical transform kernel; and

reconstructing the current block on the basis of the residual block,

wherein when a width of the current transform block is less than a first threshold or greater than a second threshold, the horizontal transform kernel is determined to be a first transform kernel,

wherein when the width of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the horizontal transform kernel is determined to be a second transform kernel,

wherein when a height of the current transform block is less than the first threshold or greater than the second threshold, the vertical transform kernel is determined to be the first transform kernel,

wherein when the height of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the vertical transform kernel is determined to be the second transform kernel.

15. The video signal encoding device of claim of 14 ,

wherein the first transform kernel is a transform kernel based on a discrete cosine transform type-2 (DCT-2), and the second transform kernel is a transform kernel based on a discrete sine transform type-7 (DST-7).

16. The video signal encoding device of claim of 14 ,

wherein the first threshold is determined on the basis of a minimum transform block size of a luma component.

17. The video signal encoding device of claim of 14 ,

wherein the first threshold is defined as 4, and the second threshold is defined as 16.

18. The video signal encoding device of claim of 14 ,

wherein the horizontal transform kernel is determined regardless of the height of the current transform block, and

wherein the vertical transform kernel is determined regardless of the width of the current transform block.

19. The video signal encoding device of claim of 14 ,

wherein the horizontal transform kernel is determined regardless of an intra prediction mode of the current block,

wherein the vertical transform kernel is determined regardless of the intra prediction mode of the current block.

20. A video signal processing method, the method comprising:

obtaining an intra sub-partitions (ISP) mode flag indicating whether or not an ISP mode is applied to a current block;

if the ISP mode is applied to the current block, obtaining an ISP partitioning flag indicating a partitioning direction of the current block;

partitioning the current block into a plurality of transform blocks on the basis of the partitioning direction;

determining a horizontal transform kernel applied to a current transform block among the plurality of transform blocks,

wherein the horizontal transform kernel is applied to a horizontal direction of the current transform block;

determining a vertical transform kernel applied to the current transform block,

wherein the vertical transform kernel is applied to a vertical direction of the current transform block;

generating a residual block of the current transform block by performing inverse transform based on the horizontal transform kernel and the vertical transform kernel on the current transform block; and

reconstructing the current block on the basis of the residual block,

wherein when a width of the current transform block is less than a first threshold or greater than a second threshold, the horizontal transform kernel is determined to be a first transform kernel,

wherein when the width of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the horizontal transform kernel is determined to be a second transform kernel,

wherein when a height of the current transform block is less than the first threshold or greater than the second threshold, the vertical transform kernel is determined to be the first transform kernel,

wherein when the height of the current transform block is greater than or equal to the first threshold and less than or equal to the second threshold, the vertical transform kernel is determined to be the second transform kernel.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECORD BY REPLACING THE PREVIOUSLY RECORDED CONFIDENTIAL PURCHASE AGREEMENT PREVIOUSLY RECORDED ON REEL 73239 FRAME 166. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 26, 2026
From: HUMAX CO., LTD.
To: ADVEXT IP LLC
Reel/Frame 075743/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2026
From: ADVEXT IP LLC
To: VIDAXIO LLC
Reel/Frame 074323/0501 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2025
From: HUMAX CO., LTD.
To: ADVEXT IP LLC
Reel/Frame 073239/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2022
From: JUNG, JAEHONG; SON, JUHYUNG; KIM, DONGCHEOL; KO, GEONJUNG; KWAK, JINSAM
To: HUMAX CO., LTD.
Reel/Frame 061870/0103 →
Priority Claims (4)
KR 10-2019-0004278 · Jan 12, 2019 · national
KR 10-2019-0007044 · Jan 18, 2019 · national
KR 10-2019-0027876 · Mar 12, 2019 · national
KR 10-2019-0036421 · Mar 29, 2019 · national
Continuity (3)
Continuation 17317629 · May 11, 2021
Continuation PCTKR2020000638 · Jan 13, 2020
Related Publication 20230100855A1 · Mar 30, 2023
References Cited (46)
US 20150264353A1 · Yie et al. · 2015 [cited by applicant]
CA 2856198A1 · 2013 [cited by applicant]
CN 101252694A · 2008 [cited by applicant]
CN 106658012A · 2017 [cited by applicant]
CN 107071474A · 2017 [cited by applicant]
CN 108141593A · 2018 [cited by applicant]
CN 108712650A · 2018 [cited by applicant]
CN 108712651A · 2018 [cited by applicant]
EP 0500306A2 · 1992 [cited by applicant]
EP 1003336A1 · 2000 [cited by applicant]
KR 1020150087207A · 2015 [cited by applicant]
KR 1020170132036A · 2017 [cited by applicant]
KR 1020180040126A · 2018 [cited by applicant]
WO 2016006894A1 · 2016 [cited by applicant]
WO 2016163616A1 · 2016 [cited by applicant]
WO 2017082670A1 · 2017 [cited by applicant]
WO 2018038554A1 · 2018 [cited by applicant]
WO 2018092868A1 · 2018 [cited by applicant]
WO 2018166429A1 · 2018 [cited by applicant]
WO 2020143811A1 · 2020 [cited by applicant]
International Search Report of International application No. PCT /KR2020/000638. May 13, 2020. [cited by applicant]
Written Opinion of International application No. PCT /KR2020/000638. May 13, 2020. [cited by applicant]
English Translation of the Written Opinion of the International Search Authority for International application No. PCT/KR2020/000638 dated May 13, 2020. [cited by applicant]
Examination report under sections 12 & 13 of the Patents Act, 1970 and the Patents Rules, 2003 from Intellectual Property India for Application No/20212702390 dated Nov. 3, 2022. [cited by applicant]
“CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2)” Document: JVET-M0102-v2 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MACN, Jan. 9-18, 2019. [cited by applicant]
AdditionalTestCE3-1.1.2Vertical4xNVsAnchor.xlsm Reference:anchor Tested:test2Vertical4xn Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
TestCE3-1.1.1vsAnchor Reference:VTM-3.0 Tested:CE3-Test 1.1.1 Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
TestCE3-1.1.2VsAnchor Reference:VTM-3.0 Tested:Test CE3-1.1.2 Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
Request for the Submission of an Opinion for KR Application No. 10-2021-7012558 from KIPO. Dated Sep. 23, 2022. [cited by applicant]
S. De-Luxán-Hernández et al., CE3 Intra Sub-Partitions Coding Mode Tests 1.1.1 and 1.1.2), JVET of ITU-T and ISOIEC, JVET-M0102-ISP-DraftText_r1.docx in JVET-M0102-v7 (Jan. 17, 2019.). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/317,629 from the USPTO dated Aug. 22, 2022. [cited by applicant]
Supplemental Notice of Allowance for U.S. Appl. No. 17/317,629 from the USPTO dated Sep. 6, 2022. [cited by applicant]
Notification of First Office Action from China National Intellectual Property Administration for Application No. 202080007132.0 dated Dec. 6, 2023, including Search Report from China National Intellectual Property Admin… [cited by applicant]
CE3: Line-based intra coding mode (Tests 2.1.1 and 2.1.2) JVET-L0076-v1 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018. [cited by applicant]
Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 10th Meeting: San Diego, US, Apr. 10-20, 2018 Yongbing Lin, etal, Prediction dependent transform for intra and inter frame coding Tit… [cited by applicant]
Written Decision on Registration from Korea Intellectual Property Office(KIPO) for Application No. 10-2021-7012558, dated Jan. 16, 2024. [cited by applicant]
Han Gao et al., Non-CE6: Unification of Implicit Transform Core Selection, JVET of ITU-T and ISO/IEC, JVET-N0172 (Mar. 13, 2019.). [cited by applicant]
Examination report under sections 12 & 13 of the Patents Act, 1970 and the Patents Rules, 2003 for IN Patent Application No. 202127023905 from Intellectual Property India. Mailed Nov. 3, 2022. [cited by applicant]
Request for the Submission of an Opinion for KR Patent Application No. 10-2021-7012558 from KIPO. Dated Sep. 13, 2022. [cited by applicant]
Request for the Submission of an Opinion for KR Patent Application No. 10-2021-7012558 from KIPO. Dated Mar. 27, 2023. [cited by applicant]
Notification of the Second Office Action from China National Intellectual Property Administration for Application No. 202080007132.0 dated Apr. 30, 2024. [cited by applicant]
Hearing Notice in Reference of Application for Application No. 202127023905 from India Intellectual Property Office dated Jun. 7, 2024. [cited by applicant]
Hearing adjournment notice in reference for Application No. 202127023905 from India Intellectual Property Office dated Jun. 26, 2024. [cited by applicant]
Office Action for Application No. 1-2021-03757 from Intellectual Property Office of Vietnam, dated Jun. 24, 2024. [cited by applicant]
Notification for Patent Registration Formalities for Application/Patent No. 202080007132.0 from China National Intellectual Property Administration, dated Jul. 31, 2024. [cited by applicant]
Office Action for KR Application No. 10-2023-7043333 from Korea Intellectual Property Office, dated Aug. 9, 2024. [cited by applicant]