IP Library Granted Patent US 12,356,010
Granted Patent B2
US 12,356,010 · App. 18/620,899 · Granted Jul 8, 2025

Video signal processing method and device using secondary transform

Inventors: Jaehong Jung (Seoul, KR); Dongcheol Kim (Suwon-Si, KR); Juhyung Son (Uiwang-Si, KR); Geonjung Ko (Seoul, KR); Jinsam Kwak (Uiwang-si, KR)
Assignee: HUMAX CO., LTD.
H04N19/619H04N19/119H04N19/159H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,010
App. No.
18/620,899
Granted
Jul 8, 2025
Kind
B2
Abstract

A video signal processor is configured to obtain a secondary transform kernel for a current block based on an intra prediction mode of the current block to which a secondary transform is applied, to obtain a secondary inverse transformed block by performing a secondary inverse transform on a top-left specific region of the current block using the secondary transform kernel, wherein the secondary inverse transform is an inverse transform of the secondary transform, and the secondary transform is a low frequency non-separable transform, to obtain a residual block of the current block by performing a primary inverse transform on the secondary inverse transformed block, wherein one or more coefficients of the top-left specific region of the current block are derived in a preset scan order and the preset scan order is a 4×4 up-right diagonal scan order regardless of a size of the current block.

Claims (61)

1. A video signal decoding device comprising a processor,

wherein the processor is configured to:

obtain a secondary transform matrix in a secondary transform matrix set based on an intra prediction mode of a current block,

obtain a secondary inverse transformed block by performing a secondary inverse transform on a specific region of the current block using the secondary transform matrix,

wherein the secondary inverse transform is an inverse transform of a secondary transform, and the secondary transform is a low frequency non-separable transform,

obtain a residual block of the current block by performing a primary inverse transform on the secondary inverse transformed block,

wherein one or more coefficients of the specific region of the current block are derived in a preset scan order,

wherein the preset scan order is a 4×4 up-right diagonal scan order regardless of a size of the current block.

2. The decoding device of claim 1 ,

wherein the processor is configured to:

determine whether the current block is a block to which the secondary transform is applied.

3. The decoding device of claim 2 ,

wherein whether the current block is the block to which the secondary transform is applied is determined by a parsing result of a syntax element,

wherein the syntax element is parsed when a width and a height of a coding block related to the current block are less than or equal to a maximum transform size.

4. The decoding device of claim 3 ,

wherein the secondary transform matrix is determined based on a value of the syntax element.

5. The decoding device of claim 3 ,

wherein when the width or the height of the coding block is greater than the maximum transform size, the coding block is split into a plurality of transform blocks.

6. The decoding device of claim 3 ,

wherein when at least one of the width and the height of the coding block is greater than the maximum transform size, the syntax element is not parsed.

7. The decoding device of claim 6 ,

wherein when the syntax element is not parsed, the current block is a block to which the secondary transform is not applied.

8. A video signal encoding device comprising a processor,

wherein the processor is configured to:

obtain a bitstream to be decoded by a decoder using a decoding method,

the decoding method comprising:

obtaining a secondary transform matrix in a secondary transform matrix set based on an intra prediction mode of a current block,

obtaining a secondary inverse transformed block by performing a secondary inverse transform on a specific region of the current block using the secondary transform matrix,

wherein the secondary inverse transform is an inverse transform of a secondary transform, and the secondary transform is a low frequency non-separable transform,

obtaining a residual block of the current block by performing a primary inverse transform on the secondary inverse transformed block,

wherein one or more coefficients of the specific region of the current block are derived in a preset scan order,

wherein the preset scan order is a 4×4 up-right diagonal scan order regardless of a size of the current block.

9. The encoding device of claim 8 ,

the decoding method further comprising:

determining whether the current block is a block to which the secondary transform is applied.

10. The encoding device of claim 9 ,

wherein whether the current block is the block to which the secondary transform is applied is determined by a parsing result of a syntax element,

wherein the syntax element is parsed when a width and a height of a coding block related to the current block are less than or equal to a maximum transform size.

11. The encoding device of claim 10 ,

wherein the secondary transform matrix is determined based on a value of the syntax element.

12. The encoding device of claim 10 ,

wherein when the width or the height of the coding block is greater than the maximum transform size, the coding block is split into a plurality of transform blocks.

13. The encoding device of claim 10 ,

wherein when at least one of the width and the height of the coding block is greater than the maximum transform size, the syntax element is not parsed.

14. The encoding device of claim 13 ,

wherein when the syntax element is not parsed, the current block is a block to which the secondary transform is not applied.

15. A method of obtaining a bitstream, the method comprising:

obtaining a secondary transform matrix in a secondary transform matrix set based on an intra prediction mode of a current block,

obtaining a secondary inverse transformed block by performing a secondary inverse transform on a specific region of the current block using the secondary transform matrix,

wherein the secondary inverse transform is an inverse transform of a secondary transform, and the secondary transform is a low frequency non-separable transform,

obtaining the bitstream including information related to obtain a residual block of the current block by performing a primary inverse transform on the secondary inverse transformed block,

wherein one or more coefficients of the specific region of the current block are derived in a preset scan order,

wherein the preset scan order is a 4×4 up-right diagonal scan order regardless of a size of the current block.

16. The method of claim 15 , further comprising:

determining whether the current block is a block to which the secondary transform is applied.

17. The method of claim 16 , further comprising:

obtaining a syntax element indicating whether the current block is the block to which the secondary transform is applied, when a width and a height of a coding block related to the current block are less than or equal to a maximum transform size.

18. The method of claim 17 ,

wherein the syntax element is used to determine the secondary transform matrix.

19. The method of claim 17 ,

wherein when the width or the height of the coding block is greater than the maximum transform size, the coding block is split into a plurality of transform blocks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2025
From: HUMAX CO., LTD.
To: HFI INNOVATION INC.
Reel/Frame 073240/0716 →
Priority Claims (3)
KR 10-2019-0014736 · Feb 8, 2019 · national
KR 10-2019-0035438 · Mar 27, 2019 · national
KR 10-2019-0051052 · Apr 30, 2019 · national
Continuity (4)
Continuation 18164460 · Feb 3, 2023
Continuation 17348227 · Jun 15, 2021
Continuation PCTKR2020001853 · Feb 10, 2020
Related Publication 20240244263A1 · Jul 18, 2024
References Cited (107)
US 11979554B2 · Kim et al. · 2024 [cited by applicant]
US 20050185937A1 · Comer · 2005 [cited by examiner]
US 20130101037A1 · Chono et al. · 2013 [cited by applicant]
US 20130136180A1 · Yang · 2013 [cited by applicant]
US 20170019686A1 · Chiu et al. · 2017 [cited by applicant]
US 20180176587A1 · Panusopone et al. · 2018 [cited by applicant]
US 20180249179A1 · Han et al. · 2018 [cited by applicant]
US 20180302631A1 · Chiang et al. · 2018 [cited by applicant]
US 20180332284A1 · Liu et al. · 2018 [cited by applicant]
US 20190313102A1 · Cho · 2019 [cited by examiner]
US 20210360240A1 · Lee · 2021 [cited by applicant]
US 20220132109A1 · Choi et al. · 2022 [cited by applicant]
US 20220191546A1 · Koo · 2022 [cited by examiner]
CN 108712650A · 2018 [cited by applicant]
JP 2022504552A · 2022 [cited by applicant]
KR 1020100095992A · 2010 [cited by applicant]
KR 1020170117112A · 2017 [cited by applicant]
KR 20180040126A · 2018 [cited by applicant]
KR 1020180061046A · 2018 [cited by applicant]
KR 1020180063186A · 2018 [cited by applicant]
KR 20180063201A · 2018 [cited by applicant]
KR 20180122362A · 2018 [cited by applicant]
KR 1020190010245A · 2019 [cited by applicant]
TW 201841506A · 2018 [cited by applicant]
TW 201906406A · 2019 [cited by applicant]
WO 2016129980A1 · 2016 [cited by applicant]
WO 2017192995A1 · 2017 [cited by applicant]
WO 2018016823A1 · 2018 [cited by applicant]
WO 2018038554A1 · 2018 [cited by applicant]
WO 2019235797A1 · 2019 [cited by applicant]
WO 2020076125A1 · 2020 [cited by applicant]
WO 2020159316A1 · 2020 [cited by applicant]
WO 2020260313A1 · 2020 [cited by applicant]
Li, Ling et al., Non-CE3: block size restriction on PDPC, Joint Vide o Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 1113th Meeting: Marrakech, MA, Jan. 9-18, 2019, [JVET-M0814-v5], JVET-M0814 (vers… [cited by applicant]
Chen, Jianle et al., Algorithm Description of Joint Exploration Test Model 7 (JEM 7), Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting: Torino, IT, Jul. 13-21, 2017 , [JV… [cited by applicant]
Non-Final Rejection of U.S. Appl. No. 17/348,227 from the USPTO dated Jun. 27, 2022. [cited by applicant]
Notice of Allowance of U.S. Appl. No. 17/348,227 from the USPTO dated Nov. 2, 2022. [cited by applicant]
Corrected Notice of Allowability of U.S. Appl. No. 17/348,227 from the USPTO dated Feb. 1, 2023. [cited by applicant]
Office Action from United States Patent and Trademark Office in Aug. 31, 2023; U.S. Appl. No. 17/401,923; Inventor: Dongcheol Kim; Title: Video Signal Processing Method and Device Using Secondary Transform. [cited by applicant]
Notification of First Office Action for Application No. 202080016690.3 from China National Intellectual Property Administration dated Dec. 6, 2023 including Search Report of China National Intellectual Property. [cited by applicant]
Hearing Notice in Reference of Application No. 202127037310 from Patent Office , Intellectual Property India, dated Dec. 19, 2023. [cited by applicant]
Notice of Allowance of U.S. Appl. No. 17/401,923 from the USPTO on Jan. 8, 2024. [cited by applicant]
Non-Final Rejection of U.S. Appl. No. 18/164,460 from USPTO dated Sep. 14, 2023. [cited by applicant]
Notice of Allowance of U.S. Appl. No. 18/164,460 from USPTO dated Dec. 28, 2023. [cited by applicant]
Corrected Notice of Allowance of U.S. Appl. No. 18/164,460 from USPTO dated Mar. 27, 2024. [cited by applicant]
First OA from Korean Intellectual Property Office for Application No. 10-2021-7017610 dated Aug. 6, 2024. [cited by applicant]
First OA Notice of reasons for refusal from Japan Intellectual Property Office for Application No. 2023-093523 dated Aug. 5, 2024. [cited by applicant]
Notification for Patent Registration Formalities for Appl: 202080016690.3 from China National Intellectual Property Administration dated May 8, 2024. [cited by applicant]
Priority documents(U.S. Appl. No. 62/834,487) of PCT International Application PCT/CN2020/084895. Dated Apr. 23, 2020. [cited by applicant]
International Search Report of PCT/KR2020/002920. Dated Jun. 16, 2020. [cited by applicant]
Written Opinion of the International Search Authority for PCT/KR2020/002920. Dated Jun. 16, 2020. [cited by applicant]
“Examination report under sections 12 & 13 of the Patents Act, 1970 and the Patents Rules, 2003” from Intellectual Property India for Application No. 202127037310. Dated Mar. 25, 2022. [cited by applicant]
“CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2)”. Document: JVET-M0102-v54 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. [cited by applicant]
“Versatile Video Coding (Draft 3)” Document: JVET-L1001-v9 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018. [cited by applicant]
JVET-M0102-CE3-1.1.1.xlsm Reference:VTM-3.0 Tested:CE3-Test 1.1.1 Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
JVET-M0102-CE3-1.1.1+nonDCT2SizeRestr.xlsm Reference:VTM-3.0 Tested:Test CE3-1.1.1 with a non-DCT-II transform size restriction Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
JVET-M0102-CE3-1.1.1+nonDCT2SizeRestr+ReversedModesDisabled.xlsm Reference:VTM-3.0 Tested:Additional Test CE3-1.1.1 with non-DCT-II restriction and reversed modes disabled Note: BD-rate is computed using piece-wise cubi… [cited by applicant]
JVET-M0102-CE3-1.1.2.xlsm Reference:VTM-3.0 Tested:Test CE3-1.1.2 Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
JVET-M0102-CE3-1.1.2+Vertical4xN.xlsm Reference:anchor Tested:test2Vertical4xn Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
Spec_text_CE6-5_1. [cited by applicant]
Reduced Secondary Transform (RST) _PPTAlgorithm Description(JVET-M0292) Moonmo Koo, Mehdi Salehifar, Jaehyun Kim, and Seung Hwan Kim. [cited by applicant]
“CE6: Reduced Secondary Transform (RST) (test 6.5.1)” Document: JVET-M0292_r5 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. [cited by applicant]
“CE6: Reduced Secondary Transform (RST) (test 6.5.1)” Document: JVET-M0292_r4 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. [cited by applicant]
“CE6: Reduced Secondary Transform (RST) (test 6.5.1)” Document: JVET-M0292_r3 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. [cited by applicant]
“CE 6-5.1: Reduced Secondary Transform (RST) (test 6.5.1)” Document: JVET-M0292_r2 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. [cited by applicant]
“CE 6-5.1: Reduced Secondary Transform (RST) (test 6.5.1)” Document: JVET-M0292_r1 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. [cited by applicant]
CE6_5_1_Test1_CTC.XLSM Reference:VTM-3.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_5_1_Test1_interMTSOn.XLSM Reference:VTM-3.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_5_1_Test2_CTC.XLSM Reference:VTM-3.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_5_1_Test2_interMTSOn.XLSM Reference:VTM-3.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_5_1_Test3_CTC.XLSM Reference:VTM-3.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_5_1_Test3_interMTSOn.XLSM Reference:VTM-3.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_5_1_Test4_CTC.XLSM Reference:VTM-3.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
“CE6: Reduced Secondary Transform (RST) (CE6-3.1)” Document: JVET-N0193_r1 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019. [cited by applicant]
“CE6: Reduced Secondary Transform (RST) (CE6-3.1)” Document: JVET-N0193_r2 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019. [cited by applicant]
“CE6: Reduced Secondary Transform (RST) (CE6-3.1)” Document: JVET-N0193_r3 Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019. [cited by applicant]
Reduced Secondary Transform (RST) _PPTAlgorithm Description(JVET-N0193) Moonmo Koo, Mehdi Salehifar, Jaehyun Kim, and Seung Hwan Kim. [cited by applicant]
Spec_text_CE6-3_1. [cited by applicant]
Spec_text_CE6-3_1d. [cited by applicant]
CE6_3_1a_CTC.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1a_interMTSOn.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1a_lowQP.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1b_CTC.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1b_interMTSOn.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1b_lowQP.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1c_CTC.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1c_interMTSOn.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1c_lowQP.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1d_CTC.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1d_interMTSOn.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1d_lowQP.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1e_CTC.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1e_interMTSOn.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
CE6_3_1e_lowQP.XLSM Reference:VTM-4.0 Tested:Test Note: BD-rate is computed using piece-wise cubic interpolation. [cited by applicant]
International Search Report of International application No. PCT/KR2020/001853. May 20, 2020. [cited by applicant]
Written Opinion of International application No. PCT/KR2020/001853. May 20, 2020. [cited by applicant]
Notice of Reasons for Refusal for Japanese Patent Application No. 2021-550241 from JPO. Dated Oct. 11, 2022. [cited by applicant]
De-Luxan-Hernandez, Santiago et al., CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2), Joint Video Experts Team (JVET) of ITU-TSG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA, Jan. 9-18… [cited by applicant]
Office Action from of U.S. Appl. No. 18/630,933 from the USPTO on Dec. 19, 2024. [cited by applicant]
Notice of Submission of Opinions for Application No. 10-2021-7025729 from Korean Intellectual Property Office (KR) dated Jan. 31, 2025. [cited by applicant]
Veleri George et al., CE3 Intra Sub-Partitions Coding Mode(Tests 1.1.1 and 1.1.2), Joint Video exploration Team (JVET), JVET-M0102-v5, Jan. 16, 2019, pp. 1-9. [cited by applicant]
Ling Li et al., Non-CE3: block size restriction on PDPC, Joint Video exploration Team(JVET), JVET-M0814-v5, Jan. 15, 2019. [cited by applicant]
Jianle Chen, et al. Algorithm Description of Joint Exploration Test Model 3, Joint Video exploration Team(JVET), JVET-C1001_v3, Jul. 6, 2016, pp. 1-34. [cited by applicant]
Office Action from of U.S. Appl. No. 18/620,899 from the USPTO on Dec. 19, 2024. [cited by applicant]
De-Luxan-Hernandez, Santiago et al., CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2) , Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marr , JVET-M0102 (ver… [cited by applicant]
Notice of Allowance issued by Japanese Patent Office, in counterpart Patent Application JP 2023093523, on Feb. 25, 2025. [cited by applicant]
Office Action/Rejection issued by Korean Patent Office, in counterpart Patent Application KR 10-2021-7017610, on Apr. 29, 2025. [cited by applicant]