IP Library Granted Patent US 12,401,809
Granted Patent B2
US 12,401,809 · App. 18/731,011 · Granted Aug 26, 2025

Video signal processing method and apparatus using scaling process

Inventors: Jaehong Jung (Seoul, KR); Juhyung Son (Uiwang-Si, KR); Dongcheol Kim (Suwon-Si, KR); Geonjung Ko (Seoul, KR); Jinsam Kwak (Uiwang-si, KR)
Assignee: HUMAX CO., LTD.
H04N19/30H04N19/159H04N19/176H04N19/186H04N19/46H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,401,809
App. No.
18/731,011
Granted
Aug 26, 2025
Kind
B2
Abstract

The present disclosure relates to a processing method of a video signal, the processing method comprising the steps of: scaling a transform coefficient for a current block on the basis of an intermediate scaling factor array; when the flag indicates that a low frequency non-separable transform is applied to the current block, obtaining a residual for the current block by applying an inverse transform of a non-separable transform and an inverse transform of a primary transform on the scaled transform coefficient, wherein the primary transform is a transform applied to a residual signal of a spatial domain before the low frequency non-separable transform; and reconstructing the current block on the basis of the residual and a predictor of the current block.

Claims (79)

1. A video signal decoding apparatus comprising a processor,

wherein the processor is configured to:

scale a transform coefficient for a current block based on an intermediate scaling factor array,

obtain a residual for the current block based on the scaled transform coefficient,

reconstruct the current block based on the residual,

wherein when a low frequency non-separable transform (LFNST) is applied to the current block, the residual is obtained based on the LFNST,

wherein whether the LFNST is applied to the current block is indicated by a first flag,

wherein the first flag indicating whether the LFNST is applied to the current block is determined based on a LFNST index,

wherein the LFNST index indicates whether the LFNST is applied to the current block and a kernel to be used for the LFNST,

wherein when the LFNST is applied to the current block, a prediction mode of the current block is an intra prediction mode,

when the first flag indicates that the LFNST is applied to the current block and a second flag indicating whether a scaling matrix is used in a block to which the LFNST is applied indicates that the scaling matrix is not used in the block to which the LFNST is applied, all factors included in the intermediate scaling factor array are set to one predetermined value.

2. The video signal decoding apparatus of claim 1 ,

wherein when a third flag indicating whether transform is applied to the current block indicates that the transform is not applied to the current block, the all factors included in the intermediate scaling factor array are set to the one predetermined value.

3. The video signal decoding apparatus of claim 1 ,

wherein the intermediate scaling factor array is derived based on values obtained from a bitstream when failing to set the all factors included in the intermediate scaling factor array to the one predetermined value.

4. The video signal decoding apparatus of claim 1 ,

wherein the second flag is obtained from at least one of a sequence parameter set (SPS), a picture parameter set (PPS), a picture header, and a slice header of a bitstream.

5. The video signal decoding apparatus of claim 1 ,

wherein the first flag indicating whether the LFNST is applied to the current block is determined further based on a type of a current coding tree.

6. The video signal decoding apparatus of claim 5 ,

when the type of the current coding tree is a SINGLE_TREE or DUAL_TREE_LUMA:

wherein when the LFNST index is 0, the first flag indicates that the LFNST is not applied to the current block,

wherein when the LFNST index is not 0, the first flag indicates that the LFNST is applied to the current block,

wherein a color component of the current block is a luma component,

wherein the SINGLE_TREE indicates that a single tree is used to partition the current coding tree including the current block,

wherein the DUAL_TREE_LUMA indicates that a dual tree is used to partition the current coding tree including the current block and the luma component is currently processed.

7. The video signal decoding apparatus of claim 5 ,

wherein when the LFNST index is 0 or the type of the current coding tree is not a DUAL_TREE_CHROMA, the first flag indicates that the LFNST is not applied to the current block,

wherein when the LFNST index is not 0 and the type of the current coding tree is the DUAL_TREE_CHROMA, the first flag indicates that the LFNST is applied to the current block,

wherein a color component of the current block is a chroma component,

wherein the DUAL_TREE_CHROMA indicates that a dual tree is used to partition the current coding tree and the chroma component is currently processed.

8. The video signal decoding apparatus of claim 1 , wherein the one predetermined value is 2{circumflex over ( )}N, and N is a natural number.

9. The video signal decoding apparatus of claim 1 , wherein the one predetermined value is 16.

10. A video signal encoding apparatus comprising a processor,

wherein the processor is configured to:

obtain a bitstream to be decoded by a decoder using a decoding method, the decoding method comprising:

scaling a transform coefficient for a current block based on an intermediate scaling factor array;

obtaining a residual for the current block based on the scaled transform coefficient; and

reconstructing the current block based on the residual,

wherein when a low frequency non-separable transform (LFNST) is applied to the current block, the residual is obtained based on the LFNST,

wherein whether the LFNST is applied to the current block is indicated by a first flag,

wherein the first flag indicating whether the LFNST is applied to the current block is determined based on a LFNST index,

wherein the LFNST index indicates whether the LFNST is applied to the current block and a kernel to be used for the LFNST,

wherein when the LFNST is applied to the current block, a prediction mode of the current block is an intra prediction mode,

when the first flag indicates that the LFNST is applied to the current block and a second flag indicating whether a scaling matrix is used in a block to which the LFNST is applied indicates that the scaling matrix is not used in the block to which the LFNST is applied, all factors included in the intermediate scaling factor array are set to one predetermined value.

11. The video signal encoding apparatus of claim 10 ,

wherein when a third flag indicating whether transform is applied to the current block indicates that the transform is not applied to the current block, the all factors included in the intermediate scaling factor array are set to the one predetermined value.

12. The video signal encoding apparatus of claim 10 ,

wherein the intermediate scaling factor array is derived based on values obtained from the bitstream when failing to set the all factors included in the intermediate scaling factor array to the one predetermined value.

13. The video signal encoding apparatus of claim 10 ,

wherein the second flag is obtained from at least one of a sequence parameter set (SPS), a picture parameter set (PPS), a picture header, and a slice header of the bitstream.

14. The video signal encoding apparatus of claim 10 ,

wherein the first flag indicating whether the LFNST is applied to the current block is determined further based on a type of a current coding tree.

15. The video signal encoding apparatus of claim 14 ,

when the type of the current coding tree is a SINGLE_TREE or DUAL_TREE_LUMA:

wherein when the LFNST index is 0, the first flag indicates that the LFNST is not applied to the current block,

wherein when the LFNST index is not 0, the first flag indicates that the LFNST is applied to the current block,

wherein a color component of the current block is a luma component,

wherein the SINGLE_TREE indicates that a single tree is used to partition the current coding tree including the current block,

wherein the DUAL_TREE_LUMA indicates that a dual tree is used to partition the current coding tree including the current block and the luma component is currently processed.

16. The video signal encoding apparatus of claim 14 ,

wherein when the LFNST index is 0 or the type of the current coding tree is not a DUAL_TREE_CHROMA, the first flag indicates that the LFNST is not applied to the current block,

wherein when the LFNST index is not 0 and the type of the current coding tree is the DUAL_TREE_CHROMA, the first flag indicates that the LFNST is applied to the current block,

wherein a color component of the current block is a chroma component,

wherein the DUAL_TREE_CHROMA indicates that a dual tree is used to partition the current coding tree and the chroma component is currently processed.

17. The video signal encoding apparatus of claim 10 , wherein the one predetermined value is 2{circumflex over ( )}N, and N is a natural number.

18. The video signal decoding apparatus of claim 10 , wherein the one predetermined value is 16.

19. A method of obtaining a bitstream, the method comprising:

scaling a transform coefficient for a current block based on an intermediate scaling factor array;

obtaining a residual for the current block based on the scaled transform coefficient; and

obtaining the bitstream including information for the transform coefficient,

wherein when a low frequency non-separable transform (LFNST) is applied to the current block, the residual is obtained based on the LFNST,

wherein whether the LFNST is applied to the current block is indicated by a first flag,

wherein the first flag indicating whether the LFNST is applied to the current block is determined based on a LFNST index,

wherein the LFNST index indicates whether the LFNST is applied to the current block and a kernel to be used for the LFNST,

wherein when the LFNST is applied to the current block, a prediction mode of the current block is an intra prediction mode,

when the first flag indicates that the LFNST is applied to the current block and a second flag indicating whether a scaling matrix is used in a block to which the LFNST is applied indicates that the scaling matrix is not used in the block to which the LFNST is applied, all factors included in the intermediate scaling factor array are set to one predetermined value.

20. The method of claim 19 ,

wherein the intermediate scaling factor array is derived based on values obtained from the bitstream when failing to set the all factors included in the intermediate scaling factor array to the one predetermined value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2025
From: HUMAX CO., LTD.
To: CB CLINE. INC
Reel/Frame 073330/0032 →
Priority Claims (2)
KR 10-2019-0115656 · Sep 19, 2019 · national
KR 10-2020-0003951 · Jan 11, 2020 · national
Continuity (3)
Continuation 17655354 · Mar 17, 2022
Continuation PCTKR2020012706 · Sep 21, 2020
Related Publication 20240323412A1 · Sep 26, 2024
References Cited (49)
US 5970162A · Kawashima · 1999 [cited by examiner]
US 6184781B1 · Ramakesavan · 2001 [cited by examiner]
US 7103545B2 · Furuta · 2006 [cited by examiner]
US 7466337B2 · Sawada · 2008 [cited by examiner]
US 7640107B2 · Shimizu · 2009 [cited by examiner]
US 9332229B2 · Ishimoto · 2016 [cited by examiner]
US 9519832B2 · Lee · 2016 [cited by examiner]
US 12034945B2 · Jung et al. · 2024 [cited by applicant]
US 20030122930A1 · Schofield · 2003 [cited by examiner]
US 20030222793A1 · Tanaka · 2003 [cited by examiner]
US 20090238271A1 · Kim et al. · 2009 [cited by applicant]
US 20100118146A1 · Schofield · 2010 [cited by examiner]
US 20100245577A1 · Yamamoto · 2010 [cited by examiner]
US 20110285848A1 · Han · 2011 [cited by examiner]
US 20120069153A1 · Mochizuki · 2012 [cited by examiner]
US 20150189289A1 · Kim et al. · 2015 [cited by applicant]
US 20160219290A1 · Zhao et al. · 2016 [cited by applicant]
US 20160269730A1 · Jeon et al. · 2016 [cited by applicant]
US 20180288439A1 · Hsu et al. · 2018 [cited by applicant]
US 20190007682A1 · Kanoh et al. · 2019 [cited by applicant]
US 20190387241A1 · Kim et al. · 2019 [cited by applicant]
US 20200097617A1 · Zhilinsky · 2020 [cited by examiner]
US 20210076070A1 · Jung · 2021 [cited by examiner]
US 20210185358A1 · Jung · 2021 [cited by examiner]
US 20220191492A1 · Xu · 2022 [cited by examiner]
US 20220210451A1 · Jung · 2022 [cited by examiner]
CN 104521232A · 2015 [cited by applicant]
CN 107835414A · 2018 [cited by applicant]
KR 1020180063186A · 2018 [cited by applicant]
WO 2014071439A1 · 2014 [cited by applicant]
WO 2018166429A1 · 2018 [cited by applicant]
WO 2018174402A1 · 2018 [cited by applicant]
Office Action for IN202227016756 from Intellectual Property India dated Nov. 21, 2022. [cited by applicant]
Office Action for CN 202080065511.5 by China National Intellectual Property Administration dated Dec. 6, 2023. [cited by applicant]
Bross, Benjamin et al. (2019). “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. JVET-O2001-vD. [cited by applicant]
International Search Report & Written Opinion for PCT/KR2020/012706, the International Searching Authority, Dec. 30, 2020. [cited by applicant]
Benjamin Bross et al. Versatile Video Coding (Draft 6), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2001-vE, 15th Meeting: Gothenburg, SE, pp. 1-439, Jul. 31, 2019 [Retrieved… [cited by applicant]
Seethal Paluri et al. AHG17: APS support for default and user defined scaling matrices, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O0299_r1, 15th Meeting: Gothenburg, SE, pp.… [cited by applicant]
Tomonori Hashimoto et al. Non-CE7: Harmonization of scaling matrix and LFNST, JVET-O0383, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019. [cited by applicant]
Office Action for U.S. Appl. No. 17/655,354 by United States Patent and Trademark Office dated Nov. 15, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/655,354 by United States Patent and Trademark Office dated Feb. 29, 2024. [cited by applicant]
Hashimoto, Tomonori et al. “Non-CE7: Harmonization of scaling matrix and LFNST”, Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC 1/SC29/WG11. JVET-00383_WD, XP030219416. Jul. 2019. [cited by applicant]
Ma, Tsung-Chuan et al. “Lossless coding for VVC”, Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC 1/SC29/WG11. JVET-01061, XP030208122. Jul. 2019. [cited by applicant]
Hearing Notice for IN 202227016756 by Intellectual Property India dated Aug. 16, 2024. [cited by applicant]
Notice of Allowance for CN 202080065511.5 by China National Intellectual Property Administration dated May 7, 2024. [cited by applicant]
Office Action for MX/a/2022/003187 by Mexican Institute of Industrial Property dated Feb. 28, 2025. [cited by applicant]
Office Action for BR 112022005281-2 by National Institute of Industrial Property (Brazil) dated Mar. 25, 2025. [cited by applicant]
Chubach, Olena et al., “CE7-related: Support of quantization matrices for VVC,”Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Mar. 2019. doc: JVET-N0847-v1. [cited by applicant]
Koo, Moonmo et al., “CE6: Reduced Secondary Transform (RST) (CE6-3.1),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Mar. 2019. doc: JVET-N0193. [cited by applicant]