IP Library › Granted Patent US 12,519,964
Granted Patent B2
US 12,519,964 · App. 18/602,976 · Granted Jan 6, 2026

Coding method and apparatus

Inventors: Yin Zhao (Hangzhou, CN); Haitao Yang (Shenzhen, CN); Jianle Chen (San Diego, CA)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/44H04N19/12H04N19/124H04N19/176H04N19/184H04N19/51H04N19/61H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,519,964
App. No.
18/602,976
Granted
Jan 6, 2026
Kind
B2
Abstract

A video decoding method, including: parsing a received bitstream to obtain prediction information of a coding unit (CU); obtaining a target transform mode of a residual transform unit (TU); parsing the received bitstream to obtain transform coefficients of the residual TU; applying an inverse quantization to the transform coefficients of the residual TU to obtain dequantized coefficients; applying, based on the target transform mode, an inverse transform to the dequantized coefficients to obtain a residual block of the residual TU; obtaining a prediction block of the CU based on the prediction information; obtaining a video block based on the residual block and the prediction block; and outputting a video sequence including a video frame that includes the video block.

Claims (71)

1 . A method, comprising:

receiving a bitstream, wherein the bitstream includes prediction information of a coding unit (CU), first information for indicating whether the CU has only one residual transform unit (TU) and for indicating whether a first size of the residual TU is less than a second size of the CU, a TU partitioning mode, and a position of the residual TU, and wherein the TU partitioning mode indicates how to partition the CU to obtain the residual TU;

obtaining the prediction information;

determining whether the CU has only the one residual TU and whether the first size is less than the second size;

obtaining, in response to determining that the CU has only the one residual TU and that the first size is less than the second size, the TU partitioning mode and the position;

obtaining, based on the TU partitioning mode and the position, a transform type of the residual TU;

obtaining coded block flags of Cb, Cr, and Y components of the residual TU, wherein at least one of the coded block flags is equal to 1;

obtaining transform coefficients of the residual TU;

obtaining, based on the transform coefficients, the transform type, and the coded block flags, a residual block of the CU;

obtaining, based on the prediction information, a prediction block of the CU; and

obtaining, based on the residual block and the prediction block, a video block.

2 . The method of claim 1 , wherein the TU partitioning mode indicates that the CU is partitioned into a left TU and a right TU, wherein the residual TU is either the left TU or the right TU, and wherein a third size of the left TU is equal to a fourth size of the right TU.

3 . The method of claim 2 , wherein obtaining the transform type comprises:

obtaining, when the position is left, a horizontal transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8) and a vertical transform of the residual TU based on discrete sine transform (DST) type VII (DST-7); or

obtaining, when the position is right, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

4 . The method of claim 1 , wherein the TU partitioning mode indicates that the CU is partitioned into a top TU and a bottom TU, wherein the residual TU is either the top TU or the bottom TU, and wherein a third size of the top TU is equal to a fourth size of the bottom TU.

5 . The method of claim 4 , wherein obtaining the transform type comprises:

obtaining, when the position is top, a horizontal transform of the residual TU based on discrete sine transform (DST) type VII (DST-7) and a vertical transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8); or

obtaining, when the position is bottom, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

6 . A video decoder, comprising:

one or more memories configured to store instructions; and

one or more processors coupled to the one or more memories and configured to execute the instructions to:

receive a bitstream, wherein the bitstream includes prediction information of a coding unit (CU), first information for indicating whether the CU has only one residual transform unit (TU) and for indicating whether a first size of the residual TU is less than a second size of the CU, a TU partitioning mode, and a position of the residual TU, and wherein the TU partitioning mode indicates how to partition the CU to obtain the residual TU;

obtain the prediction information;

determine whether the CU has only the one residual TU and whether the first size is less than the second size;

obtain, in response to determining that the CU has only the one residual TU and that the first size is less than the second size, the TU partitioning mode and the position;

obtain, based on the TU partitioning mode and the position, a transform type of the residual TU;

obtain transform coefficients of the residual TU;

obtain coded block flags of Cb, Cr, and Y components of the residual TU, wherein at least one of the coded block flags is equal to 1;

obtain, based on the transform coefficients, the transform type, and the coded block flags, a residual block of the CU;

obtain, based on the prediction information, a prediction block of the CU; and

obtain, based on the residual block and the prediction block, a video block.

7 . The video decoder of claim 6 , wherein the TU partitioning mode indicates that the CU is partitioned into a left TU and a right TU, wherein the residual TU is either the left TU or the right TU, and wherein a third size of the left TU is equal to a fourth size of the right TU.

8 . The video decoder of claim 7 , wherein the one or more processors are further configured to execute the instructions to:

obtain, when the position is left, a horizontal transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8) and a vertical transform of the residual TU based on discrete sine transform (DST) type VII (DST-7); or

obtain, when the position is right, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

9 . The video decoder of claim 6 , wherein the TU partitioning mode indicates that the CU is partitioned into a top TU and a bottom TU, wherein the residual TU is either the top TU or the bottom TU, and wherein a third size of the top TU is equal to a fourth size of the bottom TU.

10 . The video decoder of claim 9 , wherein the one or more processors are further configured to execute the instructions to:

obtain, when the position is top, a horizontal transform of the residual TU based on discrete sine transform (DST) type VII (DST-7) and a vertical transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8); or

obtain, when the position is bottom, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

11 . A method, comprising:

obtaining a block of a coding unit (CU);

partitioning according to a transform unit (TU) partitioning mode, the CU to obtain a residual TU, wherein a first size of the residual TU is less than a second size of the CU;

determining whether the CU has only one residual TU;

obtaining, in response to determining that the CU has only the one residual TU and based on the TU partitioning mode and a position of the residual TU, a transform type of the residual TU;

performing, according to the transform type, transformation on the residual TU to obtain transform coefficients of the residual TU; and

generating a bitstream that includes the transform coefficients, the TU partitioning mode, the position, first information for indicating whether the CU has only the one residual TU and for indicating whether the first size is less than the second size, and coded block flags of Cb, Cr, and Y components of the residual TU,

wherein at least one of the coded block flags is equal to 1.

12 . The method of claim 11 , wherein the TU partitioning mode indicates that the CU is partitioned into a left TU and a right TU, wherein the residual TU is either the left TU or the right TU, and wherein a third size of the left TU is equal to a fourth size of the right TU.

13 . The method of claim 12 , wherein obtaining the transform type comprises:

obtaining, when the position is left, a horizontal transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8) and a vertical transform of the residual TU based on discrete sine transform (DST) type VII (DST-7); or

obtaining, when the position is right, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

14 . The method of claim 11 , wherein the TU partitioning mode indicates that the CU is partitioned into a top TU and a bottom TU, wherein the residual TU is either the top TU or the bottom TU, and wherein a third size of the top TU is equal to a fourth size of the bottom TU.

15 . The method of claim 14 , wherein obtaining the transform type comprises:

obtaining, when the position is top, a horizontal transform of the residual TU based on discrete sine transform (DST) type VII (DST-7) and a vertical transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8); or

obtaining, when the position is bottom, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

16 . A non-transitory computer-readable medium storing a bitstream and one or more instructions executable by at least one processor to perform operations of encoding the bitstream, the operations comprising:

obtaining a block of a coding unit (CU);

partitioning, according to a transform unit (TU) partitioning mode, the CU to obtain a residual TU, wherein a first size of the residual TU is less than a second size of the CU;

determining whether the CU has only one residual TU;

obtaining, in response to determining that the CU has only the one residual TU and based on the TU partitioning mode and a position of the residual TU, a transform type of the residual TU;

performing, according to the transform type, transformation on the residual TU to obtain transform coefficients of the residual TU; and

generating the bitstream that includes the transform coefficients, the TU partitioning mode, the position, first information for indicating whether the CU has only the one residual TU and for indicating whether the first size is less than the second size, and coded block flags of Cb, Cr, and Y components of the residual TU, wherein at least one is equal to 1.

17 . The non-transitory computer-readable medium of claim 16 , wherein the TU partitioning mode indicates that the CU is partitioned into a left TU and a right TU, wherein the residual TU is either the left TU or the right TU, and wherein a third size of the left TU is equal to a fourth size of the right TU.

18 . The non-transitory computer-readable medium of claim 17 , wherein obtaining the transform type of the residual TU comprises:

obtaining, when the position is left, a horizontal transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8) and a vertical transform based on discrete sine transform (DST) type VII (DST-7); or

obtaining, when the position is right, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

19 . The non-transitory computer-readable medium of claim 16 , wherein the TU partitioning mode indicates that the CU is partitioned into a top TU and a bottom TU, wherein the residual TU is either the top TU or the bottom TU, and wherein a third size of the top TU is equal to a fourth size of the bottom TU.

20 . The non-transitory computer-readable medium of claim 19 , wherein obtaining the transform type of the residual TU comprises:

obtaining, when the position is top, a horizontal transform of the residual TU based on discrete sine transform (DST) type VII (DST-7) and a vertical transform of the residual TU based on discrete cosine transform (DCT) type VIII (DCT-8); or

obtaining, when the position is bottom, the horizontal transform based on the DST-7 and the vertical transform based on the DST-7.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2024
From: ZHAO, YIN; YANG, HAITAO; CHEN, JIANLE
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 066753/0758 →
Priority Claims (1)
WO PCT/CN2018/102524 · Aug 27, 2018 · international
Continuity (7)
Continuation 17732205 · Apr 28, 2022
Continuation 16849354 · Apr 15, 2020
Continuation PCTCN2018109256 · Oct 7, 2018
Provisional Application 62678738 · May 31, 2018
Provisional Application 62634613 · Feb 23, 2018
Provisional Application 62572987 · Oct 16, 2017
Related Publication 20240223792A1 · Jul 4, 2024
References Cited (81)
US 11006139B2 · Zhao et al. · 2021 [cited by applicant]
US 11343523B2 · Zhao et al. · 2022 [cited by applicant]
US 11523129B2 · Zhao et al. · 2022 [cited by applicant]
US 20030113026A1 · Srinivasan et al. · 2003 [cited by applicant]
US 20030156648A1 · Holcomb et al. · 2003 [cited by applicant]
US 20080232705A1 · Sohn et al. · 2008 [cited by applicant]
US 20090238271A1 · Kim et al. · 2009 [cited by applicant]
US 20110170594A1 · Budagavi et al. · 2011 [cited by applicant]
US 20120008683A1 · Karczewicz et al. · 2012 [cited by applicant]
US 20120128074A1 · Zhang et al. · 2012 [cited by applicant]
US 20130243087A1 · Lee et al. · 2013 [cited by applicant]
US 20130315302A1 · Lim et al. · 2013 [cited by applicant]
US 20140056347A1 · Xu et al. · 2014 [cited by applicant]
US 20140119455A1 · Kobayashi · 2014 [cited by applicant]
US 20140146891A1 · Chuang et al. · 2014 [cited by applicant]
US 20140226721A1 · Joshi et al. · 2014 [cited by applicant]
US 20140241424A1 · Oh et al. · 2014 [cited by applicant]
US 20140247866A1 · Lee et al. · 2014 [cited by applicant]
US 20140286591A1 · Cheon et al. · 2014 [cited by applicant]
US 20140307780A1 · Cohen et al. · 2014 [cited by applicant]
US 20140307788A1 · Lim et al. · 2014 [cited by applicant]
US 20150208094A1 · Lee et al. · 2015 [cited by applicant]
US 20150350682A1 · Zhang et al. · 2015 [cited by applicant]
US 20160219290A1 · Zhao · 2016 [cited by examiner]
US 20170094313A1 · Zhao et al. · 2017 [cited by applicant]
US 20170310958A1 · Huang et al. · 2017 [cited by applicant]
US 20170366824A1 · Hsu · 2017 [cited by applicant]
US 20180020218A1 · Zhao et al. · 2018 [cited by applicant]
US 20180115775A1 · Song et al. · 2018 [cited by applicant]
US 20180176582A1 · Zhao et al. · 2018 [cited by applicant]
US 20180376150A1 · Iwamura et al. · 2018 [cited by applicant]
US 20190222843A1 · Lee · 2019 [cited by applicant]
US 20190342582A1 · Su et al. · 2019 [cited by applicant]
US 20200304816A1 · Zhao et al. · 2020 [cited by applicant]
US 20200329253A1 · Zhao et al. · 2020 [cited by applicant]
CN 101668205A · 2010 [cited by applicant]
CN 102165771A · 2011 [cited by applicant]
CN 102986215A · 2013 [cited by applicant]
CN 103108181A · 2013 [cited by applicant]
CN 103152563A · 2013 [cited by applicant]
CN 103370939A · 2013 [cited by applicant]
CN 103380622A · 2013 [cited by applicant]
CN 103518374A · 2014 [cited by applicant]
CN 103581676A · 2014 [cited by applicant]
CN 103716623A · 2014 [cited by applicant]
CN 103997650A · 2014 [cited by applicant]
CN 104041048A · 2014 [cited by applicant]
CN 104067622A · 2014 [cited by applicant]
CN 104125466A · 2014 [cited by applicant]
CN 104735451A · 2015 [cited by applicant]
CN 104853217A · 2015 [cited by applicant]
CN 104935927A · 2015 [cited by applicant]
CN 105530518A · 2016 [cited by applicant]
CN 106254870A · 2016 [cited by applicant]
CN 106488242A · 2017 [cited by applicant]
CN 107005695A · 2017 [cited by applicant]
CN 107079165A · 2017 [cited by applicant]
CN 107211144A · 2017 [cited by applicant]
EP 2755388A1 · 2014 [cited by applicant]
JP 7381660B2 · 2019 [cited by applicant]
KR 20150086793A · 2015 [cited by applicant]
WO 2010116268A1 · 2010 [cited by applicant]
WO 2017131233A1 · 2017 [cited by applicant]
WO 2017171370A1 · 2017 [cited by applicant]
Zhang, C., et al., “Video coding using Variable Block-Size Spatially Varying Transforms,” ICASSP 2009, XP031459377, Apr. 19, 2009, p. 905-908. [cited by applicant]
Zhang, C., et al., “Video Coding Using Spatially Varying Transform,” PSIVT 2009, LNCS 5414, XP047468398, 2009, pp. 796-806. [cited by applicant]
An, J., et al., “Non-CE7: Boundary Dependent Transform for Inter Predicted Residue,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, No. JCTVC-G281, 7th Meeting: Geneva, C… [cited by applicant]
Zhao, Y., “CE6: Spatially Varying Transform (Test 6.1.12.1),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0139-v3, 11th Meeting: Ljubljana, SI, XP030199419, Jul. 10-18, 2018,… [cited by applicant]
Zhao, X., et al., “Enhanced Multiple Transform for Video Coding,” Data Compression Conference (DCC), IEEE, XP033027689, Mar. 30, 2016, p. 73-82. [cited by applicant]
Zhang, C., et al., “Video Coding Using Spatially Varying Transform,” IEEE Trans. Image Process., vol. 21, No. 2, Feb. 2011, pp. 127-140. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding,” ITU-T H.265, Dec. 2016, 664 pages. [cited by applicant]
Said, A., “Description of core experiment 6 (CE6): transforms and transform signaling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K1026, 11th Meeting: Ljubljana, SI, XP03020… [cited by applicant]
Akula, S., et at., “Description of SDR, HDR and 360° video coding technology proposal considering mobile application scenario by Samsung, Huawei, GoPro, and HiSilicon,” Joint Video Exploration Team (JVET) of ITU-T SG 16… [cited by applicant]
Document: JVET-D0117 , Xiang Li et al, Multi-Type-Tree, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, total 3 pages. [cited by applicant]
Document: JVET-B1001_v1 , Jianle Chen et al, Algorithm Description of Joint Exploration Test Model 2, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 2nd Meeting: San Diego, USA, F… [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services,” ITU-T H.264, Apr. 2017, 812 pages. [cited by applicant]
Shen Yan-Fei et al, High Efficiency Video Coding, Chinese Journal of Computers, vol. 36, No. 11, Nov. 2013, with the English Abstract, 16 pages. [cited by applicant]
JCTVC-A119_Appendix_ Decoder_Description, Kemal Ugur et al, Appendix to Description of video coding technology proposal by Tandberg Nokia Ericsson, Joint Collaborative Team on Video Coding (JCT-VC) ofITU-T SG16 WP3 and … [cited by applicant]
Xin Zhao et al., “Enhanced Multiple Transform for Video Coding,” Mar. 1, 2016, 10 pages. [cited by applicant]
Document: JCTVC-G281, Jicheng An et al., “Non-CE7: Boundary-Dependent Transform for Inter-Predicted Residue,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 7th Meeting: G… [cited by applicant]
Cixun Zhang et al.:“VIDEO Coding Using Variable Block-Size Spatially Varying Transforms.” Apr. 19-24, 2009. total 4 pages. [cited by applicant]