IP Library › Granted Patent US 12,647,592
Granted Patent B2
US 12,647,592 · App. 18/931,212 · Granted Jun 2, 2026

Encoding method and apparatus

Inventors: Yin Zhao (Hangzhou, CN); Haitao Yang (Shenzhen, CN); Jianle Chen (San Diego, CA)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/44H04N19/12H04N19/124H04N19/176H04N19/184H04N19/51H04N19/61H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,647,592
App. No.
18/931,212
Granted
Jun 2, 2026
Kind
B2
Abstract

A video processing method includes: obtaining prediction information of a CU; obtaining, when the CU comprises only one residual TU and a size of the residual TU is less than a size of the CU, a TU partitioning mode of the CU and a residual position of the residual TU, wherein the TU partitioning mode and the residual position are used to determine a horizontal transform type and a vertical transform type; obtaining transform coefficients of the residual TU based on the horizontal transform type and the vertical transform type; and generating a bitstream that is for storing or transmitting and that includes the prediction information, a first flag that indicates the TU partitioning mode, a second flag that indicates the residual position, and the transform coefficients.

Claims (44)

1 . A video encoding method, comprising:

obtaining a picture;

partitioning, based on partition information, the picture into a set of non-overlapping blocks that include a coding unit (CU);

obtaining, when the CU comprises only one residual transform unit (TU) and when a first size of the residual TU is less than a second size of the CU, a TU partitioning mode of the CU and a residual position of the residual TU;

determining, using the TU partitioning mode and the residual position, a horizontal transform type and a vertical transform type;

obtaining transform coefficients of the residual TU based on the horizontal transform type and the vertical transform type; and

generating a bitstream that comprises a first flag indicating the TU partitioning mode, a second flag indicating the residual position, the partition information, and the transform coefficients.

2 . The video encoding method of claim 1 , wherein the horizontal transform type is based on discrete sine transform (DST) type VII (DST-7) and the vertical transform type is based on the DST-7, the horizontal transform type is based on the DST-7 and the vertical transform type is based on discrete cosine transform (DCT) type VIII (DCT-8), or the horizontal transform type is based on the DCT-8 and the vertical transform type is based on the DST-7.

3 . The video encoding method of claim 2 , wherein the TU partitioning mode specifies that the CU is partitioned into two first TUs that are arranged horizontally and that comprise a left TU and a right TU, and a third size of the left TU is smaller than, greater than, or equal to a fourth size of the right TU, or wherein the TU partitioning mode specifies that the CU is partitioned into two second TUs that are arranged vertically and that comprise a top TU and a bottom TU, and a fifth size of the top TU is smaller than, greater than, or equal to a sixth size of the bottom TU.

4 . The video encoding method of claim 3 , further comprising:

partitioning the CU into the two first TUs, wherein the residual position is left or right; or

partitioning the CU into the two second TUs, wherein the residual position is a top or a bottom.

5 . The video encoding method of claim 4 , wherein the horizontal transform type is the DST-7 and the vertical transform type is the DCT-8 when the CU is partitioned into the two second TUs and the residual position is the top, the horizontal transform type is the DST-7 and the vertical transform type is the DST-7 when the CU is partitioned into the two second TUs and the residual position is the bottom, the horizontal transform type is the DCT-8 and the vertical transform type is the DST-7 when the CU is partitioned into the two first TUs and the residual position is the left, and the horizontal transform type is the DST-7 and the vertical transform type is the DST-7 when the CU is partitioned into the two first TUs and the residual position is the right.

6 . The video encoding method of claim 1 , wherein the residual TU comprises one or more residuals for one or more of a first chrominance component, a second chrominance component, or a luminance component.

7 . The video encoding method of claim 6 , wherein the one or more residuals comprise a first residual for the first chrominance component, a second residual for the second chrominance component, and a third residual for the luminance component.

8 . A video decoding method, comprising:

obtaining partition information;

partitioning, based on the partition information, a picture block into a set of non-overlapping blocks that include a coding unit (CU);

obtaining, when the CU comprises only one residual transform unit (TU) and a size of the residual TU is less than a size of the CU, a TU partitioning mode of the CU and a residual position of the residual TU;

obtaining, based on the TU partitioning mode and the residual position, a horizontal transform type and a vertical transform type;

applying, based on the horizontal transform type and the vertical transform type, an inverse transform to dequantized coefficients of the residual TU to obtain a residual block of the residual TU; and

obtaining a video block based on the residual block.

9 . The video decoding method of claim 8 , wherein the horizontal transform type is based on discrete sine transform (DST) type VII (DST-7) and the vertical transform type is based on the DST-7, the horizontal transform type is based on the DST-7 and the vertical transform type is based on discrete cosine transform (DCT) type VIII (DCT-8), or the horizontal transform type is based on the DCT-8 and the vertical transform type is based on the DST-7.

10 . The video decoding method of claim 9 , wherein the TU partitioning mode specifies that the CU is partitioned into two first TUs that are arranged horizontally and that comprise a left TU and a right TU, and a third size of the left TU is smaller than, greater than, or equal to a fourth size of the right TU, or wherein the TU partitioning mode specifies that the CU is partitioned into two second TUs that are arranged vertically and that comprise a top TU and a bottom TU, and a fifth size of the top TU is smaller than, greater than, or equal to a sixth size of the bottom TU.

11 . The video decoding method of claim 10 , further comprising:

partitioning the CU into the two first TUs, wherein the residual position is left or right; or

partitioning the CU into the two second TUs, wherein the residual position is a top or a bottom.

12 . The video decoding method of claim 11 , wherein the horizontal transform type is the DST-7 and the vertical transform type is the DCT-8 when the CU is partitioned into the two second TUs and the residual position is the top, the horizontal transform type is the DST-7 and the vertical transform type is the DST-7 when the CU is partitioned into the two second TUs and the residual position is the bottom, the horizontal transform type is the DCT-8 and the vertical transform type is the DST-7 when the CU is partitioned into the two first TUs and the residual position is the left, and the horizontal transform type is the DST-7 and the vertical transform type is the DST-7 when the CU is partitioned into the two first TUs and the residual position is the right.

13 . The video decoding method of claim 8 , wherein the residual TU comprises one or more residuals for one or more of a first chrominance component, a second chrominance component, or a luminance component.

14 . The video decoding method of claim 13 , wherein the one or more residuals comprise a first residual for the first chrominance component, a second residual for the second chrominance component, and a third residual for the luminance component.

15 . A non-transitory computer-readable storage medium storing a bitstream and one or more instructions executable by at least one processor to perform operations of decoding the bitstream, the operations comprising:

receiving the bitstream, the bitstream comprising:

partition information configured to partition a picture block into a set of non-overlapping blocks that includes a coding unit (CU);

a first flag indicating a transform unit (TU) partitioning mode that partitions the CU into at least two non-overlapping TUs that include a residual TU;

transform coefficients of the residual TU; and

a second flag indicating a residual position of the residual TU,

wherein the TU partitioning mode and the residual position determine a horizontal transform type and a vertical transform type,

wherein the horizontal transform type, the vertical transform type, and the transform coefficients obtain a residual block of the residual TU, and

wherein the residual block obtains a video block.

16 . The non-transitory computer-readable medium of claim 15 , wherein the horizontal transform type is based on discrete sine transform (DST) type VII (DST-7) and the vertical transform type is based on the DST-7, the horizontal transform type is based on the DST-7 and the vertical transform type is based on discrete cosine transform (DCT) type VIII (DCT-8), or the horizontal transform type is based on the DCT-8 and the vertical transform type is based on the DST-7.

17 . The non-transitory computer-readable medium of claim 16 , wherein the TU partitioning mode specifies that the CU is partitioned into two first TUs that are arranged horizontally and that comprise a left TU and a right TU, and a third size of the left TU is smaller than, greater than, or equal to a fourth size of the right TU, or wherein the TU partitioning mode specifies that the CU is partitioned into two second TUs that are arranged vertically and that comprise a top TU and a bottom TU, and a fifth size of the top TU is smaller than, greater than, or equal to a sixth size of the bottom TU.

18 . The non-transitory computer-readable medium of claim 17 , wherein the residual position is either left or right when the CU is partitioned into the two first TUs, and wherein the residual position is either a top or a bottom when the CU is partitioned into the two second TUs.

19 . The non-transitory computer-readable medium of claim 18 , wherein the horizontal transform type is the DST-7 and the vertical transform type is the DCT-8 when the CU is partitioned into the two second TUs and the residual position is the top, the horizontal transform type is the DST-7 and the vertical transform type is the DST-7 when the CU is partitioned into the two second TUs and the residual position is the bottom, the horizontal transform type is the DCT-8 and the vertical transform type is the DST-7 when the CU is partitioned into the two first TUs and the residual position is the left, and the horizontal transform type is the DST-7 and the vertical transform type is the DST-7 when the CU is partitioned into the two first TUs and the residual position is the right.

20 . The non-transitory computer-readable medium of claim 15 , wherein the residual TU comprises one or more residuals for one or more of a first chrominance component, a second chrominance component, or a luminance component.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2025
From: ZHAO, YIN; YANG, HAITAO; CHEN, JIANLE
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 074528/0019 →
Priority Claims (2)
WO PCT/CN2018/102524 · Aug 27, 2018 · international
WO PCT/CN2018/109254 · Oct 6, 2018 · international
Continuity (8)
Continuation 17973151 · Oct 25, 2022
Continuation 17227821 · Apr 12, 2021
Continuation 16849302 · Apr 15, 2020
Continuation PCTCN2018109361 · Oct 8, 2018
Provisional Application 62678738 · May 31, 2018
Provisional Application 62634613 · Feb 23, 2018
Provisional Application 62572987 · Oct 16, 2017
Related Publication 20250056029A1 · Feb 13, 2025
References Cited (83)
US 11006139B2 · Zhao et al. · 2021 [cited by applicant]
US 11343523B2 · Zhao et al. · 2022 [cited by applicant]
US 11523129B2 · Zhao et al. · 2022 [cited by applicant]
US 20030113026A1 · Srinivasan et al. · 2003 [cited by applicant]
US 20030156648A1 · Holcomb et al. · 2003 [cited by applicant]
US 20080232705A1 · Sohn et al. · 2008 [cited by applicant]
US 20090238271A1 · Kim et al. · 2009 [cited by applicant]
US 20110170594A1 · Budagavi et al. · 2011 [cited by applicant]
US 20120008683A1 · Karczewicz et al. · 2012 [cited by applicant]
US 20120128074A1 · Zhang et al. · 2012 [cited by applicant]
US 20130039417A1 · Wang et al. · 2013 [cited by applicant]
US 20130243087A1 · Lee et al. · 2013 [cited by applicant]
US 20130315302A1 · Lim et al. · 2013 [cited by applicant]
US 20140056347A1 · Xu et al. · 2014 [cited by applicant]
US 20140119455A1 · Kobayashi · 2014 [cited by applicant]
US 20140146891A1 · Chuang et al. · 2014 [cited by applicant]
US 20140226721A1 · Joshi et al. · 2014 [cited by applicant]
US 20140241424A1 · Oh et al. · 2014 [cited by applicant]
US 20140247866A1 · Lee et al. · 2014 [cited by applicant]
US 20140286591A1 · Cheon et al. · 2014 [cited by applicant]
US 20140307780A1 · Cohen et al. · 2014 [cited by applicant]
US 20140307788A1 · Lim et al. · 2014 [cited by applicant]
US 20150208094A1 · Lee et al. · 2015 [cited by applicant]
US 20150350682A1 · Zhang et al. · 2015 [cited by applicant]
US 20160219290A1 · Zhao et al. · 2016 [cited by applicant]
US 20170094313A1 · Zhao · 2017 [cited by examiner]
US 20170310958A1 · Huang et al. · 2017 [cited by applicant]
US 20170366824A1 · Hsu · 2017 [cited by applicant]
US 20180020218A1 · Zhao et al. · 2018 [cited by applicant]
US 20180115775A1 · Song et al. · 2018 [cited by applicant]
US 20180176582A1 · Zhao et al. · 2018 [cited by applicant]
US 20180376150A1 · Iwamura et al. · 2018 [cited by applicant]
US 20190222843A1 · Lee · 2019 [cited by applicant]
US 20190342582A1 · Su et al. · 2019 [cited by applicant]
US 20200304816A1 · Zhao et al. · 2020 [cited by applicant]
US 20200329253A1 · Zhao et al. · 2020 [cited by applicant]
CN 101668205A · 2010 [cited by applicant]
CN 102165771A · 2011 [cited by applicant]
CN 102986215A · 2013 [cited by applicant]
CN 103108181A · 2013 [cited by applicant]
CN 103152563A · 2013 [cited by applicant]
CN 103370939A · 2013 [cited by applicant]
CN 103380622A · 2013 [cited by applicant]
CN 103518374A · 2014 [cited by applicant]
CN 103581676A · 2014 [cited by applicant]
CN 103716623A · 2014 [cited by applicant]
CN 103997650A · 2014 [cited by applicant]
CN 104041048A · 2014 [cited by applicant]
CN 104067622A · 2014 [cited by applicant]
CN 104125466A · 2014 [cited by applicant]
CN 104735451A · 2015 [cited by applicant]
CN 104853217A · 2015 [cited by applicant]
CN 104935927A · 2015 [cited by applicant]
CN 105530518A · 2016 [cited by applicant]
CN 106254870A · 2016 [cited by applicant]
CN 106488242A · 2017 [cited by applicant]
CN 107005695A · 2017 [cited by applicant]
CN 107079165A · 2017 [cited by applicant]
CN 107211144A · 2017 [cited by applicant]
EP 2755388A1 · 2014 [cited by applicant]
JP 7381660B2 · 2019 [cited by applicant]
KR 20150086793A · 2015 [cited by applicant]
WO 2010116268A1 · 2010 [cited by applicant]
WO 2012150693A1 · 2012 [cited by applicant]
WO 2017131233A1 · 2017 [cited by applicant]
WO 2017171370A1 · 2017 [cited by applicant]
Zhang, C., et al., “Video coding using Variable Block-Size Spatially Varying Transforms,” ICASSP 2009, XP031459377, Apr. 19, 2009, p. 905-908. [cited by applicant]
Zhang, C., et al., “Video Coding Using Spatially Varying Transform,” PSIVT 2009, LNCS 5414, XP047468398, 2009, pp. 796-806. [cited by applicant]
An, J., et al., “Non-CE7: Boundary Dependent Transform for Inter Predicted Residue,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, No. JCTVC-G281, 7th Meeting: Geneva, C… [cited by applicant]
Zhao, Y., “CE6: Spatially Varying Transform (Test 6.1.12.1),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0139-v3, 11th Meeting: Ljubljana, SI, XP030199419, Jul. 10-18, 2018,… [cited by applicant]
Zhao, X., et al., “Enhanced Multiple Transform for Video Coding,” Data Compression Conference (DCC), IEEE, XP033027689, Mar. 30, 2016, p. 73-82. [cited by applicant]
Zhang, C., et al., “Video Coding Using Spatially Varying Transform,” IEEE Trans. Image Process., vol. 21, No. 2, Feb. 2011, pp. 127-140. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding,” ITU-T H.265, Dec. 2016, 664 pages. [cited by applicant]
Said, A., “Description of core experiment 6 (CE6): transforms and transform signaling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K1026, 11th Meeting: Ljubljana, SI, XP03020… [cited by applicant]
Akula, S., et at., “Description of SDR, HDR and 360° video coding technology proposal considering mobile application scenario by Samsung, Huawei, GoPro, and HiSilicon,” Joint Video Exploration Team (JVET) of ITU-T SG 16… [cited by applicant]
Document: JVET-D0117 , Xiang Li et al., Multi-Type-Tree, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, total 3 pages. [cited by applicant]
Document: JVET-B1001_v1 , Jianle Chen et al., Algorithm Description of Joint Exploration Test Model 2, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 2nd Meeting: San Diego, USA, … [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services,” ITU-T H.264, Apr. 2017, 812 pages. [cited by applicant]
Shen Yan-Fei et al., High Efficiency Video Coding, Chinese Journal of Computers, vol. 36, No. 11, Nov. 2013, with the English Abstract, 16 pages. [cited by applicant]
JCTVC-A119_Appendix_ Decoder_Description, Kemal Ugur et al., Appendix to Description of video coding technology proposal by Tandberg Nokia Ericsson, Joint Collaborative Team on Video Coding (JCT-VC) ofITU-T SG16 WP3 and… [cited by applicant]
Cixun Zhang et al:“Video Coding Using Variable Block-Size Spatially Varying Transforms.” Apr. 19-24, 2009. total 4 pages. [cited by applicant]
Xin Zhao et al:“Enhanced Multiple Transform for Video Coding.” Mar. 1, 2016. total 10 pages. [cited by applicant]
Jicheng An et al:“Non-CE7: Boundary-Dependent Transform for Inter-Predicted Residue.” Document: JCTVC-G281. Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 7th Meeting: Gen… [cited by applicant]