IP Library › Granted Patent US 12,200,250
Granted Patent B2
US 12,200,250 · App. 17/514,911 · Granted Jan 14, 2025

Method and apparatus for video coding

Inventors: Xin Zhao (Santa Clara, CA); Xiang Li (Saratoga, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/593H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,250
App. No.
17/514,911
Granted
Jan 14, 2025
Kind
B2
Abstract

Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. In a method, prediction information for a current block is encoded. The prediction information indicates a secondary transform index, based on which a secondary transform core is determined. A first primary transform coefficient block is generated based on a primary transform core of the current block. A size of the first primary transform coefficient block is less than a size of the secondary transform core. A second primary transform coefficient block is generated based on the first primary transform coefficient block. A size of the second primary transform coefficient block equals the size of the secondary transform core. A secondary transform coefficient block is determined based on the second primary transform coefficient block and the secondary transform core. The current block is encoded based on the secondary transform coefficient block.

Claims (41)

1. A method for video encoding in an encoder, comprising:

generating a first primary transform coefficient block based on a primary transform core of a current block in a video sequence, a size of the first primary transform coefficient block being W×H;

generating a second primary transform coefficient block based on the first primary transform coefficient block, a size of the second primary transform coefficient block being M×N, and one of H or W being less than both M and N;

determining a secondary transform coefficient block based on the second primary transform coefficient block and a secondary transform core having a size of M×N, a size of the secondary transform coefficient block being W×H;

encoding prediction information for the current block, the prediction information indicating the secondary transform core; and

encoding the current block based on the secondary transform coefficient block.

2. The method of claim 1 , wherein the generating the second primary transform coefficient block comprises:

generating the second primary transform coefficient block with a value at each coordinate position being 0; and

determining a value at a coordinate position of a part of the second primary transform coefficient block based on a value at a same coordinate position of the first primary transform coefficient block, a size of the part of the second primary transform coefficient block being W×H.

3. The method of claim 1 , wherein the generating the second primary transform coefficient block comprises:

determining whether the second primary transform coefficient block is transposed based on a type of one-dimensional cross component linear model; and

transposing the second primary transform coefficient block based on the second primary transform coefficient block being determined to be transposed.

4. The method of claim 1 , wherein syntax elements of the secondary transform coefficient block that are in the prediction information include a syntax element that indicates a secondary transform index of the secondary transform core.

5. The method of claim 4 , wherein the syntax element indicating the secondary transform index is signaled in a transform block level and is determined based on a color component of the current block.

6. The method of claim 4 , wherein the secondary transform index is signaled after a last non-zero transform coefficient of the secondary transform coefficient block and before one or more of the syntax elements related to coefficient coding of the secondary transform coefficient block.

7. The method of claim 4 , wherein whether one of the syntax elements is signaled is dependent on the secondary transform index and a transform coefficient associated with the one of the syntax elements.

8. The method of claim 1 , wherein a syntax element indicating one or more primary transform cores for the current block is signaled after a last non-zero transform coefficient of the secondary transform coefficient block and before one or more syntax elements related to coefficient coding of the secondary transform coefficient block.

9. The method of claim 4 , further comprising:

determining a context used for entropy coding of the secondary transform index based on a shape of the secondary transform core.

10. The method of claim 4 , further comprising:

determining a context used for entropy coding of the secondary transform index based on a mode number of an intra prediction mode of the current block.

11. An apparatus for video decoding, comprising:

processing circuitry configured to:

acquire prediction information for a current block in a current picture that is part of a coded video bitstream, the prediction information indicating that a secondary transform is used for coding the current block;

apply a secondary transform core having a size of M×N to a secondary transform coefficient block to generate a W×H primary transform coefficient block, the secondary transform coefficient block being generated by de-quantizing transform coefficients in the prediction information, and the secondary transform coefficient block having a size of W×H, one of H or W being less than both M and N; and

reconstruct the current block based on the primary transform coefficient block and based on a primary transform core.

12. The apparatus of claim 11 , wherein the processing circuitry is further configured to:

apply a sub-section of size W×H of the secondary transform core to the secondary transform coefficient block.

13. The apparatus of claim 11 , wherein the processing circuitry is further configured to:

determine whether the primary transform coefficient block is transposed based on a type of one-dimensional cross component linear model; and

transpose the primary transform coefficient block based on the primary transform coefficient block being determined to be transposed.

14. The apparatus of claim 11 , wherein the prediction information includes a syntax element that indicates a secondary transform index of the secondary transform core.

15. The apparatus of claim 14 , wherein the syntax element indicating the secondary transform index is signaled in a transform block level and is determined based on a color component of the current block.

16. The apparatus of claim 11 , wherein a syntax element indicating one or more primary transform cores for the current block is signaled after a last non-zero transform coefficient of the secondary transform coefficient block and before one or more syntax elements related to coefficient coding of the secondary transform coefficient block.

17. The apparatus of claim 14 , wherein the processing circuitry is further configured to:

determine a context used for entropy coding of the secondary transform index based on a shape of the secondary transform core.

18. A method of processing visual media data, the method comprising:

performing a conversion between a visual media file and a bitstream of visual media data according to a format rule, wherein

the bitstream includes prediction information of a current block, the prediction information indicating that a secondary transform is used for coding the current block;

the format rule specifies that a secondary transform core having a size of M×N is applied to a secondary transform coefficient block to generate a W×H primary transform coefficient block, the secondary transform coefficient block being generated by de-quantizing transform coefficients in the prediction information, and the secondary transform coefficient block having a size of W×H, one of H or W being less than both M and N; and

the format rule specifies that the current block is reconstructed from the bitstream based on the primary transform coefficient block and based on a primary transform core.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2024
From: ZHAO, XIN; LI, XIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 068952/0574 →
Continuity (6)
Continuation 17497511 · Oct 8, 2021
Continuation 16889738 · Jun 1, 2020
Provisional Application 62897226 · Sep 6, 2019
Provisional Application 62877727 · Jul 23, 2019
Provisional Application 62857125 · Jun 4, 2019
Related Publication 20220053214A1 · Feb 17, 2022
References Cited (41)
US 9088770B2 · Zhang et al. · 2015 [cited by applicant]
US 10491922B2 · Zhao et al. · 2019 [cited by applicant]
US 11095893B2 · Hsieh · 2021 [cited by examiner]
US 11425421B1 · Koo · 2022 [cited by examiner]
US 20140050266A1 · Zhang · 2014 [cited by examiner]
US 20170280162A1 · Zhao et al. · 2017 [cited by applicant]
US 20170324643A1 · Seregin · 2017 [cited by examiner]
US 20170359595A1 · Zhang et al. · 2017 [cited by applicant]
US 20180103252A1 · Hsieh et al. · 2018 [cited by applicant]
US 20180302631A1 · Chiang et al. · 2018 [cited by applicant]
US 20190149822A1 · Kim et al. · 2019 [cited by applicant]
US 20200366937A1 · Egilmez · 2020 [cited by examiner]
US 20210014534A1 · Koo et al. · 2021 [cited by applicant]
US 20210084301A1 · Siekmann · 2021 [cited by examiner]
US 20220103824A1 · Koo · 2022 [cited by examiner]
US 20220210426A1 · Koo · 2022 [cited by examiner]
US 20220329809A1 · Huo · 2022 [cited by examiner]
EP 3457691A1 · 2019 [cited by examiner]
EP 3764649A1 · 2021 [cited by examiner]
WO WO2019194504A1 · 2019 [cited by examiner]
WO WO2021194221A1 · 2021 [cited by examiner]
Chen et al. Algorithm description for Versatile Video Coding and Test Model 5 (VTM 5), Joint Video Experts Team (JVET) of IYU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019 (Year: … [cited by examiner]
Zhao et al., “CE6-related: Unified LFNST using block size independent kernel,” JVET-O0539-v2 [Jul. 6, 2019], Joint Video Experts Team (JVET) 15th Meeting: Gothenburg, Sweden, Jul. 3-12, 2019 [retrieved Jul. 6, 2019]. Re… [cited by applicant]
Zhang et al., “Non-CE6: On LFNST transform set selection for a CCLM coded block,” JVET-O0219-v1 [Jun. 24, 2019], Joint Video Experts Team (JVET) 15th Meeting: Gothenburg, Sweden, Jul. 3-12, 2019 [retrieved Jun. 24, 2019… [cited by applicant]
Partial Supplementary European Search Report in EP20818014, mailed Jan. 19, 2022, 13 pages. [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 5 (VTM-5),” JVET-N1002-v1 [May 21, 2019], Joint Video Experts Team (JVET), 14th Meeting: Geneva, Switzerland, Mar. 19-27, 2019 [retrieved on … [cited by applicant]
Chiang et al., “CE6-related: Latency reduction for LFNST signalling,” JVET-O0293-v5 [Jul. 9, 2019], Joint Video Experts Team (JVET) 15th Meeting: Gothenburg, Sweden, Jul. 3-12, 2019 [retrieved Jul. 9, 2019]. Retrieved f… [cited by applicant]
Extended European Search Report in EP20818014, mailed Apr. 26, 2022, 16 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5),” JVET-N1001-v9, 14th Meeting: Geneva. CH, Mar. 19-27, 2019 (406 pages). [cited by applicant]
Chiang et al., “CE6-related: Simplifications for LFNST.” JVET-O0292-v1, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (6 pages). [cited by applicant]
Chiang et al., “CE6-related: Simplifications for LFNST.” JVET-O0292-v2, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (8 pages). [cited by applicant]
Chiang et al., “CE6-related: Simplifications for LFNST.” JVET-O0292-v3, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (7 pages). [cited by applicant]
Lainema et al., “CE6-related: LFNST with one mode,” JVET-O0350, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (4 pages). [cited by applicant]
Appendix A, JVET-O0292 Results Table 3 (22 pages). [cited by applicant]
Appendix B, JVET-O0292 Results Table 4 (24 pages). [cited by applicant]
Appendix C, JVET-O0292 Results Table 5 (24 pages). [cited by applicant]
Chiang et al., “JVET-O0292: CE6-related: Simplifications for LFNST,” (7 pages). [cited by applicant]
Nokia Technologies, “CE6-related: LFNST with one mode JVET-O0350,” (4 pages). [cited by applicant]
Appendix D, JVET-O0350 and O0349-v2 Results (8 pages). [cited by applicant]
Appendix E, JVET-O0350-v2 Results (8 pages). [cited by applicant]
International Search Report and Written Opinion issued Aug. 18, 2020 in International Application No. PCT/US2020/035953, (10 pages). [cited by applicant]