IP Library › Granted Patent US 12,219,175
Granted Patent B2
US 12,219,175 · App. 17/842,995 · Granted Feb 4, 2025

Transformation method, encoder, decoder, and storage medium

Inventors: Junyan Huo (Dongguan, CN); Xinwei Li (Dongguan, CN); Wenhan Qiao (Dongguan, CN); Yanzhuo Ma (Dongguan, CN); Shuai Wan (Dongguan, CN); Fuzheng Yang (Dongguan, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/61H04N19/176H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,219,175
App. No.
17/842,995
Granted
Feb 4, 2025
Kind
B2
Abstract

Disclosed are a transformation method, an encoder, a decoder, and a storage medium. The transformation method applied to an encoder includes: determining a prediction mode parameter of a current block; determining a Matrix-based Intra Prediction (MIP) parameter when the prediction mode parameter indicates that MIP is used for the current block to determine an intra prediction value; determining an intra prediction value of the current block according to the MIP parameter and calculating a residual value between the current block and the intra prediction value; determining a Low-Frequency Non-Separable Transform (LFNST) transform kernel used for the current block according to the MIP parameter when an LFNST is used for the current block, setting an LFNST index, and signalling the LFNST index in a video bitstream; and performing a transform processing on the residual value by using the LFNST transform kernel.

Claims (61)

1. A transform method, applied to an encoder, the method comprising:

determining a prediction mode parameter of a current block;

determining a Matrix-based Intra Prediction (MIP) parameter when the prediction mode parameter indicates that MIP is used for the current block to determine an intra prediction value;

determining an intra prediction value of the current block according to the MIP parameter and calculating a residual value between the current block and the intra prediction value;

determining a Low-Frequency Non-Separable Transform (LFNST) transform kernel used for the current block according to the MIP parameter when an LFNST is used for the current block, setting an LFNST index, and signalling the LFNST index in a video bitstream; and

performing a transform processing on the residual value by using the LFNST transform kernel;

wherein the MIP parameter comprises a MIP mode index, the MIP mode index is used for indicating a MIP mode used for the current block, and the MIP mode is used for indicating a calculation and derivation mode for determining the intra prediction value of the current block by using MIP; wherein different MIP modes have different MIP mode indices;

wherein determining the LFNST transform kernel used for the current block according to the MIP parameter when the LFNST is used for the current block comprises:

determining a value of an LFNST intra prediction mode index according to a value of the MIP mode index, and selecting one LFNST transform kernel candidate set from a plurality of LFNST transform kernel candidate sets according to the value of the LFNST intra prediction mode index; or,

selecting one LFNST transform kernel candidate set from a plurality of LFNST transform kernel candidate sets according to a value of the MIP mode index;

wherein the LFNST transform kernel candidate set contains two or more preset LFNST transform kernels.

2. The method of claim 1 , wherein determining the LFNST transform kernel used for the current block according to the MIP parameter when the LFNST is used for the current block further comprises:

selecting a transform kernel indicated by the LFNST index from the selected LFNST transform kernel candidate set and setting the transform kernel as the LFNST transform kernel used for the current block;

wherein setting the LFNST index, and signalling the LFNST index in the video bitstream comprises:

setting a value of the LFNST index to indicate that the LFNST is used for the current block and an index of the LFNST transform kernel in the LFNST transform kernel candidate set.

3. The method of claim 2 , wherein determining the value of the LFNST intra prediction mode index according to the value of the MIP mode index comprises:

determining a value of the LFNST intra prediction mode index corresponding to the value of the MIP mode index by using a first look-up table, wherein the first look-up table at least contains one or more different MIP mode indices respectively corresponding to each of two LFNST intra prediction mode indices of different values.

4. The method of claim 2 , wherein selecting one LFNST transform kernel candidate set from the plurality of LFNST transform kernel candidate sets according to the value of the MIP mode index comprises:

determining a value of an LFNST transform kernel candidate set index corresponding to the value of the MIP mode index by using a second look-up table, and selecting an LFNST transform kernel candidate set indicated by the value of the LFNST transform kernel candidate set index as the selected LFNST transform kernel candidate set;

wherein the second look-up table at least contains one or more different MIP mode indices respectively corresponding to each of two LFNST transform kernel candidate set indices of different values.

5. The method of claim 2 , wherein selecting one LFNST transform kernel candidate set from the plurality of LFNST transform kernel candidate sets according to the value of the MIP mode index comprises:

determining an LFNST transform kernel candidate set index by using a first calculation method according to the value of the MIP mode index; and

selecting an LFNST transform kernel candidate set indicated by a value of the LFNST transform kernel candidate set index as the selected LFNST transform kernel candidate set.

6. A transform method, applied to a decoder, the method comprising:

parsing a bitstream and determining a prediction mode parameter of a current block;

parsing the bitstream and determining a Matrix-based Intra Prediction (MIP) parameter when the prediction mode parameter indicates that MIP is used for the current block to determine an intra prediction value;

parsing the bitstream and determining a Low-Frequency Non-Separable Transform (LFNST) index and a transform coefficient of the current block;

determining an LFNST transform kernel used for the current block according to the MIP parameter when the LFNST index indicates that an LFNST is used for the current block; and

performing a transform processing on the transform coefficient by using the LFNST transform kernel;

wherein the MIP parameter comprises a MIP mode index, the MIP mode index is used for indicating a MIP mode used for the current block, and the MIP mode is used for indicating a calculation and derivation mode for determining the intra prediction value of the current block by using MIP; wherein different MIP modes have different MIP mode indices;

wherein determining the LFNST transform kernel used for the current block according to the MIP parameter when the LFNST index indicates that the LFNST is used for the current block comprises:

determining a value of an LFNST intra prediction mode index according to a value of the MIP mode index, and selecting one LFNST transform kernel candidate set from a plurality of LFNST transform kernel candidate sets according to the value of the LFNST intra prediction mode index; or

selecting one LFNST transform kernel candidate set from a plurality of LFNST transform kernel candidate sets according to a value of the MIP mode index;

wherein the LFNST transform kernel candidate set contains two or more preset LFNST transform kernels.

7. The method of claim 6 , wherein determining the LFNST transform kernel used for the current block according to the MIP parameter when the LFNST index indicates that the LFNST is used for the current block further comprises:

selecting a transform kernel indicated by the LFNST index from the selected LFNST transform kernel candidate set and setting the transform kernel as the LFNST transform kernel used for the current block.

8. The method of claim 7 , wherein determining the value of the LFNST intra prediction mode index according to the value of the MIP mode index comprises:

determining a value of the LFNST intra prediction mode index corresponding to the value of the MIP mode index by using a first look-up table, wherein the first look-up table at least contains one or more different MIP mode indices respectively corresponding to each of two LFNST intra prediction mode indices of different values.

9. The method of claim 7 , wherein selecting one LFNST transform kernel candidate set from the plurality of LFNST transform kernel candidate sets according to the value of the MIP mode index comprises:

determining a value of an LFNST transform kernel candidate set index corresponding to the value of the MIP mode index by using a second look-up table, and selecting an LFNST transform kernel candidate set indicated by the value of the LFNST transform kernel candidate set index as the selected LFNST transform kernel candidate set;

wherein the second look-up table at least contains one or more different MIP mode indices respectively corresponding to each of two LFNST transform kernel candidate set indices of different values.

10. The method of claim 7 , wherein selecting one LFNST transform kernel candidate set from the plurality of LFNST transform kernel candidate sets according to the value of the MIP mode index comprises:

determining an LFNST transform kernel candidate set index by using a first calculation method according to the value of the MIP mode index; and

selecting an LFNST transform kernel candidate set indicated by a value of the LFNST transform kernel candidate set index as the selected LFNST transform kernel candidate set.

11. The method of claim 10 , wherein determining the LFNST transform kernel candidate set index by using the first calculation method according to the value of the MIP mode index comprises:

setting a value of the LFNST transform kernel candidate set index to be equal to the value of the MIP mode index when the value of the MIP mode index is less than a first preset value; and

setting a value of the LFNST transform kernel candidate set index to be equal to a difference value obtained by subtracting a second preset value from the value of the MIP mode index when the value of the MIP mode index is greater than or equal to the first preset value;

wherein the first preset value and the second preset value are both integer values.

12. A decoder comprising a memory and a processor, wherein

the memory is configured to store a computer program executable by the processor; and

the processor is configured to perform following operations when executing the computer program:

parsing a bitstream and determining a prediction mode parameter of a current block;

parsing the bitstream and determining a Matrix-based Intra Prediction (MIP) parameter when the prediction mode parameter indicates that MIP is used for the current block to determine an intra prediction value;

parsing the bitstream and determining a Low-Frequency Non-Separable Transform (LFNST) index and a transform coefficient of the current block;

determining an LFNST transform kernel used for the current block according to the MIP parameter when the LFNST index indicates that an LFNST is used for the current block; and

performing a transform processing on the transform coefficient by using the LFNST transform kernel;

wherein the MIP parameter comprises a MIP mode index, the MIP mode index is used for indicating a MIP mode used for the current block, and the MIP mode is used for indicating a calculation and derivation mode for determining the intra prediction value of the current block by using MIP; wherein different MIP modes have different MIP mode indices;

wherein determining the LFNST transform kernel used for the current block according to the MIP parameter when the LFNST index indicates that the LFNST is used for the current block comprises:

determining a value of an LFNST intra prediction mode index according to a value of the MIP mode index, and selecting one LFNST transform kernel candidate set from a plurality of LFNST transform kernel candidate sets according to the value of the LFNST intra prediction mode index; or

selecting one LFNST transform kernel candidate set from a plurality of LFNST transform kernel candidate sets according to a value of the MIP mode index;

wherein the LFNST transform kernel candidate set contains two or more preset LFNST transform kernels.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2022
From: HUO, JUNYAN; LI, XINWEI; QIAO, WENHAN; MA, YANZHUO; WAN, SHUAI; YANG, FUZHENG
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 060235/0389 →
Continuity (2)
Continuation PCTCN2019130157 · Dec 30, 2019
Related Publication 20220329862A1 · Oct 13, 2022
References Cited (23)
US 20190306526A1 · Cho et al. · 2019 [cited by applicant]
CN 106254883A · 2016 [cited by applicant]
CN 107925763A · 2018 [cited by applicant]
CN 109076243A · 2018 [cited by applicant]
Chosun University and Humax “Non-CE6: Simplification of LFNST LUT” JVET-P0313; JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; 16th Meeting: Geneva, CH; Oct. 1-11, 2019. 3 pages. [cited by applicant]
Extended European Search Report for European Application No. 19958505.0 issued Jan. 3, 2023. 8 pages. [cited by applicant]
InterDigital “CE6 Related: MIP Adaptation on Top of CE6-1.1d” JVET-P0349; JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; 16th Meeting; Geneva, CH; Oct. 1-11, 2019. 4 pages. [cited by applicant]
International Search Report Mailed Sep. 27, 2020 In Application No. PCT/CN2019/130157. [cited by applicant]
Koo et al., CE6: Reduced Secondary Transform (Rst) (CE6-3.1), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, Document: JVET-N0193, 19 pages. [cited by applicant]
Pfaff et al., CE3: Affine linear weighted intra prediction (CE3-4.1, CE3-4.2), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, Document: JVE… [cited by applicant]
Pfaff et al., Non-CE3: Harmonization of 8-Bit MIP with Unified-MPM and LFNST, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SWE, Jul. 3-12, 2019, Document: … [cited by applicant]
Naser et al., Non-CE6 Interaction between Implicit MTS and LFNST and MIP, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document: JVET-… [cited by applicant]
Bross et al., Versatile Video Coding (Draft 7), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC ITC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, Document: JVET-P2001-vE, 494 pages. [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Apr. 2013) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 317 page… [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Oct. 2014) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 540 page… [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Apr. 2015) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 634 page… [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Dec. 2016) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 664 page… [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Feb. 2018) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 692 page… [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Jun. 2019) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 696 page… [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Nov. 2019) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 712 page… [cited by applicant]
ITU-T H.265 Telecommunication Standardization Sector of ITU (Aug. 2021) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 716 page… [cited by applicant]
ITU-T H.266 Telecommunication Standardization Sector of ITU (Aug. 2020) Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Versatile video coding, 516 pages. [cited by applicant]
Written Opinion Mailed Sep. 27, 2020 in Application No. PCT/CN2019/130157, 7 pages. [cited by applicant]