IP Library › Granted Patent US 12,262,022
Granted Patent B2
US 12,262,022 · App. 18/532,038 · Granted Mar 25, 2025

Method for colour component prediction, encoder, decoder and storage medium

Inventors: Junyan Huo (Dongguan, CN); Yanzhuo Ma (Dongguan, CN); Wei Zhang (Dongguan, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/132G06F5/01G06F17/16H04N19/159H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,022
App. No.
18/532,038
Granted
Mar 25, 2025
Kind
B2
Abstract

A method for colour component prediction, an encoder, a decoder and a storage medium are provided. The method includes that: prediction parameters of a current block are determined, the prediction parameters including a prediction mode parameter and a size parameter of the current block; when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block are determined; and the intra prediction value of the current block is determined according to the MIP weight matrix, the shift factor and the MIP input sample matrix.

Claims (56)

1. A method for colour component prediction, applicable for an encoder and comprising:

determining prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determining an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block; and

determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix,

wherein the MIP weight matrix of the current block is at least determined according to a block size index value of the current block;

when both a width and a height of the current block are equal to 4, setting the block size index value of the current block equal to 0;

when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4, setting the block size index value of the current block equal to 1; or

when both the width and height of the current block do not meet the above conditions, setting the block size index value of the current block equal to 2,

wherein determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix comprises:

performing matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block.

2. The method of claim 1 , wherein determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix further comprises:

performing filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising prediction values of at least part of sample positions in the current block.

3. The method of claim 1 , wherein the shift factor is equal to a fixed constant value.

4. A method for colour component prediction, applicable for a decoder and comprising:

parsing a bitstream to acquire prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determining an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block; and

determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix,

wherein the MIP weight matrix of the current block is determined at least according to a block size index value of the current block;

when both a width and a height of the current block are equal to 4, setting the block size index value of the current block equal to 0;

when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4, setting the block size index value of the current block equal to 1; or

when both the width and height of the current block do not meet the above conditions, setting the block size index value of the current block equal to 2,

wherein determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix comprises:

performing matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block.

5. The method of claim 4 , wherein determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix further comprises:

performing filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising predicted values of at least part of sample positions in the current block.

6. The method of claim 4 , wherein the shift factor is equal to a fixed constant value.

7. An encoder, comprising a memory and a processor, wherein

the memory is configured to store computer programs capable of running in the processor; and

the processor is configured to run the computer programs to:

determine prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determine an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block; and

determine the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix,

wherein the MIP weight matrix of the current block is at least determined according to a block size index value of the current block;

set the block size index value of the current block equal to 0 when both a width and a height of the current block are equal to 4;

set the block size index value of the current block equal to 1 when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4; or

set the block size index value of the current block equal to 2 when both the width and height of the current block do not meet the above conditions,

wherein the processor is further configured to run the computer programs to:

perform matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block.

8. The encoder of claim 7 , wherein the processor is further configured to run the computer programs to:

perform filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising prediction values of at least part of sample positions in the current block.

9. The encoder of claim 7 , wherein the shift factor is equal to a fixed constant value.

10. A decoder, comprising a memory and a processor, wherein

the memory is configured to store computer programs capable of running in the processor; and

the processor is configured to run the computer programs to:

parse a bitstream to acquire prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determine an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block; and

determine the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix,

wherein the MIP weight matrix of the current block is determined at least according to a block size index value of the current block;

set the block size index value of the current block equal to 0 when both a width and a height of the current block are equal to 4;

set the block size index value of the current block equal to 1 when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4; or

set the block size index value of the current block equal to 2 when both the width and height of the current block do not meet the above conditions,

wherein the processor is further configured to run the computer programs to:

perform matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block.

11. The decoder of claim 10 , wherein the processor is further configured to run the computer programs to:

perform filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising predicted values of at least part of sample positions in the current block.

12. The decoder of claim 10 , wherein the shift factor is equal to a fixed constant value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2023
From: HUO, JUNYAN; MA, YANZHUO; ZHANG, WEI
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 065796/0873 →
Continuity (7)
Continuation 17942366 · Sep 12, 2022
Continuation 17197327 · Mar 10, 2021
Continuation PCTCN2020090688 · May 15, 2020
Provisional Application 62873170 · Jul 11, 2019
Provisional Application 62872830 · Jul 11, 2019
Provisional Application 62872488 · Jul 10, 2019
Related Publication 20240114142A1 · Apr 4, 2024
References Cited (107)
US 6728313B1 · Tu · 2004 [cited by applicant]
US 9258573B2 · Drugeon · 2016 [cited by applicant]
US 10349061B2 · King · 2019 [cited by applicant]
US 10674162B2 · King · 2020 [cited by applicant]
US 10694179B2 · Hermansson · 2020 [cited by applicant]
US 10819977B2 · Zhao · 2020 [cited by examiner]
US 10911765B2 · Zhao · 2021 [cited by examiner]
US 10965941B2 · Zhao · 2021 [cited by examiner]
US 11146798B2 · Wan · 2021 [cited by applicant]
US 11451791B2 · Kim · 2022 [cited by examiner]
US 11477465B2 · Wan · 2022 [cited by applicant]
US 11695930B2 · Choi · 2023 [cited by examiner]
US 11770542B2 · Wan · 2023 [cited by applicant]
US 20090204259A1 · Danko · 2009 [cited by applicant]
US 20110135212A1 · Alshina · 2011 [cited by applicant]
US 20110145549A1 · Suk · 2011 [cited by applicant]
US 20110200266A1 · Fuchie · 2011 [cited by examiner]
US 20120140821A1 · Drugeon · 2012 [cited by applicant]
US 20130101033A1 · Joshi · 2013 [cited by applicant]
US 20130128961A1 · Kim et al. · 2013 [cited by applicant]
US 20130128972A1 · Yamaguchi · 2013 [cited by applicant]
US 20140086318A1 · Kerofsky et al. · 2014 [cited by applicant]
US 20140198848A1 · Yie · 2014 [cited by applicant]
US 20140362926A1 · Rosewarne et al. · 2014 [cited by applicant]
US 20150326881A1 · Ikai · 2015 [cited by examiner]
US 20160134869A1 · Ikai · 2016 [cited by examiner]
US 20170019678A1 · Kim et al. · 2017 [cited by applicant]
US 20180020223A1 · King · 2018 [cited by applicant]
US 20180176601A1 · Jeong et al. · 2018 [cited by applicant]
US 20190037213A1 · Hermansson · 2019 [cited by examiner]
US 20190037232A1 · Ehmann · 2019 [cited by applicant]
US 20190166370A1 · Xiu · 2019 [cited by examiner]
US 20190246138A1 · Terterov et al. · 2019 [cited by applicant]
US 20190281307A1 · King · 2019 [cited by applicant]
US 20190281308A1 · King · 2019 [cited by applicant]
US 20200077090A1 · Wennersten · 2020 [cited by examiner]
US 20200128243A1 · Wang · 2020 [cited by examiner]
US 20200344468A1 · Lin et al. · 2020 [cited by applicant]
US 20200359050A1 · Van der Auwera et al. · 2020 [cited by applicant]
US 20200396455A1 · Liu et al. · 2020 [cited by applicant]
US 20210297668A1 · Racape · 2021 [cited by examiner]
US 20220103813A1 · Pfaff · 2022 [cited by applicant]
US 20220264085A1 · Galpin · 2022 [cited by applicant]
CN 1741612A · 2006 [cited by applicant]
CN 100405848C · 2008 [cited by applicant]
CN 102595112A · 2012 [cited by applicant]
CN 102595112B · 2014 [cited by applicant]
CN 105516728A · 2016 [cited by applicant]
CN 107633538A · 2018 [cited by applicant]
CN 109076237A · 2018 [cited by applicant]
CN 105516728B · 2019 [cited by applicant]
CN 111050183A · 2020 [cited by applicant]
EP 3863287A1 · 2021 [cited by applicant]
JP 2015231091A · 2015 [cited by applicant]
RU 2609094C2 · 2017 [cited by applicant]
WO 2020256599A1 · 2020 [cited by applicant]
International Search Report in the international application No. PCT/CN2020/090688, mailed on Aug. 12, 2020. [cited by applicant]
Bross B et al: “Versatile Video Coding (Draft 5)”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 ), No. JVET-N1001 Jul. 2, 2019 (Jul.… [cited by applicant]
“Test Model 5 of Versatile Video Coding (VTM 5)”, 126. MPEG Meeting; Mar. 25, 2019-Mar. 29, 2019; Geneva; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. n18371 Jul. 7, 2019 (Jul. 7, 2019), XP030222341, Ret… [cited by applicant]
J-Y Huo et al: “Non-CE3: Fixed downshifting for 8-bit MIP” 15.JVET Meeting; Jul. 3, 2019-Jul. 12, 2019 Gothenburg; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ), No. JVET-01127 Jul. 7, 20… [cited by applicant]
Kondo ( Sony ) K et al:“CE3-2:On rounding shift of MIP”, 16 . JVET Meeting;Oct. 1, 2019-Oct. 11, 2019; Geneva; (The Joint Video Exploration Team of ISO/ IEC JTC1/ SC29/WG11 and ITU-T SG . 16), No. JVET-P0056; m49976 Sep… [cited by applicant]
Supplementary European Search Report in the European application No. 20836842.3, mailed on Sep. 1, 2021. [cited by applicant]
First Office Action of the Indian application No. 202117011503, issued on Feb. 22, 2022. [cited by applicant]
First Office Action of the European application No. 20836842.3, issued on Mar. 14, 2022. [cited by applicant]
Written Opinion of the International Search Authority in the international application No. PCT/CN2020/090688, mailed on Aug. 12, 2020. [cited by applicant]
First Office Action of the Canadian application No. 3113740, issued on May 20, 2022. [cited by applicant]
Alexey Filippov et al. “Recent Advances in Intra Prediction for the Emerging H .266/VVC Video Coding Standard” 2019, https://sci-hub.se/10.1109/SIBIRCON48586.2019.8958416. [cited by applicant]
First Office Action of the Chinese application No. 202110469722.1, issued on Sep. 19, 2022. [cited by applicant]
Bross B et al: “Versatile Video Coding (Draft 7)”, 16. JVET Meeting; Oct. 1, 2019-Oct. 11, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/ WG11 and ITU-T SG.16 ), No. JVET-P2001; m51515 Oct. 12, 20… [cited by applicant]
Second Office Action of the European application No. 20836842.3, issued on Oct. 5, 2022. [cited by applicant]
Second Office Action of the Chinese application No. 202110469722.1, issued on Nov. 14, 2022. [cited by applicant]
Third Office Action of the European application No. 20836842.3, issued on Apr. 12, 2023. 6 pages. [cited by applicant]
Second Office Action of the Canadian application No. 3113740, issued on Jul. 5, 2023, 5 pages. [cited by applicant]
First Office Action of the Israeli application No. 281619, issued on Jul. 5, 2023, 4 pages. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/942,437, issued on Jul. 20, 2023, 29 pages. [cited by applicant]
First Office Action of the Vietnamese application No. 1-2021-01752, issued on Aug. 21, 2023, 3 pages with English translation. [cited by applicant]
First Office Action of the Indonesian application No. P00202102695, issued on Sep. 8, 2023, 3 pages with English translation. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/197,327, issued on May 21, 2021, 19 pages. [cited by applicant]
Interview Summary of the U.S. Appl. No. 17/197,327, issued on Aug. 6, 2021, 4 pages. [cited by applicant]
Final Office Action of the U.S. Appl. No. 17/197,327, issued on Aug. 30, 2021, 17 pages. [cited by applicant]
Advisory Action of the U.S. Appl. No. 17/197,327, issued on Nov. 15, 2021, 6 pages. [cited by applicant]
Non-Final Office Action of the US after RCE U.S. Appl. No. 17/197,327, issued on Dec. 7, 2021, 19 pages. [cited by applicant]
Interview Summary of the US after RCE U.S. Appl. No. 17/197,327, issued on Jan. 18, 2022, 4 pages. [cited by applicant]
Final Office Action of the US after RCE U.S. Appl. No. 17/197,327, issued on Feb. 11, 2022, 14 pages. [cited by applicant]
Advisory Action of the US after RCE U.S. Appl. No. 17/197,327, issued on Apr. 28, 2022, 5 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/197,327, issued on Jun. 10, 2022, 25 pages. [cited by applicant]
Corrected Notice of Allowance of the U.S. Appl. No. 17/197,327, issued on Jul. 18, 2022, 6 pages. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/942,366, issued on Jul. 19, 2023, 27 pages. [cited by applicant]
First Office Action of the Russian application No. 2021109218, issued on Sep. 20, 2023, 18 pages with English translation. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/942,366, issued on Oct. 26, 2023, 20 pages. [cited by applicant]
Oral Proceedings the European application No. 20836842.3, issued on Oct. 31, 2023, 9 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/942,437, issued on Dec. 5, 2023, 20 pages. [cited by applicant]
Third Office Action of the Canadian application No. 3113740, issued on Mar. 6, 2024, 5 pages. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 5)”, Document: JVET-N1001-v8, [online], Joint Video Experts Team (JVET) of ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N1001 (version 8), Jun. 11, 2019, pp.… [cited by applicant]
Sakae Okubo, “H.264/AVC Textbook”, 1st Edition, Jan. 1, 2009, Impress Corporation R&D, pp. 297-298, ISBN: 978-4-8443-2664-9. 12 pages with English translation. [cited by applicant]
Jonathan Pfaff, et al., “CE3: Affine linear weighted intra prediction(CE3-4.1, CE3-4.2)”, Document: JVET-N0217, [online], Joint Video ExpertsTeam (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0217 (ver… [cited by applicant]
First Office Action of the Japanese application No. 2021-541531, issued on Mar. 26, 2024, 19 pages with English translation. [cited by applicant]
First Office Action of the Singaporean application No. 11202102925X, issued on Apr. 8, 2024, 10 pages. [cited by applicant]
Brief communication (Oral proceedings) of the European application No. 20836842.3, issued on Apr. 8, 2024, 6 pages. [cited by applicant]
Notice of Rejection of the European application No. 20836842.3, issued on Apr. 24, 2024, 22 pages. [cited by applicant]
First Office Action of the Malaysian application No. PI2021001380, issued on May 28, 2024, 4 pages. [cited by applicant]
First Office Action of the Mexican application No. MX/a/2021/005855, issued on Jul. 22, 2024, 8 pages with English translation. [cited by applicant]
Alexey Filippov et al., “CE3-related: Simplification of Matrix-based Intra Prediction (MIP)”, Document: JVET-O0203-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 3-12, 2019, … [cited by applicant]
Decision of Refusal of the Japanese application No. 2021-541531, issued on Aug. 30, 2024, 16 pages with English translation. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 18/423,632, issued on Oct. 10, 2024, 30 pages. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 8)”, Document: JVET-Q2001-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q2001 (version 2), 2020.01.18, pp. 12, 13, 38-… [cited by applicant]
Reconsideration Report by Examiner before Appeal of the Japanese application No. 2021-541531, issued on Jan. 24, 2025, 22 pages with English translation. [cited by applicant]