IP Library › Granted Patent US 12,256,080
Granted Patent B2
US 12,256,080 · App. 18/423,632 · Granted Mar 18, 2025

Method for colour component prediction, encoder, decoder and storage medium

Inventors: Junyan Huo (Dongguan, CN); Yanzhuo Ma (Dongguan, CN); Wei Zhang (Dongguan, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/132G06F5/01G06F17/16H04N19/159H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,256,080
App. No.
18/423,632
Granted
Mar 18, 2025
Kind
B2
Abstract

A method for colour component prediction, an encoder, a decoder and a storage medium are provided. The method includes that: prediction parameters of a current block are determined, the prediction parameters including a prediction mode parameter and a size parameter of the current block; when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block are determined; and the intra prediction value of the current block is determined according to the MIP weight matrix, the shift factor and the MIP input sample matrix.

Claims (62)

1. A method for colour component prediction, applicable for an encoder and comprising:

determining prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter of the current block;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determining an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block, wherein the shift factor is equal to a fixed constant value; and

determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix comprising:

performing matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block,

wherein the MIP weight matrix of the current block is at least determined according to a block size index value of the current block.

2. The method of claim 1 , wherein the shift factor is equal to 6.

3. The method of claim 1 , wherein determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix further comprises:

performing filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising prediction values of at least part of sample positions in the current block.

4. The method of claim 3 , wherein the block size index value of the current block is determined according to the size parameter of the current block, and

wherein determining the block size index value of the current block according to the size parameter of the current block comprises:

when both a width and a height of the current block are equal to 4, setting the block size index value of the current block equal to 0;

when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4, setting the block size index value of the current block equal to 1; or

when both the width and height of the current block do not meet the above conditions, setting the block size index value of the current block equal to 2.

5. A method for colour component prediction, applicable for a decoder and comprising:

parsing a bitstream to acquire prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter of the current block;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determining an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block, wherein the shift factor is equal to a fixed constant value; and

determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix comprising:

performing matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block,

wherein the MIP weight matrix of the current block is determined at least according to a block size index value of the current block.

6. The method of claim 5 , wherein the shift factor is equal to 6.

7. The method of claim 5 , wherein determining the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix further comprises:

performing filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising predicted values of at least part of sample positions in the current block.

8. The method of claim 7 , wherein the block size index value of the current block is determined according to the size parameter of the current block, and

wherein determining the block size index value of the current block according to the size parameter of the current block comprises:

when both a width and a height of the current block are equal to 4, setting the block size index value of the current block equal to 0;

when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4, setting the block size index value of the current block equal to 1; or

when both the width and height of the current block do not meet the above conditions, setting the block size index value of the current block equal to 2.

9. An encoder, comprising a memory and a processor, wherein

the memory is configured to store computer programs capable of running in the processor; and

the processor is configured to run the computer programs to:

determine prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter of the current block;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determine an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block, wherein the shift factor is equal to a fixed constant value; and

determine the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix,

wherein the MIP weight matrix of the current block is at least determined according to a block size index value of the current block,

wherein the processor is further configured to run the computer programs to:

perform matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block.

10. The encoder of claim 9 , wherein the shift factor is equal to 6.

11. The encoder of claim 9 , wherein the processor is further configured to run the computer programs to:

perform filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising prediction values of at least part of sample positions in the current block.

12. The encoder of claim 11 , wherein the block size index value of the current block is determined according to the size parameter of the current block, and

wherein the processor is further configured to run the computer programs to:

set the block size index value of the current block equal to 0 when both a width and a height of the current block are equal to 4;

set the block size index value of the current block equal to 1 when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4; or

set the block size index value of the current block equal to 2 when both the width and height of the current block do not meet the above conditions.

13. A decoder, comprising a memory and a processor, wherein

the memory is configured to store computer programs capable of running in the processor; and

the processor is configured to run the computer programs to:

parse a bitstream to acquire prediction parameters of a current block, the prediction parameters comprising a prediction mode parameter of the current block;

when the prediction mode parameter indicates that a Matrix-based Intra Prediction (MIP) mode is adopted to determine an intra prediction value of the current block, determine an MIP weight matrix of the current block, a shift factor of the current block and an MIP input sample matrix of the current block, wherein the shift factor is equal to a fixed constant value; and

determine the intra prediction value of the current block according to the MIP weight matrix, the shift factor and the MIP input sample matrix,

wherein the MIP weight matrix of the current block is determined at least according to a block size index value of the current block,

wherein the processor is further configured to run the computer programs to:

perform matrix multiplication processing on the MIP input sample matrix, the MIP weight matrix and the shift factor by use of a preset calculation model to obtain an MIP-based prediction block of the current block.

14. The decoder of claim 13 , wherein the shift factor is equal to 6.

15. The decoder of claim 13 , wherein the processor is further configured to run the computer programs to:

perform filtering processing on the MIP-based prediction block to obtain the intra prediction value of the current block, the MIP-based prediction block comprising predicted values of at least part of sample positions in the current block.

16. The decoder of claim 15 , wherein the block size index value of the current block is determined according to the size parameter of the current block, and

wherein the processor is further configured to run the computer programs to:

set the block size index value of the current block equal to 0 when both a width and a height of the current block are equal to 4;

set the block size index value of the current block equal to 1 when both the width and height of the current block are equal to 8 or only one of the width and height of the current block is equal to 4; or

set the block size index value of the current block equal to 2 when both the width and height of the current block do not meet the above conditions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2024
From: HUO, JUNYAN; MA, YANZHUO; ZHANG, WEI
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 066259/0238 →
Continuity (7)
Continuation 17942437 · Sep 12, 2022
Continuation 17197327 · Mar 10, 2021
Continuation PCTCN2020090688 · May 15, 2020
Provisional Application 62872830 · Jul 11, 2019
Provisional Application 62873170 · Jul 11, 2019
Provisional Application 62872488 · Jul 10, 2019
Related Publication 20240163445A1 · May 16, 2024
References Cited (98)
US 9258573B2 · Drugeon · 2016 [cited by applicant]
US 10349061B2 · King · 2019 [cited by applicant]
US 10674162B2 · King · 2020 [cited by applicant]
US 10694179B2 · Hermansson · 2020 [cited by applicant]
US 10819977B2 · Zhao · 2020 [cited by applicant]
US 10911765B2 · Zhao · 2021 [cited by applicant]
US 10965941B2 · Zhao · 2021 [cited by applicant]
US 11146798B2 · Wan · 2021 [cited by applicant]
US 11451791B2 · Kim · 2022 [cited by applicant]
US 11477465B2 · Wan · 2022 [cited by applicant]
US 11695930B2 · Choi · 2023 [cited by applicant]
US 11770542B2 · Wan · 2023 [cited by applicant]
US 20110135212A1 · Alshina · 2011 [cited by applicant]
US 20110145549A1 · Suk · 2011 [cited by applicant]
US 20120140821A1 · Drugeon · 2012 [cited by examiner]
US 20130101033A1 · Joshi · 2013 [cited by applicant]
US 20130128961A1 · Kim et al. · 2013 [cited by applicant]
US 20130128972A1 · Yamaguchi · 2013 [cited by applicant]
US 20130251036A1 · Lee · 2013 [cited by examiner]
US 20140086318A1 · Kerofsky et al. · 2014 [cited by applicant]
US 20140198848A1 · Yie · 2014 [cited by applicant]
US 20140362926A1 · Rosewarne et al. · 2014 [cited by applicant]
US 20150326881A1 · Ikai et al. · 2015 [cited by applicant]
US 20160134869A1 · Ikai · 2016 [cited by applicant]
US 20170019678A1 · Kim et al. · 2017 [cited by applicant]
US 20170270100A1 · Audhkhasi · 2017 [cited by examiner]
US 20180020223A1 · King · 2018 [cited by applicant]
US 20180176601A1 · Jeong et al. · 2018 [cited by applicant]
US 20180288438A1 · Chao · 2018 [cited by examiner]
US 20190037213A1 · Hermansson · 2019 [cited by examiner]
US 20190037232A1 · Ehmann · 2019 [cited by examiner]
US 20190166370A1 · Xiu et al. · 2019 [cited by applicant]
US 20190246138A1 · Terterov et al. · 2019 [cited by applicant]
US 20190281307A1 · King · 2019 [cited by applicant]
US 20190281308A1 · King · 2019 [cited by applicant]
US 20200344468A1 · Lin et al. · 2020 [cited by applicant]
US 20200359050A1 · Van der Auwera et al. · 2020 [cited by applicant]
US 20200396455A1 · Liu et al. · 2020 [cited by applicant]
US 20210297668A1 · Racape et al. · 2021 [cited by applicant]
US 20220103813A1 · Pfaff · 2022 [cited by applicant]
US 20220264085A1 · Galpin · 2022 [cited by applicant]
CN 1741612A · 2006 [cited by applicant]
CN 102595112A · 2012 [cited by applicant]
CN 105516728A · 2016 [cited by applicant]
CN 107633538A · 2018 [cited by applicant]
CN 109076237A · 2018 [cited by applicant]
CN 111050183A · 2020 [cited by applicant]
EP 3863287A1 · 2021 [cited by applicant]
JP 2015231091A · 2015 [cited by applicant]
WO 2020256599A1 · 2020 [cited by applicant]
International Search Report in the international application No. PCT/CN2020/090688, mailed on Aug. 12, 2020. [cited by applicant]
Bross B et al: “Versatile Video Coding (Draft 5)”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 ), No. JVET-N1001 Jul. 2, 2019 (Jul.… [cited by applicant]
“Test Model 5 of Versatile Video Coding (VTM 5)”, 126. MPEG Meeting; Mar. 25, 2019-Mar. 29, 2019; Geneva; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. n18371 Jul. 7, 2019 (Jul. 7, 2019), XP030222341, Ret… [cited by applicant]
J-Y Huo et al: “Non-CE3: Fixed downshifting for 8-bit MIP”15.JVET Meeting; Jul. 3, 2019-Jul. 12, 2019 Gothenburg; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ), No. JVET-01127 Jul. 7, 201… [cited by applicant]
Kondo ( Sony ) K et al:“CE3-2:On rounding shift of MIP”, 16 . JVET Meeting;Oct. 1, 2019-Oct. 11, 2019;Geneva; (The Joint Video Exploration Team of ISO/ IEC JTC1/ SC29/WG11 and ITU-T SG . 16), No. JVET-P0056; m49976 Sep.… [cited by applicant]
Supplementary European Search Report in the European application No. 20836842.3, mailed on Sep. 1, 2021. [cited by applicant]
First Office Action of the Indian application No. 202117011503, issued on Feb. 22, 2022. [cited by applicant]
First Office Action of the European application No. 20836842.3, issued on Mar. 14, 2022. [cited by applicant]
Written Opinion of the International Search Authority in the international application No. PCT/CN2020/090688, mailed on Aug. 12, 2020. [cited by applicant]
First Office Action of the Canadian application No. 3113740, issued on May 20, 2022. [cited by applicant]
Alexey Filippov et al. “Recent Advances in Intra Prediction for the Emerging H .266/VVC Video Coding Standard” 2019, https://sci-hub.se/10.1109/SIBIRCON48586.2019.8958416. [cited by applicant]
First Office Action of the Chinese application No. 202110469722.1, issued on Sep. 19, 2022. [cited by applicant]
Bross B et al: “Versatile Video Coding (Draft 7)”, 16. JVET Meeting; Oct. 1, 2019-Oct. 11, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/ WG11 and ITU-T SG.16 ), No. JVET-P2001; m51515 Oct. 12, 20… [cited by applicant]
Second Office Action of the European application No. 20836842.3, issued on Oct. 5, 2022. [cited by applicant]
Second Office Action of the Chinese application No. 202110469722.1, issued on Nov. 14, 2022. [cited by applicant]
Third Office Action of the European application No. 20836842.3, issued on Apr. 12, 2023. 6 pages. [cited by applicant]
Second Office Action of the Canadian application No. 3113740, issued on Jul. 5, 2023, 5 pages. [cited by applicant]
First Office Action of the Israeli application No. 281619, issued on Jul. 5, 2023, 4 pages. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/942,366, issued on Jul. 19, 2023, 27 pages. [cited by applicant]
First Office Action of the Vietnamese application No. 1-2021-01752, issued on Aug. 21, 2023, 3 pages with English translation. [cited by applicant]
First Office Action of the Indonesian application No. P00202102695, issued on Sep. 8, 2023, 3 pages with English translation. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/197,327, issued on May 21, 2021, 19 pages. [cited by applicant]
Interview Summary of the U.S. Appl. No. 17/197,327, issued on Aug. 6, 2021, 4 pages. [cited by applicant]
Final Office Action of the U.S. Appl. No. 17/197,327, issued on Aug. 30, 2021, 17 pages. [cited by applicant]
Advisory Action of the U.S. Appl. No. 17/197,327, issued on Nov. 15, 2021, 6 pages. [cited by applicant]
Non-Final Office Action of the US after RCE U.S. Appl. No. 17/197,327, issued on Dec. 7, 2021, 19 pages. [cited by applicant]
Interview Summary of the US after RCE U.S. Appl. No. 17/197,327, issued on Jan. 18, 2022, 4 pages. [cited by applicant]
Final Office Action of the US after RCE U.S. Appl. No. 17/197,327, issued on Feb. 11, 2022, 14 pages. [cited by applicant]
Advisory Action of the US after RCE U.S. Appl. No. 17/197,327, issued on Apr. 28, 2022, 5 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/197,327, issued on Jun. 10, 2022, 25 pages. [cited by applicant]
Corrected Notice of Allowance of the U.S. Appl. No. 17/197,327, issued on Jul. 18, 2022, 6 pages. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/942,437, issued on Jul. 20, 2023, 29 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/942,437, issued on Dec. 5, 2023, 20 pages. [cited by applicant]
First Office Action of the Malaysian application No. PI2021001380, issued on May 28, 2024, 4 pages. [cited by applicant]
First Office Action of the Mexican application No. MX/a/2021/005855, issued on Jul. 22, 2024, 8 pages with English translation. [cited by applicant]
Third Office Action of the Canadian application No. 3113740, issued on Mar. 6, 2024, 5 pages. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 5)”, Document: JVET-N1001-v8, [online], Joint Video Experts Team (JVET) of ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N1001 (version 8), Jun. 11, 2019, pp.… [cited by applicant]
Sakae Okubo, “H.264/AVC Textbook”, 1st Edition, Jan. 1, 2009, Impress Corporation R&D, pp. 297-298, ISBN: 978-4-8443-2664-9. 12 pages with English translation. [cited by applicant]
Jonathan Pfaff, et al., “CE3: Affine linear weighted intra prediction(CE3-4.1, CE3-4.2)”, Document: JVET-N0217, [online], Joint Video ExpertsTeam (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0217 (ver… [cited by applicant]
First Office Action of the Japanese application No. 2021-541531, issued on Mar. 26, 2024, 19 pages with English translation. [cited by applicant]
First Office Action of the Singaporean application No. 11202102925X, issued on Apr. 8, 2024, 10 pages. [cited by applicant]
Brief communication (Oral proceedings) of the European application No. 20836842.3, issued on Apr. 8, 2024, 6 pages. [cited by applicant]
Notice of Rejection of the European application No. 20836842.3, issued on Apr. 24, 2024, 22 pages. [cited by applicant]
Alexey Filippov et al., “CE3-related: Simplification of Matrix-based Intra Prediction (MIP)”, Document: JVET-O0203-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 3-12, 2019, … [cited by applicant]
Decision of Refusal of the Japanese application No. 2021-541531, issued on Aug. 30, 2024, 16 pages with English translation. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 18/532,038, issued on Aug. 27, 2024, 32 pages. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 8)”, Document: JVET-Q2001-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q2001 (version 2), Jan. 18, 2020, pp. 12, 13, … [cited by applicant]
Reconsideration Report by Examiner before Appeal of the Japanese application No. 2021-541531, issued on Jan. 24, 2025, 22 pages with English translation. [cited by applicant]