IP Library › Granted Patent US 12,200,199
Granted Patent B2
US 12,200,199 · App. 18/449,877 · Granted Jan 14, 2025

Colour component prediction method, encoder, decoder and storage medium

Inventors: Junyan Huo (Dongguan, CN); Shuai Wan (Dongguan, CN); Yanzhuo Ma (Dongguan, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/105H04N19/132H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,199
App. No.
18/449,877
Granted
Jan 14, 2025
Kind
B2
Abstract

Disclosed are a colour component prediction method, an encoder, a decoder, and a storage medium. The method includes: determining adjacent reference pixels of a current block in a picture; constructing a subset of adjacent reference pixels according to the adjacent reference pixels, wherein the subset of adjacent reference pixels contains a part of the adjacent reference pixels; and calculating model parameters of a prediction model according to the subset of adjacent reference pixels, wherein the prediction model includes N prediction sub-models, the N prediction sub-models correspond to N groups of model parameters, and the prediction sub-models are used to perform, through corresponding model parameters, cross-component prediction of colour components to be predicted.

Claims (54)

1. A method for predicting colour components, which is applied to an encoder, the method comprising:

determining adjacent reference samples of a current block in a picture;

constructing a subset of adjacent reference samples according to the adjacent reference samples, wherein the subset of adjacent reference samples contains a part of the adjacent reference samples; and

calculating model parameters of a prediction model according to the subset of adjacent reference samples, wherein the prediction model comprises N prediction sub-models, the N prediction sub-models correspond to N groups of model parameters, and the prediction sub-models are used to perform, through corresponding model parameters, cross-component prediction of colour components to be predicted,

wherein constructing the subset of adjacent reference samples according to the adjacent reference samples comprises:

determining candidate positions of candidate samples based on at least one edge of the current block; and determining reference samples corresponding to the candidate positions from the adjacent reference samples, and forming the subset of adjacent reference samples with the determined reference samples;

wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

calculating a first sampling interval according to a preset number of candidate samples and a length of the at least one edge of the current block; and determining a reference point from the at least one edge of the current block, and determining the candidate positions according to the first sampling interval.

2. The method of claim 1 , wherein determining the adjacent reference samples of the current block in the picture comprises:

acquiring reference samples adjacent to at least one edge of the current block, wherein the at least one edge of the current block comprises at least one of: an upper row, a right upper row, a left column and a left lower column; and

obtaining the adjacent reference samples according to the acquired reference samples.

3. The method of claim 1 , wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

determining the candidate positions based on sample positions corresponding to reference samples adjacent to the at least one edge of the current block.

4. The method of claim 1 , wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

determining the candidate positions based on colour component intensity values corresponding to reference samples adjacent to the at least one edge of the current block.

5. The method of claim 1 , wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

determining the candidate positions based on sample positions and colour component intensity values corresponding to the reference samples adjacent to the at least one edge of the current block.

6. The method of claim 1 , wherein the candidate positions of the candidate samples are determined according to formulas of:

Δ=length/( N 2 /2)

shift=Δ/2

wherein Δ represents a sampling interval, length represents a quantity of reference samples in a row adjacent to an upper edge of the current block or a quantity of reference samples in a column adjacent to a left edge of the current block, N 2 represents an expected quantity of reference samples forming the subset of adjacent reference samples of the current block, and shift represents a starting point position of a determined reference sample.

7. The method of claim 1 , wherein after calculating the first sampling interval, the method further comprises:

adjusting the first sampling interval to obtain a second sampling interval; and

determining the candidate positions according to the second sampling interval based on the reference point.

8. A method for predicting colour components, which is applied to a decoder, the method comprising:

determining adjacent reference samples of a current block in a picture;

constructing a subset of adjacent reference samples according to the adjacent reference samples, wherein the subset of adjacent reference samples contains a part of the adjacent reference samples; and

calculating model parameters of a prediction model according to the subset of adjacent reference samples, wherein the prediction model comprises N prediction sub-models, the N prediction sub-models correspond to N groups of model parameters, and the prediction sub-models are used to perform, through corresponding model parameters, cross-component prediction of colour components to be predicted,

wherein constructing the subset of adjacent reference samples according to the adjacent reference samples comprises:

determining candidate positions of candidate samples based on at least one edge of the current block; and determining reference samples corresponding to the candidate positions from the adjacent reference samples, and forming the subset of adjacent reference samples with the determined reference samples;

wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

calculating a first sampling interval according to a preset number of candidate samples and a length of the at least one edge of the current block; and determining a reference point from the at least one edge of the current block, and determining the candidate positions according to the first sampling interval.

9. The method of claim 8 , wherein determining the adjacent reference samples of the current block in the picture comprises:

acquiring reference samples adjacent to at least one edge of the current block, wherein the at least one edge of the current block comprises at least one of: an upper row, a right upper row, a left column and a left lower column; and

obtaining the adjacent reference samples according to the acquired reference samples.

10. The method of claim 8 , wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

determining the candidate positions based on sample positions corresponding to reference samples adjacent to the at least one edge of the current block.

11. The method of claim 8 , wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

determining the candidate positions based on colour component intensity values corresponding to reference samples adjacent to the at least one edge of the current block.

12. The method of claim 8 , wherein determining the candidate positions of the candidate samples based on the at least one edge of the current block comprises:

determining the candidate positions based on sample positions and colour component intensity values corresponding to the reference samples adjacent to the at least one edge of the current block.

13. The method of claim 8 , wherein the candidate positions of the candidate samples are determined according to formulas of:

Δ=length/( N 2 /2)

shift=Δ/2

wherein Δ represents a sampling interval, length represents a quantity of reference samples in a row adjacent to an upper edge of the current block or a quantity of reference samples in a column adjacent to a left edge of the current block, N 2 represents an expected quantity of reference samples forming the subset of adjacent reference samples of the current block, and shift represents a starting point position of a determined reference sample.

14. The method of claim 8 , wherein after calculating the first sampling interval, the method further comprises:

adjusting the first sampling interval to obtain a second sampling interval; and

determining the candidate positions according to the second sampling interval based on the reference point.

15. An encoder comprising a first memory and a first processor, wherein

the first memory is configured to store a computer program runnable on the first processor; and

the first processor is configured to, when running the computer program, perform the method of claim 1 .

16. A decoder comprising a second memory and a second processor, wherein

the second memory is configured to store a computer program runnable on the second processor; and

the second processor is configured to, when running the computer program, perform the method of claim 8 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2023
From: HUO, JUNYAN; WAN, SHUAI; MA, YANZHUO
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 064591/0441 →
Continuity (5)
Continuation 17722082 · Apr 15, 2022
Continuation 17397680 · Aug 9, 2021
Continuation PCTCN2019113771 · Oct 28, 2019
Provisional Application 62819851 · Mar 18, 2019
Related Publication 20230388491A1 · Nov 30, 2023
References Cited (59)
US 10404980B1 · Zhao et al. · 2019 [cited by applicant]
US 10419754B1 · Zhao et al. · 2019 [cited by applicant]
US 20080008239A1 · Song et al. · 2008 [cited by applicant]
US 20080165846A1 · Kim · 2008 [cited by applicant]
US 20090141804A1 · Wang et al. · 2009 [cited by applicant]
US 20110255591A1 · Kim et al. · 2011 [cited by applicant]
US 20120287995A1 · Budagavi · 2012 [cited by applicant]
US 20130188703A1 · Liu et al. · 2013 [cited by applicant]
US 20140294061A1 · Zhang et al. · 2014 [cited by applicant]
US 20150264363A1 · Pu et al. · 2015 [cited by applicant]
US 20150365684A1 · Chen et al. · 2015 [cited by applicant]
US 20170251213A1 · Ye et al. · 2017 [cited by applicant]
US 20170359595A1 · Zhang et al. · 2017 [cited by applicant]
US 20180077426A1 · Zhang et al. · 2018 [cited by applicant]
US 20190045184A1 · Zhang et al. · 2019 [cited by applicant]
US 20200213619A1 · Aono et al. · 2020 [cited by applicant]
US 20210281853A1 · Moon et al. · 2021 [cited by applicant]
CN 101356818A · 2009 [cited by applicant]
CN 101496406A · 2009 [cited by applicant]
CN 102625126A · 2012 [cited by applicant]
CN 103200401A · 2013 [cited by applicant]
CN 106105200A · 2016 [cited by applicant]
CN 103814574B · 2018 [cited by applicant]
CN 107580222A · 2018 [cited by applicant]
CN 108702515A · 2018 [cited by applicant]
CN 109196867A · 2019 [cited by applicant]
CN 109218730A · 2019 [cited by applicant]
CN 109417623A · 2019 [cited by applicant]
GB 2567249A · 2019 [cited by applicant]
WO 2018116925A1 · 2018 [cited by applicant]
Brief communication for European Application No. 19919998.5 issued Nov. 14, 2023. 5 pages. [cited by applicant]
Decision to Refuse for European Application No. 19919998.5 issued Dec. 4, 2023. 10 pages. [cited by applicant]
Written Opinion of the International Searching Authority dated Jan. 16, 2020 cited in PCT/CN2019/113771 with translation, 7 pages. [cited by applicant]
Search Report for European Application No. 24155363.5 issued May 15, 2024, 11 pages. [cited by applicant]
Hearing Notice for Indian Application No. 202117036495 issued Jul. 31, 2024, 2 pages. [cited by applicant]
International Search Report issued Jan. 16, 2020 of PCT /CN2019/113771 (6 pages). [cited by applicant]
EP Search Report dated Feb. 11, 2022 in EP Application No. 19919998.5, 11 pages. [cited by applicant]
First Examination Report mailed Mar. 16, 2022 in India Application No. 202117036495, 6 pages. [cited by applicant]
XP30023716A, JVET, Algorithm Description of Joint Exploration Test Model 7 (JEM 7), Joint Video Exploration Team (JVET) Document: JVET-G 1001-v 1, of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, … [cited by applicant]
XP30200351A, Qualcomm Inc., CE3: On MMLM (Test 2.1), Joint Video Experts Team (JVET), of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 4 pages. [cited by applicant]
XP30213414A, Xidian University et al., CE3-related: Fixed Reference Samples Design for CCLM, Joint Video Experts Team (JVET), of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 20… [cited by applicant]
Examination Report for European Application No. 19919998.5 issued Nov. 10, 2022. 7 pages. [cited by applicant]
Fan, Y. “Research on Fast Decision Algorithm of H.264/AVC Intra-mode” Thesis submitted to Chongqing University; Apr. 2016. 80 pages with English abstract. [cited by applicant]
First Office Action for Chinese Application No. 202110993233.6 issued Sep. 28, 2022. 22 pages with English translation. [cited by applicant]
ITRI International “Non-CE3: Adaptive multiple cross-component linear model” JVET-K0536_r1; JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; 11th Meeting; Ljubljana, SL; Jul. 10-18, 2018. 9 pages. [cited by applicant]
Northwestern Polytechnical University et al. “CE3: Reduced reference samples range for CCLM_L and CCLM_T (Tests 1.3.1, 1.3.2 and 1.3.3)” JVET-N0130-v1; JVET of ITU-T SG16 WP3 and ISO/IEC TJC 1/SC 29/WG11 14th Meeting; G… [cited by applicant]
Notice of Reasons for Refusal for Japanese Application No. 2021-551793 issued Sep. 2, 2022. 17 pages with English translation. [cited by applicant]
Qualcomm Inc. “Cross-check of JVET-K0204: On cross-component linear model simplification” JVET-K0512r1; JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; 11th Meeting; Ljubljana, SL; Jul. 10-18, 2018. 10 pages. [cited by applicant]
Japan Decision of Refusal mailed Mar. 24, 2023 in JP App. 2021-551793, 8 pages. [cited by applicant]
EP Summons to attend oral proceedings mailed May 4, 2023 in EP App. 19919998.5, 9 pages. [cited by applicant]
Xiang MA et al_, CE3: CCLM/!\iIDLM using simplified coefficients derivation method (Test 5.6. t, 5.6.2 and 5.6.3), Joint /ideo Experts Team (JVET) of ITU-T SG 16 WP 3 and ISOIIEC JTC I/SC 29/WG .11, 12th Meeting: Macao,… [cited by applicant]
Non-final Office Action for U.S. Appl. No. 17/722,082 issued Feb. 1, 2023. 16 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/722,082 issued May 30, 2023. 8 pages. [cited by applicant]
Corrected Notice of Allowability for U.S. Appl. No. 17/722,082 issued Jul. 26, 2023. 6 pages. [cited by applicant]
Non-final Office Action for U.S. Appl. No. 17/397,680 issued Nov. 8, 2021. 17 pages. [cited by applicant]
Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: SanJose, US, Jan. 9-17, 2014, Document: JCTVC-P0035 (Year: 2014). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/397,680 issued Feb. 25, 2022. 8 pages. [cited by applicant]
Corrected Notice of Allowability for U.S. Appl. No. 17/397,680 issued May 16, 2022. 4 pages. [cited by applicant]
First Office Action of the Korean application No. 10-2021-7027817, issued on Sep. 24, 2024. 12 pages with English translation. [cited by applicant]