IP Library › Granted Patent US 12,341,987
Granted Patent B2
US 12,341,987 · App. 18/401,806 · Granted Jun 24, 2025

Prediction decoding method and apparatus

Inventors: Junyan Huo (Guangdong, CN); Yanzhuo Ma (Guangdong, CN); Shuai Wan (Guangdong, CN); Fuzheng Yang (Guangdong, CN); Qihong Ran (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/44H04N19/105H04N19/132H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,341,987
App. No.
18/401,806
Granted
Jun 24, 2025
Kind
B2
Abstract

A prediction decoding method, a prediction decoding apparatus, and a non-transitory computer storage medium are provided. The method includes the following. First multiple neighbouring reference samples of a coding block are determined, where the first multiple neighbouring reference samples include reference samples in a reference row or a reference column neighbouring the coding block. Positions corresponding to K reference samples are determined from a starting position of the reference row or the reference column, where K is a positive integer. Second multiple neighbouring reference samples are determined according to the determined positions corresponding to the K reference samples, where the second multiple neighbouring reference samples include neighbouring reference samples among the first multiple neighbouring reference samples. Prediction decoding is performed on the coding block according to the second multiple neighbouring reference samples.

Claims (75)

1. A prediction decoding method, comprising:

determining first multiple neighbouring reference samples of a coding block, wherein the first multiple neighbouring reference samples comprise reference samples in a reference row or a reference column neighbouring the coding block;

for the reference row, determining a value of K according to a length of a top side of the coding block and a first preset proportion, or for the reference column, determining the value of K according to a length of a left side of the coding block and a second preset proportion;

determining, from a starting position of the reference row or the reference column, positions corresponding to K reference samples, wherein K is a positive integer;

determining reference sample positions for the second multiple neighbouring reference samples based on sampling intervals, wherein a sampling starting position corresponding to the sampling intervals is indicated by the value of K;

determining second multiple neighbouring reference samples according to the determined positions corresponding to the K reference samples, wherein the second multiple neighbouring reference samples comprise neighbouring reference samples among the first multiple neighbouring reference samples;

performing prediction decoding on the coding block according to the second multiple neighbouring reference samples;

determining reference sample positions according to a preset number of samples, based on the second multiple neighbouring reference samples, wherein reference sample positions for the second multiple neighbouring reference samples are determined based on a function including a start position and a variable representing the preset number of samples; and

determining, according to the reference sample positions, reference samples corresponding to the reference sample positions from the second multiple neighbouring reference samples, to obtain third multiple neighbouring reference samples comprising the determined reference samples.

2. The method of claim 1 , wherein a prediction mode of the coding block is a multi-directional linear model (MDLM) prediction mode, wherein the MDLM prediction mode comprises an MDLM_A mode and an MDLM_L mode.

3. The method of claim 1 , wherein determining, from the starting position of the reference row or the reference column, the positions corresponding to the K reference samples comprises:

for the reference row, determining, from a leftmost position of the reference row to the right, positions corresponding to K consecutive reference samples; or

for the reference column, determining, down from a topmost position of the reference column, positions corresponding to K consecutive reference samples.

4. The method of claim 1 , wherein performing prediction decoding on the coding block according to the second multiple neighbouring reference samples comprises:

determining a second model parameter according to the third multiple neighbouring reference samples;

establishing a second prediction model according to the second model parameter, wherein the second prediction model is representative of a prediction relationship between a first colour component and a second colour component corresponding to the coding block; and

performing prediction decoding on the coding block according to the second prediction model.

5. The method of claim 1 , wherein determining reference sample positions according to a preset number of samples comprises:

determining the reference sample positions in second multiple neighbouring reference samples according to sampling intervals.

6. The method of claim 5 , wherein the sampling intervals are equal sampling intervals, determining the reference sample positions in second multiple neighbouring reference samples according to sampling intervals comprises:

determining the reference sample positions in second multiple neighbouring reference samples by performing uniform sampling on the second multiple neighbouring reference samples according to the equal sampling intervals and the following function:

(startPosN+pos*pickStepN)

wherein startPosN represents the start position of the reference sample positions, pos represents the determining procedure from position 0 to position cntN-1 with variable entN represents the preset number of samples, and pickStepN represents the equal sampling interval.

7. The method of claim 5 , wherein the sampling intervals are unequal sampling intervals, determining the reference sample positions in second multiple neighbouring reference samples according to sampling intervals comprises:

determining the reference sample positions in second multiple neighbouring reference samples by performing non-uniform sampling on the second multiple neighbouring reference samples according to the unequal sampling intervals.

8. The method of claim 2 , wherein the MDLM_A mode is INTRA_T_CCLM mode, and the MDLM_L mode is INTRA_L_CCLM mode.

9. The method of claim 8 , wherein in the INTRA_T_CCLM mode, the reference row neighbouring the coding block refers to an above neighbouring row of the coding block, in the INTRA_L_CCLM mode, the reference column neighbouring the coding block refers a left neighbouring row of the coding block.

10. The method of claim 1 , wherein each reference sample corresponds to a luma position, the neighbouring reference samples comprises above neighbouring samples and left neighbouring reference samples.

11. A prediction decoding apparatus, comprising:

a processor; and

a memory configured to store computer programs which, when executed by the processor, are operable with the processor to:

determine first multiple neighbouring reference samples of a coding block, wherein the first multiple neighbouring reference samples comprise reference samples in a reference row or a reference column neighbouring the coding block;

for the reference row, determine a value of K according to a length of a top side of the coding block and a first preset proportion, or for the reference column, determine the value of K according to a length of a left side of the coding block and a second preset proportion;

determine, from a starting position of the reference row or the reference column, positions corresponding to K reference samples, wherein K is a positive integer;

determine reference sample positions for the second multiple neighbouring reference samples based on sampling intervals, wherein a sampling starting position corresponding to the sampling intervals is indicated by the value of K;

determine second multiple neighbouring reference samples according to the determined positions corresponding to the K reference samples, wherein the second multiple neighbouring reference samples comprise neighbouring reference samples among the first multiple neighbouring reference samples;

perform prediction decoding on the coding block according to the second multiple neighbouring reference samples;

determine reference sample positions according to a preset number of samples, based on the second multiple neighbouring reference samples, wherein reference sample positions for the second multiple neighbouring reference samples are determined based on a function including a start position and a variable representing the preset number of samples; and

determine, according to the reference sample positions, reference samples corresponding to the reference sample positions from the second multiple neighbouring reference samples, to obtain third multiple neighbouring reference samples comprising the determined reference samples.

12. The apparatus of claim 11 , wherein the processor configured to perform prediction decoding on the coding block according to the second multiple neighbouring reference samples is configured to:

determine a second model parameter according to the third multiple neighbouring reference samples;

establish a second prediction model according to the second model parameter, wherein the second prediction model is representative of a prediction relationship between a first colour component and a second colour component corresponding to the coding block; and

perform prediction decoding on the coding block according to the second prediction model.

13. The apparatus of claim 11 , wherein a prediction mode of the coding block is a multi-directional linear model (MDLM) prediction mode, wherein the MDLM prediction mode comprises an MDLM_A mode and an MDLM_L mode.

14. The apparatus of claim 11 , wherein the processor configured to determine, from the starting position of the reference row or the reference column, the positions corresponding to the K reference samples is configured to:

for the reference row, determine, from a leftmost position of the reference row to the right, positions corresponding to K consecutive reference samples; or

for the reference column, determine, down from a topmost position of the reference column, positions corresponding to K consecutive reference samples.

15. A non-transitory computer readable storage medium storing program codes which, when executed by a computer, are operable with the computer to perform the following operations:

determining first multiple neighbouring reference samples of a coding block, wherein the first multiple neighbouring reference samples comprise reference samples in a reference row or a reference column neighbouring the coding block;

for the reference row, determining a value of K according to a length of a top side of the coding block and a first preset proportion, or for the reference column, determining the value of K according to a length of a left side of the coding block and a second preset proportion;

determining, from a starting position of the reference row or the reference column, positions corresponding to K reference samples, wherein K is a positive integer;

determining reference sample positions for the second multiple neighbouring reference samples based on sampling intervals, wherein a sampling starting position corresponding to the sampling intervals is indicated by the value of K;

determining second multiple neighbouring reference samples according to the determined positions corresponding to the K reference samples, wherein the second multiple neighbouring reference samples comprise neighbouring reference samples among the first multiple neighbouring reference samples;

performing prediction decoding on the coding block according to the second multiple neighbouring reference samples;

determining reference sample positions according to a preset number of samples, based on the second multiple neighbouring reference samples, wherein reference sample positions for the second multiple neighbouring reference samples are determined based on a function including a start position and a variable representing the preset number of samples; and

determining, according to the reference sample positions, reference samples corresponding to the reference sample positions from the second multiple neighbouring reference samples, to obtain third multiple neighbouring reference samples comprising the determined reference samples.

16. The non-transitory computer readable storage medium of claim 15 ,

wherein in terms of performing prediction decoding on the coding block according to the second multiple neighbouring reference samples, the program codes are operable with the computer to perform the following:

determining a second model parameter according to the third multiple neighbouring reference samples;

establishing a second prediction model according to the second model parameter, wherein the second prediction model is representative of a prediction relationship between a first colour component and a second colour component corresponding to the coding block; and

performing prediction decoding on the coding block according to the second prediction model.

17. The non-transitory computer readable storage medium of claim 15 ,

wherein in terms of determining, from the starting position of the reference row or the reference column, the positions corresponding to the K reference samples, the program codes are operable with the computer to perform the following:

for the reference row, determining, from a leftmost position of the reference row to the right, positions corresponding to K consecutive reference samples; or

for the reference column, determining, down from a topmost position of the reference column, positions corresponding to K consecutive reference samples.

18. The non-transitory computer readable storage medium of claim 15 , wherein in terms of performing prediction decoding on the coding block according to the second multiple neighbouring reference samples, the program codes are operable with the computer to perform the following:

determining a second model parameter according to the third multiple neighbouring reference samples;

establishing a second prediction model according to the second model parameter, wherein the second prediction model is representative of a prediction relationship between a first colour component and a second colour component corresponding to the coding block; and

performing prediction decoding on the coding block according to the second prediction model.

19. The non-transitory computer readable storage medium of claim 15 , wherein in terms of determining reference sample positions according to a preset number of samples, the program codes are operable with the computer to perform the following:

determining the reference sample positions in second multiple neighbouring reference samples according to sampling intervals.

20. The non-transitory computer readable storage medium of claim 19 , wherein the sampling intervals are equal sampling intervals, in terms of determining the reference sample positions in second multiple neighbouring reference samples according to sampling intervals, the program codes are operable with the computer to perform the following:

determining the reference sample positions in second multiple neighbouring reference samples by performing uniform sampling on the second multiple neighbouring reference samples according to the equal sampling intervals and the following function:

(startPosN+pos*pickStepN)

wherein startPosN represents the start position of the reference sample positions, pos represents the determining procedure from position 0 to position cntN-1 with variable cntN represents the preset number of samples, and pickStepN represents the equal sampling interval.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2024
From: HUO, JUNYAN; MA, YANZHUO; WAN, SHUAI; YANG, FUZHENG; RAN, QIHONG
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 065991/0854 →
Continuity (4)
Continuation 17660992 · Apr 27, 2022
Continuation 17356982 · Jun 24, 2021
Continuation PCTCN2019070147 · Jan 2, 2019
Related Publication 20240137544A1 · Apr 25, 2024
References Cited (94)
US 10939117B2 · Laroche · 2021 [cited by examiner]
US 11012699B2 · Choi · 2021 [cited by examiner]
US 11412244B2 · Huo · 2022 [cited by examiner]
US 11570458B2 · Zhang · 2023 [cited by examiner]
US 11871020B2 · Huo · 2024 [cited by examiner]
US 20130058401A1 · Song et al. · 2013 [cited by applicant]
US 20130188703A1 · Liu et al. · 2013 [cited by applicant]
US 20130188883A1 · Gisquet et al. · 2013 [cited by applicant]
US 20180077426A1 · Zhang et al. · 2018 [cited by applicant]
US 20180332284A1 · Liu et al. · 2018 [cited by applicant]
US 20180376161A1 · Chen et al. · 2018 [cited by applicant]
US 20200195930A1 · Choi et al. · 2020 [cited by applicant]
US 20200252619A1 · Zhang et al. · 2020 [cited by applicant]
US 20200288135A1 · Laroche et al. · 2020 [cited by applicant]
US 20200296391A1 · Choi · 2020 [cited by examiner]
US 20200366933A1 · Zhang et al. · 2020 [cited by applicant]
US 20200404282A1 · Li et al. · 2020 [cited by applicant]
US 20210136392A1 · Ma et al. · 2021 [cited by applicant]
US 20210136409A1 · Ma et al. · 2021 [cited by applicant]
US 20210227229A1 · Ma et al. · 2021 [cited by applicant]
US 20210297656A1 · Ma et al. · 2021 [cited by applicant]
US 20210314595A1 · Zhang et al. · 2021 [cited by applicant]
US 20210337224A1 · Huo et al. · 2021 [cited by applicant]
US 20220116636A1 · Kang et al. · 2022 [cited by applicant]
US 20220256179A1 · Huo et al. · 2022 [cited by applicant]
US 20220256180A1 · Huo et al. · 2022 [cited by applicant]
US 20220264132A1 · Huo et al. · 2022 [cited by applicant]
US 20220264133A1 · Huo et al. · 2022 [cited by applicant]
US 20220417517A1 · Choi et al. · 2022 [cited by applicant]
CN 101904173A · 2010 [cited by applicant]
CN 102845063A · 2012 [cited by applicant]
CN 103024378A · 2013 [cited by applicant]
CN 105284109A · 2016 [cited by applicant]
CN 107046645A · 2017 [cited by applicant]
CN 109716771A · 2019 [cited by applicant]
EP 3829167A1 · 2021 [cited by applicant]
JP 2014195142A · 2014 [cited by applicant]
JP 2022520295A · 2022 [cited by applicant]
RU 2594291C2 · 2016 [cited by applicant]
WO 2015005418A1 · 2015 [cited by applicant]
WO 2017214920A1 · 2017 [cited by applicant]
WO 2018039596A1 · 2018 [cited by applicant]
WO 2018118940A1 · 2018 [cited by applicant]
WO 2019147910A1 · 2019 [cited by applicant]
WO 2020131512A1 · 2020 [cited by applicant]
MDLM template down-sampling; Jan. 2019. (Year: 2019). [cited by examiner]
MDLM template down sampling; Hanhart; Jan. 2019. (Year: 2019). [cited by examiner]
Multi-directional LM (MDLM); Ma—Oct. 2018. (Year: 2018). [cited by examiner]
CCLM-MDLM using simplified coefficient derivation method; Ma—Oct. 2018. (Year: 2018). [cited by examiner]
Hearing Notice issued in corresponding IN application No. 202117030040 dated Dec. 12, 2023. (2 pages). [cited by applicant]
CCLM prediction with single-line neighboring luma samples; Zhang—Oct. 2018. (Year: 2018). [cited by applicant]
Communication pursuant to Article 94(3) EPC issued in corresponding EP application No. 19907160.6 dated Feb. 10, 2023. 6 pages. [cited by applicant]
Corrected Notice of Allowability issued Jul. 8, 2022 of U.S. Appl. No. 17/356,982, filed Jun. 24, 2021. [cited by applicant]
Corrected Notice of Allowance issued Jun. 2, 2022 of U.S. Appl. No. 17/356,982, filed Jun. 24, 2021. [cited by applicant]
Corrected Notice of Allowability issued Sep. 25, 2023 of U.S. Appl. No. 17/660,992, filed Apr. 27, 2022. [cited by applicant]
Decision to Grant issued in corresponding RU application No. 2021121547 dated Jun. 1, 2022. 20 pages with English Translation. [cited by applicant]
Extended European search report issued in corresponding European application No. 19907160.6 dated May 10, 2022. 9 pages. [cited by applicant]
First Examination Report issued in corresponding Indian application No. 202117030040 dated Mar. 4, 2022. 5 pages with English translation. [cited by applicant]
Hanhart, P., et al., Joint Video Experts Team {JVET) of IT'U-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting: Marrakech, MA Jan. 9-18, 2019—Document: JVET-M0146-v1—Non-CE3: MDLM template downsampling (4 pages). [cited by applicant]
International search report issued in corresponding international application No. PCT/CN2019/070147 dated Sep. 26, 2019. [cited by applicant]
Jangwon Choi et al, CE3-related : Reduced number of reference samples for CCLM parameter calculation, dated Oct. 3-12, 2018. 4 pages. [cited by applicant]
Kai Zhang et al, Enhanced Cross-component Linear Model Intra-prediction, dated Oct. 15-21, 2016. 13 pages. [cited by applicant]
Multi-directional LM; Ma—Oct. 2018. (Year: 2018). [cited by applicant]
Non-Final Office Action issued Feb. 28, 2023 of U.S. Appl. No. 17/660,917, filed Apr. 27, 2022. 26 pages. [cited by applicant]
Non-Final Office Action issued Mar. 1, 2023 of U.S. Appl. No. 17/660,970, filed Apr. 27, 2022. 26 pages. [cited by applicant]
Non-Final Office Action issued Mar. 2, 2023 of U.S. Appl. No. 17/660,992, filed Apr. 27, 2022. 26 pages. [cited by applicant]
Non-Final Office Action issued Oct. 13, 2021 of U.S. Appl. No. 17/356,982, filed Jun. 24, 2021. [cited by applicant]
Non-final rejection issued in corresponding U.S. Appl. No. 17/660,874 dated Mar. 2, 2023. 26 pages. [cited by applicant]
Notice of Allowability issued Sep. 12, 2023 of U.S. Appl. No. 17/660,992, filed Apr. 27, 2022. [cited by applicant]
Notice of Allowance issued Feb. 9, 2022 of U.S. Appl. No. 17/356,982, filed Jun. 24, 2021. [cited by applicant]
Notice of Allowance issued Sep. 5, 2023 of U.S. Appl. No. 17/660,992, filed Apr. 27, 2022. [cited by applicant]
Notice of reasons for refusal issued in corresponding JP application No. 2021-538695 dated Feb. 21, 2023. 8 pages with English translation. [cited by applicant]
Office Action issued in corresponding RU application No. 2021121547/07(045036) dated Jan. 24, 2022. 8 pages with English translation. [cited by applicant]
Reduced number of reference samples for CCLM parameter; Choi—Oct. 2017. (Year: 2017). [cited by applicant]
The First Office Action issued in corresponding CN application No. 202110714289.3 dated Jun. 20, 2022. 18 pages with English translation. [cited by applicant]
The second office action issued in corresponding CN application No. 202110714289.3 dated Nov. 11, 2022. 16 pages with English translation. [cited by applicant]
JP Notice of Allowance for Application No. 2021-538695 dated May 12, 2023 (8 pages with translation). [cited by applicant]
Choi, Jangwon , et al., “CE3-related: Reduced number of reference samples for CCLM parameter calculation”, 12. JVET Meeting; MACAO; JVET of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No. JVET-L0138-v3, Oct. 6, 2018., 5 pp. [cited by applicant]
Gisquet, Christophe , et al., “Non-CE6a: Border-adaptive subsampling for LM mode”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-H0176_r1, Feb. 3, 2012. 8 pages.,… [cited by applicant]
Hanhart, Philippe , et al., “Non-CE3: MDLM template downsampling”, (Interdigital) JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; 13th Meeting: Marrakech, MA; Jan. 9-18, 2019. 4 pages., 4 pp. [cited by applicant]
Examination Report issued in corresponding AU application No. 2019417996 dated Jun. 27, 2024. 4 pages. [cited by applicant]
Xiang Ma et al. “CE3: Multi-directional LM (Test 4.2.1, 4.2.2, 4.2.3, 4.2.4)” JVET-K0191, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018.… [cited by applicant]
Junyan Huo et al. “CE3-related: Fixed Reference Samples Design for CCLM” JVET-M0211-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. 7 … [cited by applicant]
Shuai Wan et al. “CE3-related: Improved reference samples range for MDLM” JVET-M0212-v3, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. 5… [cited by applicant]
Shuai Wan et al. “CE3: Reduced reference samples range for CCLM_L and CCLM_T(Tests 1.3.1, 1.3.2 and 1.3.3)” JVET-N0130-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting:… [cited by applicant]
Notice of reasons for refusal issued in corresponding JP application No. 2023-094669 dated Jul. 23, 2024. 6 pages with English translation. [cited by applicant]
Notice of reasons for refusal issued in corresponding JP application No. 2023-094850 dated Jul. 23, 2024. 6 pages with English translation. [cited by applicant]
Notice of reasons for refusal issued in corresponding JP application No. 2023-095568 dated Jul. 23, 2024. 11 pages with English translation. [cited by applicant]
Notice of Preliminary Rejection issued in corresponding KR application No. 10-2021-7021309 dated Jul. 15, 2024. 11 pages with English translation. [cited by applicant]
Xiang Ma et al. “CE3: Multi-directional LM (MDLM) (Test 5.4.1 and 5.4.2)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018. Document: JVET-L0338… [cited by applicant]
Philippe Hanhart & Yuwen He “Non-CE3: MDLM template downsampling” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. Document: JVET-M0146-v1.… [cited by applicant]
Examination report issued in corresponding AU application No. 2019417996 dated Oct. 21, 2024. 4 pages. [cited by applicant]
The extended European search report issued in corresponding EP application No. 24197591.1 dated Dec. 13, 2024. 12 pages. [cited by applicant]
Examination report No. 3 issued in corresponding AU application No. 2019417996 dated Jan. 28, 2025. 4 pages. [cited by applicant]