IP Library Granted Patent US 12,192,479
Granted Patent B2
US 12,192,479 · App. 17/382,932 · Granted Jan 7, 2025

Picture encoding method, picture decoding method, encoder, decoder and storage medium

Inventors: Shuai Wan (Guangdong, CN); Junyan Huo (Guangdong, CN); Yanzhuo Ma (Guangdong, CN); Fuzheng Yang (Guangdong, CN); Jinkun Guo (Guangdong, CN); Haixin Wang (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/159G06F5/01H04N19/172H04N19/184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,479
App. No.
17/382,932
Granted
Jan 7, 2025
Kind
B2
Abstract

Picture coding and decoding methods, an encoder, a decoder and a storage medium are provided. The encoder, before performing coding processing according to a matrix-based intra prediction (MIP) mode, sets initial right shift parameters corresponding to different sizes and different MIP mode numbers as an uniform offset parameter, the offset parameter indicating a number of right shifting bits of a predicted value, and when performing coding processing according to the MIP mode, performs coding processing according to the offset parameter. The decoder, before performing decoding processing according to an MIP mode, sets initial right shift parameters corresponding to different sizes and different MIP mode numbers as an uniform offset parameter, the offset parameter indicating a number of right shifting bits of a predicted value, and when performing decoding processing according to the MIP mode, performs decoding processing according to the offset parameter.

Claims (34)

1. A picture coding method, applied to an encoder and comprising:

determining a mode parameter of a current block; and

in response to a determination that the mode parameter indicates that a prediction value of the current block is determined according to a matrix-based intra prediction (MIP) mode, performing prediction on the current block according to the MIP mode based on an initial right shift parameter, wherein the initial right shift parameter is a uniform offset parameter, and the offset parameter indicates a number of right shifting bits of the prediction value, wherein the offset parameter is set to be 6.

2. The method of claim 1 , further comprising:

determining initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter.

3. The method of claim 2 , wherein determining the initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter comprises:

when one of initial right shift parameters is different from the offset parameter, modifying the initial right shift parameter to the offset parameter, to enable the numbers of right shifting bits of all prediction values corresponding to all sizes and all MIP mode numbers to be the same.

4. The method of claim 2 , wherein after determining the initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter, further comprising:

modifying an initial weight matrix and an initial bias matrix according to a preset calculation rule to obtain a modified weight matrix and a modified bias matrix, the initial weight matrix and the initial bias matrix corresponding to an initial right shift parameter subjected to unification modification; and

performing prediction on the current block according to the offset parameter, the modified weight matrix and the modified bias matrix.

5. The method of claim 2 , wherein after determining the initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter, further comprising:

performing prediction on the current block according to the offset parameter, an initial weight matrix and an initial bias matrix.

6. A picture decoding method, applied to a decoder and comprising:

determining a mode parameter of a current block; and

in response to a determination that the mode parameter indicates that a prediction value of the current block is determined according to a matrix-based intra prediction (MIP) mode, performing prediction on the current block according to the MIP mode based on an initial right shift parameter, wherein the initial right shift parameter is an uniform offset parameter, and the offset parameter indicates a number of right shifting bits of the prediction value, wherein the offset parameter is set to be 6.

7. The method of claim 6 , further comprising:

determining initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter.

8. The method of claim 7 , wherein determining the initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter comprises:

when one of the initial right shift parameters is different from the offset parameter, modifying the initial right shift parameter to the offset parameter, to enable the numbers of right shifting bits of all prediction values corresponding to all sizes and all MIP mode numbers to be the same.

9. The method of claim 7 , wherein after determining the initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter, further comprising:

modifying an initial weight matrix and an initial bias matrix according to a preset calculation rule to obtain a modified weight matrix and a modified bias matrix, the initial weight matrix and the initial bias matrix corresponding to an initial right shift parameter subjected to unification modification; and

performing prediction on the current block according to the offset parameter, the modified weight matrix and the modified bias matrix.

10. The method of claim 7 , wherein after determining the initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter, further comprising:

performing prediction on the current block according to the offset parameter, an initial weight matrix and an initial bias matrix.

11. A decoder, comprising a processor, a memory storing an instruction executable for the processor, a communication interface and a bus configured to connect the processor, the memory and the communication interface, wherein the processor is configured to perform, when running the instruction, operations of:

determining a mode parameter of a current block; and

in response to a determination that the mode parameter indicates that a prediction value of the current block is determined according to a matrix-based intra prediction (MIP) mode, performing prediction on the current block according to the MIP mode based on an initial right shift parameter, wherein the initial right shift parameter is an uniform offset parameter, and the offset parameter indicates a number of right shifting bits of the prediction value, wherein the offset parameter is set to be 6.

12. The decoder of claim 11 , wherein the processor is configured to:

determine initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter.

13. The decoder of claim 12 , wherein the processor is configured to:

when one of the initial right shift parameters is different from the offset parameter, modify the initial right shift parameter to the offset parameter, to enable the numbers of right shifting bits of all prediction values corresponding to all sizes and all MIP mode numbers to be the same.

14. The decoder of claim 12 , wherein the processor is configured to: after determining the initial right shift parameters corresponding to MIP mode numbers as the uniform offset parameter,

modify an initial weight matrix and an initial bias matrix according to a preset calculation rule to obtain a modified weight matrix and a modified bias matrix, the initial weight matrix and the initial bias matrix corresponding to an initial right shift parameter subjected to unification modification; and

perform prediction on the current block according to the offset parameter, the modified weight matrix and the modified bias matrix.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2021
From: WAN, SHUAI; HUO, JUNYAN; MA, YANZHUO; YANG, FUZHENG; GUO, JINKUN; WANG, HAIXIN
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 056948/0926 →
Continuity (3)
Continuation 17211636 · Mar 24, 2021
Continuation PCTCN2019092689 · Jun 25, 2019
Related Publication 20210352298A1 · Nov 11, 2021
References Cited (65)
US 10104374B2 · He et al. · 2018 [cited by applicant]
US 11146798B2 · Wan · 2021 [cited by examiner]
US 20120163473A1 · Laroche et al. · 2012 [cited by applicant]
US 20130259120A1 · Van et al. · 2013 [cited by applicant]
US 20160373770A1 · Zhao et al. · 2016 [cited by applicant]
US 20180020223A1 · King · 2018 [cited by applicant]
US 20190037213A1 · Hermansson et al. · 2019 [cited by applicant]
US 20200389661A1 · Zhao et al. · 2020 [cited by applicant]
US 20200396455A1 · Liu et al. · 2020 [cited by applicant]
US 20200396459A1 · Lin et al. · 2020 [cited by applicant]
US 20220103813A1 · Pfaff · 2022 [cited by examiner]
US 20220141453A1 · Huo · 2022 [cited by applicant]
US 20220182603A1 · Lee · 2022 [cited by examiner]
CN 1973547A · 2007 [cited by applicant]
CN 101771867A · 2010 [cited by applicant]
CN 104702959A · 2015 [cited by applicant]
CN 105874793A · 2016 [cited by applicant]
CN 107071417A · 2017 [cited by applicant]
CN 107743705A · 2018 [cited by applicant]
CN 108781283A · 2018 [cited by applicant]
CN 109792520A · 2019 [cited by applicant]
GB 201118705 · 2011 [cited by applicant]
JP 2000092331A1 · 2000 [cited by applicant]
KR 20110065116A · 2011 [cited by applicant]
RU 2658812C2 · 2018 [cited by applicant]
WO 2016205712A1 · 2016 [cited by applicant]
WO 2017123133A1 · 2017 [cited by applicant]
WO 2020207491A1 · 2020 [cited by applicant]
WO 2020210489A1 · 2020 [cited by applicant]
WO 2020246806A1 · 2020 [cited by applicant]
WO 2020255769A1 · 2020 [cited by applicant]
First Office Action of the Canadian application No. 3112849, issued on Apr. 11, 2022. 5 pages. [cited by applicant]
First Office Action of the European application No. 19935158.6, issued on Jan. 31, 2022. 4 pages. [cited by applicant]
First Office Action of the Indian application No. 202127015692, issued on Feb. 4, 2022. 7 pages with English translation. [cited by applicant]
Notice of Allowance of the Chinese application No. 202110310256.2, issued on Apr. 20, 2022. 7 pages with English translation. [cited by applicant]
USPTO, Corrected Notice of Allowability for U.S. Appl. No. 17/211,636. Mail Date: Sep. 8, 2021. 6 pages. [cited by applicant]
Written Opinion of the International Search Authority in the international application No. PCT/CN2019/092689, mailed on Mar. 25, 2020. 6 pages with English translation. [cited by applicant]
Biatek et al. “Non-CE3: MIP low resolution clipping”, JVET-00168-v2, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019. 7 pages. [cited by applicant]
Second Office Action of the European application No. 19935158.6, issued on May 13, 2022. 5 pages. [cited by applicant]
First Office Action of the Russian application No. 2021111540, issued on Sep. 19, 2022. 11 pages with English translation. [cited by applicant]
Junyan Huo et al., “Non-CE3: Unification of shifting for MIP mode”, JVET-O0323 v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 4 pages. [cited by applicant]
First Office Action of the Japanese application No. 2021-568185, issued on Jun. 16, 2023. 12 pages with English translation. [cited by applicant]
First Office Action of the Israeli application No. 281400, issued on Jun. 27, 2023. 4 pages. [cited by applicant]
Supplementary European Search Report in the European application No. 23170496.6, mailed on Jul. 14, 2023. 9 pages. [cited by applicant]
First Office Action of the Indonesian application No. P00202102696, issued on Sep. 13, 2023. 3 pages with English translation. [cited by applicant]
Second Office Action of the Japanese application No. 2021-568185, issued on Nov. 10, 2023. 6 pages with English translation. [cited by applicant]
International Search Report in the international application No. PCT/CN2019/092689, mailed on Mar. 25, 2020. [cited by applicant]
PFAFF, Jonathan et al. “CE3: Affine linear weighted intra prediction (CE3-4.1, CE3-4.2)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19, 2019 (Mar. 19… [cited by applicant]
Bross, Benjamin. “Versatile Video Coding (Draft 5)” Joint Video Experts Team(JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19, 2019 (Mar. 19, 2019), section 8.4.5.2.1. [cited by applicant]
Chen, JianLe. “Algorithm description for Versatile Video Coding and Test Model 5 (VTM 5)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19, 2019 (Mar. 1… [cited by applicant]
PFAFF (Fraunhofer) J et al: “8-bitmplementation and simplification of MIP”, 15. JVET Meeting: Jul. 3, 2019-Jul. 12, 2019: Othenburg; (The Joint Video Explorationteam of ISO/IEC JTC1/SC29/WG11 and ITU-TSG.16), No. JVET-0… [cited by applicant]
PFAFF (Fraunhofer) J et al.: “CE3: Affinelinear weighted intra prediction (test 1.2.1, test 1.2.2)”, 13. JVET Meeting; Jan. 9, 2019-Jan. 18, 2019: Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 a… [cited by applicant]
Supplementary European Search Report in the European application No. 19935158.6, mailed on May 19, 2021. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/211,636, issued on May 21, 2021. [cited by applicant]
First Office Action of the Israeli application No. 309549, issued on Jun. 5, 2024. 4 pages with English translation. [cited by applicant]
Jianbin Zhou et al., “Angular Intra Prediction Based Measurement Coding Algorithm for Compressively Sensed Image”, 2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Jul. 23-27, 2018, DOI: 10.110… [cited by applicant]
Myounghoon Kim et al., “Efficient Transform Domain Transcoding: Intra Frame of H.264/AVC to JPEG”, IEEE Transactions on Consumer Electronics, vol. 57, No. 3, Aug. 2011, the whole document. 8 pages. [cited by applicant]
Ziyuan Geng, “Improved Fast Mode Decision Algorithms Based on HEVC Screen Content Coding”, Beijing University of Posts and Telecommunications, Dec. 1, 2017, the whole document. 106 pages with English translation. [cited by applicant]
First Office Action of the Chinese application No. 202210766458.2, issued on Aug. 15, 2024. 12 pages with English translation. [cited by applicant]
First Written Opinion of the Singaporean application No. 11202102562W, issued on Mar. 6, 2024. 9 pages. [cited by applicant]
First Office Action of the Mexican application No. MX/a/2021/004541, issued on Apr. 17, 2024. 8 pages with English translation. [cited by applicant]
First Office Action of the Malaysian application No. PI2021001408, issued on Oct. 18, 2024. 5 pages. [cited by applicant]
Second Office Action of the Israeli application No. 309549, issued on Nov. 7, 2024. 3 pages. [cited by applicant]
First Office Action of the Australian application No. 2019455073, issued on Nov. 13, 2024. 3 pages. [cited by applicant]
First Office Action of the Japanese application No. 2024-030632, issued on Nov. 15, 2024. 6 pages with English translation. [cited by applicant]