IP Library Granted Patent US 12,231,649
Granted Patent B2
US 12,231,649 · App. 17/958,420 · Granted Feb 18, 2025

Inter prediction method, encoder, decoder and storage medium

Inventors: Yanzhuo Ma (Guangdong, CN); Junyan Huo (Guangdong, CN); Shuai Wan (Guangdong, CN); Fuzheng Yang (Guangdong, CN); Qihong Ran (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/136H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,649
App. No.
17/958,420
Filed
Oct 2, 2022
Granted
Feb 18, 2025
Kind
B2
Examiner
BECK, LERON
Art Unit
2487
USPC
375/240.02
Abstract

Disclosed are an inter prediction method, encoder/decoder, and storage medium. The method includes: determining a prediction mode parameter of a current block; when the parameter indicates that a GPM is used for determining an inter prediction value of the current block, determining an angle and a distance corresponding to a dividing line in the current block, setting an angle index value and a distance index value to index serial numbers corresponding to the angle and the distance in a preset mapping table respectively; determining a value of shifting direction indicator of the current block, which is used for indicating shifting directions of different dividing lines of the current block at the angle, by using a preset model based on size information and the angle index value of the current block; performing inter prediction on the current block based on the value of shifting direction indicator and the distance index value.

Claims (61)

1. A method for inter prediction, applied to an encoder, comprising:

determining a prediction mode parameter of a current block;

when the prediction mode parameter indicates that a Geometrical Partitioning Mode (GPM) is used for determining an inter prediction value of the current block, determining a dividing angle and a distance in the current block, and setting an angle index value and a distance index value to index serial numbers corresponding to the angle and the distance in a preset mapping table respectively;

determining a value of a shifting direction indicator of the current block by using a preset model based on size information and the angle index value of the current block, wherein, the value of a shifting direction indicator is used for indicating shifting directions of different dividing lines of the current block at the angle; wherein the size information of the current block comprises a height and a width of the current block, and determining the value of a shifting direction indicator of the current block by using the preset model based on the size information and the angle index value of the current block comprises:

determining a first refinement value according to the angle index value;

obtaining a shifted height according to the first refinement value and the height of the current block;

obtaining a shifted width according to a preset offset value and the width of the current block; and

obtaining the value of the shifting direction indicator of the current block according to a size of the shifted height and a size of the shifted width; and

performing inter prediction on the current block based on the value of the shifting direction indicator and the distance index value.

2. The method of claim 1 , wherein determining the value of a shifting direction indicator of the current block by using the preset model based on the size information and the angle index value of the current block further comprises:

searching for a shifting indication value corresponding to the angle index value from a second look-up table based on the angle index value;

comparing a searched-out shifting indication value with a preset judgment result; and

obtaining the value of a shifting direction indicator of the current block according to a comparison result, wherein, the preset judgment result is obtained by judging whether a height of the current block is greater than a width of the current block.

3. The method of claim 1 , wherein determining the value of a shifting direction indicator of the current block by using the preset model the based on size information and the angle index value of the current block further comprises:

using the angle index value to perform modulo operation on a sixth preset value to obtain a modulus result;

comparing the modulus result with a seventh preset value; and

obtaining the value of a shifting direction indicator of the current block according to a result of comparison.

4. The method of claim 1 , further comprising:

determining that a shifting direction of a dividing line of the current block at the angle is a horizontal direction if the value of a shifting direction indicator is equal to 1; and

determining that a shifting direction of a dividing line of the current block at the angle is a vertical direction if the value of a shifting direction indicator is equal to 0.

5. The method of claim 1 , wherein when the prediction mode parameter indicates that the Geometrical Partitioning Mode (GPM) is used for determining the inter prediction value of the current block, the method further comprises:

determining a partition mode of the current block; and

determining the index value of the partition mode to be an index serial number corresponding to the partition mode in the preset mapping table and signaling the index value in a bitstream, wherein, the preset mapping table is used for determining a relationship between a partition mode index value, an angle index value and a distance index.

6. The method of claim 1 , wherein performing inter prediction on the current block based on the value of a shifting direction indicator and the distance index value, comprises:

determining a target dividing line and offset information of the current block based on the value of a shifting direction indicator and the distance index value;

determining a first prediction value of a first partition of the current block and a second prediction value of a second partition of the current block based on division of the current block by the target dividing line;

calculating a weight matrix of the current block according to the offset information; and

weighting pixel points in the current block using the first prediction value, the second prediction value and the weight matrix to obtain an inter prediction value of the current block.

7. A method for inter prediction, applied to a decoder, comprising:

decoding a bitstream to obtain a prediction mode parameter of a current block;

when the prediction mode parameter indicates that a Geometrical Partition Mode (GPM) is used for determining an inter prediction value of the current block, determining an angle index value and a distance index value, wherein, the angle index value and the distance index value represent index serial numbers corresponding to a dividing angle and a distance in the current block in a preset mapping table;

determining a value of a shifting direction indicator of the current block by using a preset model based on size information and the angle index value of the current block, wherein, the value of a shifting direction indicator is used for indicating shifting directions of different dividing lines of the current block at the angle; wherein the size information of the current block comprises a height and a width of the current block, and determining the value of a shifting direction indicator of the current block by using a preset model based on the size information and the angle index value of the current block comprises:

determining a first refinement value according to the angle index value;

obtaining a shifted height according to the first refinement value and the height of the current block;

obtaining a shifted width according to a preset offset value and the width of the current block; and

obtaining the value of the shifting direction indicator of the current block according to a size of the shifted height and a size of the shifted width; and

determining the inter prediction value of the current block based on the value of the shifting direction indicator and the distance index value.

8. The method of claim 7 , wherein when the prediction Mode parameter indicates that the Geometrical Partition Mode (GPM) is used for determining the inter prediction value of the current block, the method further comprises:

decoding a bitstream to obtain a partition mode index value of the current block;

determining the angle index value and the distance index value comprises:

inquiring an angle index value and a distance index value corresponding to the partition mode index value from a preset mapping table based on the partition mode index value, wherein, the preset mapping table is used for determining a relationship between the partition mode index value, the angle index value and the distance index; and

determining the inquired angle index value and distance index value as the angle index value and the distance index value.

9. The method of claim 7 , wherein determining the value of a shifting direction indicator of the current block by using the preset model based on the size information and the angle index value of the current block further comprises:

searching for a shifting indication value corresponding to the angle index value from a second look-up table based on the angle index value;

comparing a searched-out shifting indication value with a preset judgment result; and

obtaining the value of a shifting direction indicator of the current block according to a comparison result, wherein, the preset judgment result is obtained by judging whether a height of the current block is greater than a width of the current block.

10. The method of claim 7 , wherein determining the value of a shifting direction indicator of the current block by using the preset model based on the size information and the angle index value of the current block further comprises:

using the angle index value to perform modulo operation on a sixth preset value to obtain a modulus result;

comparing the modulus result with a seventh preset value; and

obtaining the value of a shifting direction indicator of the current block according to a result of comparison.

11. The method of claim 7 , further comprising:

determining that a shifting direction of a dividing line of the current block at the angle is a horizontal direction if the value of a shifting direction indicator is equal to 1; and

determining that a shifting direction of a dividing line of the current block at the angle is a vertical direction if the value of a shifting direction indicator is equal to 0.

12. The method of claim 7 , wherein determining the inter prediction value of the current block based on the value of a shifting direction indicator and the distance index value, comprises:

determining a target dividing line and offset information of the current block based on the value of a shifting direction indicator and the distance index value;

determining a first prediction value of a first partition of the current block and a second prediction value of a second partition of the current block based on division of the current block by the target dividing line;

calculating a weight matrix of the current block according to the offset information; and

weighting pixel points in the current block using the first prediction value, the second prediction value and the weight matrix to obtain an inter prediction value of the current block.

13. A decoder comprising a second memory and a second processor, wherein

the second memory is configured to store a computer program runnable on the second processor; and

the second processor is configured to perform the method of claim 7 when running the computer program.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2022
From: MA, YANZHUO; HUO, JUNYAN; WAN, SHUAI; YANG, FUZHENG; RAN, QIHONG
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 061292/0335 →
Continuity (2)
Continuation PCTCN2020083356 · Apr 3, 2020
Related Publication 20230080546A1 · Mar 16, 2023
References Cited (18)
US 9736454B2 · Hannuksela et al. · 2017 [cited by applicant]
US 20150189272A1 · Peng et al. · 2015 [cited by applicant]
US 20210051335A1 · Liao · 2021 [cited by examiner]
US 20210144374A1 · Esenlik · 2021 [cited by examiner]
CN 101822056B · 2013 [cited by applicant]
CN 102763415B · 2015 [cited by applicant]
CN 108293132A · 2018 [cited by applicant]
TW 202007161A · 2020 [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q0339-r1, CE4-related: Adjustment of the distance on the GEO mode, Jan. 7-17, 2020. (9 pages). [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q2001-vD, Versatile Video Coding (Draft 8), Jan. 7-17, 2020. (509 pages). [cited by applicant]
Extended European Search Report for EP Application 20928250.8 mailed Mar. 30, 2023. (8 pages). [cited by applicant]
Huawei Technologies Co., Ltd, RWTH Aachen University; Non-CE4: Geometrical partitioning for inter blocks; Joint Video Experts Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; JVET-00489 v4; Jul. 3-12, 2019. (9 pa… [cited by applicant]
Huawei Technologies Co., Ltd, RWTH Aachen University; CE4: CE4-1.1, CE4-1.2 and CE4-1.14: Geometric Merge Mode (GEO); Joint Video Experts Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; JVET-P0068-v2; Oct. 1-11,… [cited by applicant]
MediaTek Inc.; CE4-related: Reducing GEO modes; Joint Video Experts Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; JVET-Q0189-v2; Jan. 7-17, 2020. (6 pages). [cited by applicant]
Editors; Versatile Video Coding (Draft 8); Joint Video Experts Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11; JVET-Q2001-v8; Jan. 7-17, 2020. (501 pages). [cited by applicant]
International Search Report and Written Opinion with English Translation for PCT Application PCT/CN2020/083356 mailed Jan. 4, 2021. (14 pages). [cited by applicant]
Versatile video coding; Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video; Recommendation ITU-T H.266; Aug. 2020. (516 pages). [cited by applicant]
Taiwan First Office Action with English translation for TW Application No. 110109406, mailed May 7, 2024, 14 pages. [cited by applicant]
Cited By (1)
US 12,666,071