IP Library › Granted Patent US 12,335,489
Granted Patent B2
US 12,335,489 · App. 17/703,006 · Granted Jun 17, 2025

Method and apparatus of simplified geometric merge mode for inter prediction

Inventors: Alexey Konstantinovich Filippov (Moscow, RU); Vasily Alexeevich Rufitskiy (Moscow, RU); Semih Esenlik (Munich, DE); Han Gao (Shenzhen, CN); Elena Alexandrovna Alshina (Munich, DE)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/159H04N19/119H04N19/176H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,489
App. No.
17/703,006
Granted
Jun 17, 2025
Kind
B2
Abstract

A method includes: obtaining one or more parameters of a geometric merge (GEO) inter prediction mode for a current coding block; defining a size of a subblock that is smaller than a size of the current coding block; specifying a position of the subblock within the current coding block, so that either two or three sides of the subblock coincide with sides of the current coding block; determining one or more allowed split directions of a triangle partitioning mode (TPM) for the subblock depending on which of the sides of the subblock coincide with the sides of the current coding block; and obtaining one or more predicted samples for the current coding block by using the TPM partitioning performed for the subblock in accordance with the size of the subblock, the position of the subblock within the current coding block and a TPM split direction of the subblock.

Claims (51)

1. A computer-implemented method of inter-prediction, the method comprising:

obtaining one or more parameters of a geometric merge (GEO) inter prediction mode for a current coding block;

defining a size of a subblock that is smaller than a size of the current coding block;

specifying a position of the subblock within the current coding block, so that either two or three sides of the subblock coincide with sides of the current coding block;

determining one or more allowed split directions of a triangle partitioning mode (TPM) for the subblock depending on which of the sides of the subblock coincide with the sides of the current coding block; and

obtaining one or more predicted samples for the current coding block by using the TPM partitioning performed for the subblock in accordance with the size of the subblock, the position of the subblock within the current coding block and a TPM split direction of the subblock.

2. The computer-implemented method according to claim 1 , wherein obtaining the one or more predicted samples further comprises:

setting weights at positions of samples belonging to a subblock area equal to a corresponding weight of the TPM partitioning specified for the subblock; and

setting the weights at positions of samples that do not belong to a subblock area equal to a constant value V.

3. The computer-implemented method according to claim 2 , wherein the constant value V depends on the coinciding sides of the current coding block and the subblock and the subblock split direction.

4. The computer-implemented method according to claim 1 , wherein, after determining the one or more allowed split directions and before obtaining the one or more predicted samples, the method further comprises selecting one of the allowed split directions as a split direction for obtaining the one or more predicted samples.

5. The computer-implemented method according to claim 4 , wherein the selecting comprises determining whether there is more than one allowed split direction and, if there is more than one allowed split direction, selecting one of the allowed split directions for obtaining the one or more predicted samples.

6. The computer-implemented method according to claim 1 , wherein the one or more parameters of the GEO inter prediction mode comprise at least one of: an angle parameter, a width W and/or a height H of the current coding block, or a sample distance value that is determined using an aspect ratio, nCbR.

7. The computer-implemented method according to claim 6 , wherein the aspect ratio is determined from dimensions of the current coding block by

nCbR

=

W

H

.

8. The computer-implemented method according to claim 6 , wherein the aspect ratio is determined from dimensions of the subblock,

nCbR

=

nCbH

nCbW

,

wherein nCbH is a height of the subblock and nCbW is a width of the subblock.

9. The computer-implemented method according to claim 8 , wherein the height of the subblock nCbH=2 p pixels and the width of the subblock nCbW=2 q pixels, with q, p∈N.

10. The computer-implemented method according to claim 1 , wherein two opposite sides of the subblock coincide with two opposite sides of the current coding block.

11. The computer-implemented method according to claim 10 , wherein a length of a opposite sides of the subblock is shorter than a length of two opposite sides of the current coding block.

12. The computer-implemented method according to claim 1 , wherein two adjacent sides of the subblock coincide with two adjacent sides of the current coding block.

13. The computer-implemented method according to claim 12 , wherein a length of at least one of the two adjacent sides of the subblock is shorter than a length of the corresponding side of the current coding block.

14. The computer-implemented method according to claim 1 , wherein a center of the subblock coincides with a center of the current coding block or wherein the center of the subblock does not coincide with the center of the current coding block.

15. A decoder comprising:

one or more processors; and

a non-transitory computer-readable storage medium coupled to the one or more processors and storing programming for execution by the one or more processors, wherein the programming, when executed by the one or more processors, configures the decoder to perform operations comprising:

obtaining one or more parameters of a geometric merge (GEO) inter prediction mode for a current coding block;

defining a size of a subblock that is smaller than a size of the current coding block; specifying a position of the subblock within the current coding block, so that either two or three sides of the subblock coincide with sides of the current coding block;

determining one or more allowed split directions of a triangle partitioning mode (TPM) for the subblock depending on which of the sides of the subblock coincide with the sides of the current coding block; and

obtaining one or more predicted samples for the current coding block by using the TPM partitioning performed for the subblock in accordance with the size of the subblock, the position of the subblock within the current coding block and a TPM split direction of the subblock.

16. The decoder according to claim 15 , wherein obtaining predicted samples further comprises:

setting weights at positions of samples belonging to a subblock area equal to a corresponding weight of the TPM partitioning specified for the subblock; and

setting the weights at positions of samples that do not belong to a subblock area equal to a constant value V.

17. The decoder according to claim 16 , wherein the constant value V depends on the coinciding sides of the current coding block and the subblock and the subblock split direction.

18. The decoder according to claim 15 , wherein, after determining the one or more allowed split directions and before obtaining the one or more predicted samples, the operations further comprise selecting one of the allowed split directions a split direction for obtaining the one or more predicted samples.

19. The decoder according to claim 18 , wherein the selecting comprises determining whether there is more than one allowed split direction and, if there is more than one allowed split direction, selecting one of the allowed split directions for obtaining the one or more predicted samples.

20. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations, the operations comprising:

obtaining one or more parameters of a geometric merge (GEO) inter prediction mode for a current coding block;

defining a size of a subblock that is smaller than a size of the current coding block;

specifying a position of the subblock within the current coding block, so that either two or three sides of the subblock coincide with sides of the current coding block;

determining one or more allowed split directions of a triangle partitioning mode (TPM) for the subblock depending on which of the sides of the subblock coincide with the sides of the current coding block; and

obtaining one or more predicted samples for the current coding block by using the TPM partitioning performed for the subblock in accordance with the size of the subblock, the position of the subblock within the current coding block and a TPM split direction of the subblock.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2025
From: FILIPPOV, ALEXEY KONSTANTINOVICH; RUFITSKIY, VASILY ALEXEEVICH; ESENLIK, SEMIH; GAO, HAN; ALSHINA, ELENA ALEXANDROVNA
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 070423/0808 →
Priority Claims (1)
WO PCT/RU2019/000674 · Sep 25, 2019 · international
Continuity (2)
Continuation PCTRU2020050247 · Sep 25, 2020
Related Publication 20220232226A1 · Jul 21, 2022
References Cited (15)
US 11233996B2 · Nam · 2022 [cited by examiner]
US 20130272418A1 · Jeon et al. · 2013 [cited by applicant]
US 20140286428A1 · Lee et al. · 2014 [cited by applicant]
US 20160309169A1 · Winken et al. · 2016 [cited by applicant]
US 20160373780A1 · Hsu et al. · 2016 [cited by applicant]
US 20220210460A1 · Deng · 2022 [cited by examiner]
EP 4029249A2 · 2022 [cited by applicant]
WO 2019039322A1 · 2019 [cited by applicant]
WO 2019083334A1 · 2019 [cited by applicant]
WO 2019164031A1 · 2019 [cited by applicant]
Document: JVET-L1001-v2, Benjamin Bross et al., Versatile Video Coding (Draft 3), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 168 pages. [cited by applicant]
ITU-T H.264(Jun. 2019), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, 836 pages. [cited by applicant]
ITU-T H.265(Jun. 2019), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, 696 pages. [cited by applicant]
Liang Zhao et al., “CE3-related: Unification of angular intra prediction for square and non-square blocks”, Document: JVET-L0279, total:Joint Video ExPerts Team(JVET) of ITU TSG16WP3andISOIIECJTCI/S C29IWGII 12th Meetin… [cited by applicant]
Han Cao et al., “CE4: CE4-1.1, CE4-1.2 and CE4-1.14: Geometric Merge Mode (GEO)”,Document: JVET-P0068-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, 1 Oc… [cited by applicant]