IP Library › Granted Patent US 12,301,857
Granted Patent B2
US 12,301,857 · App. 17/716,410 · Granted May 13, 2025

Method and apparatus of harmonizing triangular merge mode with weighted prediction

Inventors: Huanbang Chen (Shenzhen, CN); Haitao Yang (Shenzhen, CN); Alexey Konstantinovich Filippov (Moscow, RU); Vasily Alexeevich Rufitskiy (Moscow, RU)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/503H04N19/105H04N19/109H04N19/136H04N19/174H04N19/176H04N19/186H04N19/119H04N19/126H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,857
App. No.
17/716,410
Granted
May 13, 2025
Kind
B2
Abstract

The present disclosure relates to moving picture processing, and in particular, to cases where non-rectangular partitioning modes are used for inter-prediction in a combination with weighted prediction (WP) for coding fades. Non-rectangular modes refer to those inter-prediction modes, in which case a current block is partitioned/sliced in a non-rectangular way (slices). Such modes may be triangular (TMP) or geometric (GEO) prediction. The aim of the disclosure is to harmonize non-rectangular partitioning modes with WP by way of disabling TMP/GEO when WP is applied. This may be accomplished by checking whether all reference pictures for a current slice are disabled, and if this is the case to disable the slice-level WP for non-rectangular prediction units. Whether the reference pictures are disabled may be determined based on conditions applied on set values, for example, of luma/chroma flags, which refer to the reference pictures.

Claims (31)

1. An inter prediction method, comprising:

determining whether reference pictures in a preset reference picture set of a current slice are disabled for a slice-level weighted prediction of the current slice;

determining that non-rectangular prediction units for the current slice are disabled for the slice-level weighted prediction, when the reference pictures are determined to be disabled; and

predicting the current slice in accordance with a determination result.

2. The method of claim 1 , wherein the disabling of the reference pictures is indicated by one or more flags.

3. The method of claim 2 , wherein the one or more flags include at least one of one or more luma-weighted flags or one or more chroma-weighted flags.

4. The method of claim 3 , wherein the one or more luma-weighted flags and the one or more chroma-weighted flags each refer to a list0 and a list1 of the reference pictures, wherein the list0 includes reference pictures of a first predictor P 0 of the current slice and the list1 includes reference pictures of a second predictor P 1 of the current slice.

5. The method of claim 4 , wherein the disabling of the reference pictures is indicated when all the following conditions are true:

the luma-weighted flags of the list0 are 0;

the luma-weighted flags of the list1 are 0;

the chroma-weighted flags of the list0 are 0; and

the chroma-weighted flags of the list1 are 0.

6. The method of claim 1 , wherein the slice-level weighted prediction is enabled in the event that any one of the reference pictures is enabled for the weighted prediction.

7. The method according to claim 6 , wherein the slice-level weighted prediction is a triangle prediction mode (TPM) or a geometric prediction mode (GEO).

8. An inter prediction method, comprising:

parsing an indicator from a bitstream corresponding to a current slice;

determining whether a slice-level weighted prediction for non-rectangular prediction units of the current slice is enabled for the current slice according to a value of the indicator; and

predicting the current slice in accordance with a determination result.

9. The method of claim 8 , wherein the indicator is a flag.

10. The method of claim 9 , wherein the flag is based on a type of the current slice.

11. The method of claim 8 , wherein the slice-level weighted prediction is determined to be enabled when the value is a first value.

12. The method of claim 11 , wherein the slice-level weighted prediction is disabled when the value is a second value different from the first value.

13. The method according to claim 8 , wherein the slice-level weighted prediction is a non-rectangular prediction mode.

14. The method according to claim 13 , wherein the non-rectangular prediction mode is a triangle prediction mode (TPM) or a geometric prediction mode (GEO).

15. An inter prediction method, comprising:

determining whether weighing factors of reference pictures of a current block are carried by a bitstream when the current block is processed by a sub-block based prediction mode for non-rectangular prediction units of the current block; and

obtaining a prediction value of the current block by blending weighted parameters when the weighing factors are not carried by the bitstream.

16. The method of claim 15 , further comprising:

obtaining the prediction value of the current block according to the weighing factors when the weighing factors are carried by the bitstream.

17. The method of claim 15 , wherein the sub-block based prediction mode is a non-rectangular prediction mode.

18. The method of claim 17 , wherein the non-rectangular prediction mode comprises a triangle prediction mode (TPM) or a geometric prediction mode (GEO).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2025
From: CHEN, HUANBANG; YANG, HAITAO; FILIPPOV, ALEXEY KONSTANTINOVICH; RUFITSKIY, VASILY ALEXEEVICH
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 070128/0106 →
Continuity (4)
Continuation PCTCN2020120027 · Oct 9, 2020
Provisional Application 62913711 · Oct 10, 2019
Provisional Application 62913219 · Oct 10, 2019
Related Publication 20220248044A1 · Aug 4, 2022
References Cited (20)
US 20150189323A1 · An et al. · 2015 [cited by applicant]
US 20160255359A1 · Yu · 2016 [cited by examiner]
US 20230353723A1 · Sun · 2023 [cited by examiner]
CN 108702516A · 2018 [cited by applicant]
CN 109076235A · 2018 [cited by applicant]
WO 2021061027A1 · 2021 [cited by applicant]
Document: JVET-M0328_v4, Fangdong Chen et al, CE10-related: Simplified Triangle Prediction Unit Mode, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. … [cited by applicant]
Rui Zhang et al, Accurate Parameter Estimation and Efficient Fade Detection for Weighted Prediciton in H.264 Video Compression, 2008 IEEE, 4 pages. [cited by applicant]
Document: JVET-N0646-v3, Chun-Chi Chen et al, Non-CE4/8: Combination of Blending-off Switch (JVET-00645) and Simplified Motion Storage (JVET-00411) for TPM Mode, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and I… [cited by applicant]
Jill M. Boyce, Weighted Prediction in the H.264/MPEG AVC Video Coding Standard, 2004 IEEE, 4 pages. [cited by applicant]
Athanasios Leontaris et al, Weighted prediction methods for improved motion compensation, 2009 16th IEEE International Conference on Image Processing (ICIP), 4 pages. [cited by applicant]
Document: JVET-L0124-v2, Ru-Ling Liao et al, CE10.3.1.b: Triangular prediction unit mode, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, … [cited by applicant]
Document: JVET-O0244-v1, Vadim Seregin et al, AHG17: On zero delta POC in reference picture structure, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul… [cited by applicant]
Document: JVET- O0489-v4, Semih Esenlik et al, Non-CE4: Geometrical partitioning for inter blocks, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-… [cited by applicant]
ITU-T H.264(Jun. 2019), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services-Coding of moving video, Advanced video coding for generic audiovisual services, total 836 pages. [cited by applicant]
ITU-T H.265(Jun. 2019), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, total 696 pages. [cited by applicant]
Filippov, et al. (Huawei), “On TPM and GEO merge modes in presence of weighted prediction,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting, Brussels, BE; Jan. 7-17, 2020,… [cited by applicant]
Chen, et al., (Qualcomm), “Non-CE4/8: Blending-off Switch for TPM Mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-17, 2019, Document No. JVE… [cited by applicant]
Alexey Filippov et al., “On TPM and GEO merge modes in presence of weighted prediction”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, JV… [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of Itu-T Sg 16 WP 3 and Iso/Iec Jtc 1/SC 29/WG 11,15th Meeting: Gothenburg, SE, Jul. 3 - 12, 2019, JVET-O2001-vE; 455 total page… [cited by applicant]