IP Library › Granted Patent US 12,301,790
Granted Patent B2
US 12,301,790 · App. 17/718,011 · Granted May 13, 2025

Methods and apparatuses for video coding using triangle partition

Inventors: Xianglin Wang (San Diego, CA); Yi-Wen Chen (San Diego, CA); Xiaoyu Xiu (San Diego, CA); Tsung-Chuan Ma (San Diego, CA); Hong-Jheng Jhu (Beijing, CN); Bing Yu (Beijing, CN)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/105H04N19/119H04N19/13H04N19/139H04N19/172H04N19/46H04N19/52H04N19/573H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,790
App. No.
17/718,011
Granted
May 13, 2025
Kind
B2
Abstract

Methods and apparatuses are provided for video coding. The method includes: partitioning video pictures into a plurality of CUs, at least one CU is further partitioned into two PUs including at least one geometric shaped PU; constructing a first merge list including a plurality of candidates, each candidate being a MV including a List 0 MV, or a List 1 MV; locating a first candidate for the first PU and a second candidate for the second PU according to a first index and a second index, respectively; obtaining a first uni-prediction MV for the first PU by selecting a List X1 MV of the first candidate according to a first binary reference list indication flag; and obtaining a second uni-prediction MV for the second PU by selecting a List X2 MV of the second candidate according to a second binary reference list indication flag.

Claims (48)

1. A method for video decoding with geometric partition, comprising:

obtaining video pictures, wherein the video pictures are partitioned into a plurality of coding units (CUs), wherein at least one of the plurality of CUs is partitioned into two prediction units (PUs) comprising a first PU and a second PU, wherein the two PUs comprise at least one geometric shaped PU;

constructing a first merge list comprising a plurality of candidates, based on a merge list construction process for regular merge prediction, wherein each one of the plurality of candidates is a motion vector (MV) comprising at least one of a List 0 MV or a List 1 MV;

locating a first candidate for the first PU from the first merge list according to a first index;

locating a second candidate for the second PU from the first merge list according to a second index;

obtaining a first uni-prediction MV for the first PU according to a first binary reference list indication flag by determining a List X 1 MV of the first candidate upon determining that the List X 1 MV of the first candidate exists and by determining a List (1-X 1 ) MV of the first candidate upon determining that the List X 1 MV of the first candidate does not exist, wherein X 1 takes a value of 0 or 1 and is indicated by the first binary reference list indication flag; and

obtaining a second uni-prediction MV for the second PU according to a second binary reference list indication flag by determining a List X 2 MV of the second candidate upon determining that the List X 2 MV of the second candidate exists and by determining a List (1-X 2 ) MV of the second candidate upon determining that the List X 2 MV of the second candidate does not exist, wherein X 2 takes a value of 0 or 1 and is indicated by the second binary reference list indication flag,

wherein the first and second binary reference list indication flags are determined based on values of the first and second indexes, respectively.

2. The method for video decoding with geometric partition of claim 1 , further comprising:

determining that the second binary reference list indication flag comprises a contrary value relative to the first binary reference list indication flag upon determining that the first and second indexes are the same.

3. The method for video decoding with geometric partition of claim 1 , further comprising:

determining that the second binary reference list indication flag comprises a contrary value relative to the first binary reference list indication flag upon determining that backward prediction is used for a current picture; and

determining that the second binary reference list indication flag comprises a same value as the first binary reference list indication flag upon determining that the backward prediction is not used for the current picture.

4. The method for video decoding with geometric partition of claim 3 , wherein the first and second binary reference list indication flags are coded as CABAC context bins.

5. The method for video decoding with geometric partition of claim 1 , further comprising:

determining the first and second binary reference list indication flags further based on parities of index values of the first and second candidates in the first merge list, respectively.

6. An apparatus for video decoding with geometric partition, comprising:

one or more processors; and

a memory configured to store instructions executable by the one or more processors; wherein the one or more processors, upon execution of the instructions, are configured to:

obtain video pictures, wherein the video pictures are partitioned into a plurality of coding units (CUs), wherein at least one of the plurality of CUs is partitioned into two prediction units (PUs) comprising a first PU and a second PU, wherein the two PUs comprise at least one geometric shaped PU;

construct a first merge list comprising a plurality of candidates, based on a merge list construction process for regular merge prediction, wherein each one of the plurality of candidates is a motion vector (MV) comprising at least one of a List 0 MV or a List 1 MV;

locate a first candidate for the first PU from the first merge list according to a first index;

locate a second candidate for the second PU from the first merge list according to a second index;

obtain a first uni-prediction MV for the first PU according to a first binary reference list indication flag by determining a List X 1 MV of the first candidate upon determining that the List X 1 MV of the first candidate exists and by determining a List (1-X 1 ) MV of the first candidate upon determining that the List X 1 MV of the first candidate does not exist, wherein X 1 takes a value of 0 or 1 and is indicated by the first binary reference list indication flag; and

obtain a second uni-prediction MV for the second PU according to a second binary reference list indication flag by determining a List X 2 MV of the second candidate upon determining that the List X 2 MV of the second candidate exists and by determining a List (1-X 2 ) MV of the second candidate upon determining that the List X 2 MV of the second candidate does not exist, wherein X 2 takes a value of 0 or 1 and is indicated by the second binary reference list indication flag,

wherein the first and second binary reference list indication flags are determined based on values of the first and second indexes, respectively.

7. The apparatus for video decoding with geometric partition of claim 6 , wherein the one or more processors are further configured to:

determine that the second binary reference list indication flag comprises a contrary value relative to the first binary reference list indication flag upon determining that the first and second indexes are the same.

8. The apparatus for video decoding with geometric partition of claim 6 , wherein the one or more processors are further configured to:

determine that the second binary reference list indication flag comprises a contrary value relative to the first binary reference list indication flag upon determining that backward prediction is used for a current picture; and

determine that the second binary reference list indication flag comprises a same value as the first binary reference list indication flag upon determining that the backward prediction is not used for the current picture.

9. The apparatus for video decoding with geometric partition of claim 6 , wherein the one or more processors are further configured to:

determine the first and second binary reference list indication flags further based on parities of index values of the first and second candidates in the first merge list, respectively.

10. The apparatus for video decoding with geometric partition of claim 6 , wherein the first and second binary reference list indication flags are coded as CABAC context bins.

11. A non-transitory computer-readable storage medium for video decoding with geometric partition storing a bitstream and associated instructions to decode the bitstream, the instructions comprising:

obtaining video pictures, wherein the video pictures are partitioned into a plurality of coding units (CUs), wherein at least one of the plurality of CUs is partitioned into two prediction units (PUs) comprising a first PU and a second PU, wherein the two PUs comprise at least one geometric shaped PU;

constructing a first merge list comprising a plurality of candidates, based on a merge list construction process for regular merge prediction, wherein each one of the plurality of candidates is a motion vector (MV) comprising at least one of a List 0 MV or a List 1 MV;

locating a first candidate for the first PU from the first merge list according to a first index;

locating a second candidate for the second PU from the first merge list according to a second index;

obtaining a first uni-prediction MV for the first PU according to a first binary reference list indication flag by determining-a List X 1 MV of the first candidate upon determining that the List X 1 MV of the first candidate exists and by determining a List (1-X 1 ) MV of the first candidate upon determining that the List X 1 MV of the first candidate does not exist, wherein X 1 takes a value of 0 or 1 and is indicated by the first binary reference list indication flag; and

obtaining a second uni-prediction MV for the second PU according to a second binary reference list indication flag by determining a List X 2 MV of the second candidate upon determining that the List X 2 MV of the second candidate exists and by determining a List (1-X 2 ) MV of the second candidate upon determining that the List X 2 MV of the second candidate does not exist, wherein X 2 takes a value of 0 or 1 and is indicated by the second binary reference list indication flag,

wherein the first and second binary reference list indication flags are determined based on values of the first and second indexes, respectively.

12. The non-transitory computer-readable storage medium for video coding with geometric partition of claim 11 , wherein the acts further comprise:

determining that the second binary reference list indication flag comprises a contrary value relative to the first binary reference list indication flag upon determining that the first and second indexes are the same.

13. The non-transitory computer-readable storage medium for video coding with geometric partition of claim 11 , wherein the acts further comprise:

determining that the second binary reference list indication flag comprises a contrary value relative to the first binary reference list indication flag upon determining that backward prediction is used for a current picture; and

determining that the second binary reference list indication flag comprises a same value as the first binary reference list indication flag upon determining that backward prediction is not used for the current picture.

14. The non-transitory computer-readable storage medium for video decoding with geometric partition of claim 11 , wherein the first and second binary reference list indication flags are coded as CABAC context bins.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2022
From: WANG, XIANGLIN; CHEN, YI-WEN; XIU, XIAOYU; MA, TSUNG-CHUAN; JHU, HONG-JHENG; YU, BING
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 059565/0975 →
Continuity (4)
Continuation PCTUS2020055259 · Oct 12, 2020
Provisional Application 62948781 · Dec 16, 2019
Provisional Application 62913710 · Oct 10, 2019
Related Publication 20220239902A1 · Jul 28, 2022
References Cited (38)
US 10248966B2 · Helle · 2019 [cited by examiner]
US 20100208818A1 · Yin · 2010 [cited by examiner]
US 20120300850A1 · Yie · 2012 [cited by examiner]
US 20130202038A1 · Seregin · 2013 [cited by examiner]
US 20140161179A1 · Seregin · 2014 [cited by examiner]
US 20140192883A1 · Seregin · 2014 [cited by examiner]
US 20150229955A1 · Seregin · 2015 [cited by examiner]
US 20150264352A1 · Yie · 2015 [cited by examiner]
US 20160065987A1 · Lee · 2016 [cited by examiner]
US 20170310988A1 · Lin · 2017 [cited by examiner]
US 20200195973A1 · Xu · 2020 [cited by examiner]
US 20200213622A1 · Xu · 2020 [cited by examiner]
US 20210152825A1 · Reuze · 2021 [cited by examiner]
US 20210203931A1 · Yang · 2021 [cited by examiner]
US 20210227247A1 · Blaeser · 2021 [cited by examiner]
US 20210266539A1 · Lee · 2021 [cited by examiner]
US 20210337196A1 · Lee · 2021 [cited by examiner]
US 20220070445A1 · Wang · 2022 [cited by examiner]
CN 113924774A · 2022 [cited by applicant]
WO 2019147910A1 · 2019 [cited by applicant]
WO 2019083334A1 · 2019 [cited by applicant]
WO 2019151284A1 · 2019 [cited by applicant]
Vietnamese Office Action issued to Vietnamese Application No. 1-2022-02826, dated Aug. 30, 2024, with English translation, (4p). [cited by applicant]
EP Office Action of European Patent Application No. 20873782.5 dated Jul. 19, 2024, (5p). [cited by applicant]
Extended European Search Report of EP Application No. 20873782.5 dated Nov. 7, 2022, (9p). [cited by applicant]
First Office Action issued to Indian Application No. 202247023370 dated Aug. 23, 2022, (5p). [cited by applicant]
Chen, Jianle et al., “Algorithm description for Versatile Video Coding and Test Model 6 (VTM 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2002-v1, 15th Meeting: Gothenbur… [cited by applicant]
International Search Report of PCT Application No. PCT/US2020/055259 dated Jan. 26, 2021, (2p). [cited by applicant]
Jianle Chen et al., Algorithm description for Versatile Video Coding and Test Model 6 (VTM 6), Joint Video Experts Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2002-v2 15th Meeting: Gothenburg, SE… [cited by applicant]
First Office Action issued on Feb. 14, 2023 for counterpart Korean patent application No. 10-2022-7014846, along with the English translation, (12p). [cited by applicant]
The Notice of Final Rejection issued on Jul. 21, 2023 by KIPO for corresponding Korean Patent Application No. 10-2022-7014846 with English translation,(8p). [cited by applicant]
Decision of Rejection issued on May 16, 2023 by JPO for corresponding Japanese Patent Application No. 2022-521768 dated on May 12, 2023, with English translation,(5p). [cited by applicant]
First Office Action issued for corresponding Japanese Patent Application 2022-521768 mailed on Nov. 15, 2022, with English translation, (10p). [cited by applicant]
Kianglin Wang, et al., CE4-related: An improved method for triangle merge list construction, Joint Video Experts Team (JVET) of ITU-T SG 16WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0340_r1, 14th meeting Geneva, CH, Mar.… [cited by applicant]
Notice of Final Rejection issued on Dec. 21, 2023 for counterpart Korean patent application No. 10-2022-7014846 (5 pages). [cited by applicant]
The First Office Action and search report issued on Jul. 19, 2023 for counterpart Chinese patent application No. 202211277982.X, along with machine EN translation.(32p). [cited by applicant]
Second Office Action and search report issued on Oct. 11, 2023 for counterpart Chinese patent application No. 202211277982.X, along with machine EN translation, (29p). [cited by applicant]
Hearing Notice issued in IN Application No. 202247023370 dated Mar. 28, 2024, (2p). [cited by applicant]