IP Library › Granted Patent US 12,309,421
Granted Patent B2
US 12,309,421 · App. 17/828,872 · Granted May 20, 2025

Signaling a maximum number of merge motion vector prediction candidates for inter prediction

Inventors: Ling Li (Seoul, KR); Xiang Li (Saratoga, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/56H04N19/176H04N19/184H04N19/44H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,309,421
App. No.
17/828,872
Granted
May 20, 2025
Kind
B2
Abstract

A method for video encoding includes generating a first syntax element indicating a maximum number of merge motion vector prediction (MVP) candidates, and encoding the first syntax element at a first coding level in a coded video bitstream, the first coding level being higher than a picture parameter set (PPS) level. The video encoding method also includes transmitting the coded video bitstream including the first syntax element. The maximum number of merge MVP candidates indicated by the first syntax element is applicable for reconstructing coding blocks of the coded video bitstream associated with the first coding level.

Claims (59)

1. A method for video encoding, comprising:

generating, by processing circuitry of a video encoder, a set of syntax elements defining maximum numbers of merge candidates for a picture sequence in a coded video bitstream, the set of syntax elements including at least one of a first syntax element indicating a maximum number of merge motion vector prediction (MVP) candidates, a second syntax element indicating a maximum number of geometric merge mode merge candidates, a third syntax element indicating a maximum number of subblock-based merge MVP candidates, and a fourth syntax element indicating a maximum number of intra block copy (IBC) merge block vector prediction (BVP) candidates;

encoding the set of syntax elements defining the maximum numbers of merge candidates in a sequence parameter set (SPS) in the coded video bitstream; and

transmitting the coded video bitstream including the set of syntax elements,

wherein coding blocks of the picture sequence in the coded video bitstream are coded using the maximum numbers of merge candidates indicated by the set of syntax elements.

2. The method of claim 1 , further comprising:

including, in the set of syntax elements in the coded video bitstream, the second syntax element, the third syntax element, and the fourth syntax element.

3. The method of claim 1 , further comprising:

including, in the coded video bitstream and based on a condition being satisfied, a fifth syntax element at a second coding level, the fifth syntax element indicating a maximum number of merge candidates for one of a geometric merge mode, a subblock-based merge mode, and an intra block copy (IBC) merge mode.

4. The method of claim 3 , wherein

the one of the geometric merge mode, the subblock-based merge mode, and the IBC merge mode is the geometric merge mode;

the maximum number of merge candidates is a maximum number of geometric merge mode merge candidates;

the fifth syntax element indicates the maximum number of geometric merge mode merge candidates; and

the condition is the geometric merge mode being enabled at the second coding level and the maximum number of merge MVP candidates being larger than or equal to 3.

5. The method of claim 3 , wherein

the one of the geometric merge mode, the subblock-based merge mode, and the IBC merge mode is the subblock-based merge mode;

the maximum number of merge candidates is a maximum number of subblock-based merge MVP candidates;

the fifth syntax element indicates the maximum number of subblock-based merge MVP candidates; and

the condition is an affine mode being enabled at the second coding level.

6. The method of claim 3 , wherein

the one of the geometric merge mode, the subblock-based merge mode, and the IBC merge mode is the IBC merge mode;

the maximum number of merge candidates is a maximum number of IBC merge block vector prediction (BVP) candidates;

the fifth syntax element indicates the maximum number of IBC merge BVP candidates; and

the condition is the IBC merge mode being enabled at the second coding level.

7. The method of claim 3 , wherein the second coding level is a sequence level.

8. The method of claim 5 , wherein the fifth syntax element is modified at a coding level that is lower than the second coding level.

9. The method of claim 8 , wherein the second coding level is a sequence level, and the coding level that is lower than the second coding level is a picture level.

10. An apparatus for video decoding, comprising:

processing circuitry configured to

decode, from a coded video bitstream, a sequence parameter set (SPS) including a set of syntax elements defining maximum numbers of merge candidates for a picture sequence in the coded video bitstream, the set of syntax elements including at least one of a first syntax element indicating a maximum number of merge motion vector prediction (MVP) candidates, a second syntax element indicating a maximum number of geometric merge mode merge candidates, a third syntax element indicating a maximum number of subblock-based merge MVP candidates, and a fourth syntax element indicating a maximum number of intra block copy (IBC) merge block vector prediction (BVP) candidates; and

decode coding blocks of the picture sequence in the coded video bitstream using the maximum numbers of merge candidates indicated by the set of syntax elements.

11. The apparatus of claim 10 , wherein the processing circuitry is further configured to:

decode, from the set of syntax elements in the coded video bitstream, the second syntax element, the third syntax element, and the fourth syntax element.

12. The apparatus of claim 10 , wherein the processing circuitry is further configured to:

decode, from the coded video bitstream and based on a condition being satisfied, a fifth syntax element signaled at a second coding level, the fifth syntax element indicating a maximum number of merge candidates for one of a geometric merge mode, a subblock-based merge mode, and an intra block copy (IBC) merge mode.

13. The apparatus of claim 12 , wherein

the one of the geometric merge mode, the subblock-based merge mode, and the IBC merge mode is the geometric merge mode;

the maximum number of merge candidates is a maximum number of geometric merge mode merge candidates;

the fifth syntax element indicates the maximum number of geometric merge mode merge candidates; and

the condition is the geometric merge mode being enabled at the second coding level and the maximum number of merge MVP candidates being larger than or equal to 3.

14. The apparatus of claim 12 , wherein

the one of the geometric merge mode, the subblock-based merge mode, and the IBC merge mode is the subblock-based merge mode;

the maximum number of merge candidates is a maximum number of subblock-based merge MVP candidates;

the fifth syntax element indicates the maximum number of subblock-based merge MVP candidates; and

the condition is an affine mode being enabled at the second coding level.

15. The apparatus of claim 12 , wherein

the one of the geometric merge mode, the subblock-based merge mode, and the IBC merge mode is the IBC merge mode;

the maximum number of merge candidates is a maximum number of IBC merge block vector prediction (BVP) candidates;

the fifth syntax element indicates the maximum number of IBC merge BVP candidates; and

the condition is the IBC merge mode being enabled at the second coding level.

16. The apparatus of claim 12 , wherein the second coding level is a sequence level.

17. The apparatus of claim 14 , wherein the fifth syntax element is modified at a coding level that is lower than the second coding level.

18. A method of processing visual media data, the method comprising:

processing a bitstream of the visual media data according to a format rule, wherein

the bitstream includes a set of syntax elements defining maximum numbers of merge candidates for a picture sequence in the bitstream, the set of syntax elements including at least one of a first syntax element indicating a maximum number of merge motion vector prediction (MVP) candidates, a second syntax element indicating a maximum number of geometric merge mode merge candidates, a third syntax element indicating a maximum number of subblock-based merge MVP candidates, and a fourth syntax element indicating a maximum number of intra block copy (IBC) merge block vector prediction (BVP) candidates;

the format rule specifies that

the set of syntax elements defining the maximum numbers of merge candidates is encoded in a sequence parameter set (SPS) in the bitstream;

the bitstream including the set of syntax elements is transmitted; and

coding blocks of the picture sequence in the bitstream are coded using the maximum numbers of merge candidates indicated by the set of syntax elements.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2022
From: LI, LING; LI, XIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 060059/0299 →
Continuity (3)
Continuation 17088073 · Nov 3, 2020
Provisional Application 62960930 · Jan 14, 2020
Related Publication 20230164350A1 · May 25, 2023
References Cited (23)
US 10362330B1 · Li et al. · 2019 [cited by applicant]
US 20140211857A1 · Sugio et al. · 2014 [cited by applicant]
US 20150078450A1 · Chen · 2015 [cited by examiner]
US 20160105670A1 · Pang et al. · 2016 [cited by applicant]
US 20170280159A1 · Xu et al. · 2017 [cited by applicant]
US 20170289566A1 · He et al. · 2017 [cited by applicant]
US 20190335200A1 · Xu et al. · 2019 [cited by applicant]
US 20210006798A1 · Jang · 2021 [cited by applicant]
WO 2013051209A1 · 2013 [cited by applicant]
WO 2015180014A1 · 2015 [cited by applicant]
WO 2020004990A1 · 2020 [cited by applicant]
Japanese Office Action issued Oct. 18, 2022 in Application No. 2021-557681 with English Translation, 17 pages. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 7)”, Document: JVET-P2001-vE, [online], Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 8, 2020, JVET-Q0508 (version 1) pp. … [cited by applicant]
Japanese Office Action issued Apr. 25, 2023 in Application No. 2021-557681 with English Translation, 18 pages. [cited by applicant]
Sadayasu Ono, et al., “Ubiquitous Technology High Efficiency Coding of Video—MPEG-4 and H.264-”, 1st edition, Apr. 20, 2005, Ohmsha Co., Ltd., No. 106-108, pp. 126-127, ISBN: 4-274-20060-4. [cited by applicant]
Shintaro Ueda, et al., “Stream Authentication in NAL for H.264/AVC” IPSJ Symposium Series Multimedia Communication and Distributed Processing Workshop Proceedings, vol. 2006, No. 15, Nov. 29, 2006, Incorporated Associat… [cited by applicant]
Chun-Chia Chen, et al., “CE4.3.1: Shared merging candidate list”, Document: JVET-M0170-v1, Joint Video Experts Team (JVET) of IT UT SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 2, 2019, pp. 1-13. [cited by applicant]
Singaporean Search Report and Written Opinion issued Apr. 17, 2023 in Application No. 11202111741S, 9 pages. [cited by applicant]
International Search Report issued Mar. 25, 2021 in Application No. PCT/US21/13051, 3 pages. [cited by applicant]
Written Opinion issued Mar. 25, 2021 in Application No. PCT/US21/13051, 10 pages. [cited by applicant]
Supplementary European Search Report mailed Feb. 2, 2024 in Application No. 21740870.7, 9 pages. [cited by applicant]
Benjamin Bross et al: “Versatile Video Coding (Draft 7)”, 16. JVET Meeting; Oct. 1, 2019-Oct. 11, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16) No. JVET-P2001-vE; Nov. 14, 2… [cited by applicant]
Lil et al: “SPS level control over the number of merge candidates”, 17. JVET Meeting; Jan. 7, 2020-Jan. 17, 2020; Brussels; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVET-Q0798; … [cited by applicant]