IP Library › Granted Patent US 12,432,339
Granted Patent B2
US 12,432,339 · App. 17/804,687 · Granted Sep 30, 2025

Merge candidate reordering in video coding

Inventors: Han Huang (San Diego, CA); Vadim Seregin (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/105H04N19/176H04N19/503H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,432,339
App. No.
17/804,687
Granted
Sep 30, 2025
Kind
B2
Abstract

A video coder is configured to construct a merge candidate list of merge candidates, wherein the merge candidate list has N1 candidates, N1 being a positive integer value, reorder the merge candidates in the merge candidate list to create a reordered merge candidate list, reduce the reordered merge candidate list to create an output merge candidate list, wherein the output merge candidate list has N2 candidates, wherein N2 is less than N1, and code a block of video data using the output merge candidate list.

Claims (50)

1. A method of coding video data, the method comprising:

coding one or more syntax elements indicative of a first value of N1 and a second value of N2, wherein N1 is a positive integer value, and wherein N2 is less than N1, wherein coding the one or more syntax elements indicative of the first value of N1 and the second value of N2 comprises:

coding a first syntax element that indicates the second value of N2; and

determining the second value for N1 as N2+k, wherein k is a fixed integer value greater than 0;

constructing a merge candidate list of merge candidates, wherein the merge candidate list has N1 candidates;

reordering the N1 merge candidates in the merge candidate list according to a cost function to create a reordered merge candidate list;

discarding a last N1-N2 candidates in the reordered merge candidate list to reduce the reordered merge candidate list to a specified number, N2, of candidates to create an output merge candidate list, wherein the output merge candidate list has N2 candidates, and wherein the N2 candidates in the output merge candidate list have smaller costs of the cost function relative to the N1-N2 candidates that were discarded; and

coding a block of video data using the output merge candidate list.

2. The method of claim 1 , wherein reordering the merge candidates in the merge candidate list according to the cost function to create the reordered merge candidate list comprises:

reordering the merge candidates in the merge candidate list using a template matching cost.

3. The method of claim 1 , wherein reordering the merge candidates in the merge candidate list according to the cost function to create the reordered merge candidate list comprises:

reordering the merge candidates in the merge candidate list using a bilateral-matching cost.

4. The method of claim 1 , wherein reordering the merge candidates in the merge candidate list according to the cost function to create the reordered merge candidate list comprises:

reordering the merge candidates in the merge candidate list using a bi-prediction cost.

5. The method of claim 1 , further comprising:

coding a merge index into the output merge candidate list based on a value of N2.

6. The method of claim 1 , further comprising:

determining a third value for k based on a merge mode.

7. The method of claim 1 , wherein coding comprises encoding.

8. The method of claim 1 , wherein coding comprises decoding.

9. An apparatus configured to code video data, the apparatus comprising:

a memory configured to store video data; and

one or more processors in communication with the memory, the one or more processors configured to:

code one or more syntax elements indicative of a first value of N1 and a second value of N2, wherein N1 is a positive integer value, and wherein N2 is less than N1, wherein to code the one or more syntax elements indicative of the first value of N1 and the second value of N2, the one or more processors are further configured to:

code a first syntax element that indicates the second value of N2; and

determine the second value for N1 as N2+k, wherein k is a fixed integer value greater than 0;

construct a merge candidate list of merge candidates, wherein the merge candidate list has N1 candidates;

reorder the NI merge candidates in the merge candidate list according to a cost function to create a reordered merge candidate list;

discard a last N1-N2 candidates in the reordered merge candidate list to reduce the reordered merge candidate list to a specified number, N2, of candidates to create an output merge candidate list, wherein the output merge candidate list has N2 candidates, and wherein the N2 candidates in the output merge candidate list have smaller costs of the cost function relative to the N1-N2 candidates that were discarded; and

code a block of video data using the output merge candidate list.

10. The apparatus of claim 9 , wherein to reorder the merge candidates in the merge candidate list according to the cost function to create the reordered merge candidate list, the one or more processors are further configured to:

reorder the merge candidates in the merge candidate list using a template matching cost.

11. The apparatus of claim 9 , wherein to reorder the merge candidates in the merge candidate list according to the cost function to create the reordered merge candidate list, the one or more processors are further configured to:

reorder the merge candidates in the merge candidate list using a bilateral-matching cost.

12. The apparatus of claim 9 , wherein to reorder the merge candidates in the merge candidate list according to the cost function to create the reordered merge candidate list, the one or more processors are further configured to:

reorder the merge candidates in the merge candidate list using a bi-prediction cost.

13. The apparatus of claim 9 , wherein the one or more processors are further configured to:

code a merge index into the output merge candidate list based on a value of N2.

14. The apparatus of claim 9 , wherein the one or more processors are further configured to:

determine a third value for k based on a merge mode.

15. The apparatus of claim 9 , wherein the apparatus is configured to encode video data.

16. The apparatus of claim 9 , wherein the apparatus is configured to decode video data.

17. An apparatus configured to code video data, the apparatus comprising:

means for coding one or more syntax elements indicative of a first value of N1 and a second value of N2, wherein N1 is a positive integer value, and wherein N2 is less than N1, wherein means for coding the one or more syntax elements indicative of the first value of N1 and the second value of N2 comprises:

means for coding a first syntax element that indicates the second value of N2; and

means for determining the second value for N1 as N2+k, wherein k is a fixed integer value greater than 0;

means for constructing a merge candidate list of merge candidates, wherein the merge candidate list has N1 candidates;

means for reordering the N1 merge candidates in the merge candidate list according to a cost function to create a reordered merge candidate list;

means for discarding a last N1-N2 candidates in the reordered merge candidate list to reduce the reordered merge candidate list to a specified number, N2, of candidates to create an output merge candidate list, wherein the output merge candidate list has N2 candidates, and wherein the N2 candidates in the output merge candidate list have smaller costs of the cost function relative to the N1-N2 candidates that were discarded; and

means for coding a block of video data using the output merge candidate list.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2022
From: HUANG, HAN; SEREGIN, VADIM; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 060318/0054 →
Continuity (2)
Provisional Application 63216432 · Jun 29, 2021
Related Publication 20220417500A1 · Dec 29, 2022
References Cited (23)
US 10701393B2 · Chen et al. · 2020 [cited by applicant]
US 20130188715A1 · Seregin · 2013 [cited by examiner]
US 20190124350A1 · Thirumalai · 2019 [cited by examiner]
US 20200162743A1 · Park · 2020 [cited by examiner]
US 20200374513A1 · Xiu · 2020 [cited by examiner]
US 20210037238A1 · Park · 2021 [cited by examiner]
US 20220417500A1 · Huang · 2022 [cited by examiner]
Chang Y-J., et al., “EE2-3.4, EE2-3.5, EE2-3.6: Experimental Results of the MV Candidates Reordering in Candidate Types Based on Template Matching Costs”, JVET-Y0134-v3, Joint Video Experts Team (JVET) of ITU-T SG 16 WP… [cited by applicant]
Chang Y.J., et al., “EE2-Related: MV Candidate Type-Based ARMC”, JVET-X0133-v3, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 24th Meeting, by teleconference, Oct. 6-15, 2021, pp. 1-4. [cited by applicant]
Chang Y-J., et al., “Compression Efficiency Methods Beyond VVC”, 21. JVET Meeting, Oct. 6, 2021-Jan. 15, 2021, by teleconference, (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No. JVET-U0… [cited by applicant]
Chang Y-J., et al., (Qualcomm): “EE2: Tests of Compression Efficiency Methods Beyond VVC”, 22. JVET Meeting, Apr. 20, 2021-Apr. 28, 2021, Teleconference, (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and I… [cited by applicant]
Chen Y., et al., “Description of SDR, HDR and 360° Video Coding Technology Proposal by Qualcomm and Technicolor—Low and High Complexity Versions”, JVET-J0021, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and … [cited by applicant]
Coban M., et al., “Algorithm Description of Enhanced Compression Model 3 (ECM 3)”, JVET-X2025-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 23rd Meeting, by teleconference, Jul. 7-16, … [cited by applicant]
Hsu C.W., (Mediatek) et al., “CE4-Related: On Merge List Construction”, 126. MPEG Meeting, JVET-N0851-v2, Mar. 25, 2019-Mar. 29, 2019, Geneva, (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m47960, Mar. 24… [cited by applicant]
Hsu C-W., et al., “CE4-related: On Merge List Construction”, JVET-N0851, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Geneva, CH, Mar. 19-27, 2019, XP030204829, pp. 1-… [cited by applicant]
International Search Report and Written Opinion—PCT/US2022/072680—ISA/EPO—Sep. 23, 2022. [cited by applicant]
“ITU-T H.265, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, High Efficiency Video Coding”, The International Telecommunication Union, Apr. 2015, 634 Pages. [cited by applicant]
ITU-T H.266: “Series H: Audiovisual and Multimedia Systems Infrastructure of Audiovisual Services—Coding of Moving Video”, Versatile Video Coding, The International Telecommunication Union, Aug. 2020, 516 pages. [cited by applicant]
Karczewicz M., et al., “Common Test Conditions and Evaluation Procedures for Enhanced Compression Tool Testing”, JVET-W2017-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 24th Meeting, b… [cited by applicant]
Su Y-C., et al., “CE4-related: Generalized Bi-prediction Improvements Combined from JVET-L0197 and JVET-L0296”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN,… [cited by applicant]
Wen H.U., et al., “A VVC Proposal With Quaternary Tree Plus Binary-Ternary Tree Coding Block Structure and Advanced Coding Techniques”, IEEE Transactions on Circuits and Systems for Video Technology, IEEE, USA, vol. 30,… [cited by applicant]
Zhang (Bytedance) N., et al., “AHG12: Adaptive Reordering of Merge Candidates with Template Matching”, 22. IVET Meeting, Apr. 20, 2021-Apr. 28, 2021, Teleconference, (The Joint Video Exploration Team of ISO/IEC JTC1/SC2… [cited by applicant]
Zhao L., et al., “Non-EE2: Template Matching Based Merge Candidate List Construction (TM-MCLC)”, JVET-X0087-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 24th Meeting, by teleconference… [cited by applicant]