IP Library Granted Patent US 12,659,503
Granted Patent B2
US 12,659,503 · App. 18/886,821 · Granted Jun 16, 2026

Video signal encoding and decoding method, and apparatus therefor

Inventor: Bae Keun Lee (Seongnam-si, KR)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/513H04N19/107H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,659,503
App. No.
18/886,821
Granted
Jun 16, 2026
Kind
B2
Abstract

A video decoding method includes the steps of: generating a merge candidate list for a first block; selecting one among merge candidates included in the merge candidate list; and performing motion compensation for the first block based on motion information of the selected merge candidate. At this point, an inter-region merge candidate included in an inter-region motion information list may be added to the merge candidate list based on the number of spatial merge candidates and temporal merge candidates included in the merge candidate list.

Claims (45)

1 . A video decoding method, comprising:

generating a merge candidate list for a first block;

selecting one among merge candidates included in the merge candidate list; and

performing motion compensation for the first block based on motion information of the selected merge candidate;

wherein an inter-region merge candidate included in an inter-region motion information list is added to the merge candidate list based on the number of spatial merge candidates and temporal merge candidates included in the merge candidate list;

the merge candidates comprise a first merge candidate and a second merge candidate, and a prediction block for the first block is generated based on the first merge candidate and the second merge candidate;

index information merge_idx of the first merge candidate and index information merge_2nd_idx of the second merge candidate are obtained by analyzing a bitstream; and a value of an index of the second merge candidate is obtained on the basis of a value of the index information merge_idx of the first merge candidate.

2 . The method according to claim 1 , wherein the inter-region motion information list includes an inter-region merge candidate derived based on motion information of a block decoded before the first block.

3 . The method according to claim 1 , wherein when the first block is included in a merge processing area, a temporary merge candidate derived based on motion information of the first block is added to a temporary motion information list, and when all blocks included in the merge processing area are decoded, the temporary merge candidate is added in the inter-region motion information list.

4 . The method according to claim 1 , wherein based on determination regarding whether one inter-region merge candidate included in the inter-region motion information list is the same as at least one merge candidate included in the merge candidate list, it is determined whether to add the one inter-region merge candidate to the merge candidate list.

5 . The method according to claim 4 , wherein the determination is performed by comparing at least one merge candidate of which the index value is smaller than or equal to a threshold value with the one inter-region merge candidate; or

the determination is performed by comparing at least one merge candidate of which the index value is larger than a threshold value with the one inter-region merge candidate.

6 . The method according to claim 4 , wherein when it is determined that there is a merge candidate the same as the one inter-region merge candidate, the one inter-region merge candidate is not added to the merge candidate list, and based on a result of determining whether another inter-region merge candidate included in the inter-region motion information list is the same as at least one merge candidate included in the merge candidate list, it is determined whether to add the another inter-region merge candidate to the merge candidate list, and no determination regarding whether the another inter-region merge candidate is the same as the merge candidate that is the same as the one inter-region merge candidate is performed.

7 . The method according to claim 1 , wherein when an inter-region merge candidate the same as motion information of the first block exists in the merge candidate list, an index assigned to an inter-region merge candidate in the inter-region motion information list is updated to a maximum value.

8 . The method according to claim 4 , wherein the determination is performed by comparing a merge candidate derived from a block at a specific position with the one inter-region merge candidate, wherein the specific position includes at least one of a top-right neighboring block or a bottom-left neighboring block of the first block.

9 . The method according to claim 1 , wherein performing motion compensation for the first block comprises:

performing motion compensation prediction for the first block using a plurality of merge candidates.

10 . The method according to claim 9 , wherein

the first merge candidate and the second merge candidate are included in the merge candidate list for the first block; and

a first prediction block is generated using the first merge candidate, a second prediction block is generated using a second merge candidate, and the prediction block for the first block is generated based on the first prediction block and the second prediction block.

11 . The method according to claim 10 , wherein the prediction block for the first block is generated based on a weighted sum operation of the first prediction block and the second prediction block.

12 . A video encoding method, comprising:

generating a merge candidate list for a first block;

selecting one among merge candidates included in the merge candidate list; and

performing motion compensation for the first block based on motion information of the selected merge candidate;

wherein an inter-region merge candidate included in an inter-region motion information list is added to the merge candidate list based on the number of spatial merge candidates and temporal merge candidates included in the merge candidate list;

the merge candidates comprise a first merge candidate and a second merge candidate, and a prediction block for the first block is generated based on the first merge candidate and the second merge candidate;

index information merge_idx of the first merge candidate and index information merge_2nd_idx of the second merge candidate are signaled through a bitstream, respectively, and a value of an index of the second merge candidate is obtained on the basis of a value of the index information merge_idx of the first merge candidate.

13 . The method according to claim 12 , wherein the inter-region motion information list includes an inter-region merge candidate derived based on motion information of a block encoded before the first block.

14 . The method according to claim 12 , wherein when the first block is included in a merge processing area, a temporary merge candidate derived based on motion information of the first block is added to a temporary motion information list, and when all blocks included in the merge processing area are encoded, the temporary merge candidate is added in the inter-region motion information list.

15 . The method according to claim 12 , wherein based on determination regarding whether one inter-region merge candidate included in the inter-region motion information list is the same as at least one merge candidate included in the merge candidate list, it is determined whether to add the one inter-region merge candidate to the merge candidate list.

16 . The method according to claim 15 , wherein the determination is performed by comparing at least one merge candidate of which the index value is smaller than or equal to a threshold value with the one inter-region merge candidate.

17 . The method according to claim 15 , wherein when it is determined that there is a merge candidate the same as the one inter-region merge candidate, the one inter-region merge candidate is not added to the merge candidate list, and based on a result of determining whether another inter-region merge candidate included in the inter-region motion information list is the same as at least one merge candidate included in the merge candidate list, it is determined whether to add the another inter-region merge candidate to the merge candidate list, and no determination regarding whether the another inter-region merge candidate is the same as the merge candidate that is the same as the one inter-region merge candidate is performed.

18 . A video decoding apparatus, comprising a memory and a processor, wherein the memory is configured to store a computer program capable of running in the processor; and

the processor is configured to run the computer program to execute a video decoding method, the method comprising:

generating a merge candidate list for a first block;

selecting one among merge candidates included in the merge candidate list; and

performing motion compensation for the first block based on motion information of the selected merge candidate,

wherein an inter-region merge candidate included in an inter-region motion information list is added to the merge candidate list based on the number of spatial merge candidates and temporal merge candidates included in the merge candidate list;

the merge candidates comprise a first merge candidate and a second merge candidate, and a prediction block for the first block is generated based on the first merge candidate and the second merge candidate;

index information merge_idx of the first merge candidate and index information merge_2nd_idx of the second merge candidate are obtained by analyzing a bitstream; and a value of an index of the second merge candidate is obtained on the basis of a value of the index information merge_idx of the first merge candidate.

19 . A video encoding apparatus, comprising a memory and a processor, wherein

the memory is configured to store a computer program capable of running in the processor; and

the processor is configured to run the computer program to execute the video encoding method of claim 12 .

20 . A non-transitory computer-readable storage medium, having a computer program and a bitstream stored thereon, wherein the computer program, when executed by a processor, enables the processor to perform the steps of the encoding method of claim 12 to generate the bitstream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2024
From: LEE, BAE KEUN
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 068601/0171 →
Priority Claims (3)
KR 10-2018-0114348 · Sep 21, 2018 · national
KR 10-2018-0114349 · Sep 21, 2018 · national
KR 10-2018-0148858 · Nov 27, 2018 · national
Continuity (5)
Continuation 18336857 · Jun 16, 2023
Continuation 17455204 · Nov 16, 2021
Continuation 17205515 · Mar 18, 2021
Continuation PCTKR2019012292 · Sep 20, 2019
Related Publication 20250016355A1 · Jan 9, 2025
References Cited (86)
US 9729873B2 · Wang · 2017 [cited by applicant]
US 10075733B2 · Yamamoto · 2018 [cited by applicant]
US 10110891B2 · Yamamoto · 2018 [cited by applicant]
US 10187657B2 · Park · 2019 [cited by applicant]
US 10194169B2 · Yamamoto · 2019 [cited by applicant]
US 11218720B2 · Lee · 2022 [cited by applicant]
US 11750833B2 · Lee · 2023 [cited by examiner]
US 12132925B2 · Lee · 2024 [cited by examiner]
US 20120263235A1 · Sugio · 2012 [cited by applicant]
US 20130101042A1 · Sugio et al. · 2013 [cited by applicant]
US 20130188720A1 · Wang et al. · 2013 [cited by applicant]
US 20140226719A1 · Yamamoto et al. · 2014 [cited by applicant]
US 20150312588A1 · Yamamoto et al. · 2015 [cited by applicant]
US 20170078699A1 · Park et al. · 2017 [cited by applicant]
US 20170310991A1 · Yamamoto et al. · 2017 [cited by applicant]
US 20180316934A1 · Nam et al. · 2018 [cited by applicant]
US 20180376155A1 · Yamamoto et al. · 2018 [cited by applicant]
US 20190110070A1 · Yamamoto et al. · 2019 [cited by applicant]
US 20190200040A1 · Lim et al. · 2019 [cited by applicant]
US 20200154135A1 · Lee · 2020 [cited by applicant]
US 20200162743A1 · Park et al. · 2020 [cited by applicant]
US 20210211708A1 · Lee · 2021 [cited by applicant]
CN 107079161A · 2017 [cited by applicant]
CN 107404651A · 2017 [cited by applicant]
EP 3806472A1 · 2021 [cited by applicant]
EP 3833021A1 · 2021 [cited by applicant]
EP 3840376A1 · 2021 [cited by applicant]
JP 2016195452A · 2016 [cited by applicant]
KR 20160132859A · 2016 [cited by applicant]
KR 20180114348A · 2018 [cited by applicant]
KR 20180114349A · 2018 [cited by applicant]
RU 2577779C2 · 2016 [cited by applicant]
WO 2017069505A1 · 2017 [cited by applicant]
WO 2018012886A1 · 2018 [cited by applicant]
WO 2018026222A1 · 2018 [cited by applicant]
WO 2020060325A1 · 2020 [cited by applicant]
Zhang (Bytedance) L et al: “CE4-related: History-based Motion Vector Prediction”, 11. JVET Meeting; Jul. 11, 2018-Jul. 18, 2018; Ljubljana; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITUT SG.16), No… [cited by applicant]
An (Hisilicon) J et al: “Enhanced Merge Mode based on JEM7.0”, 10. JVET Meeting; Apr. 10, 2018-Apr. 20, 2018; San Diego; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No. JVET-J0059 Apr. … [cited by applicant]
Li Zhang et al: “CE4: History-based Motion Vector Prediction (Test 4.4.7)”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVET-L0… [cited by applicant]
Zhang (Bytedance) L et al: “Non-CE4: shared merge list without double HMVP tables”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITUT SG. 16), No… [cited by applicant]
Zhou (Ti) M: “Parallelized merge/skip mode for HEVC”, 6. JCT-VC Meeting; 97. MPEG Meeting; Jul. 14, 2011-Jul. 22, 2011; Torino; (Joint Collaborative Team on Video Coding of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16); URL: … [cited by applicant]
Partial Supplementary European Search Report in the European application No. 19861621.1, mailed on Sep. 13, 2021. 13 pages. [cited by applicant]
Corrected Partial Supplementary European Search Report in the European application No. 19861621.1, mailed on Oct. 26, 2021. 13 pages. [cited by applicant]
Written Opinion of the International Search Authority in the international application PCT/KR2019/012292, mailed on Dec. 24, 2019. 9 pages with English translation. [cited by applicant]
First Office Action of the U.S. Appl. No. 17/205,515, issued on May 27, 2021. 14 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/205,515, issued on Aug. 11, 2021. 7 pages. [cited by applicant]
First Office Action of the U.S. Appl. No. 18/336,857, issued on Feb. 29, 2024. 20 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 18/336,857, issued on Jun. 12, 2024. 15 pages. [cited by applicant]
First Office Action of the Russian application No. 2023130422, issued on Mar. 20, 2024. 16 pages with English translation. [cited by applicant]
First Office Action of the Mexican application No. MX/a/2021/003327, issued on Apr. 10, 2024. 8 pages with English translation. [cited by applicant]
Third Office Action of the Canadian application No. 3113585, issued on Feb. 28, 2024. 5 pages. [cited by applicant]
First Office Action of the Australian application No. 2019344274, issued on Aug. 12, 2022. 3 pages. [cited by applicant]
First Office Action of the European application No. 19861621.1, issued on Aug. 18, 2022. 5 pages. [cited by applicant]
First Office Action of the Canadian application No. 3113585, issued on May 19, 2022. 4 pages. [cited by applicant]
Brief Communication (Oral Proceedings) of the European application No. 19861621.1, issued on Jan. 12, 2024. 5 pages. [cited by applicant]
Decision to Refuse of the European application No. 19861621.1, issued on Mar. 1, 2024. 12 pages. [cited by applicant]
Hearing Notice of the Indian application No. 202117017663, issued on Dec. 28, 2023. 2 pages with English translation. [cited by applicant]
European Search Report in the European application No. 24173580.2, mailed on Jul. 26, 2024. 11 pages. [cited by applicant]
Benjamin Bross et al.: “Versatile Video Coding (Draft 4)”, 13. JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ), No. JVET-M1001-v6; JVET-… [cited by applicant]
International Search Report in the international application No. PCT/KR2019/012292, mailed on Dec. 24, 2019. 5 pages with English translation. [cited by applicant]
Yang, Haitao ct al. Description of Core Experinent 4 (CE4): Inter prediction and motion vector coding, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. JVET-K1024_v4. 11th Meeting. Ljub… [cited by applicant]
First Office Action of the Chilean application No. 202100686, issued on Jan. 20, 2022. 18 pages with English translation. [cited by applicant]
Zhao (LGE) Jet Al: “CE4-related: Simplification to History Based Motion Vector Prediction”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITUT Sg. 1… [cited by applicant]
Zhang (Bytedance) L. et al: “CE4: History-based Motion Vector Prediction (Test 4.4.7)”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 )… [cited by applicant]
Lee H et al: “Non-CE4: HMVP unification between the Merge and MVP list”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 ), No. JVET-N0… [cited by applicant]
M-S Chiang et al: “CE10.1.1: Multi-hypothesis prediction for improving AMVP mode, skip or merge mode, and intra mode”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JT… [cited by applicant]
Supplementary European Search Report in European application No. 19861621.1, mailed on Feb. 15, 2022. 15 pages. [cited by applicant]
Office Action of the Indian application No. 202117017663, issued on Feb. 14, 2022. 6 pages with English translation. [cited by applicant]
First Office Action of the Chinese application No. 202110444343.7, issued on Apr. 6, 2022. 20 pages with English translation. [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/455,171, issued on Mar. 2, 2023. 32 pages. [cited by applicant]
Second Office Action of the European application No. 19861621.1, issued on Jan. 26, 2023. 3 pages. [cited by applicant]
First Office Action of the Russian application No. 2021111108, issued on Feb. 9, 2023. 13 pages with English translation. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/455,204, issued on Mar. 20, 2023. 28 pages. [cited by applicant]
Correct notice of Allowance of the U.S. Appl. No. 17/455,204, issued on Apr. 11, 2023. 7 pages. [cited by applicant]
First Office Action of the Korean application No. 10-2019-0116385, issued on Apr. 11, 2025. 13 pages with English translation. [cited by applicant]
First Office Action of the Malaysian application No. PI2021001527, issued on Jul. 26, 2023. 4 pages. [cited by applicant]
Oral Proceedings of the European application No. 19861621.1, issued on Sep. 1, 2023. 8 pages. [cited by applicant]
Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, Document: JVET-C0047, Title: Generalized bi-prediction for inter coding, Author(s) or … [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, Document: JVET-K0257-v1, Title: CE10.1: Combined and multi-hypothesis prediction, Author(… [cited by applicant]
First Office Action of the Japanese application No. 2021-515146, issued on Sep. 8, 2023. 12 pages with English translation. [cited by applicant]
First Office Action of the Indonesian application No. P00202102864, issued on Jul. 13, 2023. 5 pages with English translation. [cited by applicant]
Second Office Action of the Canadian application No. 3113585, issued on Jul. 5, 2023. 5 pages. [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, Document: JVET-K0104-v5, Title: CE4-related: History-based Motion Vector Prediction, Auth… [cited by applicant]
Minutes of the Oral Proceedings of the European application No. 19861621.1, issued on Feb. 29, 2024. [cited by applicant]
Notice of Final Rejection of the Korean application No. 10-2019-0116385, issued on Dec. 2, 2025. [cited by applicant]
First Office Action of the European application No. 24173580.2, issued on Apr. 14, 2026. [cited by applicant]