IP Library Granted Patent US 11,082,702
Granted Patent B2
US 11,082,702 · App. 16/628,420 · Granted Aug 3, 2021

Inter prediction mode-based image processing method and device therefor

Inventors: Naeri Park (Seoul, KR); Junghak Nam (Seoul, KR); Seunghwan Kim (Seoul, KR); Jungdong Seo (Seoul, KR); Jaeho Lee (Seoul, KR); Hyeongmoon Jang (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/159H04N19/105H04N19/139H04N19/176H04N19/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,082,702
App. No.
16/628,420
Granted
Aug 3, 2021
Kind
B2
Abstract

Disclosed herein are an inter prediction mode-based image processing method and an apparatus therefor. Specifically, a method for processing an image based on an inter prediction mode may include: generating a temporary candidate list by using a spatial neighbor block or temporal neighbor block of a current block; calculating a cost for each candidate in the temporary candidate list by using a template of the current block; generating a final candidate list by rearranging candidates of the temporary candidate list based on the calculated cost; decoding a merge index indicating a specific candidate in the final candidate list; and generating a prediction block of the current block by using motion information of a candidate indicated by the merge index.

Claims (36)

1. A method for processing an image based on an inter prediction mode, comprising:

generating, by a processor, a temporary candidate list by using a spatial neighbor block or temporal neighbor block of a current block;

calculating, by the processor, a cost for each candidate in the temporary candidate list based on a difference between a template of the current block and a template of a reference block of a motion vector of the candidate;

generating, by the processor, a final candidate list by rearranging candidates of the temporary candidate list based on the calculated cost;

decoding, by the processor, a merge index indicating a specific candidate in the final candidate list; and

generating, by the processor, a prediction block of the current block by using motion information of a candidate indicated by the merge index,

wherein the calculating of the cost includes: performing a normalization on the difference based on a width and a height of the current block when the current block is a non-square block.

2. The method of claim 1 ,

wherein the merge index indicates one of predetermined number of candidates according to a high order of the final candidate list.

3. The method of claim 1 ,

wherein generating the temporary candidate list comprises:

identifying a candidate having a bi-direction motion information among candidates of the temporary candidate list; and

adding uni-direction motion information of L0 direction or L1 direction to the temporary candidate list, among motion information having the bi-direction motion information.

4. The method of claim 1 ,

wherein generating the temporary candidate list comprises:

adding an average value or a median value of motion information of blocks having a predetermined size neighboring to a left side or an upper side of the current block to the temporary candidate list.

5. The method of claim 4 ,

wherein adding the average value or the median value to the temporary candidate list comprises:

scaling a motion vector of the blocks having the predetermined size according to a distance to a reference picture.

6. The method of claim 1 , further comprising:

refining, by the processor, a motion vector of candidates in the final candidate list in an integer pixel unit or a fractional pixel unit.

7. The method of claim 6 ,

wherein refining the motion vector comprises:

calculating a cost of a motion vector indicating a neighboring integer pixel or a neighboring fractional pixel which is adjacent to a pixel indicated by the motion vector.

8. The method of claim 7 ,

wherein the cost of the motion vector indicating the neighboring integer pixel or the neighboring fractional pixel is calculated based on a difference between the template of the current block and a template of a reference block identified by the motion vector indicating the neighboring integer pixel or the neighboring fractional pixel.

9. An apparatus for processing an image based on an inter prediction mode, comprising:

a memory configured to store data of the image; and

a processor coupled to the memory,

wherein the processor is configured for:

generating a temporary candidate list by using a spatial neighbor block or temporal neighbor block of a current block;

calculating a cost for each candidate in the temporary candidate list based on a difference between a template of the current block and a template of a reference block of a motion vector of the candidate;

generating a final candidate list by rearranging candidates of the temporary candidate list based on the calculated cost;

decoding a merge index indicating a specific candidate in the final candidate list; and

generating a prediction block of the current block by using motion information of a candidate indicated by the merge index,

wherein the processor is further configured for performing a normalization on the difference based on a width and a height of the current block when the current block is a non-square block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2020
From: PARK, NAERI; NAM, JUNGHAK; KIM, SEUNGHWAN; SEO, JUNGDONG; LEE, JAEHO; JANG, HYEONGMOON
To: LG ELECTRONICS INC.
Reel/Frame 051445/0546 →
Continuity (2)
Provisional Application 62528159 · Jul 3, 2017
Related Publication 20200162743A1 · May 21, 2020