IP Library Granted Patent US 10,321,151
Granted Patent B2
US 10,321,151 · App. 15/126,365 · Granted Jun 11, 2019

Method of adaptive interpolation filtering in video coding

Inventors: Ching-Yeh Chen (Taipei, TW); Yu-Wen Huang (Taipei, TW)
Assignee: MEDIATEK INC.
H04N19/523H04N19/105H04N19/117H04N19/583H04N19/96H04N19/174H04N19/176H04N19/182
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,321,151
App. No.
15/126,365
Granted
Jun 11, 2019
Kind
B2
Abstract

A method and apparatus of adaptive interpolation filter for motion compensation with fractional-pixel accuracy are disclosed. Embodiments of the present invention generate interpolated reference samples at non-integer locations based on existing reference samples in a reference block by using an interpolation filter set adaptively according to pixel location and/or pixel characteristics. A current block is then encoded or decoded using a temporal predictor including the interpolated reference samples. The adaptive interpolation filter can be applied to the prediction unit (PU). In one embodiment, the interpolation filter set consists of interpolation filters having different filter lengths. An interpolation filter with a longer tap length is applied to generate interpolated reference samples farther from the block boundary and an interpolation filter with a shorter tap length is applied to generate interpolated reference samples closer to the block boundary.

Claims (36)

1. A method of interpolation for motion compensation with fractional pixel accuracy in a video coding system, the method comprising:

receiving input data associated with one or more current blocks in a current picture;

determining one or more current MVs (motion vectors) associated with said one or more current blocks;

locating one or more reference blocks in a reference picture according to said one or more current MVs; and

for each of said one or more current MVs corresponding to a fractional-pixel location:

generating interpolated reference samples at non-integer locations based on existing reference samples in one reference block by using an interpolation filter set adaptively according to at least one of pixel location or pixel characteristics, wherein the interpolation filter set comprises a longer-tap filter and a shorter-tap filter, wherein the longer-tap filter is configured to generate a first interpolated reference sample, the shorter-tap filter is configured to generate a second interpolated reference sample, and the first interpolated reference sample is farther from a related block boundary than the second interpolated reference sample, wherein the shorter-tap filter is applied to generate the interpolated reference samples in an overlapped area between said two adjacent blocks, and wherein the block boundary separates reference pixels from current pixels in a current block among the one or more current blocks; and

encoding or decoding one current block using a temporal predictor including the interpolated reference samples.

2. The method of claim 1 , wherein said one or more current blocks and said one or more reference block correspond to prediction unit (PU).

3. The method of claim 1 , wherein said one or more current blocks correspond to two adjacent blocks for overlapped motion compensation (OBMC).

4. The method of claim 3 , wherein the shorter-tap filter corresponds to a 4-tap filter.

5. The method of claim 4 , wherein the longer-tap filter corresponds to an 8-tap filter and the longer-tap filter is applied to generate the interpolated reference samples in a non-overlapped area of said two adjacent blocks.

6. The method of claim 1 , wherein said one or more current blocks corresponds to one current block for motion boundary enhancement (MBE), and the shorter-tap filter is applied to generate boundary interpolated reference samples of said one current block.

7. The method of claim 6 , wherein the shorter-tap filter corresponds to a 4-tap filter.

8. The method of claim 7 , wherein the longer-tap filter corresponds to an 8-tap filter and the longer-tap filter is applied to generate the interpolated reference samples in said one current block.

9. The method of claim 1 , wherein the current picture is partitioned into multiple regions and an individual interpolation filter set is determined for each region.

10. The method of claim 9 , wherein each region corresponds to one slice, one tile, one coding tree unit (CTU), one coding tree block (CTB), one coding unit (CU) or one prediction unit (PU).

11. The method of claim 9 , wherein information related to the individual interpolation filter set for each region is signaled explicitly or derived implicitly at a decoder side.

12. The method of claim 11 , wherein a syntax element related to the individual interpolation filter set for each region is signaled to indicate the individual interpolation filter set selected for a current region.

13. The method of claim 11 , wherein the information related to the individual interpolation filter set for each region is derived at the decoder side based on coding unit (CU) size, prediction unit (PU) size, characteristic of reference pixels, prediction mode, motion vector, or any combination thereof.

14. The method of claim 1 , wherein:

the longer-tap filter is a horizontal long-tap filter;

the shorter-tap filter is a horizontal short-tap filter; and

the related block boundary is a vertical block boundary such that the first interpolated reference sample is farther from the vertical block boundary than the second interpolated reference sample.

15. The method of claim 1 , wherein:

the longer-tap filter is a vertical long-tap filter;

the shorter-tap filter is a vertical short-tap filter; and

the related block boundary is a horizontal block boundary such that the first interpolated reference sample is farther from the horizontal block boundary than the second interpolated reference sample.

16. The method of claim 14 , wherein

the interpolation filter set further comprises a vertical longer-tap filter and a vertical shorter-tap filter.

17. An apparatus for motion compensation with fractional pixel accuracy in a video coding system, the apparatus comprising one or more electronic circuits configured to:

receive input data associated with one or more current blocks in a current picture;

determine one or more current MVs (motion vectors) associated with said one or more current blocks;

locate one or more reference blocks in a reference picture according to said one or more current MVs; and

for each of said one or more current MVs corresponding to a fractional-pixel location:

generate interpolated reference samples at non-integer locations based on existing reference samples in one reference block by using an interpolation filter set adaptively according to at least one of pixel location or pixel characteristics, wherein the interpolation filter set comprises a longer-tap filter and a shorter-tap filter, wherein the longer-tap filter is configured to generate a first interpolated reference sample, the shorter-tap filter is configured to generate a second interpolated reference sample, and the first interpolated reference sample is farther from a related block boundary than the second interpolated reference sample, wherein the shorter-tap filter is applied to generate the interpolated reference samples in an overlapped area between said two adjacent blocks, and wherein the block boundary separates reference pixels from current pixels in a current block among the one or more current blocks; and

encode or decode one current block using a temporal predictor including the interpolated reference samples.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2022
From: MEDIATEK INC.
To: HFI INNOVATION INC.
Reel/Frame 059339/0015 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2016
From: CHEN, CHING-YEH; HUANG, YU-WEN
To: MEDIATEK INC.
Reel/Frame 039755/0232 →
Continuity (2)
Provisional Application 61973407 · Apr 1, 2014
Related Publication 20170085913A1 · Mar 23, 2017
Cited By (1)
US 12,382,063