IP Library Granted Patent US 10,506,252
Granted Patent B2
US 10,506,252 · App. 15/372,686 · Granted Dec 10, 2019

Adaptive interpolation filters for video coding

Inventors: Dmytro Rusanovskyy (Tampere, FI); Kemal Ugur (Tampere, FI)
Assignee: Conversant Wireless Licensing S.a r.l.
H04N19/523H04N7/12H04N19/105H04N19/117H04N19/136H04N19/436H04N19/63H04N19/172H04N19/182H04N19/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,506,252
App. No.
15/372,686
Granted
Dec 10, 2019
Kind
B2
Abstract

In digital video image encoding and decoding, a filter type is selected based on symmetrical properties of the images and coefficient values of an interpolation filter are calculated based on the selected filter type. Coefficient values, filter tap-length and selected filter-type are provided in the encoded video data. Coefficient values are also calculated based on a prediction signal representative of the difference between a video frame and a reference image. The prediction signal is calculated from the reference image based on a predefined base filter and motion estimation performed on the video frame. The predefined base filter has fixed coefficient values. Coefficient values are selected from interpolation of pixel values in a selected image segment in the video frame. Symmetry properties of images can be a vertical symmetry, a horizontal symmetry and a combination thereof, so that only a portion of the filter coefficients are coded.

Claims (36)

1. A method for encoding images in a digital video sequence, comprising:

based on symmetry of statistical properties of the images in the digital video sequence, selecting an interpolation filter used in motion compensated prediction from the group consisting of:

a first filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in both the horizontal and vertical directions;

a second filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the horizontal direction;

a third filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the vertical direction;

a fourth filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the horizontal direction, and in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the vertical direction; and

a non-symmetrical filter type;

calculating coefficient values for the selected interpolation filter based on a minimization of energy of a prediction error signal; and

providing encoded data indicative of the digital video sequence for communication to a video decoder, the encoded data comprising information indicating:

the selected filter type for the interpolation filter;

the calculated coefficient values for the interpolation filter; and

a tap length indicating a number of the coefficient values of the interpolation filter.

2. The method of claim 1 , wherein the digital video sequence comprises a sequence of video frames;

and wherein the prediction error signal is representative of a difference between a selected one of the video frames and a reference image.

3. The method of claim 1 , wherein the digital video sequence comprises a sequence of video frames;

and wherein each video frame of the sequence of video frames is partitioned in a plurality of sections, at least one section of the plurality of sections having a different symmetry property from other sections of the plurality of sections.

4. The method of claim 3 , wherein the interpolation filter comprises a filter for the at least one section and one or more other filters for the other sections.

5. An apparatus for encoding images in a digital video sequence, the apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the processor, cause the apparatus at least to:

based on symmetry of statistical properties the images in the digital video sequence, select an interpolation filter used in motion compensated prediction from the group consisting of:

a first filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in both the horizontal and vertical directions;

a second filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the horizontal direction;

a third filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the vertical direction;

a fourth filter type in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the horizontal direction, and in which the same filter coefficients are used for the same distances of full-pixel positions to sub-pixel positions in the vertical direction; and

a non-symmetrical filter type;

calculate coefficient values for the selected interpolation filter based on a minimization of energy of a prediction error signal; and

provide encoded data indicative of the digital video sequence for communication to a video decoder, the encoded data including information indicating:

the selected filter type for the interpolation filter;

the calculated coefficient values for the interpolation filter; and

a tap length indicating a number of the coefficient values of the interpolation filter.

6. The apparatus of claim 5 , wherein the digital video sequence comprises a sequence of video frames;

and wherein the prediction error signal is representative of a difference between a selected one of the video frames and a reference image.

7. The apparatus of claim 5 , wherein the digital video sequence comprises a sequence of video frames;

and wherein each video frame of the sequence of video frames is partitioned in a plurality of sections, at least one section of the plurality of sections having a different symmetry property from other sections of the plurality of sections.

8. The apparatus of claim 7 , wherein the interpolation filter comprises a filter for the at least one section and one or more other filters for the other sections.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2023
From: CONVERSANT WIRELESS LICENSING S.A R.L.
To: CONVERSANT WIRELESS LICENSING LTD.
Reel/Frame 063507/0900 →
RELEASE OF SECURITY INTEREST Recorded Apr 13, 2021
From: CPPIB CREDIT INVESTMENTS INC.
To: CONVERSANT WIRELESS LICENSING S.A R.L.
Reel/Frame 055910/0698 →
AMENDED AND RESTATED U.S. PATENT SECURITY AGREEMENT (FOR NON-U.S. GRANTORS) Recorded Aug 22, 2018
From: CONVERSANT WIRELESS LICENSING S.A R.L.
To: CPPIB CREDIT INVESTMENTS, INC.
Reel/Frame 046897/0001 →
CHANGE OF NAME Recorded Sep 11, 2017
From: CORE WIRELESS LICENSING S.A.R.L.
To: CONVERSANT WIRELESS LICENSING S.A R.L.
Reel/Frame 043814/0274 →
Continuity (5)
Continuation 13962009 · Aug 8, 2013
Continuation 12008254 · Jan 8, 2008
Provisional Application 60884185 · Jan 9, 2007
Provisional Application 60879762 · Jan 9, 2007
Related Publication 20170094272A1 · Mar 30, 2017