IP Library Granted Patent US 9,769,490
Granted Patent B2
US 9,769,490 · App. 13/962,009 · Granted Sep 19, 2017

Adaptive interpolation filters for video coding

Inventors: Dmytro Rusanovskyy (Tampere, FI); Kemal Ugur (Tampere, FI)
Assignee: Core Wireless Licensing S.a.r.l.
H04N19/523H04N7/12H04N19/117H04N19/136H04N19/63H04N19/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,769,490
App. No.
13/962,009
Granted
Sep 19, 2017
Kind
B2
Abstract

In digital video image encoding and decoding, a filter type is selected based on symmetrical properties of the images and coefficient values of an interpolation filter are calculated based on the selected filter type. Coefficient values, filter tap-length and selected filter-type are provided in the encoded video data. Coefficient values are also calculated based on a prediction signal representative of the difference between a video frame and a reference image. The prediction signal is calculated from the reference image based on a predefined base filter and motion estimation performed on the video frame. The predefined base filter has fixed coefficient values. Coefficient values are selected from interpolation of pixel values in a selected image segment in the video frame. Symmetry properties of images can be a vertical symmetry, a horizontal symmetry and a combination thereof, so that only a portion of the filter coefficients are coded.

Claims (70)

1. A method for encoding images in a digital video sequence, comprising:

calculating coefficient values for an interpolation filter used in motion compensated prediction, the coefficient values being calculated based on a selected filter type for the interpolation filter;

providing encoded data indicative of the digital video sequence, the encoded data including information indicating:

the selected filter type for the interpolation filter;

the calculated coefficient values for the interpolation filter; and

a tap length indicating a number of the coefficient values of the interpolation filter; and

forming, at a multiplexer, an encoded bit-stream comprising at least the encoded data indicative of the digital video sequence,

wherein the selected filter type for the interpolation filter is selected based on symmetry properties of the images in the digital video sequence, and wherein the symmetry properties of the images can be at least one of a vertical image symmetry and a horizontal image symmetry.

2. The method of claim 1 , wherein the symmetry properties of the images include a statistical characteristic.

3. The method of claim 1 , wherein:

the digital video sequence comprises a sequence of video frames; and

the coefficient values are calculated based on a prediction signal representative of a difference between a selected one of the video frames and a reference image.

4. The method of claim 1 , wherein:

the digital video sequence comprises a sequence of video frames; and

each video frame of the sequence of video frames is partitioned in a plurality of sections, at least one section of the plurality of sections having a different symmetry property from other sections of the plurality of sections.

5. The method of claim 4 , wherein the interpolation filter comprises a filter for the at least one section and one or more other filters for the other sections.

6. An apparatus for encoding images in a digital video sequence, the apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the processor, cause the apparatus at least to:

calculate coefficient values for an interpolation filter used in motion compensated prediction, the coefficient values being calculated based on a selected filter type for the interpolation filter;

provide encoded data indicative of the digital video sequence, the encoded data including information indicating:

the selected filter type for the interpolation filter;

the calculated coefficient values for the interpolation filter; and

a tap length indicating a number of the coefficient values of the interpolation filter; and

form an encoded bit-stream comprising at least the encoded data indicative of the digital video sequence,

wherein the selected filter type for the interpolation filter is selected based on symmetry properties of the images in the digital video sequence, and wherein the symmetry properties of the images can be at least one of a vertical image symmetry and a horizontal image symmetry.

7. The apparatus of claim 6 , wherein the symmetry properties of the images include a statistical characteristic.

8. The apparatus of claim 7 , wherein:

the digital video sequence comprises a sequence of video frames; and

the coefficient values are calculated based on a prediction signal representative of a difference between a selected one of the video frames and a reference image.

9. The apparatus of claim 7 , wherein:

the digital video sequence comprises a sequence of video frames; and

each video frame of the sequence of video frames is partitioned in a plurality of sections, at least one section of the plurality of sections having a different symmetry property from other sections of the plurality of sections.

10. The apparatus of claim 9 , wherein the interpolation filter comprises a filter for the at least one section and one or more other filters for the other sections.

11. A method for decoding encoded video data, comprising:

demultiplexing encoded video data;

retrieving, from the encoded video data, information indicating:

a selected filter type for an interpolation filter used in motion compensated prediction;

coefficient values for the interpolation filter, the coefficient values being calculated based on the selected filter type for the interpolation filter; and

a tap length indicating a number of the coefficient values of the interpolation filter;

constructing the interpolation filter based on the filter type, the coefficient values and the tap length; and

reconstructing pixel values in a frame of the video sequence based on the constructed interpolation filter and the encoded video data,

wherein the selected filter type for the interpolation filter is selected based on symmetry properties of the images in the digital video sequence, and wherein the symmetry properties of the images can be at least one of a vertical image symmetry and a horizontal image symmetry.

12. The method of claim 11 , wherein the symmetry properties of the images include a statistical characteristic.

13. The method of claim 11 , wherein:

the digital video sequence comprises a sequence of video frames; and

the coefficient values are calculated based on a prediction signal representative of a difference between a selected one of the video frames and a reference image.

14. The method of claim 11 , wherein:

the digital video sequence comprises a sequence of video frames; and

each video frame of the sequence of video frames is partitioned in a plurality of sections, at least one section of the plurality of sections having a different symmetry property from other sections of the plurality of sections.

15. The method of claim 14 , wherein the interpolation filter comprises a filter for the at least one section and one or more other filters for the other sections.

16. An apparatus for decoding encoded video data, comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

demultiplex encoded video data;

retrieve, from the encoded video data, information indicating:

a selected filter type for an interpolation filter used in motion compensated prediction;

coefficient values for the interpolation filter, the coefficient values being calculated based on the selected filter type for the interpolation filter; and

a tap length indicating a number of the coefficient values of the interpolation filter;

construct the interpolation filter based on the filter type, the coefficient values and the tap length; and

reconstruct pixel values in a frame of the video sequence based on the constructed interpolation filter and the encoded video data,

wherein the selected filter type for the interpolation filter is selected based on symmetry properties of the images in the digital video sequence, and wherein the symmetry properties of the images can be at least one of a vertical image symmetry and a horizontal image symmetry.

17. The apparatus of claim 16 , wherein the symmetry properties of the images include a statistical characteristic.

18. The apparatus of claim 16 , wherein:

the digital video sequence comprises a sequence of video frames; and

the coefficient values are calculated based on a prediction signal representative of a difference between a selected one of the video frames and a reference image.

19. The apparatus of claim 16 , wherein:

the digital video sequence comprises a sequence of video frames; and

each video frame of the sequence of video frames is partitioned in a plurality of sections, at least one section of the plurality of sections having a different symmetry property from other sections of the plurality of sections.

20. The apparatus of claim 19 , wherein the interpolation filter comprises a filter for the at least one section and one or more other filters for the other sections.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Apr 13, 2021
From: CPPIB CREDIT INVESTMENTS INC.
To: CONVERSANT WIRELESS LICENSING S.A R.L.
Reel/Frame 055910/0698 →
AMENDED AND RESTATED U.S. PATENT SECURITY AGREEMENT (FOR NON-U.S. GRANTORS) Recorded Aug 22, 2018
From: CONVERSANT WIRELESS LICENSING S.A R.L.
To: CPPIB CREDIT INVESTMENTS, INC.
Reel/Frame 046897/0001 →
CHANGE OF NAME Recorded Sep 11, 2017
From: CORE WIRELESS LICENSING S.A.R.L.
To: CONVERSANT WIRELESS LICENSING S.A R.L.
Reel/Frame 043814/0274 →
Continuity (4)
Continuation 12008254 · Jan 8, 2008
Provisional Application 60879762 · Jan 9, 2007
Provisional Application 60884185 · Jan 9, 2007
Related Publication 20140037006A1 · Feb 6, 2014