IP Library Granted Patent US 7,274,402
Granted Patent B2
US 7,274,402 · App. 10/871,881 · Granted Sep 25, 2007

Method and apparatus for motion-vector-aided pixel interpolation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,274,402
App. No.
10/871,881
Granted
Sep 25, 2007
Kind
B2
Abstract

In a method and apparatus for motion-vector-aided interpolation of a pixel in an intermediate image lying temporally or spatially between first and second images, motion vectors are assigned to the pixel to be interpolated, one pixel in each image being assigned to each vector. Video information values (e.g., luminance or chrominance values) are determined based on the video information values of pixels assigned to the motion vectors. A further video information value is generated by mixing certain of the video information values, and other video information values form a value interval, the mathematical position of the further video information value being determined relative to the interval boundaries. The video information value to be interpolated is determined depending on the position of the further video information value relative to the interval boundaries.

Claims (43)

1. A method for motion-vector-aided interpolation of a pixel in an intermediate image lying between a first image and a second image, comprising the steps of:

assigning a first motion vector and a second motion vector to the pixel to be interpolated;

assigning a first pixel in the first image to the first motion vector and assigning a second pixel in the second image to the second motion vector;

determining a first video information value based on a video information value of the first pixel and determining a second video information value based on a video information value of the second pixel;

determining a first further video information value based on a video information value of a third pixel at an initial point of the second motion vector in the first image and determining a second further video information value based on a video information value of a fourth pixel at a terminal point of the second motion vector in the second image;

generating a third video information value by mixing the first and second further video information values;

determining an interval having boundaries defined by the first and second video information values;

determining a position of the third video information value relative to the interval boundaries;

selecting the third video information value as a video information value of the interpolated pixel if the third video information value lies inside the interval boundaries; and

determining a video information value of the interpolated pixel if the third video information value lies outside the interval boundaries, by

a) determining a mathematical distance from the third video information value to the nearest interval boundary;

b) determining a video information value that is spaced apart from the nearest interval boundary by the value of the determined mathematical distance and lying inside the interval boundaries; and

c) selecting the determined video information value from step b) as a video information value of the interpolated pixel.

2. The method of claim 1 , where an average of the first and second video information values is selected as the video information value of the interpolated pixel if the third video information value lies outside the interval boundaries defined by the first and second video information values and the distance from the third video information value to the nearest interval boundary is larger than half the width of the interval.

3. The method of claim 1 , where the determined mathematical distance is set equal to zero if the mathematical distance from the third video information value to the nearest interval boundary is smaller than a specified threshold value.

4. The method of claim 1 , where the determined mathematical distance is increased.

5. The method of claim 1 , where the determined mathematical distance is decreased.

6. The method of claim 1 , where the second motion vector is a zero vector.

7. The method of claim 2 , where the third video information value is generated from an average of the first and second further video information values.

8. The method of claim 1 , further comprising the following steps determining the first and second video information values:

d) selecting a plurality of the first motion vectors and determining the video information values of pixels assigned to the first motion vectors in the first image and determining the video information values of pixels assigned to the second motion vectors in the second image; and

e) selecting one of the determined first video information values from step d) as the first video information value and selecting one of the determined second video information values from step e) as the second video information value.

9. The method of claim 8 , further comprising the step of determining the intervals between each of the video information values of the pixels assigned to the first motion vectors in the first image and each of the video information values of the pixels assigned to the first motion vectors in the second image, and selecting as the first and second video information values the two video information values between which the smallest interval is formed.

10. The method of claim 1 , further comprising the following steps for determining the first and second video information values:

selecting a plurality of first motion vectors and determining, the video information values of pixels assigned to the first motion vectors in the first image and determining the video information values assigned to the first motion vectors in the second image;

filtering the video information values determined on the basis of the first motion vectors to generate an intermediate value; and

selecting the video information values assigned to one of the first motion vectors and selecting as the first and second video information values the two values, from a set including the first and second video information values and the intermediate value, that span the largest interval.

11. The method of claim 8 , further comprising the step of determining intervals between each of the video information values of pixels assigned to the first motion vectors in the first image and each of the video information values of pixels assigned to the first motion vectors in the second image, and selecting as the first and second video information values the two video information values between which the largest interval is formed.

12. A method for determining a video information value of a pixel that is interpolated in an intermediate image lying between a first image and a second image, comprising the steps of:

determining a position of an interpolated pixel video information value relative to an interval having boundaries defined by certain ones of a plurality of video information values associated with a plurality of pixels in each of the first and second images;

selecting the interpolated pixel video information value at the determined position as the determined video information value of the interpolated pixel if the determined position lies inside the interval boundaries;

determining the video information value of the interpolated pixel if the determined position lies outside the interval boundaries, by

a) determining the distance from the determined position to the nearest interval boundary;

b) determining a video information value spaced from the nearest interval boundary by the value of the determined distance in step a) and lying inside the interval boundaries;

c) selecting the determined video information value from step b) as the determined video information value of the interpolated pixel,

where the step of determining a position of an interpolated video information value relative to an interval further comprises the steps of:

assigning a first motion vector and a second motion vector to the pixel to be interpolated;

assigning a first pixel in the first image to the first motion vector and assigning a second pixel in the second image to the second motion vector;

determining a first video information value based on a video information value of the first pixel and determining a second video information value based on a video information value of the second pixel;

determining a first further video information value based on a video information value of a third pixel at an initial point of the second motion vector in the first image and determining a second further video information value based on a video information value of a fourth pixel at a terminal point of the second motion vector in the second image;

generating a third video information value from the first and second further video information values;

determining the interval having boundaries defined by the first and second video information values; and

determining a position of the third video information value relative to the interval boundaries, the position of the third video information value being the determined video information value of the interpolated pixel.

Assignments (9)
RELEASE OF SECURITY INTEREST Recorded Jun 23, 2021
From: MUFG UNION BANK, N.A.
To: MAXLINEAR, INC.; EXAR CORPORATION; MAXLINEAR COMMUNICATIONS LLC
Reel/Frame 056656/0204 →
SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001) Recorded Jul 1, 2020
From: JPMORGAN CHASE BANK, N.A.
To: MUFG UNION BANK, N.A.
Reel/Frame 053115/0842 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2018
From: MAXLINEAR INC; ENTROPIC COMMUNICATIONS LLC
To: DYNAMIC DATA TECHNOLOGIES LLC
Reel/Frame 047128/0295 →
SECURITY AGREEMENT Recorded May 12, 2017
From: MAXLINEAR, INC.; ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.); EXAR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042453/0001 →
MERGER AND CHANGE OF NAME Recorded May 19, 2015
From: ENTROPIC COMMUNICATIONS, INC.; EXCALIBUR SUBSIDIARY, LLC; ENTROPIC COMMUNICATIONS, LLC
To: ENTROPIC COMMUNICATIONS, LLC
Reel/Frame 035717/0628 →
MERGER AND CHANGE OF NAME Recorded May 18, 2015
From: EXCALIBUR ACQUISITION CORPORATION; ENTROPIC COMMUNICATIONS, INC.; ENTROPIC COMMUNICATIONS, INC.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 035706/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2012
From: TRIDENT MICROSYSTEMS, INC.; TRIDENT MICROSYSTEMS (FAR EAST) LTD.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 028146/0054 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2009
From: MICRONAS GMBH
To: TRIDENT MICROSYSTEMS (FAR EAST) LTD.
Reel/Frame 023134/0885 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2004
From: HAHN, MARKO
To: MICRONAS GMBH
Reel/Frame 015892/0157 →