IP Library Granted Patent US 7,620,254
Granted Patent B2
US 7,620,254 · App. 10/775,532 · Granted Nov 17, 2009

Apparatus and method for motion-vector-aided interpolation of a pixel of an intermediate image of an image sequence

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,620,254
App. No.
10/775,532
Granted
Nov 17, 2009
Kind
B2
Abstract

Method for motion-vector-aided interpolation of a pixel of an intermediate image lying between two input images includes a first pixel being selected from a first field and a second pixel being selected from a second field using a first motion vector, and a third pixel being selected from the first field and a fourth pixel being selected from the second field using a second motion vector. Next, an interval specified by video information values of the first pixel and the second pixel or an interval specified by video information values of the third pixel and the fourth pixel is determined and the video information values are mixed such that the video information value of the pixel to be interpolated lies within this interval.

Claims (54)

1. A method for motion-vector-aided interpolation of a pixel of an intermediate image lying between two input images, the method comprising: using a processor to perform

selecting a first pixel from the first input image and assigning a first video information value to the first pixel using a first motion vector;

selecting a second pixel from the second input image and assigning a second video information value to the second pixel using the first motion vector;

selecting a third pixel from the first input image and assigning a third video information value to the third pixel using a second motion vector;

selecting a fourth pixel from the second input image and assigning a fourth video information value to the fourth pixel using the second motion vector;

determining a first interval specified by the first video information value and the second video information value or a second interval specified by the third video information value and the fourth video information value; and

mixing the video information values by multiplying the first video information value by a first weighting factor, the second video information value by a second weighting factor, the third video information value by a third weighting factor, and the fourth video information value by a fourth weighting factor and adding the weighted video information values to obtain a video information value of the pixel of the intermediate image, the weighting factors being chosen such that the video information value of the pixel of the intermediate image lies within the determined first or second intervals.

2. The method of claim 1 , further comprising the step of selecting the first, second, third and fourth weighting factors based on the one of the first and second determined intervals that is smaller in absolute value.

3. The method of claim 1 , further comprising the step of equally weighting the first video information value and the second video information value.

4. The method of claim 1 , further comprising the step of equally weighting the third video information value and the fourth video information value.

5. The method of claim 1 , where the second motion vector comprises a zero vector.

6. The method of claim 1 , further comprising the steps of:

generating a first intermediate value by mixing the first video information value and the second video information value;

generating a second intermediate value by mixing the third video information value and the fourth video information value; and

weighting the first and second intermediate values using a weighting factor to obtain the video information value of the pixel of the intermediate image.

7. The method of claim 6 , further comprising the steps of:

equally weighting the first video information value and the second video information value during the step of generating the first intermediate value; and

equally weighting the third video information value and the fourth video information value during the step of generating the second intermediate value.

8. The method of claim 7 , further comprising the step of selecting one of the first intermediate value and the second intermediate value as the video information value of the pixel of the intermediate image depending on the location of the first and second intermediate values relative to the determined first and second intervals.

9. The method of claim 8 , where the step of selecting one of the first and second intermediate values selects one of the first and second intermediate values that is within one of the first and second determined intervals.

10. The method of claim 1 , further comprising the steps of:

determining a first interpolated video information value using the first determined interval;

determining a second interpolated video information value using the second determined interval; and

mixing the first interpolated video information value and the second interpolated video information value to generate the video information value of the pixel of the intermediate image.

11. The method of claim 10 , where the first and second interpolated video information values are equally weighted.

12. Apparatus for motion-vector-aided interpolation of a pixel of an intermediate image lying between two input images, the apparatus comprising:

means for selecting a first pixel from the first input image and assigning a first video information value to the first pixel using a first motion vector;

means for selecting a second pixel from the second input image and assigning a second video information value to the second pixel using the first motion vector;

means for selecting a third pixel from the first input image and assigning a third video information value to the third pixel using a second motion vector;

means for selecting a fourth pixel from the second input image and assigning a fourth video information value to the fourth pixel using the second motion vector;

means for determining a first interval specified by the first video information value and the second video information value or a second interval specified by the third video information value and the fourth video information value; and

means for mixing the video information values by multiplying the first video information value by a first weighting factor, the second video information value by a second weighting factor, the third video information value by a third weighting factor, and the fourth video information value by a fourth weighting factor and adding the weighted video information values to obtain a video information value of the pixel of the intermediate image, the weighting factors being chosen such that the video information value of the pixel of the intermediate image lies within the determined first or second intervals.

13. The apparatus of claim 12 , further comprising means for selecting the first, second, third and fourth weighting factors based on the one of the first and second determined intervals that is smaller in absolute value.

14. The apparatus of claim 12 , further comprising means for equally weighting the first video information value and the second video information value.

15. The apparatus of claim 12 , further comprising means for equally weighting the third video information value and the fourth video information value.

16. The apparatus of claim 12 , further comprising:

means for generating a first intermediate value by mixing the first video information value and the second video information value;

means for generating a second intermediate value by mixing the third video information value and the fourth video information value; and

means for weighting the first and second intermediate values using a weighting factor to obtain the video information value of the pixel of the intermediate image.

17. The apparatus of claim 16 , further comprising:

means for equally weighting the first video information value and the second video information value during the step of generating the first intermediate value; and

means for equally weighting the third video information value and the fourth video information value during the step of generating the second intermediate value.

18. The apparatus of claim 17 , further comprising means for selecting one of the first intermediate value and the second intermediate value as the video information value of the pixel of the intermediate image depending on the location of the first and second intermediate values relative to the determined first and second intervals.

19. The apparatus of claim 12 , further comprising:

means for determining a first interpolated video information value using the first determined interval;

means for determining a second interpolated video information value using the second determined interval; and

means for mixing the first interpolated video information value and the second interpolated video information value to generate the video information value of the pixel of the intermediate image.

20. A method for motion-vector-aided interpolation of a pixel of an intermediate image lying between two input images, the method comprising: using a processor to perform

selecting a first pixel from the first input image and assigning a first video information value to the first pixel using a first motion vector;

selecting a second pixel from the second input image and assigning a second video information value to the second pixel using the first motion vector;

selecting a third pixel from the first input image and assigning a third video information value to the third pixel using a second motion vector;

selecting a fourth pixel from the second input image and assigning a fourth video information value to the fourth pixel using the second motion vector;

determining a first interval specified by the first video information value and the second video information value or a second interval specified by the third video information value and the fourth video information value; and

mixing the video information values by multiplying the first video information value by a first weighting factor, the second video information value by a second weighting factor, the third video information value by a third weighting factor, and the fourth video information value by a fourth weighting factor and adding the weighted video information values to obtain a video information value of the pixel of the intermediate image, the weighting factors being chosen such that the video information value of the pixel of the intermediate image lies within the determined first or second intervals and a sum of the first, the second, the third and the fourth weighting factors is equal to approximately 1.

Assignments (9)
RELEASE OF SECURITY INTEREST Recorded Jun 23, 2021
From: MUFG UNION BANK, N.A.
To: MAXLINEAR, INC.; EXAR CORPORATION; MAXLINEAR COMMUNICATIONS LLC
Reel/Frame 056656/0204 →
SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001) Recorded Jul 1, 2020
From: JPMORGAN CHASE BANK, N.A.
To: MUFG UNION BANK, N.A.
Reel/Frame 053115/0842 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2018
From: MAXLINEAR INC; ENTROPIC COMMUNICATIONS LLC
To: DYNAMIC DATA TECHNOLOGIES LLC
Reel/Frame 047128/0295 →
SECURITY AGREEMENT Recorded May 12, 2017
From: MAXLINEAR, INC.; ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.); EXAR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042453/0001 →
MERGER AND CHANGE OF NAME Recorded May 19, 2015
From: ENTROPIC COMMUNICATIONS, INC.; EXCALIBUR SUBSIDIARY, LLC; ENTROPIC COMMUNICATIONS, LLC
To: ENTROPIC COMMUNICATIONS, LLC
Reel/Frame 035717/0628 →
MERGER AND CHANGE OF NAME Recorded May 18, 2015
From: EXCALIBUR ACQUISITION CORPORATION; ENTROPIC COMMUNICATIONS, INC.; ENTROPIC COMMUNICATIONS, INC.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 035706/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2012
From: TRIDENT MICROSYSTEMS, INC.; TRIDENT MICROSYSTEMS (FAR EAST) LTD.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 028146/0054 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2009
From: MICRONAS GMBH
To: TRIDENT MICROSYSTEMS (FAR EAST) LTD.
Reel/Frame 023134/0885 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2005
From: SCHU, MARKUS
To: MICRONAS GMBH
Reel/Frame 015760/0666 →