IP Library Granted Patent US 8,488,059
Granted Patent B2
US 8,488,059 · App. 12/855,094 · Granted Jul 16, 2013

Adaptation of frame selection for frame rate conversion

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,488,059
App. No.
12/855,094
Granted
Jul 16, 2013
Kind
B2
Abstract

At least a method and a system are described for providing frame rate upconversion by way of using “short side” or bidirectional interpolation in generating interpolated frames. In a representative embodiment, the method may comprise receiving a first frame of video corresponding to a first frame time and a second frame of the video corresponding to a second frame time, computing a first absolute difference between the first frame time and an interpolated frame time wherein the interpolated frame time temporally is located between the first frame time and the second frame time. The method further comprises using a first motion vector field and the first frame to compute a third frame at the interpolated frame time. The method further comprises outputting the third frame as the interpolated frame at the interpolated frame time if the first absolute difference is less than or equal to a first threshold value.

Claims (42)

1. A method of performing frame rate upconversion of video by way of generating an interpolated frame comprising:

receiving a first frame of the video corresponding to a first frame time and a second frame of the video corresponding to a second frame time;

using a first motion vector field and the first frame to compute a third frame at an interpolated frame time, wherein the first motion vector field is a function of the interpolated frame time and the first frame;

using a second motion vector field and the second frame to compute a fourth frame at the interpolated frame time, wherein the second motion vector field is a function of the interpolated frame time and the second frame:

computing a difference measure using the third frame and the fourth frame;

determining if the difference measure is less than a first threshold value;

if the difference measure is less than the first threshold value:

computing a first absolute difference between the first frame time and an interpolated frame time, the interpolated frame time temporally located between the first frame time and the second frame time;

selecting and outputting the third frame as an interpolated frame of the one or more interpolated frames if the first absolute difference is less than a second threshold value,

otherwise, computing a second absolute difference between the interpolated frame time and the second frame time; and

selecting and outputting the fourth frame as the interpolated frame if the second absolute difference is less than a third threshold value; and

if the difference measure is not less than the first threshold:

combining pixel values of corresponding pixels from the third frame and the fourth frame to generate a fifth frame; and

outputting the fifth frame as the interpolated frame.

2. The method of claim 1 wherein said first and said second frames correspond to successive input frames, said second frame corresponding to a previous frame, said first frame corresponding to a next frame.

3. The method of claim 1 wherein said combining pixel values comprises computing the average of said pixel values.

4. The method of claim 3 wherein said average comprises a weighted average of said third and fourth frames based on temporal distances from said interpolated frame time and said first frame time and said second frame time.

5. The method of claim 1 wherein said frame rate is upconverted by a value equal to the number of interpolated frames plus 1 .

6. The method of claim 1 wherein said frame rate of said video is upconverted from 24 Hz to 120 Hz.

7. The method of claim 1 wherein said first and said second frames correspond to successive input frames, said first frame corresponding to a previous frame, said second frame corresponding to a next frame.

8. The method of claim 1 wherein said difference measure comprises computing differences between corresponding pixels of said third frame and said fourth frame.

9. A system for performing frame rate upconversion of video by way of generating an interpolated frame comprising:

one or more processors, one or more circuits, or any combination thereof operable for, at least:

receiving a first frame of the video corresponding to a first frame time and a second frame of the video corresponding to a second frame time;

using a first motion vector field and the first frame to compute a third frame at an interpolated frame time, wherein the first motion vector field is a function of the interpolated frame time and the first frame;

using a second motion vector field and the second frame to compute a fourth frame at the interpolated frame time, wherein the second motion vector field is a function of the interpolated frame time and the second frame;

computing a difference measure using the third frame and the fourth frame;

determining if the difference measure is less than a first threshold value;

if the difference measure is less than the first threshold value:

computing a first absolute difference between the first frame time and an interpolated frame time, the interpolated frame time temporally located between the first frame time and the second frame time;

selecting and outputting the third frame as an interpolated frame of the one or more interpolated frames if the first absolute difference is less than a second threshold value,

otherwise, computing a second absolute difference between the interpolated frame time and the second frame time; and

selecting and outputting the fourth frame as the interpolated frame if the second absolute difference is less than a third threshold value; and

if the difference measure is not less than the first threshold:

combining pixel values of corresponding pixels from the third frame and the fourth frame to generate a fifth frame; and

outputting the fifth frame as the interpolated frame.

10. The system of claim 9 wherein said first and said second frames correspond to successive input frames, said second frame corresponding to a previous frame, said first frame corresponding to a next frame.

11. The system of claim 9 wherein said combining pixel values comprises computing the average of said pixel values.

12. The system of claim 11 wherein said average comprises a weighted average of said third and fourth frames based on temporal distances from said interpolated frame time and said first frame time and said second frame time.

13. The system of claim 9 wherein said frame rate is upconverted by a value equal to the number of interpolated frames plus 1 .

14. The system of claim 9 wherein said frame rate of said video is upconverted from 24 Hz to 120 Hz.

15. The system of claim 9 wherein said first and said second frames correspond to successive input frames, said first frame corresponding to a previous frame, said second frame corresponding to a next frame.

Assignments (4)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2010
From: BURNS, KATHLEEN; VAVRECK, KENNETH EDWARD; ROLETTER, GERALD MICHAEL; PEARLSTEIN, LARRY ALAN
To: BROADCOM CORPORATION
Reel/Frame 025011/0069 →