IP Library › Granted Patent US 10,382,782
Granted Patent B2
US 10,382,782 · App. 14/742,238 · Granted Aug 13, 2019

Image frame interpolation apparatus, display apparatus and control method thereof

Inventors: Tae-gyoung Ahn (Yongin-si, KR); Hyung-jun Lim (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/577H04N19/587
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,382,782
App. No.
14/742,238
Granted
Aug 13, 2019
Kind
B2
Abstract

An image frame interpolation apparatus includes a motion vector generator configured to generate a motion vector based on a first image frame and a second image frame; a motion scaler configured to scale the motion vector to thereby generate a scaled motion vector; and a motion compensator including an internal memory, the motion compensator being configured to perform motion compensation based on the scaled motion vector and generate an interpolation frame using the internal memory, the motion scaler being configured to scale the motion vector based on a size of the motion vector and a size of the internal memory.

Claims (175)

1. An image frame interpolation apparatus comprising:

a receiver configured to receive a first image frame and a second image frame; and

a video processor comprising an internal memory, the video processor being configured to:

generate a motion vector based on the first image frame and the second image frame using a first memory size in the internal memory;

scale the motion vector based on a size of the motion vector and a size of the internal memory to thereby generate a scaled motion vector; and

perform motion compensation based on the scaled motion vector and generate an interpolation frame using a second memory size in the internal memory,

wherein the video processor is configured to generate a plurality of motion vectors including the motion vector, and determine a scaling value that prevents a size of a motion vector having a largest motion value among the plurality of motion vectors from exceeding a search range stored in the internal memory,

wherein the second memory size is smaller than the first memory size by a predetermined size.

2. The image frame interpolation apparatus according to claim 1 ,

wherein the video processor is configured to generate the motion vector based on a first portion of image data of the first image frame and a second portion of image data of the second image frame.

3. The image frame interpolation apparatus according to claim 2 ,

wherein the video processor is configured to down-scale the plurality of motion vectors based on the determined scaling value.

4. The image frame interpolation apparatus according to claim 3 ,

wherein the video processor is configured to scale all of the plurality of motion vectors corresponding to an entirety of the first image frame and the second image frame according to the determined scaling value.

5. The image frame interpolation apparatus according to claim 2 ,

wherein the video processor is configured to scale the motion vector based on an equation:

MV

me

⁡

(

x

,

y

)

=

(

MC

SR

max

x

,

y

⁢

MV

me

⁡

(

x

,

y

)

)

×

MV

me

⁡

(

x

,

y

)

,

⁢

for

⁢

⁢

0

≤

x

<

W

,

0

≤

y

<

H

where MV me (x, y) is the motion vector generated by the video processor, MC SR is the search range of the internal memory, and MV mc (x, y) is the scaled motion vector which is output to the video processor.

6. The image frame interpolation apparatus according to claim 1 ,

wherein the first image frame is a previous image frame, and the second image frame is a current image frame positioned after the previous image frame in a frame order.

7. The image frame interpolation apparatus according to claim 1 ,

wherein the internal memory of the video processor has a size that is smaller than a predetermined size.

8. A display apparatus comprising:

a broadcast receiver configured to receive a broadcast signal;

a video processor configured to convert a frame rate of a video signal included in the received broadcast signal; and

a display configured to display the video signal having the converted frame rate,

wherein the video processor comprises an internal memory and is configured to:

generate a motion vector based on a first image frame and a second image frame included in the video signal using a first memory size in the internal memory;

scale the motion vector based on a size of the motion vector and a size of the internal memory to thereby generate a scaled motion vector, and

perform motion compensation based on the scaled motion vector and generate an interpolation frame using a second memory size in the internal memory,

wherein the video processor is configured to generate a plurality of motion vectors including the motion vector, and determine a scaling value that prevents a size of a motion vector having a largest motion value among the plurality of motion vectors from exceeding a search range stored in the internal memory,

wherein the second memory size is smaller than the first memory size by a predetermined size.

9. The display apparatus according to claim 8 ,

wherein the internal memory of the video processor has a size that is smaller than a predetermined size.

10. A method for controlling an image frame interpolation apparatus, the method comprising:

generating a motion vector based on a first image frame and a second image frame using a first memory size in a memory configured to be used in motion compensation;

scaling the motion vector based on a size of the motion vector and a size of the memory; and

performing the motion compensation based on the scaled motion vector and generating an interpolation frame using a second memory size in the memory,

wherein the generating the motion vector further comprises generating a plurality of motion vectors including the motion vector,

wherein the method further comprises determining a scaling value that prevents a size of a motion vector having a largest motion value among the plurality of motion vectors from exceeding a search range stored in the memory, and

wherein the second memory size is smaller than the first memory size by a predetermined size.

11. The method according to claim 10 ,

wherein the generating the motion vector comprises generating the motion vector based on a first portion of image data of the first image frame and a second portion of image data of the second image frame.

12. The method according to claim 11 ,

wherein the scaling the motion vector comprises:

down-scaling the motion vector based on the determined scaling value.

13. The method according to claim 12 ,

wherein the scaling the motion vector comprises scaling all of the plurality of motion vectors corresponding to an entirety of the first image frame and the second image frame according to the determined scaling value.

14. The method according to claim 11 ,

wherein the scaling the motion vector comprises scaling the motion vector based on an equation:

MV

me

⁡

(

x

,

y

)

=

(

MC

SR

max

x

,

y

⁢

MV

me

⁡

(

x

,

y

)

)

×

MV

me

⁡

(

x

,

y

)

,

⁢

for

⁢

⁢

0

≤

x

<

W

,

0

≤

y

<

H

where MV me (x, y) is the generated motion vector, MC SR is the search range of the memory, and MV mc (x, y) is the scaled motion vector.

15. The method according to claim 10 ,

wherein the first image frame is a previous image frame, and the second image frame is a current image frame positioned after the previous image frame in a frame order.

16. A method for controlling a display apparatus, the method comprising:

receiving a broadcast signal;

converting a frame rate of a video signal included in the received broadcast signal; and

displaying the video signal having the converted frame rate,

wherein the converting the frame rate comprises:

generating a motion vector based on a first image frame and a second image frame included in the video signal using a first memory size in an internal memory,

scaling the motion vector based on a size of the motion vector and a size of a memory configured to be used in motion compensation, and

performing motion compensation based on the scaled motion vector and generating an interpolation frame using a second memory size in the internal memory,

wherein the generating the motion vector further comprises generating a plurality of motion vectors including the motion vector, and

the method further comprises determining a scaling value that prevents a size of a motion vector having a largest motion value among the plurality of motion vectors from exceeding a search range stored in the memory,

wherein the second memory size is smaller than the first memory size by a predetermined size.

17. A video apparatus comprising:

a receiver configured to receive a frame of a video; and

a video processor comprising an internal memory, the video processor configured to:

scale a motion vector obtained from the frame of the video to thereby generate a scaled motion vector using a first memory size in the internal memory; and

perform motion compensation based on the scaled motion vector using a second memory size in the internal memory,

wherein the video processor is configured to scale the motion vector based on a search range of the internal memory, and

wherein the video processor is configured to determine a scaling value that prevents a size of a motion vector having a largest motion value among a plurality of motion vectors including the motion vector from exceeding the search range stored in the internal memory,

wherein the second memory size is smaller than the first memory size by a predetermined size.

18. The video apparatus according to claim 17 , wherein the video processor is further configured to reduce the frame of the video to thereby obtain a reduced frame,

wherein the video processor is configured to generate the motion vector from the reduced frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2015
From: AHN, TAE-GYOUNG; LIM, HYUNG-JUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 035862/0298 →
Priority Claims (1)
KR 10-2014-0137629 · Oct 13, 2014 · national
Continuity (2)
Provisional Application 62018086 · Jun 27, 2014
Related Publication 20150382015A1 · Dec 31, 2015