Techniques for frame repetition control in frame rate up-conversion
Various embodiments are generally directed to techniques for determining whether to use an interpolated frame or repeat a base frame in up-converting the frame rate of a base video stream to generate an up-converted video stream. A device to up-convert a frame rate includes an analysis component to analyze a pair of temporally adjacent base frames and a motion vector associated with movement of an object between the pair of base frames to determine a degree of visual artifacts involving an edge of the object in an interpolated frame, and a selection component to compare the degree of visual artifacts to a threshold and select the interpolated frame for insertion between the preceding base frame and the following base frame in up-converting a frame rate of the base video stream to generate an up-converted video stream based on the comparison. Other embodiments are described and claimed.
1. A device to up-convert a motion video frame rate comprising:
a processor circuit; and
a memory storing instructions which when executed by the processor circuit cause the processor circuit to:
receive a pair of temporally adjacent base frames of a base video stream, the base frames comprising a preceding base frame and a following base frame;
analyze a motion vector associated with movement of an object between the preceding base frame and the following base frame to determine a degree of visual artifacts involving an edge of the object in an interpolated frame based on a first criterion value and a second criterion value for the preceding base frame, the first criterion value corresponding to a count of pixels of the edge of the object in the preceding base frame having color values not used in determining color values for pixels in the interpolated frame, the second criterion value corresponding to a count of pixels of the edge of the object in the preceding base frame having color values used to determine color values for more than one pixel in the interpolated frame; and
select the interpolated frame for insertion between the preceding base frame and the following base frame in up-converting a frame rate of the base video stream to generate an up-converted video stream based on at least one of the first and second criterion values exceeding a threshold.
2. The device of claim 1 , the memory storing instructions which when executed by the processor circuit cause the processor circuit to selectively insert a copy of one of the preceding base frame and the following base frame between the preceding base frame and the following base frame instead of the interpolated frame based on a determination that the first and second criterion values do not exceed the threshold.
3. The device of claim 1 , the memory storing instructions which when executed by the processor circuit cause the processor circuit to:
determine the first criterion value and the second criterion value for the following base frame; and
select the interpolated frame for insertion between the preceding base frame and
the following base frame based on at least one of the first and second criterion values for
the following base frame exceeding the threshold.
4. The device of claim 3 , the memory storing instructions which when executed by the processor circuit cause the processor circuit to:
multiply the first criterion values for the preceding base frame and the following base frame by a first factor;
multiply the second criterion values for the preceding base frame and the following base frame by a second factor;
compute a respective sum of the multiplied first criterion values and the multiplied second criterion values for the preceding base frame and the following base frame:
divide the sum for the preceding base frame by a count of pixels in the preceding base frame depicting an edge to determine a modified criterion value for the preceding base frame; and
divide the sum for the following base frame by a count of pixels in the following base frame depicting an edge to determine a modified criterion value for the following base frame.
5. The device of claim 4 , the memory storing instructions which when executed by the processor circuit cause the processor circuit to select the interpolated frame for insertion between the preceding base frame and the following base frame by:
compare the modified criterion values of the preceding base frame and the following base frame to identify a greater one of the modified criterion values; and
determine that the greater one of the modified criterion values exceeds the threshold.
6. The device of claim 5 , the threshold corresponding to an amount of distraction of a human visual system (HVS) introduced by the visual artifacts.
7. The device of claim 1 , comprising at least one of a display to visually present frames of the up-converted video stream or an interface to transmit up-converted video data comprising the up-converted video stream to a display device via a network following up-conversion of the base video stream to generate the up-converted video stream, the base video stream and the up-converted video stream representing a motion video.