Frame rate conversion with partial motion vector
A system can include a memory and a motion vector calculator (MVC) configured to receive a block from the memory, the MVC including an MVC core configured to generate a partial motion vector (MV) for the block, a halo reduction block configured to perform halo reduction on the partial MV, and an MV post-processing block configured to smooth the partial MV and output the smoothed partial MV.
1. A machine-implemented method of frame rate conversion (FRC), comprising:
a motion vector (MV) generator at a client, the MV generator internally generating motion vectors (MVs);
a frame interpolation (FI) block at the client, the FI block using the internally generated MVs to perform motion-compensated FI;
an image comparator configured to compare a first frame from a first FI block at a server to a second frame from a second FI block at the server;
an external MV generator externally generating MVs;
the client receiving the externally generated MVs;
replacing, at the client, at least a portion of the internally generated MVs with the externally generated MVs based on the comparing; and
using the externally generated MVs in place of the internally generated MVs in subsequent iterations of a recursive three-dimensional (3D) motion vector calculation (MVC) process.
2. The machine-implemented method of FRC according to claim 1 , further comprising inserting additional information into the externally generated MVs.
3. The machine-implemented method of FRC according to claim 2 , wherein the additional information may include any of the following: global MV, global motion model, regional foreground/background MV, and regional brightness compensation value.
4. The machine-implemented method of FRC according to claim 1 , further comprising packing the internally generated MVs into a compressed video stream.
5. The machine-implemented method of FRC according to claim 1 , further comprising replacing at least some of the MVs used for H.264 compression with generated partial MVs.
6. The machine-implemented method of FRC according to claim 1 , further comprising compressing the externally generated MVs.
7. The machine-implemented method of FRC according to claim 1 , further comprising a partial MV packer performing MV compression to reduce the size of the partial MV.
8. The machine-implemented method of FRC according to claim 1 , further comprising:
decomposing the partial MVs; and
applying the decomposed MVs to improve MV quality near an object boundary.