Method and apparatus for motion compensated temporal interpolation of video sequences
View Patent ↗A method and device for processing video signals is provided, comprising the steps of: selecting a motion vector having the least mean square error from an M×N block, applying a vector filter to the motion vector, and if filter output MSE is below a present threshold select the filtered motion vector as output filter, and if above the threshold, select input vector as output filter. Perform a P×Q nearest neighbor motion vector substitution on the output motion vector field, where P is less than M and Q is less than N. Perform an S×T nearest neighbor substitution on the output motion vector field, where S is less than P and T is less than Q.
1. A method of processing video signals in the form of motion vectors generated by motion estimation, the method characterized by the steps of:
selecting a motion vector having the least mean square error from a block of size M×N;
applying a vector filter to the motion vector, if filter output MSE is below a preset threshold select the filtered motion vector as output filter, and if above the threshold, select input vector as output filter;
performing a P×Q nearest neighbor motion vector substitution on the output motion vector field, where P is less than M and Q is less than N; and
performing an S×T nearest neighbor substitution on the output motion vector field, where S is less than P and T is less than Q.
2. The method according to claim 1 , wherein the step of applying a vector filter is performed using a nonlinear filter.
3. The method according to claim 2 , wherein the nonlinear filter is the R E filter.
4. The method according to claim 1 , wherein the preset threshold is sixteen times MSE of the input vector.
5. The method according to claim 1 , wherein the step of performing P×Q nearest neighbor substitution includes comparing the output motion vector against motion vectors of neighboring P×Q blocks and outputting the motion vector having the smallest MSE.
6. The method according to claim 1 , wherein the step of performing S×T nearest neighbor substitution includes comparing the selected motion vector against motion vectors of neighboring S×T blocks and outputting the motion vector having the smallest MSE.
7. The method according to claim 1 , wherein M×N is 32×32, P×Q is 16×16 and S×T is 8×8.
8. An apparatus for processing video signals in the form of motion vectors generated by motion estimation, the apparatus characterized by:
means for selecting a motion vector having the least mean square error from a block of size M×N;
means for applying a vector filter to the motion vector, if filter output MSE is below a preset threshold select the filtered motion vector as output filter, and if above the threshold, select input vector as output filter;
means for performing a P×Q nearest neighbor motion vector substitution on the output motion vector field, where P is less than M and Q is less than N; and
means for performing an S×T nearest neighbor substitution on the output motion vector field, where S is less than P and T is less than Q.
9. The apparatus according to claim 8 , wherein the step of applying a vector filter is performed using a nonlinear filter.
10. The apparatus according to claim 9 , wherein the nonlinear filter is the R E filter.
11. The apparatus according to claim 8 , wherein the preset threshold is sixteen times MSE of the input vector.
12. The apparatus according to claim 8 , wherein the step of performing P×Q nearest neighbor substitution includes comparing the output motion vector against motion vectors of neighboring P×Q blocks and outputting the motion vector having the smallest MSE.
13. The apparatus according to claim 8 , wherein the step of performing S×T nearest neighbor substitution includes comparing the selected motion vector against motion vectors of neighboring S×T blocks and outputting the motion vector having the smallest MSE.
14. The apparatus according to claim 8 , wherein M×N is 32×32, P×Q is 16×16 and S×T is 8×8.