Motion vector field re-timing
A method of estimating a particular motion vector (D R (x, n+α)) for a particular pixel, having a particular spatial position and being located at a temporal position (n+α) intermediate a first image and a second image of a sequence of video images, on basis of a first motion vector field (D 3 (x, n−1)) being estimated for the first image and on basis of a second motion vector field (D 3 (x, n)) being estimated for the second image is disclosed. The method comprises: creating a set of motion vectors (D p , D n , D c ) by selecting a number of motion vectors from the first motion vector field (D 3 (x, n−1)) and second motion vector field (D 3 (x, n)), on basis of the particular spatial position of the particular pixel; and establishing the particular motion vector (D R (x,n+α)) by performing an order statistical operation on the set of motion vectors (D p , D n , D c ).
1 . A method of estimating a particular motion vector ({right arrow over (D)} R ({right arrow over (x)},n+α)) for a particular pixel, having a particular spatial position and being located at a temporal position (n+α) intermediate a first image and a second image of a sequence of video images, on basis of a first motion vector field {right arrow over (()}D 3 ({right arrow over (x)},n−1)) being estimated for the first image and on basis of a second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)}, n−1)) being estimated for the second image, the method comprising:
creating a set of motion vectors ({right arrow over (D)} p , {right arrow over (D)} n ,{right arrow over (D)} c ) by selecting a number of motion vectors from the first motion vector field ({right arrow over (D)} 3 ({right arrow over (x)}, n−1)) and second motion vector field ({right arrow over (D)} 3 ({right arrow over (x)},n)), on basis of the particular spatial position of the particular pixel; and
establishing the particular motion vector ({right arrow over (D)} R ({right arrow over (x)}, n+α)) by performing an order statistical operation on the set of motion vectors ({right arrow over (D)} p , {right arrow over (D)} n , {right arrow over (D)} c ).
2 . A method of estimating a particular motion vector as claimed in claim 1 , wherein the order statistical operation is a median operation.
3 . A method of estimating a particular motion vector as claimed in claim 1 , wherein creating the set of motion vectors comprises selecting a first motion vector being estimated for the first image, having a first spatial position which corresponds to the particular spatial position of the particular pixel.
4 . A method of estimating a particular motion vector as claimed in claim 3 , wherein creating the set of motion vectors comprises selecting a second motion vector being estimated for the first image, having a second spatial position which is determined by the particular spatial position of the particular pixel and the first motion vector being selected.
5 . A method of estimating a particular motion vector as claimed in claim 4 , wherein creating the set of motion vectors comprises selecting a third motion vector being estimated for the second image, having a third spatial position which is determined by the particular spatial position of the particular pixel and the first motion vector being selected.
6 . A method of estimating a particular motion vector as claimed in claim 1 , wherein creating the set of motion vectors comprises selecting a second motion vector being estimated for the first image, having a second spatial position which is determined by the particular spatial position of the particular pixel and a first motion vector being estimated for the particular pixel.
7 . A method of estimating a particular motion vector as claimed in claim 6 , wherein creating the set of motion vectors comprises selecting a third motion vector being estimated for the second image, having a third spatial position which is determined by the particular spatial position of the particular pixel and the first motion vector being estimated for the particular pixel.
8 . A method of estimating a particular motion vector as claimed in claim 3 , wherein creating the set of motion vectors comprises selecting a second motion vector being estimated for the second image, having a second spatial position which corresponds to the particular spatial position of the particular pixel.
9 . A method of estimating a particular motion vector as claimed in claim 8 , wherein creating the set of motion vectors comprises selecting a third motion vector being estimated for the first image, having a third spatial position and a fourth motion vector being estimated for the first image, having a fourth spatial position, the first spatial position, the third spatial position and the fourth spatial position being located on a line.
10 . A method of estimating a particular motion vector as claimed in claim 9 , wherein an orientation of the line corresponds with the first motion vector.
11 . A method of estimating a particular motion vector as claimed in claim 1 , wherein the method comprises up-conversion of a first intermediate motion vector field into the first motion vector field, the first motion vector field having a higher resolution than the first intermediate motion vector field, and comprises up-conversion of a second intermediate motion vector field into the second motion vector field, the second motion vector field having a further higher resolution than the second intermediate motion vector field.
12 . A motion estimation unit ( 501 ) for estimating a particular motion vector for a particular pixel, having a particular spatial position and being located at a temporal position intermediate a first image and a second image of a sequence of video images, on basis of a first motion vector field being estimated for the first image and on basis of a second motion vector field being estimated for the second image, the motion estimation unit comprising:
set creating means ( 502 ) for creating a set of motion vectors by selecting a number of motion vectors from the first motion vector field and second motion vector field, on basis of the particular spatial position of the particular pixel; and
establishing means ( 504 ) for establishing the particular motion vector by performing an order statistical operation on the set of motion vectors.
13 . An image processing apparatus ( 700 ) comprising:
receiving means ( 702 ) for receiving a signal corresponding to a sequence of video images;
motion estimation means ( 506 ) for estimating a first motion vector field for a first one of the video images and a second motion vector field for a second one of the video images;
a motion estimation unit ( 501 ) for estimating a particular motion vector for a particular pixel, having a particular spatial position and being located at a temporal position between the first one of the video images and the second one of the video images, the motion estimation unit comprising:
set creating means ( 502 ) for creating a set of motion vectors by selecting a number of motion vectors from the first motion vector field and second motion vector field, on basis of the particular spatial position of the particular pixel; and
establishing means ( 504 ) for establishing the particular motion vector by performing an order statistical operation on the set of motion vectors; and
an image processing unit ( 704 ) for calculating a sequence of output images on basis of the sequence of video images and the particular motion vector.
14 . An image processing apparatus ( 700 ) as claimed in claim 13 , further comprising a display device ( 406 ) for displaying the output images.
15 . An image processing apparatus ( 700 ) as claimed in claim 14 , being a TV.
16 . A computer program product to be loaded by a computer arrangement, comprising instructions to estimate a particular motion vector for a particular pixel, having a particular spatial position and being located at a temporal position intermediate a first image and a second image of a sequence of video images, on basis of a first motion vector field being estimated for the first image and on basis of a second motion vector field being estimated for the second image, the computer arrangement comprising processing means and a memory, the computer program product, after being loaded, providing said processing means with the capability to carry out:
creating a set of motion vectors by selecting a number of motion vectors from the first motion vector field and second motion vector field, on basis of the particular spatial position of the particular pixel; and
establishing the particular motion vector by performing an order statistical operation on the set of motion vectors.