Method and system for providing reliable motion vectors

1. A method for providing reliable motion vectors, comprising:

determining, with a processor, motion vectors between a first image frame and a second image frame with backward and forward estimation, the first image frame preceding the second image frame;

comparing, with the processor, backward estimation motion vectors and forward estimation motion vectors;

detecting, with the processor, unreliable motion vectors based on a comparison result;

determining, with the processor, image background regions covered by an object and image background regions left uncovered by the object based on unreliable motion vectors;

removing, with the processor, the unreliable motion vectors; and

replacing, with the processor, removed unreliable motion vectors with reliable, predetermined background motion vectors,

wherein an unreliable motion vector is detected by

selecting, as a block under test, a block within the second image frame using the processor,

determining, with the processor, the backward estimation motion vector for the block under test,

finding, with the processor, a block within the first image frame to which the backward estimation motion vector is pointing,

determining, with the processor, the forward estimation motion vector for the block found within the first image frame, and

comparing, with the processor, the determined backward estimation motion vector and the determined forward estimation motion vector, the determined backward motion vector being unreliable and subject to removal when the determined forward motion vector points to a block other than the block under test, and

the image background regions covered by the object and the image background regions left uncovered by the object are determined by

assigning, with the processor, a forward motion vector reliability indicator to each block in the first image frame based on a reliability determination for forward estimation motion vectors corresponding to each block,

assigning, with the processor, a backward motion vector reliability indicator to each block in the second image frame based on a reliability determination for backward estimation motion vectors corresponding to each block, and

computing, with the processor, a final indicator identifying an image background regions as covered by the object or as left uncovered by the object.

2. A system for providing reliable motion vectors, comprising:

circuitry configured to

determine motion vectors between a first image frame and a second image frame with backward estimation, the first image frame preceding the second image frame;

determine motion vectors between the first and second image frames with forward estimation;

compare backward estimation motion vectors and forward estimation motion vectors;

detect unreliable motion vectors based on a comparison result;

determine image background regions covered by an object and image background regions left uncovered by the object based on unreliable motion vectors;

remove the unreliable motion vectors; and

replace removed unreliable motion vectors with reliable, predetermined background motion vectors,

wherein in comparing the backwards estimation motion vectors and the forward estimation motion vectors, the circuitry is further configured to

select as a block under test a block within second image frame,

determine the backward estimation motion vector for the block under test,

find a block within the first frame to which the backward estimation motion vector is pointing,

determine the forward estimation motion vector for the found block, and

compare the determined backward estimation motion vector and the determined forward estimation motion vector, the determined backward motion vector being unreliable and subject to removal when the determined forward motion vector points to a block other than the block under test, and

in determining the image background regions covered by the object and the image background regions left uncovered by the object to, the circuitry is further configured to

assign a forward motion vector reliability indicator to each block in the first image frame based on a reliability determination for forward estimation motion vectors corresponding to each block,

assign a backward motion vector reliability indicator to each block in the second image frame based on a reliability determination for backward estimation motion vectors corresponding to each block, and

compute a final indicator identifying an image background regions as covered by the object or as left uncovered by the object.

3. A non-transitory computer-readable medium having computer-readable instructions stored thereon, the computer-readable instructions when executed by a computer cause the computer to perform the method comprising:

determining motion vectors between a first image frame and a second image frame with backward and forward estimation, the first image frame preceding the second image frame;

comparing backward estimation motion vectors and forward estimation motion vectors;

detecting unreliable motion vectors based on a the comparison result;

determining image background regions covered by an object and image background regions left uncovered by the object based on unreliable motion vectors;

removing the unreliable motion vectors; and

replacing removed unreliable motion vectors with reliable, predetermined background motion vectors,

wherein an unreliable motion vector is detected by

selecting as a block under test a block within the second image frame,

determining the backward estimation motion vector for the block under test,

finding a block within the first image frame to which backward estimation motion vector is pointing,

determining the forward estimation motion vector for the found block, and

comparing the determined backward estimation motion vector and the determined forward estimation motion vector, the determined backward motion vector being unreliable and subject to removal when the determined forward motion vector points to a block other than the block under test, and

the image background regions covered by the object and the image background regions left uncovered by the object are determined by

assigning a forward motion vector reliability indicator to each block in the first image frame based on a reliability determination for forward estimation motion vectors corresponding to each block,

assigning a backward motion vector reliability indicator to each block in the second image frame based on a reliability determination for backward estimation motion vectors corresponding to each block, and

computing a final indicator identifying an image background regions as covered by the object or as left uncovered by the object.

4. A method for providing reliable motion vectors, comprising:

determining, with a processor, motion vectors between a first image frame and a second image frame with backward and forward estimation, the first image frame preceding the second image frame;

comparing, with the processor, backward estimation motion vectors and forward estimation motion vectors;

detecting, with the processor, unreliable motion vectors based on a comparison result;

determine, with the processor, image background regions covered by an object and image background regions left uncovered by the object based on unreliable motion vectors;

removing, with the processor, the unreliable motion vectors; and

replacing, with the processor, removed unreliable motion vectors with reliable, predetermined background motion vectors,

wherein an unreliable motion vector is detected by

selecting as a block under test a block within the first image frame using the processor,

determining, with the processor, the forward estimation motion vector for the block under test,

finding, with the processor, a block within the second image frame to which the forward estimation motion vector is pointing,

determining, with the processor, the backward estimation motion vector for the found block, and

comparing, with the processor, the determined forward estimation motion vector and the determined backward estimation motion vector, the determined forward motion vector being unreliable and subject to removal when the determined backward motion vector points to a block other than the block under test, and

the image background regions covered by the object and the image background regions left uncovered by the object are determined by

assigning, with the processor, a forward motion vector reliability indicator to each block in the first image frame based on a reliability determination for forward estimation motion vectors corresponding to each block,

assigning, with the processor, a backward motion vector reliability indicator to each block in the second image frame based on a reliability determination for backward estimation motion vectors corresponding to each block, and

computing, with the processor, a final indicator identifying an image background regions as covered by the object or as left uncovered by the object.

5. A system for providing reliable motion vectors, comprising:

circuitry configured to

determine motion vectors between a first image frame and a second image frame with backward estimation, the first image frame preceding the second image frame;

determine motion vectors between the first image frame and the second image frame with forward estimation;

compare backward estimation motion vectors and forward estimation motion vectors;

detect unreliable motion vectors based on a comparison result;

determine image background regions covered by an object and image background regions left uncovered by the object based on unreliable motion vectors;

remove the unreliable motion vectors; and

replace removed unreliable motion vectors with reliable, predetermined background motion vectors,

wherein in comparing the backward estimation motion vectors and the forward estimation motion vectors, the circuitry is further configured to

select as a block under test a block within the first image frame,

determine the forward estimation motion vector for the block under test,

find a block within the second image frame to which the forward estimation motion vector is pointing,

determine the backward estimation motion vector for the found block, and

compare the determined forward estimation motion vector and the determined backward estimation motion vector, the determined forward motion vector being unreliable and subject to removal when the determined backward motion vector points to a block other than the block under test, and

in determining the image background regions covered by the object and the image background regions left uncovered by the object, the circuitry is further configured to

assign a forward motion vector reliability indicator to each block in the first image frame based on a reliability determination for forward estimation motion vectors corresponding to each block,

assign a backward motion vector reliability indicator to each block in the second image frame based on a reliability determination for backward estimation motion vectors corresponding to each block, and

compute a final indicator identifying an image background regions as covered by the object or as left uncovered by the object.

6. A non-transitory computer-readable medium having computer-readable instructions stored thereon, the computer-readable instructions when executed by a computer cause the computer to perform a method comprising:

determining motion vectors between a first image frame and a second image frame with backward and forward estimation, the first image frame preceding the second image frame;

comparing backward estimation motion vectors and forward estimation motion vectors;

detecting unreliable motion vectors based on a comparison result;

determining image background regions covered by an object and image background regions left uncovered by the object based on detected unreliable motion vectors;

removing the unreliable motion vectors; and

replacing removed unreliable motion vectors with reliable, predetermined background motion vectors,

wherein an unreliable motion vector is detected by

selecting as a block under test a block within the first image frame,

determining the forward estimation motion vector for the block under test,

finding a block within the second image frame to which the forward estimation motion vector is pointing,

determining the backward estimation motion vector for the found block, and

comparing the determined forward estimation motion vector and the determined backward estimation motion vector, the determined forward motion vector being unreliable and subject to removal when the determined backward motion vector points to a block other than the block under test, and

the image background regions covered by the object and the image background regions left uncovered by the object are determined by

assigning a forward motion vector reliability indicator to each block in the first image frame based on a reliability determination for forward estimation motion vectors corresponding to each block,

assigning a backward motion vector reliability indicator to each block in the second image frame based on a reliability determination for backward estimation motion vectors corresponding to each block, and

computing a final indicator identifying an image background regions as covered by the object or as left uncovered by the object.

7. A method according to claim 1 or 4 , wherein the step of comparing includes calculating the vector distance between the compared motion vectors, preferably calculating the Euclidian or Manhattan distance.

8. A method according to claim 7 , wherein the step of comparing includes detecting whether the calculated vector distance exceeds a predefined threshold.

9. An electronic device, preferably a television, comprising a system according to claim 2 or 5 .