Granted Patent B2

US 7,995,793 · App. 10/494,503 · Granted Aug 9, 2011

Abstract

Claims (27)

1. An occlusion detector for detecting occlusion areas in a first image based on a set of motion vectors, with the first image belonging to a series of consecutive images, wherein the occlusion detector comprises:

a motion vector selector for selecting a first motion vector and a second motion vector from the set of motion vectors, based on a substantial vector difference between the first motion vector and the second motion vector;

a pixel value comparator for calculating a first pixel value difference between a first luminance value of a first pixel of a second image and a second luminance value of a second pixel of a third image, with a first relation between the first pixel and the second pixel given by the first motion vector, and for calculating a second pixel value difference between a third luminance value of a third pixel of the second image and a fourth luminance value of a fourth pixel of the third image, with a second relation between the third pixel and the fourth pixel given by the second motion vector; and

a decision unit for deciding whether a particular pixel of the first image, corresponding to an intersection of the first motion vector and the second motion vector, belongs to one of the occlusion areas by checking whether the first pixel value difference is larger than a first predetermined threshold and the second pixel value difference is larger than a second predetermined threshold.

2. An occlusion detector as claimed in claim 1 , wherein the motion vector selector is designed to select the first motion vector based on a distance between the particular pixel and a further pixel that belongs to a particular group of pixels to which the first motion vector corresponds.

3. An occlusion detector as claimed in claim 1 , wherein the motion vector selector is designed to determine frequencies of occurrence for motion vectors of the set of motion vectors and to select the first motion vector on the basis of the frequencies of the occurrence.

4. An occlusion detector as claimed in claim 1 , wherein the pixel value comparator is designed to calculate an absolute difference between the first value and the second value.

5. An occlusion detector as claimed in claim 1 , wherein the motion vector selector is designed to select the first motion vector from the set of motion vectors, with the set comprising motion vectors estimated for respective groups of pixels of the first image and the third image.

6. An occlusion detector as claimed in claim 1 , wherein the occlusion detector comprises a measurement unit to determine the first predetermined threshold.

7. A method of detecting occlusion areas in a first image based on a set of motion vectors, with the first image belonging to a series of consecutive images wherein the method comprises:

selecting a first motion vector and a second motion vector from the set of motion vectors, based on a substantial vector difference between the first motion vector and the second motion vector;

calculating a first pixel value difference between a first luminance value of a first pixel of a second image and a second luminance value of a second pixel of a third image, with a first relation between the first pixel and the second pixel given by the first motion vector, and for calculating a second pixel value difference between a third luminance value of a third pixel of the second image and a fourth luminance value of a fourth pixel of the third image, with a second relation between the third pixel and the fourth pixel given by the second motion vector; and

deciding whether a particular pixel of the first image, corresponding to an intersection of the first motion vector and the second motion vector, belongs to one of the occlusion areas by checking whether the first pixel value difference is larger than a first predetermined threshold and the second pixel value difference is larger than a second predetermined threshold.

8. A motion estimator comprising:

a motion vector estimator for calculating a set of motion vectors;

an occlusion detector for detecting occlusion areas in a first image based on the set of motion vectors; and

a motion vector assigning unit for assigning a particular motion vector to a particular pixel on the basis of output of the occlusion detector, wherein the occlusion detector comprises:

a motion vector selector for selecting a first motion vector and a second motion vector from the set of motion vectors, based on a substantial vector difference between the first motion vector and the second motion vector;

a pixel value comparator for calculating a first pixel value difference between a first luminance value of a first pixel of a second image and a second luminance value of a second pixel of a third image, with a first relation between the first pixel and the second pixel given by the first motion vector, and for calculating a second pixel value difference between a third luminance value of a third pixel of the second image and a fourth luminance value of a fourth pixel of the third image, with a second relation between the third pixel and the fourth pixel given by the second motion vector; and

a decision unit for deciding whether a particular pixel of the first image, corresponding to an intersection of the first motion vector and the second motion vector belongs to one of the occlusion areas by checking whether the first pixel value difference is larger than a first predetermined threshold and the second pixel value difference is larger than a second predetermined threshold.

9. An image processing apparatus comprising:

receiving means for receiving a signal representing a first image to be displayed;

a motion estimator comprising an occlusion detector for detecting occlusion areas in the first image based on a set of motion vectors, with the first image belonging to a series of consecutive images; and

a motion compensated image processing unit wherein the occlusion detector comprises:

a motion vector selector for selecting a first motion vector and a second motion vector from the set of motion vectors, based on a substantial vector difference between the first motion vector and the second motion vector;

a pixel value comparator for calculating a first pixel value difference between a first luminance value of a first pixel of a second image and a second luminance value of a second pixel of a third image, with a first relation between the first pixel and the second pixel given by the first motion vector, and for calculating a second pixel value difference between a third luminance value of a third pixel of the second image and a fourth luminance value of a fourth pixel of the third image, with a second relation between the third pixel and the fourth pixel given by the second motion vector; and

a decision unit for deciding whether a particular pixel of the first image, corresponding to an intersection of the first motion vector and the second motion vector, belongs to one of the occlusion areas by checking whether the first pixel value difference is larger than a first predetermined threshold and the second pixel value difference is larger than a second predetermined threshold.

Assignments (12)