Method for processing an image sequence having consecutive video images in order to improve the spatial resolution
View Patent ↗An image sequence includes consecutive video images each exhibiting at least one image region having a number of pixels, where each pixel includes at least one intensity value. For each image a motion measure value is determined indicative of temporal change of a video content of the image region and varying the intensity values of the pixels of the image region relative to the associated intensity values from video image to video image, a measure for the variation of the intensity values being dependent on the motion measure value determined and the change in the intensity values relative to the associated intensity values being greater the larger the motion represented by the motion measure value.
1. A method for processing an image sequence having consecutive video images each exhibiting at least one image region having a number of pixels, at least one intensity value being associated with each pixel, the method comprising;
for each image region, determining a motion measure indicative of a temporal change of a video content of the image region; and
varying, from video image to video image, a plurality of displayed intensity values of the pixels of the image region relative to the associated intensity values, a measure for the variation of the displayed intensity values being dependent on the motion measure determined, and the change in the displayed intensity values relative to the associated intensity values being greater the larger the motion represented by the motion measure, wherein the displayed intensity values of the pixels are alternately increased to a first value greater than the associated intensity value and decreased to a second value less than the associated intensity value from video image to video image, wherein the change in the displayed intensity value relative to the associated intensity value is largest for the associated intensity value halfway between zero and a maximum possible associated intensity value.
2. The method of claim 1 , wherein a common motion measure is determined for image regions that are located at the same position in two consecutive images, and wherein the displayed intensity values of the pixels of the image region are increased in one of the two images and decreased in the other of the two images.
3. The method of claim 1 , wherein the determination of a motion measure for an image region of a video image comprises:
determining a first motion measure for the image region and determining a second motion measure for the same image region in at least one temporally subsequent or temporally previous image; and
filtering the first motion measure and the second motion measure in order to obtain the motion measure.
4. The method of claim 1 , wherein intensity values for three colors are associated with each pixel and wherein at least one of the displayed intensity values is varied in dependence on the motion measure determined.
5. The method of claim 1 , wherein a brightness value (luminance value) and two color values (chrominance value) are associated with each pixel and wherein the brightness value is varied in dependence on the motion measure determined.
6. The method of claim 2 , wherein a measure by which the displayed intensity values are increased in the one image corresponds to a measure by which the displayed intensity values are diminished in the other image.
7. The method of claim 6 , wherein the determination of a motion measure for an image region of a video image comprises:
determining a first motion measure for the image region and determining a second motion measure for at least one image region adjacent the image region; and
filtering the first motion measure and the second motion measure to obtain the motion measure.
8. The method of claim 3 , wherein the filtering comprises low-pass filtering.
9. The method of claim 7 , wherein the filtering comprises low-pass filtering.
10. The method of claim 4 , wherein three displayed intensity values are varied for each pixel in dependence on the motion measure determined.
11. A method for processing an image sequence that, exhibits original images and, between every two original images, at least one motion compensated intermediate image having at least one image region, the at least one image region exhibiting a number of pixels, at least one intensity value being associated with each pixel, the method comprising:
determining a motion estimation quality value of the at least one image region of the intermediate image; and
adjusting a plurality of displayed intensity values of the pixels of the image region of the intermediate image by an amount that depends on the motion estimation quality value, wherein the displayed intensity values of the pixels is alternately increased to a first value greater than the associated intensity value and decreased to a second value less than the associated intensity value from video image to video image, wherein the change in the displayed intensity value relative to the associated intensity value is largest for the associated intensity value halfway between zero and a maximum possible associated intensity value.
12. The method of claim 11 , wherein the displayed intensity values of the pixels of the image region of the intermediate image remain unchanged when the motion estimation quality value lies above a specified threshold value.
13. The method of claim 11 , wherein a motion vector is associated with the at least one image region of the intermediate image, which motion vector exhibits an initial point and a final point, the initial point indicating a first image region in an image previous to the intermediate image and the final point indicating a second image region in an image subsequent to the intermediate image, the first image region and the second image region each exhibiting a number of pixels with each of which at least one video information value is associated, and wherein the determination of the motion estimation quality value comprises comparing the video information values associated with the pixels of the first and second image regions.
14. The method of claim 12 , wherein the displayed intensity values of the pixels of the image region of the intermediate image are reduced relative to the associated intensity values when the motion estimation quality values lies below the specified threshold value.
15. The method of claim 14 , wherein, for a motion estimation quality value below the threshold value, the displayed intensity values are diminished more, relative to the associated intensity values, the smaller the motion estimation quality value.
16. The method of claim 15 , wherein, for a motion estimation quality value below the threshold value, the displayed intensity values of the image region are increased in an original image previous or subsequent to the intermediate image.