Image-processing apparatus, image-processing method, and non-transitory computer readable medium storing image-processing program

1. An image-processing apparatus comprising:

a computer, wherein the computer is configured to:

detect a positional-displacement amount between a plurality of low-resolution images including a standard image and at least one reference image that are acquired in a time series;

generate a high-resolution combined image by positioning, on the basis of the positional-displacement amount detected, pixel information of the reference image at a standard-image position and by performing combining thereof in a high-resolution image space;

evaluate a positioning error caused by a resolution-enhancement magnification used when positioning the reference image in the high-resolution image space when generating the high-resolution combined image; and

correct the high-resolution combined image on the basis of the evaluation result,

wherein the correcting of the high-resolution combined image combines a high-resolution correction image generated by applying a filter to the high-resolution combined image on the basis of the evaluation result obtained, and the high-resolution combined image in accordance with combining ratios based on the evaluation result.

2. The image-processing apparatus according to claim 1 , further comprising:

an image-acquisition portion that acquires the plurality of low-resolution images in a time series,

wherein the image-acquisition portion is provided with an optical system that collects light coming from an imaging subject, an imaging device that acquires the individual low-resolution images by acquiring images of the light collected by the optical system, a sensor shifting mechanism that shifts a relative position of the optical system and imaging device in a direction that intersects the optical-axis direction, and a sensor-shift controller that controls a shifting direction and a shifting amount achieved by the sensor shifting mechanism.

3. The image-processing apparatus according to claim 2 , wherein the detecting of the positional-displacement amount detects a positional-displacement amount between the low-resolution images on the basis of the shifting direction and the shifting amount controlled by the sensor-shift controller.

4. The image-processing apparatus according to claim 1 , wherein the detecting of the positional-displacement amount calculates a positional-displacement amount between the low-resolution images on the basis of the standard image and the at least one reference image.

5. The image-processing apparatus according to claim 1 , wherein the generating of the high-resolution combined image performs, on the basis of the pixel information placed in the high-resolution space, interpolation of pixels at which the pixel information is not placed.

6. The image-processing apparatus according to claim 1 , wherein the evaluating of the positioning error includes:

calculating a characteristic quantity of a region that includes an arbitrary pixel-of-interest in the high-resolution combined image, and

calculating an error evaluation value of the pixel-of-interest by using the calculated characteristic quantity and the high-resolution combined image.

7. The image-processing apparatus according to claim 6 , wherein the calculating of the characteristic quantity calculates the characteristic quantity in the form of edge-direction information for the region in the high-resolution combined image.

8. The image-processing apparatus according to claim 6 , wherein the calculating of the error evaluation value calculates the error evaluation value on the basis of information indicating whether or not, in the region including the pixel-of-interest, a subject pixel for computing the error evaluation value falls within a pixel cycle determined by the resolution-enhancement magnification.

9. The image-processing apparatus according to claim 8 , wherein, when the resolution-enhancement magnification is M (M is a natural number), the calculating of the error evaluation value calculates the error evaluation value at the pixel-of-interest position by using a first correlation value between at least one pixel positioned 2M pixels away from the pixel-of-interest and the pixel-of-interest, and a second correlation value between at least one pixel positioned at other positions and the pixel-of-interest.

10. The image-processing apparatus according to claim 8 , wherein, when the resolution-enhancement magnification is M (M is a natural number), the calculating of the error evaluation value uses, as the error evaluation value at the pixel-of-interest position, a result of computing a correlation by setting contributions of the pixel-of-interest and pixel positioned 2M pixels away from the pixel-of-interest so as to be greater than contributions of pixels positioned at other positions.

11. An image-processing method comprising:

a positional-displacement detecting step of detecting a positional-displacement amount between a plurality of low-resolution images including a standard image and at least one reference image that are acquired in a time series;

a high-resolution combining step of generating a high-resolution combined image by positioning, on the basis of the positional-displacement amount detected in the positional-displacement detecting step, pixel information of the reference image at a standard-image position and by performing combining thereof in a high-resolution image space;

a positioning-error evaluating step of evaluating a positioning error caused by a resolution-enhancement magnification used when positioning the reference image in the high-resolution image space when generating the high-resolution combined image in the high-resolution combining step; and

an image-correcting step of correcting the high-resolution combined image on the basis of the evaluation result in the positioning-error evaluating step,

wherein, in the image-correcting step, a high-resolution correction image generated by applying a filter to the high-resolution combined image on the basis of the evaluation result obtained in the positioning-error evaluating step, and the high-resolution combined image are combined in accordance with combining ratios based on the evaluation result.

12. A non-transitory computer readable medium storing an image-processing program that causes a computer to execute image processing comprising:

a positional-displacement detecting step of detecting a positional-displacement amount between a plurality of low-resolution images including a standard image and at least one reference image that are acquired in a time series;

a high-resolution combining step of generating a high-resolution combined image by positioning, on the basis of the positional-displacement amount detected in the positional-displacement detecting step, pixel information of the reference image at a standard-image position and by performing combining thereof in a high-resolution image space;

a positioning-error evaluating step of evaluating a positioning error caused by a resolution-enhancement magnification used when positioning the reference image in the high-resolution image space when generating the high-resolution combined image in the high-resolution combining step; and

an image correcting step of correcting the high-resolution combined image on the basis of the evaluation result in the positioning-error evaluating step,

wherein, in the image-correcting step, a high-resolution correction image generated by applying a filter to the high-resolution combined image on the basis of the evaluation result obtained in the positioning-error evaluating step, and the high-resolution combined image are combined in accordance with combining ratios based on the evaluation result.