Image processing apparatus that produces a higher resolution image, image pickup apparatus and image processing program
The image processing apparatus includes an image obtaining part configured to obtain a first image and a second image. The first image is an image generated by image capturing or generated by expanding part of the captured image and includes a first object image. The second image corresponds to an image captured at a higher image capturing magnification than that for the first image and includes a second object image corresponding to part of the first object image. The apparatus includes a processing part configured to produce a third image whose resolution is higher than that of the first image by performing image processing on the first image using the second image as a constraint condition.
1. An image processing apparatus comprising:
an image obtainer configured to obtain a first image and a second image, the first image being an image generated by image capturing of an object as an original image or generated by expanding part of the image generated by the image capturing of the object, the first image including a first object image, the second image corresponding to an image captured at a higher image capturing magnification than that for the first image, and the second image including a second object image corresponding to part of the first object image; and
a processor configured to perform an estimation of one of the original image and a degradation function in the image capturing by using the second image as a constraint condition, and configured to produce a third image whose resolution is higher than that of the first image by performing calculation processing using the first image and a result of the estimation.
2. An image processing apparatus according to claim 1 , wherein the processor is configured to perform the estimation by calculation of a minimum value of the following evaluation function T(f):
T ( f )=λ g ( x )− C×f ( x )∥ 2 +αZ ( f )
where g(x) represents the first image, C represent a known degradation function in the image capturing, f(x) represents the original image, α represents a weighting factor, and Z(f) represents a constraint function corresponding to the constraint condition and including a correlation function that shows correlation between the first image and the second image.
3. An image processing apparatus according to claim 1 , wherein the processor is configured to perform the estimation using, as the degradation function, a transfer function of an image taking optical system used in the image capturing, the transfer function being estimated from the second image.
4. An image pickup apparatus comprising:
an image capturing part configured to perform image capturing; and
an image processing apparatus,
wherein the image processing apparatus comprising:
an image obtainer configured to obtain a first image and a second image, the first image being an image generated by the image capturing of an object as an original image or generated by expanding part of the image generated by the image capturing of the object, the first image including a first object image, the second image corresponding to an image captured at a higher image capturing magnification than that for the first image, and the second image including a second object image corresponding to part of the first object image; and
a processor configured to perform an estimation of one of the original image and a degradation function in the image capturing by using the second image as a constraint condition, and configured to produce a third image whose resolution is higher than that of the first image by performing calculation processing using the first image and a result of the estimation.
5. An image processing method comprising:
obtaining a first image and a second image, the first image being an image generated by image capturing of an object as an original image or generated by expanding part of the image generated by the image capturing of the object, the first image including a first object image, the second image corresponding to an image captured at a higher image capturing magnification than that for the first image, and the second image including a second object image corresponding to part of the first object image;
performing an estimation of one of the original image and a degradation function in the image capturing by using the second image as a constraint condition; and
producing a third image whose resolution is higher than that of the first image by performing calculation processing using the first image and a result of the estimation.
6. A non-transitory storage medium storing an image processing program for causing a computer to perform processing comprising:
obtaining a first image and a second image, the first image being an image generated by image capturing of an object as an original image or generated by expanding part of the image generated by the image capturing of the object, the first image including a first object image, the second image corresponding to an image captured at a higher image capturing magnification than that for the first image, and the second image including a second object image corresponding to part of the first object image;
performing an estimation of one of the original image and a degradation function in the image capturing by using the second image as a constraint condition; and
producing a third image whose resolution is higher than that of the first image by performing calculation processing using the first image and a result of the estimation.