Image pickup apparatus, image pickup method, and recording medium having recorded image pickup program

1. An image pickup apparatus, comprising:

an image pickup device that includes pixels in a predetermined color array and is configured to be able to acquire a plurality of color array images corresponding to the color array through pixel shift;

a chromatic aberration correction processing section configured to receive the plurality of color array images and to perform chromatic aberration correction processing on each of the plurality of color array images;

a pixel shift composition processing section configured to perform pixel shift composition processing on the plurality of color array images that are subjected to the chromatic aberration correction processing by the chromatic aberration correction processing section, to acquire a pixel shift high-resolution image; and

a demosaicking processing section configured to perform demosaicking processing on the pixel shift high-resolution image.

2. The image pickup apparatus according to claim 1 , comprising a distortion aberration correction processing section configured to perform distortion aberration correction processing on the pixel shift high-resolution image after the demosaicking processing.

3. The image pickup apparatus according to claim 2 , comprising:

a first image processing pipeline in which processing by the chromatic aberration correction processing section is performable;

a second image processing pipeline in which a series of processes by the demosaicking processing section and the distortion aberration correction processing section is performable; and

a control section configured to cause the first image processing pipeline to perform the chromatic aberration correction processing on the plurality of color array images, to cause the pixel shift composition processing section to perform the pixel shift composition processing on the plurality of color array images after the chromatic aberration correction processing, and to cause the second image processing pipeline to perform the demosaicking processing and the distortion aberration correction processing on the pixel shift high-resolution image after the pixel shift composition processing.

4. The image pickup apparatus according to claim 3 , comprising a third image processing pipeline in which a series of processes by the chromatic aberration correction processing section, the demosaicking processing section, and the distortion aberration correction processing section is performable, wherein

in a case where one color array image corresponding to the color array is outputted from the image pickup device, the control section causes the third image processing pipeline to perform the processing on the one color array image.

5. The image pickup apparatus according to claim 4 , wherein

the color aberration correction processing section is a processing section common to the first and third image processing pipelines, the demosaicking processing section and the distortion aberration correction processing section are processing sections common to the second and third image processing pipelines, and a buffer memory of each of the processing sections in the first to third image processing pipelines is set to a capacitance value corresponding to the case where the one color array image corresponding to the color array is outputted from the image pickup device.

6. The image pickup apparatus according to claim 1 , comprising a memory configured to hold information of chromatic aberration characteristics for the chromatic aberration correction processing by the chromatic aberration correction processing section.

7. The image pickup apparatus according to claim 4 , comprising an image processing section that includes the chromatic aberration correction processing section, the demosaicking processing section, the distortion aberration correction processing section, a first switch, and a second switch, wherein

the first switch supplies the plurality of color array images to the chromatic aberration correction processing section or the second switch by switching, and

the second switch outputs without any change, or provides to the demosaicking processing section, an output of the chromatic aberration correction processing section or the color array images supplied from the first switch.

8. The image pickup apparatus according to claim 7 , wherein

the first image processing pipeline is configured by providing the plurality of color array images to the chromatic aberration correction processing section by the first switch and outputting the output of the chromatic aberration correction processing section without change by the second switch,

the second image processing pipeline is configured by providing the plurality of color array images to the second switch by the first switch and providing the color array images from the first switch to the demosaicking processing section by the second switch, and

the third image processing pipeline is configured by providing the plurality of color array images to the chromatic aberration correction processing section by the first switch and providing the output of the chromatic aberration correction processing section to the demosaicking processing section by the second switch.

9. An image pickup apparatus, comprising:

an image pickup device that includes pixels in a predetermined color array and is configured to be able to acquire a plurality of color array images corresponding to the color array through pixel shift;

a pixel shift composition processing section configured to perform pixel shift composition processing to acquire a pixel shift high-resolution image;

an image processing section that can perform first image processing pipeline processing in which processing by a chromatic aberration correction processing section is performable, second image processing pipeline processing in which a series of processes by a demosaicking processing section and a distortion aberration correction processing section is performable, and third image processing pipeline processing in which a series of processes by the chromatic aberration correction processing section, the demosaicking processing section, and the distortion aberration correction processing section is performable; and

a control section configured to control order of the pixel shift composition processing and the first to third image processing pipeline processing.

10. The image pickup apparatus according to claim 9 , wherein

the control section performs the third image processing pipeline processing when a normal resolution image is acquired, and

the control section sequentially performs the first image processing pipeline processing, the pixel shift composition processing, and the second image processing pipeline processing when a pixel shift high-resolution image is acquired.

11. The image pickup apparatus according to claim 9 , wherein when the pixel shift high-resolution image is acquired, the control section sequentially performs the first image processing pipeline processing, the pixel shift composition processing, and the second image processing pipeline processing in a case where a color shift amount based on a chromatic aberration coefficient exceeds a predetermined threshold, and the control section sequentially performs the pixel shift composition processing and the third image processing pipeline processing in a case where the color shift amount does not exceed the predetermined threshold.

12. An image pickup method, comprising:

acquiring a plurality of color array images corresponding to a predetermined color array through pixel shift photographing by an image pickup device that includes pixels in the predetermined color array;

performing chromatic aberration correction processing on each of the plurality of color array images;

performing pixel shift composition processing on the plurality of color array images subjected to the chromatic aberration correction processing to acquire a pixel shift high-resolution image; and

performing demosaicking processing on the pixel shift high-resolution image.

13. A non-temporary computer-readable recording medium having a recorded image pickup program that causes a computer to execute:

acquiring a plurality of color array images corresponding to a predetermined color array through pixel shift photographing by an image pickup device that includes pixels in the predetermined color array;

performing chromatic aberration correction processing on each of the plurality of color array images;

performing pixel shift composition processing on the plurality of color array images subjected to the chromatic aberration correction processing to acquire a pixel shift high-resolution image; and

performing demosaicking processing on the pixel shift high-resolution image.