Image capture apparatus, image processing system, and control method thereof
When distribution image data indicating a defocus distribution is generated from a plurality of sets of image data including pupil-divided image data that is captured image data corresponding to part of an exit pupil, reduced image data is used. Further, based on the distribution image data, pixel data that is to be subjected to the image processing is extracted from the pupil-divided image data corresponding to the distribution image data. The extracted pixel data, the defocus distribution image data, and captured image data corresponding to the entirety of the exit pupil are recorded or output to an external device.
1. An image capture apparatus comprising;
an image sensor having a plurality of pixels, wherein each of the plurality of pixels has a plurality of photoelectric conversion units that respectively receives luminous fluxes that have passed through different regions on an exit pupil of an optical system,
a conversion circuit that converts signals output from the plurality of pixels into image data;
a reduction circuit that reduces a pair of image data respectively corresponding to the different regions of the exit pupil;
a generation circuit that generates distribution data representing distribution of defocus amount in the pair of reduced image data; and
a controller that controls the conversion circuit so as to output captured image data corresponding to the entirety of the exit pupil and pupil-divided image data corresponding to a part of the exit pupil, controls the generation circuit so as to output the distribution data, and causes the output data of the conversion circuit and the generation circuit to be recorded in the image capture apparatus or transmitted outside.
2. An image processing apparatus comprising: an obtaining circuit that obtains the captured image data, the pupil-divided image data, and the distribution data, which are output by the image capture apparatus according to claim 1 ; a conversion circuit that converts the distribution data, based on the captured image data, the pupil-divided image data, and, the distribution data into converted distribution data corresponding to the captured image data; and an image processing circuit that applies, based on the converted distribution data obtained by the conversion circuit, predetermined image processing to the captured image data.
3. The image processing apparatus according to claim 2 , further comprising:
a combining circuit that combines the captured image data to which the predetermined image processing has been applied.
4. The image processing apparatus according to claim 2 , the image processing apparatus being a device external to the image capture apparatus.
5. An image processing system formed by communicably connecting an image capture apparatus and the image processing apparatus according to claim 4 to each other, wherein the image capture apparatus comprising:
an image sensor having a plurality of pixels, wherein each of the plurality of pixels has a plurality of photoelectric conversion units that respectively receives luminous fluxes that have passed through different regions on an exit pupil of an optical system,
a conversion circuit that converts signals output from the plurality of pixels into image data;
a reduction circuit that reduces a pair of image data respectively corresponding to the different regions of the exit pupil;
a generation circuit that generates distribution data representing distribution of defocus amount in the pair of reduced image data; and
a controller that controls the conversion circuit so as to output captured image data corresponding to the entirety of the exit pupil and pupil-divided image data corresponding to a part of the exit pupil, controls the generation circuit so as to output the distribution data, and causes the output data of the conversion circuit and the generation circuit to be recorded in the image capture apparatus or transmitted outside.
6. The image processing apparatus according to claim 2 , the image processing apparatus being incorporated in the image capture apparatus.
7. A method for controlling an image processing apparatus, comprising: obtaining the captured image data, the pupil-divided image data, and the distribution data, which are output by the image capture apparatus according to claim 1 ; converting the distribution data, based on the captured image data, the pupil-divided image data, and the distribution data into converted distribution data corresponding to the captured image data; and applying, based on the converted distribution data obtained in the converting, predetermined image processing to the captured image data.
8. A non-transitory computer-readable medium that stores a program for causing, when executed by a computer, the computer to function as: an image processing apparatus comprising: an obtaining circuit configured to obtain the captured image data, the pupil-divided image data, and the distribution data, which are output by the image capture apparatus according to claim 1 ; a conversion circuit configured to convert the distribution data, based on the captured image data, the pupil-divided image data, and the distribution data, the distribution data into converted distribution data corresponding to the captured image data; and an image processing circuit that applies, based on the converted distribution data obtained by the conversion circuit, predetermined image processing to the captured image.
9. A non-transitory computer-readable medium that stores a program for causing, when executed by a computer included in an image capture apparatus having an image sensor having a plurality of pixels, wherein each of the plurality of pixels has a plurality of photoelectric conversion units that respectively receives luminous fluxes that have passed through different regions on an exit pupil of an optical system, the computer to function as: a conversion circuit configured to convert signals output from the plurality of pixel into image data; a reduction circuit configured to reduce a pair of image data respectively corresponding to the different regions of the exit pupil; a generation circuit configured to generate distribution data representing distribution of defocus amount in the pair of reduced image data; and a controller configured to control the conversion circuit so as to output captured image data corresponding to the entirety of the exit pupil and pupil-divided image data corresponding to a part of the exit pupil, control the generation circuit so as to output the distribution data, and cause the output data of the conversion circuit and the generation circuit to be recorded in the image capture apparatus or transmitted outside.
10. A method for controlling an image capture apparatus, wherein the image capture apparatus has an image sensor having a plurality of pixels, wherein each of the plurality of pixels has a plurality of photoelectric conversion units that respectively receives luminous fluxes that have passed through different regions on an exit pupil of an optical system, the method comprising;
converting signals output from the plurality of pixels into image data;
reducing a pair of image data respectively corresponding to the different regions of the exit pupil;
generating distribution data representing distribution of defocus amount in the pair of reduced image data;
controlling the conversion circuit so as to output captured image data corresponding to the entirety of the exit pupil and pupil-divided image data corresponding to a part of the exit pupil, and the generation circuit so as to output the distribution data; and
causing the output data of the conversion circuit and the generation circuit to be recorded in the image capture apparatus or transmitted outside.