Image processing apparatus capable of obtaining an image focused on a plurality of subjects at different distances and control method thereof

1. An image processing apparatus comprising:

a processor; and

a memory including instructions that, when executed by the processor, cause the processor to:

obtain depth information according to subject distances subjects its an image captured by an image capture unit;

select a plurality of subject distances based on peaks in a frequency distribution of the depth information; and

control the image capture unit to capture a plurality of images whose focus distances correspond to the plurality of selected subject distances, respectively;

wherein the frequency distribution of the depth information is based on a range image generated from a pair of captured images constituting stereoscopic images, and

wherein the image capture unit comprises;

an image sensor in which a plurality of pixels each having a plurality of photoelectric conversion areas are arranged, and that is capable of outputting the pair of captured images.

2. The image processing apparatus according to claim 1 ,

wherein the instructions further cause the processor to control the image capture unit to capture the plurality of images in order from a shortest distance among the focus distances corresponding to the plurality elected subject distances.

3. The image processing apparatus according to claim 1 , wherein the instructions further cause the processor to:

detect a subject of interest from an image captured by the image capture unit; and

select the plurality of subject distances so as to include a subject distance corresponding to the subject of interest.

4. The image processing apparatus according to claim 1 ,

wherein the instructions further cause the processor to

detect a subject of interest from an image captured by the image capture unit; and

perform weighting such that a frequency of the subject distance depth information corresponding to the subject of interest increases.

5. The image processing apparatus according claim 1 , wherein the instructions further cause the processor to

change an image capture condition of the image capture unit based on the frequency distribution of the depth information.

6. An image processing apparatus comprising:

a processor; and

a memory including instructions that, when executed by the processor, cause the processor to:

obtain depth information according to subject distances of subjects in an image captured by an image capture unit;

select a plurality of subject distances based on peaks in a frequency distribution, depth information; and

control the image capture unit to, capture a plurality of images whose focus distances correspond to the plurality of selected subject distances, respectively;

wherein the frequency distribution of the depth information is based on a range, image generated form a pair of captured images constituting stereoscopic images, and

wherein the instructions further cause the processor to:

combine at least two of the plurality of images and generate a combined image having an expanded depth of field.

7. The image processing apparatus according to claim 6 , wherein the instructions further cause the processor to

determine mages to be combined from the plurality of images according to a depth of field set by the user.

8. The image processing apparatus according to claim 6 , wherein the instructions further cause the processor to:

obtain a combination ratio per pixel based on pixel values of the range image; and

combine at least two of the plurality of images in accordance with the combination ratio in order to generate the combined image.

9. The image processing apparatus according to claim 8 ,

wherein the instructions further cause the processor to obtain the combination ratio of two images to be combined, based on pixel values of the range image corresponding to one of the two images.

10. The image processing apparatus according to claim 8 ,

wherein the instructions further cause the processor to obtain the combination ratio, based on pixel values of the range image corresponding to a predetermined one of the plurality of images.

11. A method of controlling an image processing apparatus, comprising:

obtaining, depth information according to subject distances subjects n an image captured by image capturing unit;

selecting a plurality of subject distances based on peaks in frequency distribution of the depth information; and

controlling, the image capture unit to capture a plurality of images whose focus distances correspond to the plurality of selected subject distances, respectively;

wherein the frequency distribution of the depth information is based on a range image generated from a pair of captured images constituting stereoscopic images, and

wherein the image capture unit comprises:

an image sensor in which a plurality of pixels each having a plurality of photoelectric conversion areas are arranged, and that is capable of outputting the pair of captured images.

12. A method of controlling an image processing apparatus, comprising:

obtaining, depth information according to subject distances of subjects in an image captured by an image capturing unit;

selecting a plurality of subject distances based on peaks in a frequency distribution of the depth information; and

controlling, the image capture unit to capture a plurality of images whose focus distances correspond to the plurality of selected subject distances, respectively; and

combining at least two of the plurality of images and generate a combined image having an expanded depth of field,

wherein the frequency distribution of the depth information is based on a range image generated form a pair of captured images constituting stereoscopic images.