Image processing apparatus, image capturing apparatus, image processing method, and storage medium

1. An image processing apparatus comprising:

an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas;

a first generation unit configured to generate a rearranged image in which the plurality of subject areas is rearranged in the image based on the distance information; and

a second generation unit configured to generate an image comprising the rearranged image in which information on a focus state for image combination processing to change the focus state of the image including the plurality of subject areas is reflected in the rearranged image.

2. The image processing apparatus according to claim 1 , wherein

the information on the focus state includes at least one of a focus position, a depth of field, and a focus control range.

3. The image processing apparatus according to claim 1 , wherein

the first generation unit performs the rearrangement so that the plurality of subject areas is arranged in order in a depth direction in accordance with the distance information.

4. The image processing apparatus according to claim 1 , wherein

the distance information is information indicative of the respective distance to the plurality of subject areas from the image capturing apparatus having captured the image including the plurality of subject areas, and

the image processing apparatus further comprises a distance derivation unit configured to derive the distance information.

5. The image processing apparatus according to claim 4 , wherein

the acquisition unit acquires parallax image data, which is image data indicative of the image including the plurality of subject areas, which is obtained by capturing images from a plurality of viewpoints, and which is configured by a plurality of single-viewpoint images each corresponding to respective viewpoints, and

the distance derivation unit derives the distance information by performing stereo matching between the plurality of single-viewpoint images.

6. The image processing apparatus according to claim 1 , wherein

the acquisition unit acquires parallax image data, which is image data indicative of the image including the plurality of subject areas, which is obtained by capturing images from a plurality of viewpoints, and which is configured by a plurality of single-viewpoint images each corresponding to the respective viewpoints, and

the second generation unit generates an image comprising the rearranged image in which information on the focus state for the image combination processing is reflected in the rearranged image based on one single-viewpoint image of the plurality of single-viewpoint images.

7. The image processing apparatus according to claim 1 , wherein

the acquisition unit acquires parallax image data, which is image data indicative of the image including the plurality of subject areas, which is obtained by capturing images from a plurality of viewpoints, and which is configured by a plurality of single-viewpoint images each corresponding to the respective viewpoints, and

the second generation unit generates an image comprising the rearranged image in which information on the focus state for the image combination processing is reflected in the rearranged image based on the image generated by the image combination processing.

8. The image processing apparatus according to claim 1 , wherein the image combination processing is processing to combine a plurality of parallax images obtained by capturing the plurality of subject areas from a plurality of different viewpoints.

9. The image processing apparatus according to claim 1 , wherein the image combination processing is filtering processing on the image including the plurality of subject areas.

10. The image processing apparatus according to claim 1 , further comprising an extraction unit configured to extract subject areas from the image including the plurality of subject areas based on the distance information, wherein the first generation unit generates the rearranged image by rearranging subject areas extracted by the extraction unit.

11. The image processing apparatus according to claim 10 , wherein the extraction unit extracts an area along a contour of a subject or an area in an arbitrary shape including a subject as the subject area.

12. An image capturing apparatus having the image processing apparatus according to claim 1 , the image capturing apparatus comprising:

a reception unit configured to receive a user's instructions;

a display unit configured to display an image in which information on the focus state is reflected; and

an adjustment unit configured to adjust the focus state of the image displayed in the display unit based on the user's instructions.

13. The image capturing apparatus having the image processing apparatus according to claim 12 , wherein the display unit has a live view function and displays an image in which information on the focus state is reflected in a live view.

14. An image processing method comprising:

acquiring an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas;

generating a rearranged image in which the plurality of subject areas is rearranged in the image based on the distance information; and

generating an image comprising the rearranged image in which information on a focus state for image combination processing to change the focus state of the image including the plurality of subject areas is reflected in the rearranged image.

15. A non-transitory computer readable storage medium storing a program for causing a computer to perform the image processing method according to claim 14 .