Image processing apparatus, imaging apparatus, image processing method, and recording medium

1. An image processing apparatus, comprising:

on or more processors: and

a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as:

a first acquiring unit configured to acquire information relating to a depth distribution of an object as map data with a first resolution;

a second acquiring unit configured to acquire image data of the object as image data with a second resolution higher than the first resolution;

a shaping unit configured to shape the map data based on the image data acquired by the second acquiring, unit;

a first reducing unit configured to reduce the image data acquired by the second acquiring unit so as to conform to the first resolution: and

a second reducing unit configured to reduce the image data acquired by the second acquiring unit for display so as to conform to a resolution lower than the second resolution,

wherein the shaping unit shapes the map data with the first resolution with reference to the image data of which the resolution has been changed from the second resolution to the first resolution, and

wherein the second reducing unit suppresses alias generated by reduction of the image more strongly than that suppressed by the first reducing unit.

2. The image processing apparatus according to claim 1 , wherein, when a pixel value of a pixel of interest and pixel values of its surrounding pixels are smoothed with respect to the pixel of interest and pixel values of its surrounding pixels are smoothed with respect to the pixel of interest in the map data, the shaping unit increases a weight of smoothing with respect to the output of the surrounding pixels as the pixel value of the pixel of interest becomes closer to the pixel values of the surrounding pixels.

3. The image processing apparatus according to claim 1 ,

wherein the shaping unit shapes the map data with reference to the image data which has been reduced by the first reducing unit.

4. The image processing apparatus according to claim 1 , further comprising:

an aligning unit configured to correct a position deviation between the map data acquired by the first acquiring unit and the image data acquired by the second acquiring unit,

wherein the shaping unit shapes the map data which has been corrected by the aligning unit.

5. The image processing apparatus according to claim 1 , further comprising:

an image acquiring unit configured to acquire a plurality of image data exhibiting parallax,

wherein the first acquiring unit acquires data with the first resolution, which has been generated by using the plurality of image data.

6. The image processing apparatus according to claim 5 , further comprising:

a map generating unit configured to generate the map data with lower resolution than the resolution of the plurality of image data by using image data extracted from the plurality of image data at a predetermined pixel interval so as to output the map data to the shaping unit.

7. The image processing apparatus according to claim 1 , wherein the shaping a bilateral filter processing that refers to the image data of the object.

8. An imaging apparatus, comprising;

an image processing apparatus, comprising:

one or more processors; and

a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as;

a first acquiring unit configured to acquire information relating to a depth distribution of an object as map data with a first resolution;

a second acquiring unit configured to acquire image data of the object as image data with a second resolution higher than the first resolution;

a shaping unit configured to shape the map data based on the image data acquired by the second acquiring unit;

a first reducing unit configured to reduce the image data acquired by the second acquiring unit so as to conform to the first resolution; and

a second reducing unit configured to reduce the image data acquired by the second acquiring unit for display so as to conform to a resolution lower than the second resolution,

wherein the shaping unit shapes the map data with the first resolution with reference to the image data of which the resolution has been changed from he second resolution to the first resolution, and

wherein the second reducing unit suppresses alias generated by reduction of the image more strongly than that suppressed by the first reducing unit,

an imaging element that images an object through an imaging optical system,

wherein the imaging element has a plurality of photoelectric converters which receive and photoelectrically convert light beams which have passed through different pupil areas of the imaging optical system, and

wherein the first acquiring unit acquires information relating to a depth distribution of an object front signals respectively output from the plurality of photoelectric converters.

9. An imaging apparatus according to claim 8 , wherein the first acquiring unit calculates an amount of defocus for each pixel-of-interest position using signals respectively output from the plurality of photoelectric converters so as to acquire information relating to depth distribution of an object.

10. An image processing method to be executed by an image processing apparatus that acquires information relating to a depth distribution of an object to process map data, the image processing method comprising:

acquiring information relating to a depth distribution of an object as map data with a first resolution and then acquiring image data of the object as image data with a second resolution higher than the first resolution; and

shaping the map data based on the image data acquired in the acquiring step

reducing, by at least one processor programmed to operate as a first reducing unit, the image data with the second resolution so as to conform to the first resolution; and

reducing, by the at least one processor programmed to operate as a first reducing unit, the image data with the second resolution so as to conform to a resolution lower than the second resolution,

wherein, in shaping, the map data with the first resolution is shaped with reference to the image data of which the resolution has been changed from the second resolution to the first resolution, and

wherein the second reducing unit suppresses alias generated by reduction of the image more strongly than that suppressed by the first reducing unit.

11. A non-transitory recording medium storing a program for causing a computer of an image processing apparatus to execute the steps of an image processing method, the method comprising:

acquiring information relating to a depth distribution of an object as map data with a first resolution and then acquiring image data of the object as image data with a second resolution higher than the first resolution; and

shaping the map data based on the image data acquired in the acquiring step

reducing, by at least one processor programmed to operate as a first reducing unit, the image data with the second resolution so as to conform to the first resolution; and

reducing, by the at least one processor pro rammed to operate as a second reducing unit, the image data with the second resolution for display so as to conform to a resolution lower than the second resolution,

wherein, in shaping, the map data with the first resolution is shaped with reference to the image data of which the resolution has been changed from the second resolution to the first resolution, and

wherein the second reducing unit suppresses alias generated by reduction of the image more strongly than that suppressed by the first reducing unit.