Data processing apparatus, imaging apparatus and data processing method
Provided is a data processing apparatus for calculating confidence coefficient data to indicate a confidence of pixel values of a second image data. The apparatus acquires similarity between a pixel value of a first pixel of the first image data corresponding to a target pixel of the confidence coefficient data, and each pixel value of a plurality of second pixels around the first pixel. The apparatus acquires the confidence coefficient by determining an estimated pixel value in the third pixel of the second image data corresponding to the first pixel, based on the similarity of each of the plurality of second pixels, each pixel value of the plurality of fourth pixels around the third pixel and the pixel value of the third pixel and by comparing the pixel value of the third image and the estimated pixel value in the third pixel.
1. A data processing apparatus comprising:
a memory that stores a program; and
a processor that executes the program to operate as units comprising:
(a) an acquisition unit adapted to acquire image data and a depth map indicating distribution of depth information corresponding to the image data; and
(b) a correction unit adapted to generate a corrected depth map by applying filter processing to each region in the depth map by referring to a corresponding region in the image data,
wherein the correction unit performs weighted addition to depth information in a target region in the depth map using depth information in a peripheral region at a periphery of the target region to correct the depth information in the target region, thereby generating the corrected depth map,
wherein, in the weighted addition, a weight for depth information at a second position is set greater compared to a weight for depth information at a first position, wherein the second position is closer in the depth map to the target region than the first position is, and
wherein, in the weighted addition, a weight for depth information at a position corresponding to a position in the image data having a second pixel value is set greater compared to a weight for depth information at a position corresponding to a position in the image data having a first pixel value, wherein the second pixel value is closer to a pixel value of image data at a position corresponding to the target region than the first pixel value is.
2. The data processing apparatus according to claim 1 , wherein the units further comprise a determination unit adapted to determine reliability of the depth map on the basis of the image data, and
wherein the correction unit is further adapted to generate the corrected depth map by applying a weight according to the reliability to depth information for use in generating the corrected depth map.
3. The data processing apparatus according to claim 2 , wherein the determination unit is further adapted to determine that a reliability for a region with less texture in the image data is lower compared to a reliability for a region with greater texture.
4. A imaging apparatus comprising:
an imaging element; and
the data processing apparatus according to claim 1 .
5. A data processing method comprising:
acquiring image data and a depth map indicating distribution of depth information corresponding to the image data; and
generating a corrected depth map by applying filter processing to each region in the depth map by referring to a corresponding region in the image data,
wherein generating the corrected depth map comprises performing weighted addition to depth information in a target region in the depth map using depth information in a peripheral region at a periphery of the target region to correct the depth information in the target region,
wherein, in the weighted addition, a weight for depth information at a second position is set greater compared to a weight for depth information at a first position, wherein the second position is closer in the depth map to the target region than the first position is, and
wherein, in the weighted addition, a weight for depth information at a position corresponding to a position in the image data having a second pixel value is set greater compared to a weight for depth information at a position corresponding to a position in the image data having a first pixel value, wherein the second pixel value is closer to a pixel value of image data at a position corresponding to the target region than the first pixel value is.
6. A non-transitory computer-readable storage medium storing a program which, when executed by a computer, causes the computer to execute a method comprising:
acquiring image data and a depth map indicating distribution of depth information corresponding to the image data; and
generating a corrected depth map by applying filter processing to each region in the depth map by referring to a corresponding region in the image data,
wherein generating the corrected depth map comprises performing weighted addition to depth information in a target region in the depth map using depth information in a peripheral region at a periphery of the target region to correct the depth information in the target region,
wherein, in the weighted addition, a weight for depth information at a second position is set greater compared to a weight for depth information at a first position, wherein the second position is closer in the depth map to the target region than the first position is, and
wherein, in the weighted addition, a weight for depth information at a position corresponding to a position in the image data having a second pixel value is set greater compared to a weight for depth information at a position corresponding to a position in the image data having a first pixel value, wherein the second pixel value is closer to a pixel value of image data at a position corresponding to the target region than the first pixel value is.
7. A data processing apparatus comprising:
a memory that stores a program; and
a processor that executes the program to operate as units comprising:
(a) an acquisition unit adapted to acquire image data and a map comprising a plurality of data each corresponding to each region of the image data; and
(b) a correction unit adapted to generate a corrected map by applying filter processing to each region in the map by referring to a corresponding region in the image data,
wherein the correction unit performs weighted addition to data in a target region in the map using data in a peripheral region at a periphery of the target region to correct the data in the target region, thereby generating the corrected depth map,
wherein, in the weighted addition, a weight for data at a second position is set greater compared to a weight for data at a first position, wherein the second position is closer in the map to the target region than the first position is, and
wherein, in the weighted addition, a weight for data at a position corresponding to a position in the image data having a second pixel value is set greater compared to a weight for data at a position corresponding to a position in the image data having a first pixel value, wherein the second pixel value is closer to a pixel value of image data at a position corresponding to the target region than the first pixel value is.
8. The data processing apparatus according to claim 7 , wherein the units further comprise a determination unit adapted to determine reliability of the map on the basis of the image data, and
wherein the correction unit is further adapted to generate the corrected map by applying a weight according to the reliability to data for use in generating the corrected map.
9. The data processing apparatus according to claim 8 , wherein the determination unit is further adapted to determine that a reliability for a region with less texture in the image data is lower compared to a reliability for a region with greater texture.
10. A imaging apparatus comprising:
an imaging element; and
the data processing apparatus according to claim 7 .
11. A data processing method comprising:
acquiring image data and a map comprising a plurality of data each corresponding to each region of the image data; and
generating a corrected map by applying filter processing to each region in the map by referring to a corresponding region in the image data,
wherein generating the corrected map comprises performing weighted addition to data in a target region in the map using data in a peripheral region at a periphery of the target region to correct the data in the target region,
wherein, in the weighted addition, a weight for data at a second position is set greater compared to a weight for data at a first position, wherein the second position is closer in the map to the target region than the first position is, and
wherein, in the weighted addition, a weight for data at a position corresponding to a position in the image data having a second pixel value is set greater compared to a weight for data at a position corresponding to a position in the image data having a first pixel value, wherein the second pixel value is closer to a pixel value of image data at a position corresponding to the target region than the first pixel value is.
12. A non-transitory computer-readable storage medium storing a program which, when executed by a computer, causes the computer to execute a method comprising:
acquiring image data and a map comprising a plurality of data each corresponding to each region of the image data; and
generating a corrected map by applying filter processing to each region in the map by referring to a corresponding region in the image data,
wherein generating the corrected map comprises performing weighted addition to data in a target region in the map using data in a peripheral region at a periphery of the target region to correct the data in the target region,
wherein, in the weighted addition, a weight for data at a second position is set greater compared to a weight for data at a first position, wherein the second position is closer in the map to the target region than the first position is, and
wherein, in the weighted addition, a weight for data at a position corresponding to a position in the image data having a second pixel value is set greater compared to a weight for data at a position corresponding to a position in the image data having a first pixel value, wherein the second pixel value is closer to a pixel value of image data at a position corresponding to the target region than the first pixel value is.