Image processing apparatus, image processing method, and computer program
An apparatus and a method for efficiently executing correction of false color, such as purple fringe, caused by chromatic aberration and for generating and outputting high-quality image data are provided. A white-saturated pixel is detected from image data, a false-color-pixel detection area is set around the detected white-saturated pixel, and pixels having color corresponding to false color such as purple fringe are detected from the set area. The detected pixels are determined as false-color pixels and correction processing based on the values of the surrounding pixels is performed on the determined false-color pixels. With this configuration, an area of false color such as purple fringe generated in the neighborhood of a white-saturated pixel can be efficiently detected, pixel values can be partially corrected, and high-quality image data can be generated and output without affecting the entire image.
1. An image processing apparatus, having:
a white-saturation detection unit for detecting a white saturated pixel from image data;
a false-color-pixel detection-area setting unit for setting a false-color-pixel detection area around the white-saturated pixel detected by the white-saturation detection unit, the false-color-pixel detection-area setting unit further comprising:
a reference-image analyzing unit for receiving a reference image in which a pixel at a position corresponding to a white-saturated pixel in an image to be processed does not have a saturation luminance value and for obtaining a luminance value of the reference-image pixel corresponding to the white-saturated pixel in the image to be processed, the reference image being a photographed image of the same subject as the image to be processed; and
a false-color-pixel detection-area determining unit for setting a false-color-pixel detection area in accordance with the luminance value of the corresponding reference-image pixel, the luminance value being obtained by the reference-image analyzing unit;
a false-color detection unit for identifying pixels having color corresponding to false color as false-color pixels in the area set by the false-color-pixel detection-area setting unit; and
a pixel-value correction unit for executing pixel-value correction processing, based on values of surrounding pixels, on the false-color pixels detected by the false-color detection unit.
2. The image processing apparatus according to claim 1 , wherein the pixel-value correction unit has a compensation interpolation unit for executing compensation interpolation processing, based on the surrounding pixel values, on the false-color pixels, and a color blur processing unit for executing color blur processing on the false-color pixels.
3. The image processing apparatus according to claim 2 , wherein the pixel-value correction unit selects pixels other than false-color pixels and white-saturated pixels from pixels that exist around the false-color pixels and executes compensation interpolation processing based on the selected pixels.
4. The image processing apparatus according to claim 1 , wherein the false-color detection unit executes processing for identifying, as false-color pixels, pixels having preset specific color in the area set by the false-color-pixel detection-area setting unit.
5. The image processing apparatus according to claim 1 , wherein the the false color is purple fringe, and the false-color detection unit executes processing for identifying, as false-color pixels, purple pixels in the area set by the false-color-pixel detection-area setting unit.
6. The image processing apparatus according to claim 1 , wherein the white-saturation detection unit executes processing for selecting a white-saturated pixel having a luminance higher than or equal to a predetermined threshold.
7. The image processing apparatus according to claim 1 , further having a color conversion unit for executing data conversion processing for separating input image data into luminance-component image data and color-component image data, and executes pixel-value correction processing based on the converted data generated by the color conversion unit.
8. The image processing apparatus according to claim 1 , wherein the false-color-pixel detection-area determining unit sets a false-color-pixel detection area by using a lookup table in which the luminance value of the reference image and a false-color generable pixel range or the false-color-pixel detection area are associated with each other.
9. The image processing apparatus according to claim 1 , wherein the false-color-pixel detection-area determining unit executes processing for setting a wider false-color-pixel detection area as the luminance value of a corresponding pixel in the reference image increases.
10. The image processing apparatus according to claim 1 , wherein, by using, as the reference image, an image photographed by an image capture device having a low-sensitivity sensor or an image photographed under a condition of a low exposure less than an adequate exposure, the false-color-pixel detection-area determining unit obtains a reference-image luminance value of a portion corresponding to a white-saturated pixel in an image to be processed.
11. An image processing method, having:
a white-saturation detecting step of detecting a white saturated pixel from image data;
a false-color-pixel detection-area setting step of setting a false-color-pixel detection area around the white-saturated pixel detected in the white-saturation detecting step, the false-color-pixel detection-area setting step further comprising:
a reference-image analyzing step of inputting a reference image in which a pixel at a position corresponding to a white-saturated pixel in an image to be processed does not have a saturation luminance value and for obtaining a luminance value of the reference-image pixel corresponding to the white-saturated pixel in the image to be processed, the reference image being a photographed image of the same subject as the image to be processed; and
a false-color-pixel detection-area determining step of setting a false-color-pixel detection area in accordance with the luminance value of the corresponding reference-image pixel, the luminance value being obtained in the reference-image analyzing step;
a false-color detecting step of identifying pixels having color corresponding to false color as false-color pixels in the area set in the false-color-pixel detection-area setting step; and
a pixel-value correcting step of executing pixel-value correction processing, based on values of surrounding pixels, on the false-color pixels detected in the false-color detecting step.
12. The image processing method according to claim 11 , wherein the pixel-value correcting step has:
a compensation interpolation step of executing compensation interpolation processing, based on the surrounding pixel values, on the false-color pixels; and
a color blur processing step of executing color blur processing on the false-color pixels.
13. The image processing method according to claim 12 , wherein the pixel-value correcting step is a step of selecting pixels other than false-color pixels and white-saturated pixels from pixels that exist around the false-color pixels and executing compensation interpolation processing based on the selected pixels.
14. The image processing method according to claim 11 , wherein the false-color detecting step is a step of executing processing for identifying, as false-color pixels, pixels having preset specific color in the area set in the false-color-pixel detection-area setting step.
15. The image processing method according to claim 11 , wherein the false color is purple fringe, and the false-color detecting step is a step of executing processing for identifying, as false-color pixels, purple pixels in the area set in the false-color-pixel detection-area setting step.
16. The image processing method according to claim 11 , wherein the white-saturation detecting step is a step of executing processing for selecting a white-saturated pixel having a luminance higher than or equal to a predetermined threshold.
17. The image processing method according to claim 11 , further having a color converting step of executing data conversion processing for separating input image data into luminance-component image data and color-component image data and of executing pixel-value correction processing based on the converted data generated by the color conversion unit.
18. The image processing method according to claim 11 , wherein the false-color-pixel detection-area determining step is a step of setting a false-color-pixel detection area by using a lookup table in which the luminance value of the reference image and a false-color generable pixel range or the false-color-pixel detection area are associated with each other.
19. The image processing method according to claim 11 , wherein the false-color-pixel detection-area determining step is a step of executing processing for setting a wider false-color-pixel detection area as the luminance value of a corresponding pixel in the reference image increases.
20. The image processing method according to claim 11 , wherein in the false-color-pixel detection-area determining step, an image photographed by an image capture device having a low-sensitivity sensor or an image photographed under a condition of a low exposure less than an adequate exposure is used as the reference image, and a reference-image luminance value of a position corresponding to a white-saturated pixel in an image to be processed is obtained.
21. A computer-readable storage medium storing a computer program which, when executed by a processor, causes a computer to execute an image processing method, the method comprising:
a white-saturation detecting step of detecting a white saturated pixel from image data;
a false-color-pixel detection-area setting step of setting a false-color-pixel detection area around the white-saturated pixel detected in the white-saturation detecting step, the false-color-pixel detection-area setting step further comprising:
a reference-image analyzing step of inputting a reference image in which a pixel at a position corresponding to a white-saturated pixel in an image to be processed does not have a saturation luminance value and for obtaining a luminance value of the reference-image pixel corresponding to the white-saturated pixel in the image to be processed, the reference image being a photographed image of the same subject as the image to be processed; and
a false-color-pixel detection-area determining step of setting a false-color-pixel detection area in accordance with the luminance value of the corresponding reference-image pixel, the luminance value being obtained in the reference-image analyzing step;
a false-color detecting step of identifying pixels having color corresponding to false color as false-color pixels in the area set in the false-color-pixel detection-area setting step; and
a pixel-value correcting step of executing pixel-value correction processing, based on values of surrounding pixels, on the false-color pixels detected in the false-color detecting step.