Image processing device, image processing method, program, and imaging device
An image processing device includes: a coordinate conversion unit ( 142 ) which calculates a corresponding sampling coordinate on a color mosaic image corresponding to a pixel position of a color image when a deformation process is performed, according to the pixel position of the color image; a sampling unit ( 143 ); a sampling unit ( 143 ) which interpolates-generates a pixel value in a sampling coordinate for each of color planes obtained by decomposing the color mosaic image; and a color generation unit ( 144 ) which generates a color image by synthesizing interpolation values of the respective color planes. Each pixel value of a color image subjected to a deformation process is obtained as a pixel value of the sampling coordinate from the color mosaic image by interpolation calculation, thereby realizing the color interpolation process for generating a color image from the color mosaic image and a deformation process of the color image by one interpolation calculation.
1. An apparatus, comprising:
color plane decomposition hardware to receive pixel values of a color mosaic image, and to generate color plane pixel values of at least a red color plane, a green color plane, and a blue color plane from the received color mosaic image pixel values; and
sampling hardware to generate interpolated pixel values for each of the red, green, and blue color planes based on the corresponding color plane pixel values and on sampling coordinates determined for each of the red, green, and blue color planes, wherein the sampling coordinates have been determined based at least in part on a non-linear conversion of coordinates of the color plane pixel values.
2. The apparatus of claim 1 , further comprising memory to store at least some of the generated pixel values of at least one of the red, green, and blue color planes.
3. The apparatus of claim 1 , further comprising analog to digital conversion hardware to generate the color mosaic image from analog image data.
4. The apparatus of claim 3 , further comprising an image sensor to generate the analog image data.
5. The apparatus of claim 1 , wherein non-linear conversion of coordinates of the color plane pixel values comprises, at least in part, applying different image distortion coefficients for each of the red color plane, green color plane, and blue color plane.
6. The apparatus of claim 5 , wherein the image distortion coefficients correspond to at least one of chromatic aberration values, image distortion values, hand blur correction values, or lens state skew correction values.
7. The apparatus of claim 1 , wherein the sampling coordinates comprise non-integer sampling coordinates.
8. A method, comprising:
accessing pixel values of a color mosaic image;
generating color plane pixel values of at least a red color plane, a green color plane, and a blue color plane from the color mosaic image pixel values; and
generating interpolated pixel values for each of the red, green, and blue color planes based on the corresponding color plane pixel values and on sampling coordinates determined for each of the red, green, and blue color planes, wherein the sampling coordinates have been determined based at least in part on a non-linear conversion of coordinates of the color plane pixel values.
9. The method of claim 8 , further comprising storing at least some of the generated pixel values of at least one of the red, green, and blue color planes in memory.
10. The method of claim 8 , further comprising generating the color mosaic image from analog image data.
11. The method of claim 8 , wherein a non-linear conversion of coordinates of the color plane pixel values comprises, at least in part, applying different image distortion coefficients for each of the red color plane, green color plane, and blue color plane.
12. The method of claim 11 , wherein the image distortion coefficients correspond to at least one of chromatic aberration values, image distortion values, hand blur correction values, or lens state skew correction values.
13. The method of claim 8 , wherein the sampling coordinates comprise non-integer sampling coordinates.
14. One or more non-transitory computer readable media having stored thereon instructions that, when executed by an apparatus, cause the apparatus to:
access pixel values of a color mosaic image;
generate color plane pixel values of at least a red color plane, a green color plane, and a blue color plane from the color mosaic image pixel values; and
generate interpolated pixel values for each of the red, green, and blue color planes based on the corresponding color plane pixel values and on sampling coordinates determined for each of the red, green, and blue color planes, wherein the sampling coordinates have been determined based at least in part on a non-linear conversion of coordinates of the color plane pixel values.
15. The one or more non-transitory computer readable media of claim 14 , further comprising instructions that, when executed by the apparatus, cause the apparatus to store at least some of the generated pixel values of at least one of the red, green, and blue color planes in memory.
16. The one or more non-transitory computer readable media of claim 14 , further comprising instructions that, when executed by the apparatus, cause the apparatus to generate the color mosaic image from analog image data.
17. The one or more non-transitory computer readable media of claim 14 , wherein a non-linear conversion of coordinates of the color plane pixel values comprises, at least in part, applying different image distortion coefficients for each of the red color plane, green color plane, and blue color plane.
18. The one or more non-transitory computer readable media of claim 17 , wherein the image distortion coefficients correspond to at least one of chromatic aberration values, image distortion values, hand blur correction values, or lens state skew correction values.
19. The one or more non-transitory computer readable media of claim 14 , wherein the sampling coordinates comprise non-integer sampling coordinates.