Image processing device and image processing method
An image processor, and an image processing method, includes an acquirer configured to acquire first pixel data from a first pixel group corresponding to a first color, and acquire second pixel data and third pixel data from a second pixel group and a third pixel group, respectively, which are arranged on both sides of the first pixel group and correspond to a second color. The image processor also includes a determiner configured to determine one of second pixel data and third pixel data as interpolation reference data using different schemes depending on a type of edge detected based on a difference in the first color and the second color in an image region corresponding to the first pixel data. The image processor further includes an interpolator configured to interpolate a part of the first pixel data to correspond to the second color based on interpolation reference data.
1 . An image processor, comprising:
an acquirer configured to acquire first pixel data from a first pixel group corresponding to a first color, and acquire second pixel data and third pixel data from a second pixel group and a third pixel group, respectively, which are arranged on both sides of the first pixel group and correspond to a second color distinguished from the first color;
a determiner configured to determine one of the second pixel data or the third pixel data as interpolation reference data using different schemes depending on a type of edge that is detected based on a difference in the first color and a difference in the second color in an image region corresponding to the first pixel data; and
an interpolator configured to interpolate a part of the first pixel data to correspond to the second color based on the determined interpolation reference data corresponding to one of the second pixel data or the third pixel data.
2 . The image processor according to claim 1 , wherein the edge comprises one of:
a first edge for which the difference in the first color is less than a threshold value and the difference in the second color is equal to or greater than the threshold value, and
a second edge for which the difference in the first color and the difference in the second color are equal to or greater than the threshold value.
3 . The image processor according to claim 2 , wherein the determiner comprises:
an edge determiner configured to determine whether the edge is present in the image region; and
an interpolation reference determiner configured to, in response to a determination that the edge is present in the image region, determine the interpolation reference data using a first scheme corresponding to the first edge or a second scheme corresponding to the second edge.
4 . The image processor according to claim 3 , wherein the edge determiner comprises:
a first edge determiner configured to determine whether the first edge is present in the image region based on the first pixel data, the second pixel data, and the third pixel data; and
a second edge determiner configured to, in response to a determination that no first edge is present in the image region, determine whether the second edge is present in the image region.
5 . The image processor according to claim 4 , wherein the first edge determiner determines whether the first edge is present in the image region, based on similarities between the first pixel data and pieces of pixel data acquired from pixel groups, which are arranged within a first distance from the first pixel group and correspond to the first color, and similarities between pieces of pixel data acquired from pixel groups, which are arranged within a second distance from the first pixel group and correspond to the second color.
6 . The image processor according to claim 5 , wherein the interpolation reference determiner comprises:
a first interpolation reference determiner configured to, in response to a determination by the first edge determiner that the first edge is present in the image region,
identify a pixel group most similar to the part of the first pixel data among pieces of pixel data acquired from the pixel groups, which are arranged within the first distance from the first pixel group and correspond to the first color,
when the most similar pixel group is adjacent to the second pixel group, determine the second pixel data as the interpolation reference data, and
when the most similar pixel group is adjacent to the third pixel group, determine the third pixel data as the interpolation reference data.
7 . The image processor according to claim 4 , wherein the determiner comprises:
an estimator configured to acquire first estimated pixel data and second estimated pixel data respectively corresponding to the second pixel group and the third pixel group based on pixel data acquired from pixel groups corresponding to the first color, wherein the first estimated pixel data and the second estimated pixel data correspond to the first color.
8 . The image processor according to claim 7 , wherein the second edge determiner determines whether the second edge is present in the image region, based on a gradient in a designated direction included in at least parts of the first pixel data, pieces of pixel data acquired from pixel groups, which are arranged within a first distance from the first pixel group and correspond to the first color, the first estimated pixel data, and the second estimated pixel data.
9 . The image processor according to claim 7 , wherein the interpolation reference determiner comprises:
a second interpolation reference determiner configured to, in response to a determination by the second edge determiner that the second edge is present in the image region,
identify a position of the second edge in the image region, based on at least parts of the first pixel data, pieces of pixel data acquired from pixel groups, which are arranged within a first distance from the first pixel group and correspond to the first color, the first estimated pixel data, and the second estimated pixel data, and
determine any one of the second pixel data and the third pixel data as interpolation reference data based on the position of the second edge.
10 . The image processor according to claim 3 , wherein the interpolation reference determiner comprises:
a third interpolation reference determiner configured to, in response to a determination by the edge determiner that no edge is present in the image region, interpolate the part of the first pixel data to correspond to the second color based on the second pixel data and the third pixel data.
11 . The image processor according to claim 1 , wherein the first color is green (G).
12 . The image processor according to claim 1 , wherein the second color is one of red (R) and blue (B).
13 . An image processing method, comprising:
acquiring first pixel data from a first pixel group corresponding to a first color, and acquiring second pixel data and third pixel data from a second pixel group and a third pixel group, respectively, which are arranged on both sides of the first pixel group and correspond to a second color distinguished from the first color;
determining any one of the second pixel data and the third pixel data as interpolation reference data using different schemes depending on a type of edge that is detected based on a difference in the first color and a difference in the second color in an image region corresponding to the first pixel data; and
interpolating a part of the first pixel data to correspond to the second color based on the determined interpolation reference data.
14 . The image processing method according to claim 13 , wherein the edge comprises one of:
a first edge for which the difference in the first color is less than a threshold value and the difference in the second color is equal to or greater than the threshold value, and
a second edge for which the difference in the first color and the difference in the second color are equal to or greater than the threshold value.
15 . The image processing method according to claim 14 , wherein determining the interpolation reference data comprises:
determining whether the edge is present in the image region; and
in response to a determination that the edge is present in the image region, determining the interpolation reference data using a first scheme corresponding to the first edge or a second scheme corresponding to the second edge.
16 . An electronic device, comprising:
an image sensor including a first pixel group corresponding to a first color and a second pixel group and a third pixel group, which are arranged on both sides of the first pixel group and correspond to a second color distinguished from the first color;
an acquirer configured to acquire image data including first pixel data acquired from the first pixel group, second pixel data acquired from the second pixel group, and third pixel data acquired from the third pixel group;
a determiner configured to determine any one of the second pixel data and the third pixel data as interpolation reference data using different schemes depending on a type of edge that is detected based on a difference in the first color and a difference in the second color in an image region corresponding to the first pixel data based on the image data; and
an interpolator configured to interpolate a part of the first pixel data to correspond to the second color based on the determined interpolation reference data.
17 . The electronic device according to claim 16 , wherein the first pixel group includes N×N pixels, where N is a natural number equal to or greater than 2.
18 . The electronic device according to claim 16 , wherein the first pixel data includes N×N pixel values.
19 . The electronic device according to claim 18 , wherein the interpolator interpolates a part of the N×N pixel values included in the first pixel data to correspond to the second color based on the determined interpolation reference data.
20 . The electronic device according to claim 19 , wherein the interpolator is configured to:
acquire first estimated pixel data, which corresponds to the second pixel group and corresponds to the first color, based on pixel data corresponding to the first color and included in the image data,
calculate a ratio of an average value of N×N pixel values included in the second pixel data to an average value of N×N pixel values included in the first estimated pixel data, and
perform the interpolation by multiplying the ratio by the part of the N×N pixel values included in the first pixel data in response to a decision that the second pixel data is determined as the interpolation reference data.