Method and processor for image data processing utilizing full pixel information of same color
A method of processing image data includes: receiving image data from a color filter array including N×N same color pixels; converting first pixel data in an N×N array into second pixel data in an (N−L)×(N−M) array, wherein the first pixel data is output from the N×N same color pixels; and generating third pixel data in the N×N array by performing reconstruction on the second pixel data, wherein each of “L” and “M” is a natural number that is greater than or equal to 1 and less than N, and “N” is a natural number that is greater than or equal to 2.
1 . A method of processing image data, the method comprising:
receiving image data from a color filter array including pixels in an N×N array, wherein all the pixels in the N×N array are of a same color and output a first pixel data in the N×N array;
converting the first pixel data in the N×N array into second pixel data in an (N−L)×(N−M) array; and
generating third pixel data in the N×N array corresponding to the pixels in the N×N array by performing reconstruction on the second pixel data,
wherein each of “L” and “M” is a natural number that is greater than or equal to 1 and less than N,
“N” is a natural number that is greater than or equal to 2, and
the converting of the first pixel data into the second pixel data includes forming (N−L)×(N−M) nodes through binning using a conversion unit, and a size of the conversion unit corresponds to a region size of a set of the pixels in the N×N array covered by a microlens.
2 . The method of claim 1 , wherein
each respective node of the (N−L)×(N−M) nodes includes data information of a corresponding set of the pixels of the first pixel data, wherein each respective node of the (N−L)×(N−M) nodes is adjacent to the corresponding set of the pixels.
3 . The method of claim 2 , wherein the generating of the third pixel data includes generating a piece of the third pixel data by interpolating at least two nodes among the (N−L)×(N−M) nodes.
4 . The method of claim 3 , wherein the third pixel data in the N×N array includes at least one piece of central pixel data and a plurality of pieces of edge pixel data surrounding the at least one piece of central pixel data.
5 . The method of claim 4 , wherein the at least one piece of central pixel data is generated by interpolating four nodes surrounding the at least one piece of central pixel data.
6 . The method of claim 4 , wherein the plurality of pieces of edge pixel data include:
a plurality of pieces of outer pixel data adjacent to the at least one piece of central pixel data in an X-axis direction or a Y-axis direction, which are perpendicular to each other; and
a plurality of pieces of corner pixel data adjacent to the at least one piece of central pixel data in a diagonal direction with respect to the X-axis direction and the Y-axis direction.
7 . The method of claim 6 , wherein each of the plurality of pieces of outer pixel data is generated by interpolating two nodes adjacent thereto.
8 . The method of claim 6 , wherein each of the plurality of pieces of outer pixel data is generated by performing linear interpolation or interpolation using a second-order polynomial on two nodes adjacent thereto and additional nodes in same columns or rows as the two nodes.
9 . The method of claim 6 , wherein each of the plurality of pieces of corner pixel data is generated by performing linear interpolation or interpolation using a second-order polynomial on one node adjacent thereto and additional nodes in a diagonal direction with respect to the X-axis direction and the Y-axis direction.
10 . A method of processing image data, the method comprising:
receiving image data output from a color filter array (CFA) including a plurality of CFA blocks including at least one color region including pixels in a first array, wherein all the pixels in the first array are of a same color and output a first pixel data in the first array;
generating second pixel data in a second array by converting the first pixel data in the first array; and
generating third pixel data in the first array corresponding to the pixels in the first array by performing reconstruction on the second pixel data in the second array,
wherein the generating of the second pixel data includes forming a plurality of nodes including information about the pixels in the first array through binning using a conversion unit, and a size of the conversion unit corresponds to a region size of a set of the pixels in the first array covered by a microlens.
11 . The method of claim 10 , wherein the forming of the plurality of nodes includes setting a conversion unit and performing binning with a center of the conversion unit being set as each of the plurality of nodes.
12 . The method of claim 11 , wherein each of the plurality of nodes corresponds to a contact point between a plurality of pieces of pixel data included in the third pixel data.
13 . The method of claim 12 , wherein the third pixel data includes:
central pixel data surrounded by four nodes among the plurality of nodes;
outer pixel data in contact with two nodes among the plurality of nodes; and
corner pixel data in contact with one node among the plurality of nodes.
14 . The method of claim 13 , wherein the central pixel data is generated by interpolating the four nodes surrounding the central pixel data.
15 . The method of claim 13 , wherein the outer pixel data is generated by interpolation using an average value of the two nodes adjacent to the outer pixel data or generated by performing linear interpolation or interpolation using a second-order polynomial on the two nodes adjacent to the outer pixel data and additional nodes in same columns or rows as the two nodes.
16 . The method of claim 13 , wherein the corner pixel data is generated by obtaining a value of the one node adjacent to the corner pixel data or by performing linear interpolation or interpolation using a second-order polynomial on the one node adjacent to the corner pixel data and additional nodes in a diagonal direction with respect to an X-axis direction and a Y-axis direction, which are perpendicular to each other.
17 . The method of claim 10 , wherein a method of performing the reconstruction on the second pixel data varies with a number of nodes contacting a piece of pixel data included in the third pixel data.
18 . An image processing processor for processing image data output from an image sensor, the image processing processor comprising:
a first processing circuit configured to perform conversion of the image data received from the image sensor, wherein the image sensor includes pixels in an N×N array, and all the pixels in the N×N array are of a same color, and the image data includes a first pixel data in the N×N array from the pixels in the N×N array; and
a second processing circuit configured to perform reconstruction on converted data,
wherein the first processing circuit is configured to perform the conversion by binning the first pixel data in the N×N array into a second pixel data in an (N−L)×(N−M) array through binning using a conversion unit, and a size of the conversion unit corresponds to a region size of a set of the pixels in the N×N array covered by a microlens,
where each of “L” and “M” is a natural number that is greater than or equal to 1 and less than “N”,
“N” is a natural number that is greater than or equal to 2, and
the second processing circuit is configured to perform the reconstruction corresponding to the pixels in the N×N array by interpolating nodes corresponding to the second pixel data in the (N−L)×(N−M) array.
19 . The image processing processor of claim 18 , wherein the second processing circuit is configured to reconstruct pixel data surrounded by four nodes among the nodes corresponding to the pixel data in the (N−L)×(N−M) array by performing interpolation using an average value of the four nodes.
20 . The image processing processor of claim 18 , wherein the second processing circuit is configured to reconstruct pixel data contacting one or two nodes among the nodes corresponding to the pixel data in the (N−L)×(N−M) array by performing linear interpolation or interpolation using a second-order polynomial on the one or two nodes.