Image processing apparatus, image processing method, and image processing system for performing sub-pixel interpolation

1. An image processing apparatus comprising:

a region determiner configured to receive image data and perform a region determination by determining whether each of a plurality of sub-pixels included in the image data is included in an in-focusing region that is focused or an out-focusing region that is not focused; and

an interpolator configured to perform demosaicing with respect to a sub-pixel included in the in-focusing region by using a first algorithm and perform the demosaicing with respect to a sub-pixel included in the out-focusing region by using a second algorithm, according to a result of the region determination,

wherein, when the demosaicing with respect to the sub-pixel included in the in-focusing region is performed, one or more peripheral sub-pixels having phases that are different from a phase of the sub-pixel, on which the demosaicing is performed, are used.

2. The image processing apparatus of claim 1 , wherein the region determiner is configured to perform the region determination based on at least one from among a depth map extraction, a cross-correlation calculation, and a blur measurement with respect to the image data.

3. The image processing apparatus of claim 1 , wherein the region determiner is configured to output a flag having a state that varies depending on the result of the region determination.

4. The image processing apparatus of claim 3 , wherein the interpolator is configured to perform the demosaicing with respect to the sub-pixel by using the first algorithm when the flag corresponding to the sub-pixel has a first state, and perform the demosaicing with respect to the sub-pixel by using the second algorithm when the flag corresponding to the sub-pixel has a second state.

5. The image processing apparatus of claim 1 , wherein the image data comprises a plurality of pixels, each of which comprises n (n being an integer equal to or greater than two) sub-pixels having phases different from each other.

6. The image processing apparatus of claim 5 , wherein the interpolator is configured to perform the demosaicing with respect to a first sub-pixel included in the in-focusing region by using one or more peripheral sub-pixels having phases that are same as a phase of the first sub-pixel and one or more peripheral sub-pixels having phases that are different from the phase of the first sub-pixel.

7. The image processing apparatus of claim 1 , wherein the image data comprises a plurality of pixels, each of which comprises n (n being an integer equal to or greater than two) sub-pixels having phases different from each other, and the interpolator is configured to perform the demosaicing with respect to a first sub-pixel included in the out-focusing region by selectively using one or more peripheral sub-pixels having a certain phase.

8. The image processing apparatus of claim 1 , wherein the region determiner is configured to divide the image data into a plurality of phase group images according to phases of sub-pixels included in the image data, and perform the region determination of each sub-pixel by analyzing similarities between a reference phase group image, from among the plurality of phase group images, and a phase group image in which the each sub-pixel is included.

9. The image processing apparatus of claim 1 , wherein the image data comprises a plurality of pixels, each of which comprises n (n being an integer equal to or greater than two) sub-pixels having phases different from each other, and the region determiner is configured to perform the region determination according to a unit of a pixel.

10. The image processing apparatus of claim 1 , wherein the image data comprises a plurality of pixel groups, each of which comprises a plurality of pixels, and the region determiner is configured to perform the region determination according to a unit of a pixel group.

11. The image processing apparatus of claim 1 , wherein the interpolator comprises a first interpolator configured to perform the demosaicing according to the first algorithm and a second interpolator configured to perform the demosaicing according to the second algorithm, and data of each sub-pixel is selectively provided to the first interpolator or the second interpolator according to the result of region determination.

12. An image processing system comprising:

an image sensor comprising a pixel array, in which a plurality of pixels are arranged, and each of the plurality of pixels comprises n (n being an integer equal to or greater than two) sub-pixels having phases different from each other; and

an image processing apparatus configured to receive image data from the image sensor, perform a first demosaicing with respect to a first sub-pixel, in response to the first sub-pixel being included in an in-focusing region that is focused, by using peripheral sub-pixels having at least two phases different from each other, and perform a second demosaicing with respect to the first sub-pixel, in response to the first sub-pixel being included in an out-focusing region that is not focused, by using one or more peripheral sub-pixels having the same phase.

13. The image processing system of claim 12 , wherein the image processing apparatus comprises:

a region determiner configured to perform a region determination by determining a region, among the in-focusing region and the out-focusing region, in which the first sub-pixel is included, based on at least one from among a depth map extraction, a cross-correlation calculation, and a blur measurement with respect to the image data; and

an interpolator configured to perform an interpolation by selectively applying the first demosaicing or the second demosaicing with respect to the first sub-pixel, according to a result of the region determination.

14. The image processing system of claim 12 , wherein the region determiner generates a flag corresponding to the first sub-pixel according to a result of the region determination.

15. The image processing system of claim 14 , wherein the interpolator is configured to perform an interpolation with respect to the first sub-pixel by performing the first demosaicing according to a first algorithm when the flag has a first value, and perform an interpolation with respect to the first sub-pixel by performing the second demosaicing according to a second algorithm when the flag has a second value.

16. A method of processing an image captured by an image sensor, the method comprising:

interpolating a first sub-pixel included in the image by performing a first demosaicing algorithm in response to the first sub-pixel being included in a first region in the image, the first region being focused; and

interpolating a second sub-pixel included in the image by performing a second demosaicing algorithm that is different from the first demosaicing algorithm, in response to the second sub-pixel being included in a second region in the image, the second region being not focused,

wherein the first demosaicing algorithm uses at least one peripheral sub-pixel having a phase that is different from a phase of a peripheral sub-pixel used in the second demosaicing algorithm.

17. The method of claim 16 , wherein the interpolating the first sub-pixel comprises interpolating the first sub-pixel by performing the first demosaicing algorithm using at least two peripheral sub-pixels having phases that are different from each other.

18. The method of claim 16 , wherein the interpolating the second sub-pixel comprises interpolating the second sub-pixel by performing the second demosaicing algorithm using one or more peripheral sub-pixels having the same phase.

19. The method of claim 16 , further comprising:

determining the first sub-pixel as being included in the first region or the second sub-pixel as being included in the second region based on at least one from among a depth map extraction, a cross-correlation calculation, and a blur measurement with respect to the image data.