Image sensing device and method of image signal processing
An image sensing device and a method of image signal processing are provided. The image sensing device includes a lens module, a microlens below the lens module, an image sensor below the microlens and which includes a first pixel having a cyan color filter, and which outputs a first image signal, a second pixel having a magenta color filter, and which outputs a second image signal, a third pixel having a yellow color filter, and which outputs a third image signal, and a fourth pixel which outputs a fourth image signal, and an image signal processor which receives image signals of the image sensor, and extracts a red (R) data component, green (G) data component, blue (B) data component, and near-infrared (IR) data component of the light from the image signals.
1 . An image sensing device comprising:
a lens module;
a microlens below the lens module;
an image sensor below the microlens and comprising:
a first pixel having a cyan color filter, and which receives light through the lens module and outputs a first image signal;
a second pixel having a magenta color filter, and which receives light through the lens module and outputs a second image signal;
a third pixel having a yellow color filter, and which receives light through the lens module and outputs a third image signal; and
a fourth pixel which receives light through the lens module and outputs a fourth image signal; and
an image signal processor which receives a plurality of image signals including the first image signal, the second image signal, the third image signal and the fourth image signal, and extracts a red (R) data component, a green (G) data component, a blue (B) data component, and a near-infrared (IR) data component from the plurality of image signals,
wherein the image signal processor extracts the IR data component using the first image signal, the second image signal, the third image signal, and the fourth image signal.
2 . The image sensing device of claim 1 ,
wherein the lens module comprises:
a first pass filter which transmits light of an IR wavelength range; and
a second pass filter which transmits light of a visible wavelength range.
3 . The image sensing device of claim 2 ,
wherein the first pass filter is on the second pass filter.
4 . The image sensing device of claim 1 ,
wherein the image signal processor extracts the R data component using the first image signal and the fourth image signal.
5 . The image sensing device of claim 4 ,
wherein the R data component is extracted by subtracting the first image signal from the fourth image signal.
6 . The image sensing device of claim 1 ,
wherein the image signal processor extracts the G data component using the second image signal and the fourth image signal.
7 . The image sensing device of claim 6 ,
wherein the G data component is extracted by subtracting the second image signal from the fourth image signal.
8 . The image sensing device of claim 1 ,
wherein the image signal processor extracts the B data component using the third image signal and the fourth image signal.
9 . The image sensing device of claim 8 ,
wherein the B data component is extracted by subtracting the third image signal from the fourth image signal.
10 . The image sensing device of claim 1 ,
wherein the IR data component is extracted by subtracting the fourth image signal twice from a result obtained by adding the first image signal, the second image signal, and the third image signal.
11 . The image sensing device of claim 1 , further comprising a liner on the image sensor, wherein the microlens is disposed directly on the liner in a region of the fourth pixel.
12 . The image sensing device of claim 1 ,
wherein no color filter is disposed in a region of the fourth pixel.
13 . The image sensing device of claim 1 , wherein the image signal processor extracts the R data component, the G data component, the B data component, and the IR data component using a color correction matrix for correcting the plurality of image signals based on a pattern formed by an arrangement of the first pixel, the second pixel, the third pixel, and the fourth pixel.
14 . An image sensing device comprising:
an image sensor configured to output, based on a received light, a first image signal including a cyan signal component, a second image signal including a magenta signal component, a third image signal including a yellow signal component, and a fourth image signal including a white signal component; and
an image signal processor configured to receive the first image signal, the second image signal, the third image signal, and the fourth image signal from the image sensor, and extract a red (R) data component, a green (G) data component, a blue (B) data component, and a near-infrared (IR) data component of the received light from the first image signal, the second image signal, the third image signal, and the fourth image signal,
wherein the R data component is extracted using the first image signal and the fourth image signal,
wherein the G data component is extracted using the second image signal and the fourth image signal,
wherein the B data component is extracted using the third image signal and the fourth image signal, and
wherein the IR data component is extracted using the first image signal, the second image signal, the third image signal, and the fourth image signal.
15 . A method of processing an image signal, the method comprising:
filtering a first light through a lens module to obtain a second light;
generating, by an image sensor, a first image signal using a first portion of the second light received through a cyan color filter;
generating, by the image sensor a second image signal using a second portion of the second light received through a magenta color filter;
generating, by the image sensor, a third image signal using a third portion of the second light received through a yellow color filter;
generating, by the image sensor, a fourth image signal using the second light; and extracting, by an image signal processor, a red (R) data component, a green (G) data component, a blue (B) data component, and a near-infrared (IR) data component from the first image signal, the second image signal, the third image signal, and the fourth image signal,
wherein the R data component is extracted using the first image signal and the fourth image signal,
the G data component is extracted using the second image signal and the fourth image signal,
the B data component is extracted using the third image signal and the fourth image signal, and
the IR data component is extracted using the first image signal, the second image signal, the third image signal, and the fourth image signal.
16 . The method of processing the image signal of claim 15 ,
wherein filtering the first light through the lens module comprises:
transmitting light of an IR wavelength range through a first pass filter; and
transmitting light of a visible wavelength range through a second pass filter, and
wherein the transmitting of the light of the visible wavelength range is performed after the transmitting of the light of the IR wavelength range.
17 . The method of processing the image signal of claim 16 ,
wherein the R data component is extracted by subtracting the first image signal from the fourth image signal,
the G data component is extracted by subtracting the second image signal from the fourth image signal,
the B data component is extracted by subtracting the third image signal from the fourth image signal, and
the IR data component is extracted by subtracting the fourth image signal twice, from a result obtained by adding the first image signal, the second image signal, and the third image signal.