IMAGE PROCESSING APPARATUS, IMAGING APPARATUS, MICROSCOPE SYSTEM, IMAGE PROCESSING METHOD, AND COMPUTER READABLE RECORDING MEDIUM
An image processing apparatus includes: an image acquiring unit that acquires an image signal of a monochromatic image acquired by imaging a subject and an image signal of a color image acquired by imaging the subject, the color image having at least a plurality of pieces of color information; and an interpolation processing unit that generates an interpolated image by interpolating color information missing at each pixel forming the color image, based on a signal value of each pixel forming the monochromatic image.
1 . An image processing apparatus, comprising:
an image acquiring unit that acquires an image signal of a monochromatic image acquired by imaging a subject and an image signal of a color image acquired by imaging the subject, the color image having at least a plurality of pieces of color information; and
an interpolation processing unit that generates an interpolated image by interpolating color information missing at each pixel forming the color image, based on a signal value of each pixel forming the monochromatic image.
2 . The image processing apparatus according to claim 1 , wherein the interpolation processing unit interpolates the missing color information, by using the signal value of each pixel forming the monochromatic image as luminance information.
3 . The image processing apparatus according to claim 2 , wherein
the color image is an image in which a plurality of pixels having color information of any of red, blue, and green are arranged, and
the interpolation processing unit:
uses the luminance information as green color information in the interpolated image; and
calculates red color information and blue color information in the interpolated image by using: the signal value of each pixel forming the monochromatic image; a signal value of a pixel having color information of red from the pixels forming the color image; and a signal value of a pixel having color information of blue from the pixels forming the color image.
4 . The image processing apparatus according to claim 2 , wherein
the color image is an image in which a plurality of pixels having color information of any of red, blue, and green are arranged, and
the interpolation processing unit:
uses the luminance information as a luminance component in a YCbCr color space; and
calculates a color difference component in the YCbCr color space by using: the signal value of each pixel forming the monochromatic image; a signal value of a pixel having color information of red from the pixels forming the color image; and a signal value of a pixel having color information of blue from the pixels forming the color image.
5 . The image processing apparatus according to claim 1 , further comprising:
a structural information extracting unit that extracts structural information in the monochromatic image based on the signal value of each pixel forming the monochromatic image; and
a direction determination unit that determines an interpolation direction for performing interpolation processing based on the structural information, wherein
the interpolation processing unit interpolates the missing color information by performing the interpolation processing according to the interpolation direction determined by the direction determination unit.
6 . The image processing apparatus according to claim 5 , wherein the structural information is information representing a continuity or a gradient between the signal value of each pixel forming the monochrome image and signal values of surrounding pixels of the each pixel.
7 . An imaging apparatus, comprising:
the image processing apparatus according to claim 1 ; and
an imaging unit that generates and outputs the image signals of the color image and monochromatic image by imaging the subject.
8 . The imaging apparatus according to claim 7 , wherein the imaging unit includes:
two imaging elements that generate image signals corresponding to incident light;
a color filter provided on a light receiving surface of one of the two imaging elements; and
an optical system that divides observation light of the subject and guides the divided observation light respectively into directions of the two imaging elements, or sequentially guides the observation light to directions of the two imaging elements.
9 . The imaging apparatus according to claim 8 , wherein the two imaging elements have pixel pitches that are equal to each other.
10 . A microscope system, comprising:
the imaging apparatus according to claim 7 ;
a stage on which the subject is configured to be placed; and
an optical system that guides observation light of the subject to the imaging apparatus.
11 . An image processing method, comprising the steps of:
acquiring an image signal of a monochromatic image acquired by imaging a subject and an image signal of a color image acquired by imaging the subject, the color image having at least a plurality of pieces of color information; and
generating an interpolated image by interpolating color information missing at each pixel forming the color image, based on a signal value of each pixel forming the monochromatic image.
12 . A non-transitory computer readable recording medium having an image processing program recorded therein, the image processing program instructing a processor to perform the steps of:
acquiring an image signal of a monochromatic image acquired by imaging a subject and an image signal of a color image acquired by imaging the subject, the color image having at least a plurality of pieces of color information; and
generating an interpolated image by interpolating color information missing at each pixel forming the color image, based on a signal value of each pixel forming the monochromatic image.