Solid-state imaging device, image processing apparatus, and a camera module having an image synthesizer configured to synthesize color information
According to one embodiment, a solid-state imaging device includes a first image sensor, a second image sensor, and an image pickup processing circuit. The first image sensor is configured to output a first image signal according to an intensity distribution of each of color lights from an object. The second image sensor is configured to output a second image signal according to a luminance distribution of the light from the object. The image pickup processing circuit includes an image synthesizer. The image synthesizer is configured to synthesize color information included in the first image signal and luminance information included in the second image signal.
1. A solid-state imaging device comprising:
a first image sensor configured to output a first image signal according to an intensity distribution of each of color lights from an object;
a second image sensor configured to output a second image signal according to a luminance distribution of the light from the object; and
an image pickup processing circuit configured to process the first image signal and the second image signal, wherein
the image pickup processing circuit includes
an image signal separator configured to separate the first image signal which has been received from the first image sensor, into color information and first luminance information,
a luminance information synthesizer configured to synthesize the first luminance information and second luminance information included in the second image signal with each other so as to produce synthesized luminance information,
an image synthesizer configured to synthesize the color information output from the image signal separator and the synthesized luminance information produced by the luminance information synthesizer with each other so as to produce synthetic image data,
a parallax amount calculator configured to calculate parallax amount of a first image acquired by the first image sensor and a second image acquired by the second image sensor, and
a parallax corrector configured to correct a parallax between the first image and the second image, and
the parallax amount calculator calculates the parallax amount by using the first luminance information output from the image signal separator and the second luminance information, and
the luminance information synthesizer synthesizes the first luminance information and the second luminance information output from the parallax corrector with each other.
2. The solid-state imaging device according to claim 1 , wherein the image pickup processing circuit further includes:
an image signal converter configured to convert the second image signal which has been received from the second image sensor, into the second luminance information, and
the luminance information synthesizer synthesizes the second luminance information output from the image signal converter and the first luminance information with each other.
3. The solid-state imaging device according to claim 1 , wherein the image pickup processing circuit further includes a resolution restorer configured to restore a resolution of a synthesized image based on the synthesized luminance information, and
the image synthesizer synthesizes the color information with the synthesized luminance information through the resolution restoration.
4. The solid-state imaging device according to claim 1 , wherein the image pickup processing circuit further includes a smoother configured to smooth the color information output from the image signal separator, and
the image synthesizer synthesizes the synthesized luminance information with the color information through the smoothing.
5. The solid-state imaging device according to claim 1 , wherein the image signal separator extracts the color information in higher priority than the first luminance information from the first image signal.
6. The solid-state imaging device according to claim 1 , further comprising a frame memory configured to store at least either one of the first image signal and the second image signal, wherein the first image sensor, the second image sensor, and the frame memory are mounted on a common board.
7. The solid-state imaging device according to claim 1 , wherein the first image sensor is a color image sensor configured to detect a plurality of color lights, and
the second image sensor is a monochromatic image sensor configured to detect a single color light.
8. The solid-state imaging device according to claim 7 , wherein the monochromatic image sensor has a white pixel configured to detect a white light.
9. The solid-state imaging device according to claim 7 , wherein the monochromatic image sensor has a green pixel configured to detect a green light, and
the second luminance information is a signal value of a green component.
10. The solid-state imaging device according to claim 1 , wherein both of the first image sensor and the second image sensor are a color image sensor for detecting a plurality of color lights, and
a wavelength region of each of the color lights to be detected by the second image sensor is set wider than that of each of the color lights to be detected by the first image sensor.
11. An image processing apparatus comprising:
an image signal separator configured to separate a first image signal according to an intensity distribution of each of color lights from an object into color information and first luminance information;
an image signal converter configured to convert a second image signal according to a luminance distribution of the light from the object into second luminance information;
a luminance information synthesizer configured to synthesize the first luminance information and the second luminance information output from the image signal converter with each other so as to produce synthesized luminance information;
an image synthesizer configured to synthesize the color information output from the image signal separator and the synthesized luminance information produced in the luminance information synthesizer with each other so as to produce synthetic image data,
a parallax amount calculator configured to calculate parallax amount of a first image based on the first image signal and a second image based on the second image signal; and
a parallax corrector configured to correct a parallax between the first image and the second image, wherein
the parallax amount calculator calculates the parallax amount by using the first luminance information output from the image signal separator and the second luminance information, and
the luminance information synthesizer synthesizes the first luminance information and the second luminance information output from the parallax corrector with each other.
12. The image processing apparatus according to claim 11 , further comprising a smoother configured to smooth the color information output from the image signal separator, wherein
the image synthesizer synthesizes the synthesized luminance information with the color information through the smoothing.
13. A camera module comprising:
a lens module configured to capture light from an object so as to form an image of the object; and
a solid-state imaging device configured to pick up the image of the object, wherein
the solid-state imaging device includes:
a first image sensor configured to output a first image signal according to an intensity distribution of each of color lights from the object;
a second image sensor configured to output a second image signal according to a luminance distribution of the light from the object; and
an image pickup processing circuit configured to process the first image signal and the second image signal, wherein
the image pickup processing circuit includes
an image signal separator configured to separate the first image signal which has been received from the first image sensor, into color information and first luminance information,
a luminance information synthesizer configured to synthesize the first luminance information and second luminance information included in the second image signal with each other so as to produce synthesized luminance information,
an image synthesizer configured to synthesize the color information output from the image signal separator and the synthesized luminance information produced by the luminance information synthesizer with each other so as to produce synthetic image data,
a parallax amount calculator configured to calculate parallax amount of a first image based on the first image signal and a second image based on the second image signal, and
a parallax corrector configured to correct a parallax between the first image and the second image, wherein
the parallax amount calculator calculates the parallax amount by using the first luminance information output from the image signal separator and the second luminance information, and
the luminance information synthesizer synthesizes the first luminance information and the second luminance information output from the parallax corrector with each other.
14. The camera module according to claim 13 , wherein the lens module includes:
a first image pickup lens configured to capture light from the object to enter the first image sensor;
a second image pickup lens configured to capture light from the object to enter the second image sensor; and
a lens driver configured to adjust the focuses of the first image pickup lens and the second image pickup lens, and
the lens driver drives the first image pickup lens and the second image pickup lens.
15. The camera module according to claim 14 , wherein the first image pickup lens and the second image pickup lens are held by a common lens holder; and
the lens driver moves the lens holder so as to drive the first image pickup lens and the second image pickup lens together.
16. The camera module according to claim 13 , wherein the solid-state imaging device includes a frame memory configured to store at least either one of the first image signal and the second image signal, and
the first image sensor, the second image sensor, and the frame memory are mounted on a common board.
17. The camera module according to claim 13 , wherein the image pickup processing circuit further includes a resolution restorer configured to restore a resolution of a synthesized image based on the synthesized luminance information, and
the resolution restorer restores the resolution based on individual information previously held in the camera module.