Image sensor and sensor module
According to one aspect of the present invention, an image sensor and a sensor module have a configuration in which the image sensor outputs first brightness information representing brightness information of first image information obtained with a first exposure time and second brightness information representing brightness information of second image information obtained with a second exposure time separately from a composite image obtained by synthesizing the first image information and the second image information, updates the first and second exposure times based on an exposure time set value externally generated based on the first brightness information and the second brightness information, and changes a synthesis set value used for synthesis of the composite image based on the exposure time set value externally generated based on the first brightness information and the second brightness information.
1. An image sensor comprising:
a pixel array that outputs image information based on incident light information;
a pixel control unit that controls an exposure time for pixels arranged in the pixel array;
a first brightness information generation unit that generates first brightness information from first image information generated based on incident light information obtained by the pixel array with a first exposure time;
a second brightness information generation unit that generates second brightness information from second image information generated based on incident light information obtained by the pixel array with a second exposure time shorter than the first exposure time; and
an image synthesizing unit that synthesizes the first image information and the second image information and outputs a composite image, wherein
the pixel control unit updates the first exposure time and the second exposure time based on an exposure time set value generated by a processing device different from the pixel control circuit and the image synthesizing unit, the exposure time set value being generated by the processing device based on the first brightness information and the second brightness information, and
the image synthesizing unit updates conditions for synthesizing the first image information and the second image information based on a synthesis set value generated by the processing device based on the first brightness information and the second brightness information.
2. The image sensor according to claim 1 , wherein
the first brightness information includes at least a histogram of the first image information, and
the second brightness information includes at least a histogram of the second image information.
3. The image sensor according to claim 1 , wherein the image synthesizing unit performs image synthesizing processing to generate a pixel corresponding to a low brightness portion of the composite image by using the first image information equal to or smaller than an output code threshold included in the synthesis set value, and to generate a pixel corresponding to a high brightness portion of the composite image by using the second image information greater than the output code included in the synthesis set value.
4. A sensor module comprising:
an image sensor; and
an arithmetic unit that is provided separately from the image sensor, and generates an exposure time set value and a synthesis set value based on first brightness information and second brightness information, the first brightness information and the second brightness information being output from the image sensor, wherein
the image sensor includes:
a pixel array that outputs image information based on incident light information;
a pixel control unit that controls an exposure time for pixels arranged in the pixel array;
a first brightness information generation unit that generates the first brightness information from first image information generated based on incident light information obtained by the pixel array with a first exposure time;
a second brightness information generation unit that generates the second brightness information from second image information generated based on incident light information obtained by the pixel array with a second exposure time shorter than the first exposure time; and
an image synthesizing unit that synthesizes the first image information and the second image information and outputs a composite image,
the pixel control unit updates the first exposure time and the second exposure time based on the exposure time set value generated in the arithmetic unit based on the first brightness information and the second brightness information, and
the image synthesizing unit updates conditions for synthesizing the first image information and the second image information based on the synthesis set value generated in the arithmetic unit based on the first brightness information and the second brightness information.
5. The sensor module according to claim 4 , wherein the arithmetic unit outputs the exposure time set value and the synthesis set value so that an output code of a pixel with a maximum brightness in the composite image becomes equal to or smaller than a maximum output code corresponding to a maximum value of a brightness value of the pixel, based on the first brightness information and the second brightness information.
6. The sensor module according to claim 4 , wherein the arithmetic unit is incorporated in an image processing processor that performs image processing on the composite image.
7. The sensor module according to claim 4 , wherein when an occurrence of a flicker in the first image information is detected based on the first brightness information, the arithmetic unit changes a cycle of performing an exposure in the first exposure time.
8. The sensor module according to claim 4 , wherein
the arithmetic unit includes a program storage unit, and
the sensor module implements a function for outputting the exposure time set value and the synthesis set value by firmware or driver software, the firmware or driver software being added to software stored in the program storage unit.