Camera using preview image to select exposure
View Patent ↗A digital camera comprises an image sensor for providing initial sensor image data and final sensor image data; a lens for exposing the image of a scene onto the image sensor; an exposure control system for adjusting an exposure level of a final image on the image sensor in response to a scene type; and a processor for processing the initial sensor image data to select one of a plurality of scene types, and to process the final sensor image data in response to the scene type.
1. An image processing device comprising:
an image sensor configured to provide initial sensor image data and final sensor image data;
a lens configured to expose an image of a scene onto the image sensor;
an exposure control system that adjusts an exposure level of a final image on the image sensor in response to a scene type; and
a processor configured to:
process the initial sensor image data to select one of a plurality of pre-determined scene types, wherein processing the initial sensor image data comprises performing at least one of a face detection analysis, an auto focus analysis, or a motion analysis, and wherein the selected scene type is determined based on the at least one of the face detection analysis, the auto focus analysis, or the motion analysis, and wherein processing the initial sensor image data further includes determining whether an ISO exposure is equal to or greater than a threshold value if the selected scene type is not a text scene,
provide the selected scene type to the exposure control system prior to capturing the final sensor image data to cause the exposure control system to adjust the exposure level of the final image on the image sensor, wherein the exposure control system sets the exposure level of the final image to be a default scene exposure level shifted by a pre-determined relative exposure level corresponding to the selected scene type and the ISO exposure, and
process the final sensor image data to compensate for the exposure level of the final image on the image sensor by using a set of pre-determined exposure compensation processing parameters corresponding to the selected scene type and the ISO exposure.
2. The device of claim 1 , wherein the processor is configured to further process the final sensor image data by using a pre-determined pipeline processing parameter corresponding to the selected scene type, which is selected from a group of parameter types including: neutral balance, color balance, flare correction, contrast adjustment, color saturation, sharpness adjustment, noise reduction, and combinations thereof.
3. The device of claim 1 , wherein the processor is further configured to apply adaptive tone scale processing to the final image sensor data by using a set of pre-determined adaptive tone scale processing parameters corresponding to the selected scene type.
4. The device of claim 1 , wherein the processor used the initial image data to detect faces, and wherein the plurality of scene types includes a first subset which includes faces and a second subset which does not include faces.
5. The device of claim 1 , wherein the processor uses the initial image data to calculate average values for a plurality of n×m regions, uses the average values to form a histogram, and uses the histogram to select the scene type.
6. The device of claim 1 , wherein the processor uses the initial image data to provide a preview image for display on a viewfinder display of the digital camera.
7. The device of claim 1 , wherein the processing the initial sensor image data comprises performing each of the face detection analysis, the auto focus analysis, and the motion analysis, and wherein the selected scene type is determined based on a combination of the face detection analysis, the auto focus analysis, and the motion analysis.
8. The device of claim 7 , wherein the processing the initial sensor image data further comprises performing an auto white balance analysis and an auto exposure analysis, and wherein the selected scene type is determined based on a combination of the face detection analysis, the auto focus analysis, the motion analysis, the auto white balance analysis, and the auto exposure analysis.
9. An image processing device, comprising:
an image sensor having an array of pixels that include different colored pixels and effective when actuated in a first mode for providing preview sensor image data and effective when actuated in a second mode for providing final sensor image data;
a lens configured to expose the image of a scene onto the image sensor;
an exposure control system that adjusts the exposure level of a final image on the image sensor in response to a scene type; and
a processor configured to:
process the preview image data to select one of a plurality of pre-determined scene types, wherein processing the preview image data comprises performing at least one of a face detection analysis, an auto focus analysis, or a motion analysis, and wherein the selected scene type is determined based on the at least one of the face detection analysis, the auto focus analysis, or the motion analysis, and wherein processing the initial sensor image data further includes determining whether an ISO exposure is equal to or greater than a threshold value if the selected scene type is not a text scene,
communicate the selected scene type to the exposure control system prior to image capture of the final sensor image data to cause the exposure control system to adjust the exposure level of the final image on the image sensor, wherein the exposure control system sets the exposure level of the final image to be a default scene exposure level shifted by a pre-determined relative exposure level corresponding to the selected scene type and the ISO exposure,
store the final sensor image data in response to the scene type by combining a plurality of pixels having the same color, and
process the stored final sensor image data to compensate for the exposure level of the final image by using a set of pre-determined exposure compensation processing parameters corresponding to the selected scene type and the ISO exposure.
10. The device of claim 9 , wherein the processor is configured to further process the final sensor image data by using a pre-determined pipeline processing parameter corresponding to the selected scene type, which is selected from a group of parameter types including: neutral balance, color balance, flare correction, contrast adjustment, color saturation, sharpness adjustment, noise reduction, and combinations thereof.
11. The device of claim 9 , wherein the processor is further configured to apply adaptive tone scale processing to the final image sensor data by using a set of pre-determined adaptive tone scale processing parameters corresponding to the selected scene type.
12. The device of claim 9 , wherein the scene types include high contrast scene, low contrast scene, blue key scene, night scene, color saturated scene, and text scene.
13. A method comprising:
receiving initial sensor image data and final sensor image data from an image sensor;
adjusting an exposure level of a final image on the image sensor in response to a scene type;
processing the initial sensor image data to select one of a plurality of pre-determined scene types, wherein processing the initial sensor image data comprises performing at least one of a face detection analysis, an auto focus analysis, or a motion analysis, and wherein the selected scene type is determined based on the at least one of the face detection analysis, the auto focus analysis, or the motion analysis, and wherein processing the initial sensor image data further includes determining whether an ISO exposure is equal to or greater than a threshold value if the selected scene type is not a text scene;
prior to capturing the final sensor image data, adjusting the exposure level of the final image on the image sensor, wherein the exposure level of the final image is set to be a default scene exposure level shifted by a pre-determined relative exposure level corresponding to the selected scene type and the ISO exposure; and
processing the final sensor image data to compensate for the exposure level of the final image on the image sensor by using a set of pre-determined exposure compensation processing parameters corresponding to the selected scene type and the ISO exposure.
14. The method of claim 13 , further comprising processing the final sensor image data by using a pre-determined pipeline processing parameter corresponding to the selected scene type, which is selected from a group of parameter types including: neutral balance, color balance, flare correction, contrast adjustment, color saturation, sharpness adjustment, noise reduction, and combinations thereof.
15. The method of claim 13 , further comprising applying adaptive tone scale processing to the final image sensor data by using a set of pre-determined adaptive tone scale processing parameters corresponding to the selected scene type.
16. The method of claim 13 , wherein the scene types include high contrast scene, low contrast scene, (blue) sky scene, night scene, color saturated scene, and text scene.
17. The method of claim 13 , further comprising detecting faces with the initial image date data, wherein the plurality of scene types includes a first subset which includes faces and a second subset which does not include faces.
18. The method of claim 13 , further comprising calculating average values for a plurality of n×m regions using the initial image data.