Dynamic image-based adjustment of image capture parameters
A portable electronic device with image capturing capabilities automatically or semi-automatically adjusts one or more image capturing parameters based on an image metric calculated from image data captured by the device. The device can be configured for processing image data captured by an on-board camera to determine the image metric, and to perform an automated adjustment action based on the determined value of the image metric. In some embodiments, the image metric is an image brightness metric upon which automated adjustment of a camera sensitivity parameter is based.
1. A method comprising:
using a camera incorporated in a portable electronic device, capturing image data according to a plurality of image capture parameters; and
using one or more computer processors incorporated in the portable electronic device, performing operations comprising:
processing the image data to determine a sharpness metric for one or more images represented by the image data, the processing of the image data comprising:
extracting a plurality of video frames from video content forming part of the image data;
calculating a respective sharpness value for each of the plurality of video frames; and
determining a count of video frames in the plurality of video frames for which the sharpness value exceeds a predefined threshold, the sharpness metric being based at least in part on the count of threshold-transgressing video frames; and
based at least in part on the sharpness metric, performing an automated adjustment action with respect to one or more of the plurality of image capture parameters of the camera.
2. The method of claim 1 , wherein the automated adjustment action comprises automatically modifying the one or more image capture parameters.
3. The method of claim 2 , wherein the modifying of the one or more image capture parameters comprises automatically modifying a shutter speed of the camera.
4. The method of claim 2 , wherein the modifying of the one or more image capture parameters comprises automatically modifying a camera exposure setting of the camera.
5. The method of claim 4 , wherein the camera exposure setting is an f-stop value for the camera.
6. The method of claim 2 , wherein the modifying of the one or more image capture parameters comprises automatically modifying an image stabilization setting for the camera.
7. The method of claim 1 , wherein the automated adjustment action comprises automatically causing display of a user-selectable user interface element on a user interface provided by the portable electronic device, the one or more computer processors being configured to modify the one or more image capture parameters responsive to user selection of the user interface element.
8. The method of claim 1 , wherein the processing of the image data further determines an image brightness metric, and wherein the automated adjustment action is based on the image brightness metric and the sharpness metric.
9. The method of claim 1 , wherein:
the extracting of the plurality of video frames is responsive to user engagement with an input mechanism to activate image-capture by the camera; and
the performing of the automated adjustment action is in response to and conditional upon identifying that the count of threshold-transgressing video frames exceeds a pre-defined threshold number, which automated adjustment action comprises automatically modifying the one or more image capture parameters.
10. The method of claim 1 , wherein the portable electronic device is an article of eyewear, having a frame that is head-mountable for carrying one or more optical elements within a field of view of the user.
11. A device comprising:
a frame;
a camera mounted on the frame and configured to capture and process image data according to a plurality of image capture parameters; and
a camera controller incorporated in the frame and configured to perform operations comprising:
processing the image data to determine a sharpness metric for one or more images represented by the image data, the processing of the image data comprising:
extracting a plurality of video frames from video content forming part of the image data;
calculating a respective sharpness value for each of the plurality of video frames; and
determining a count of video frames in the plurality of video frames for which the sharpness value exceeds a predefined threshold, the sharpness metric being based at least in part on the count of threshold-transgressing video frames; and
based at least in part on the sharpness metric, performing an automated adjustment action with respect to one or more of the plurality of image capture parameters of the camera.
12. The device of claim 11 , wherein the automated adjustment action comprises automatically modifying the one or more image capture parameters.
13. The device of claim 11 , wherein the modifying of the one or more image capture parameters comprises automatically modifying a shutter speed of the camera.
14. The device of claim 11 , wherein the modifying of the one or more image capture parameters comprises automatically modifying a camera exposure setting of the camera.
15. The device of claim 14 , wherein the camera exposure setting is an f-stop value for the camera.
16. The device of claim 11 , wherein the modifying of the one or more image capture parameters comprises automatically modifying an image stabilization setting for the camera.
17. The device of claim 11 , wherein the camera controller is configured such that the automated adjustment action comprises:
automatically causing display of a user-selectable user interface element on a user interface provided by the device; and
modifying the one or more image capture parameters responsive to user selection of the user interface element.
18. The device of claim 11 , wherein the camera controller is further configured to determine an image brightness metric for the image data, and to perform the automated adjustment action is based on the image brightness metric and the sharpness metric.
19. The device of claim 11 , wherein the camera controller is configured to process the image data such that:
the extracting of the plurality of video frames is responsive to user engagement with an input mechanism to activate image-capture by the camera; and
the performing of the automated adjustment action is in response to and conditional upon identifying that the count of threshold-transgressing video frames exceeds a pre-defined threshold number, which automated adjustment action comprises automatically modifying the one or more image capture parameters.
20. A non-transitory computer-readable storage medium having stored thereon instructions for causing a machine, when executing the instructions, perform operations comprising:
receiving image data captured by a camera incorporated in a portable electronic device, the camera being configured to operate according to a plurality of image capture parameters;
processing the image data to determine a sharpness metric for one or more images represented by the image data, the processing of the image data comprising:
extracting a plurality of video frames from video content forming part of the image data;
calculating a respective sharpness value for each of the plurality of video frames; and
determining a count of video frames in the plurality of video frames for which the sharpness value exceeds a predefined threshold, the sharpness metric being based at least in part on the count of threshold-transgressing video frames; and
based at least in part on the sharpness metric, performing an automated adjustment action with respect to one or more of the plurality of image capture parameters of the camera.