High speed autofocus for images
Disclosed are systems and techniques for image processing. For example, a computing device can obtain, from an image sensor, a primary image frame of a scene. The computing device can obtain, from the image sensor during an idle time (e.g., a vertical blanking interval (VBI)) of the image sensor, auxiliary image frames of the scene. Each of the auxiliary image frames corresponds to a region of interest in the scene and includes a lower resolution than the primary image frame. The computing device can process the primary image frame and the auxiliary image frames to focus the image sensor based on the region of interest.
1 . An apparatus for image processing, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
obtain, from an image sensor, a primary image frame of a scene;
obtain, from the image sensor during an idle time of the image sensor, a plurality of auxiliary image frames of the scene, wherein each auxiliary image frame of the plurality of auxiliary image frames corresponds to a region of interest in the scene and comprises a lower resolution than the primary image frame; and
process the primary image frame and the plurality of auxiliary image frames to focus the image sensor based on the region of interest.
2 . The apparatus of claim 1 , wherein each auxiliary image frame of the plurality of auxiliary image frames further comprises a lower number of bits per pixel than the primary image frame.
3 . The apparatus of claim 1 , wherein each auxiliary image frame of the plurality of auxiliary image frames further comprises a downscaled pixel ratio as compared to the primary image frame.
4 . The apparatus of claim 1 , wherein each auxiliary image frame of the plurality of auxiliary image frames further comprises analog pixel binning with respect to the primary image frame.
5 . The apparatus of claim 1 , wherein the region of interest is based on at least one of user input, object detection, a center of the primary image frame, an area of the scene associated with a gaze of a user, or a predetermined distance from the image sensor.
6 . The apparatus of claim 1 , further comprising cropping the primary image frame according to the region of interest.
7 . The apparatus of claim 1 , wherein the at least one processor is configured to output, for transmission to the image sensor, the region of interest and a resolution of each auxiliary image frame of the plurality of auxiliary image frames.
8 . The apparatus of claim 7 , further comprising the image sensor, wherein the image sensor is configured to adjust parameters of the image sensor based on the region of interest and the resolution of each auxiliary image frame of the plurality of auxiliary image frames received from the at least one processor.
9 . The apparatus of claim 8 , wherein the image sensor is configured to capture the primary image frame and the plurality of auxiliary image frames of the scene.
10 . The apparatus of claim 1 , wherein the idle time of the image sensor is a vertical blanking interval.
11 . The apparatus of claim 1 , wherein, to process the primary image frame and the plurality of auxiliary image frames, the at least one processor is configured perform at least one of contrast detection automatic focusing or phase detection automatic focusing.
12 . The apparatus of claim 1 , wherein the at least one processor is an autofocus processor.
13 . A method of image processing, the method comprising:
obtaining, by an image sensor, a primary image frame of a scene;
obtaining, by the image sensor during an idle time of the image sensor, a plurality of auxiliary image frames of the scene, wherein each auxiliary image frame of the plurality of auxiliary image frames corresponds to a region of interest in the scene and comprises a lower resolution than the primary image frame; and
processing, by a processor, the primary image frame and the plurality of auxiliary image frames to focus the image sensor based on the region of interest.
14 . The method of claim 13 , wherein each auxiliary image frame of the plurality of auxiliary image frames further comprises a lower number of bits per pixel than the primary image frame.
15 . The method of claim 13 , wherein each auxiliary image frame of the plurality of auxiliary image frames further comprises a downscaled pixel ratio as compared to the primary image frame.
16 . The method of claim 13 , wherein each auxiliary image frame of the plurality of auxiliary image frames further comprises analog pixel binning with respect to the primary image frame.
17 . The method of claim 13 , wherein the region of interest is based on at least one of user input, object detection, a center of the primary image frame, an area of the scene associated with a gaze of a user, or a predetermined distance from the image sensor.
18 . The method of claim 13 , further comprising cropping the primary image frame according to the region of interest.
19 . The method of claim 13 , further comprising transmitting, by the processor to the image sensor, the region of interest and a resolution of each auxiliary image frame of the plurality of auxiliary image frames.
20 . The method of claim 19 , further comprising adjusting, by the image sensor, parameters of the image sensor based on the region of interest and the resolution of each auxiliary image frame of the plurality of auxiliary image frames received from the processor.