SYSTEMS AND METHODS FOR ADJUSTING FOCUS BASED ON FOCUS TARGET INFORMATION
A system, method, and computer program product are provided for generating a focus sweep to produce a focus stack. In use, an image is sampled as image data. Next, a first focus region is identified and a second focus region is identified. Next, first focus target information corresponding to the first focus region is determined and second focus target information corresponding to the second focus region is determined. Further, a focus is adjusted, based on the first focus target information and at least one first image is captured based on the first focus target information. Additionally, the focus is adjusted, based on the second focus target information and at least one second image is captured based on the second focus target information. Lastly, the at least one first image and the at least one second image are saved to an image stack. Additional systems, methods, and computer program products are also presented.
1 . A device, comprising:
a non-transitory memory storing instructions; and
one or more processors in communication with the non-transitory memory, wherein the one or more processors execute the instructions to:
sample a preliminary image as image data, using a camera module;
identify a first focus region, using an image classifier;
identify a second focus region, using the image classifier;
determine a first focus target information corresponding to the first focus region;
determine a second focus target information corresponding to the second focus region;
adjust a focus, based on the first focus target information, using the camera module;
capture at least one first image based on the first focus target information, using the camera module;
adjust the focus, based on the second focus target information, using the camera module;
capture at least one second image based on the second focus target information, using the camera module; and
save the at least one first image and the at least one second image to an image stack.
2 . The device of claim 1 , wherein the one or more processors further execute the
instructions to:
align the at least one first image and the at least one second image; and
blend the at least one first image and the at least one second image to create a first blended image.
3 . The device of claim 1 , wherein the device is configured such that the first focus region and the second focus region each include one or more pixel points with a radius and weight profile.
4 . The device of claim 1 , wherein the device is configured such that the first focus region and the second focus region each include one or more pixel points with a weight mask.
5 . The device of claim 4 , wherein the device is configured such that one or more weights associated with the weight mask are used to establish a focus estimate.
6 . The device of claim 1 , wherein the device is configured such that first information from one or more focus pixels associated with the first focus region is aggregated to generate a first focus estimate for the first focus region, the first focus estimate based on the first focus target information, and second information from one or more focus pixels associated with the second focus region is aggregated to generate a second focus estimate for the second focus region, the second focus estimate based on the second focus target information.
7 . The device of claim 1 , wherein the device is configured such that the first focus target information and the second focus target information each include a 2D mask of values.
8 . The device of claim 1 , wherein the device is configured such that the first focus target information is saved as metadata associated with the at least one first image, and the second focus target information is saved as metadata associated with the at least one second image.
9 . The device of claim 1 , wherein the device is configured such that the first focus target information and the second focus target information each includes at least one coordinate corresponding to one or more pixel points.
10 . The device of claim 1 , wherein the device is configured such that at least one of the first focus target information and the second focus target information is selected by a user.
11 . The device of claim 1 , wherein capturing the at least one first image includes capturing two or more first images and capturing the at least one second image includes capturing two or more second images.
12 . The device of claim 1 , wherein the one or more processors further execute the instructions to: capture at least one third image based on third focus target information, the third focus target information found between the first focus target information and the second focus target information.
13 . The device of claim 12 , wherein the device is configured such that the first focus target information corresponds with a first focus setting, the second focus target information corresponds with a second focus setting, and the third focus target information corresponds with a third focus setting.
14 . The device of claim 13 , wherein the device is configured such that the first focus setting is used to capture the at least one first image, the second focus setting is used to capture the at least one second image, and the third focus setting is used to capture a third image, wherein the at least one first image, the at least one second image, and the third image are blended to create a second blended image.
15 . The device of claim 1 , wherein the one or more processors further execute the instructions to:
receive updated focus target information corresponding to the identified first focus region or the identified second focus region;
in response to receiving the updated focus target information, adjust the focus, based on the updated focus target information.
16 . The device of claim 3 , wherein the device is configured such that the weight profile includes a start point and an end point, with a predefined function to be applied between the start point and the end point.
17 . The device of claim 2 , wherein the device is configured such that blending the at least one first image and the at least on second image is based on at least one of focus stacking, focal plane merging, z-stacking, and focus blending.
18 . The device of claim 2 , wherein the device is configured such that the first blended image preserves the first focus target information and the second focus target information such that the first focus region or the second focus region may be later selected to readjust a point of focus.
19 . A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium that when executed by a processor instruct the processor to:
sample a preliminary image as image data, using a camera module;
identify a first focus region, using an image classifier;
identify a second focus region, using the image classifier;
determine a first focus target information corresponding to the first focus region;
determine a second focus target information corresponding to the second focus region;
adjust a focus, based on the first focus target information, using the camera module;
capture at least one first image based on the first focus target information, using the camera module;
adjust the focus, based on the second focus target information, using the camera module;
capture at least one second image based on the second focus target information, using the camera module; and
save the at least one first image and the at least one second image to an image stack.
20 . A computer-implemented method, comprising:
sampling a preliminary image as image data, using a camera module;
identifying a first focus region, using an image classifier;
identifying a second focus region, using the image classifier;
determining a first focus target information corresponding to the first focus region, using a processing unit;
determining a second focus target information corresponding to the second focus region, using the processing unit;
adjusting a focus, based on the first focus target information, using the camera module;
capturing at least one first image based on the first focus target information, using the camera module;
adjusting the focus, based on the second focus target information, using the camera module;
capturing at least one second image based on the second focus target information, using the camera module; and
save the at least one first image and the at least one second image to an image stack, using the processing unit.