Systems and methods for fusing images
A method performed by an electronic device is described. The method includes obtaining a first image from a first camera, the first camera having a first focal length and a first field of view. The method also includes obtaining a second image from a second camera, the second camera having a second focal length and a second field of view disposed within the first field of view. The method further includes aligning at least a portion of the first image and at least a portion of the second image to produce aligned images. The method additionally includes fusing the aligned images based on a diffusion kernel to produce a fused image. The diffusion kernel indicates a threshold level over a gray level range. The method also includes outputting the fused image. The method may be performed for each of a plurality of frames of a video feed.
1 . An apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
select, for a fused image, pixels from a first area of a first image obtained using a first type of lens;
select, for the fused image, pixels from a first area of a second image obtained using a second type of lens that is different than the first type of lens, wherein the first area of the first image and the first area of the second image are within a region of interest, wherein a portion of the region of interest is outside of the first image and is smaller than the second image, and wherein the first area of the second image obtained using the second type of lens is used to fill in the portion of the region of interest not captured in the first area of the first image obtained using the first type of lens;
blend pixels in a second area of the first image and pixels in a second area of the second image to obtain blended pixels; and
include the pixels from the first area of the first image, the pixels from the first area of the second image, and the blended pixels in the fused image.
2 . The apparatus of claim 1 , wherein the at least one processor is configured to:
output the fused image.
3 . The apparatus of claim 1 , wherein the second area of the first image is within the first area of the first image, and wherein the second area of the second image is within the first area of the second image.
4 . The apparatus of claim 3 , wherein the second area of the first image overlaps with the second area of the second image.
5 . The apparatus of claim 1 , wherein the first area of the first image comprises a first composite region from the first image, and wherein the first area of the second image comprises a second composite region from the second image.
6 . The apparatus of claim 5 , wherein, to blend the pixels in the second area of the first image and the pixels in the second area of the second image, the at least one processor is configured to:
perform seam blending between the first composite region and the second composite region.
7 . The apparatus of claim 1 , wherein the at least one processor is configured to blend the pixels in the second area of the first image and the pixels in the second area of the second image to recover the portion of the region of interest based on replacing the portion of the region of interest that does not exist in the first image with at least a part of the second image.
8 . The apparatus of claim 1 , wherein the first type of lens is a telephoto lens, and wherein the second type of lens is a wide-angle lens.
9 . The apparatus of claim 1 , wherein the first image and the second image are captured concurrently.
10 . The apparatus of claim 1 , wherein the first image and the second image are captured at different times.
11 . A method performed by an electronic device, the method comprising:
selecting, for a fused image, pixels from a first area of a first image obtained using a first type of lens;
selecting, for the fused image, pixels from a first area of a second image obtained using a second type of lens that is different than the first type of lens, wherein the first area of the first image and the first area of the second image are within a region of interest, wherein a portion of the region of interest is outside of the first image and is smaller than the second image, and wherein the first area of the second image obtained using the second type of lens is used to fill in a portion of the region of interest not captured in the first area of the first image obtained using the first type of lens;
blending pixels in a second area of the first image and pixels in a second area of the second image to obtain blended pixels; and
including the pixels from the first area of the first image, the pixels from the first area of the second image, and the blended pixels in the fused image.
12 . The method of claim 11 , further comprising:
outputting the fused image.
13 . The method of claim 11 , wherein the second area of the first image is within the first area of the first image, and wherein the second area of the second image is within the first area of the second image.
14 . The method of claim 13 , wherein the second area of the first image overlaps with the second area of the second image.
15 . The method of claim 11 , wherein the first area of the first image comprises a first composite region from the first image, and wherein the first area of the second image comprises a second composite region from the second image.
16 . The method of claim 15 , wherein blending the pixels in the second area of the first image and the pixels in the second area of the second image comprises:
performing seam blending between the first composite region and the second composite region.
17 . The method of claim 11 , wherein blending the pixels in the second area of the first image and the pixels in the second area of the second image is performed in order to recover the portion of the region of interest based on replacing the portion of the region of interest that does not exist in the first image with at least a part of the second image.
18 . The method of claim 11 , wherein the first type of lens is a telephoto lens, and wherein the second type of lens is a wide-angle lens.
19 . The method of claim 11 , wherein the first image and the second image are captured concurrently.
20 . The method of claim 11 , wherein the first image and the second image are captured at different times.