Target image quality enhancement using a guide image

1. A method comprising:

obtaining a first image having a first resolution and comprising a plurality of first pixels having a plurality of corresponding first pixel values;

obtaining a second image having a second resolution and comprising a plurality of second pixels having a plurality of corresponding second pixel values; and

generating a third image based on the first image and the second image, the third image having the second resolution and comprising a plurality of third pixels having a plurality of corresponding third pixel values, wherein generating the third image comprises:

upscaling the first image from the first resolution to the second resolution to generate an upscaled first image having the second resolution and comprising a plurality of upscaled first pixels having a plurality of corresponding upscaled first pixel values; and

determining, for a particular third pixel, a corresponding third pixel value based on the upscaled first pixel value of a particular upscaled first pixel corresponding to the particular third pixel and the second pixel value of a particular second pixel corresponding to the particular third pixel.

2. The method of claim 1 , wherein the third pixel value is selected as either the upscaled first pixel value or the second pixel value.

3. The method of claim 1 , wherein the third pixel value is a weighted sum of the upscaled first pixel value and the second pixel value.

4. The method of claim 1 , wherein the third pixel value is determined based on comparing a neighborhood of pixels around the particular upscaled first pixel to a neighborhood of pixels around the particular second pixel.

5. The method of claim 4 , wherein comparing the neighborhood of pixels around the particular upscaled first pixel to the neighborhood of pixels around the particular second pixel comprises determining a normalized cross-correlation (NCC) between the neighborhood of pixels around the particular upscaled first pixel and the neighborhood of pixels around the particular second pixel.

6. The method of claim 1 , further comprising obtaining a fourth image having the second resolution and comprising a plurality of fourth pixels having a plurality of corresponding fourth pixel values, wherein determining the corresponding third pixel value is further based on the fourth pixel value of a particular fourth pixel corresponding to the particular third pixel.

7. The method of claim 6 , wherein determining the third pixel value is further based on a sharpness of a neighborhood of pixels around the particular second pixel and a sharpness of a neighborhood of pixels around the particular fourth pixel.

8. The method of claim 1 , further comprising:

detecting, via an input device of an electronic device, a capture input; and

in response to detecting the capture input, capturing, via a camera of the electronic device, a high-resolution image of a scene and a sequence of low-resolution images of the scene.

9. The method of claim 8 , wherein obtaining the first image comprises:

displaying, on a display, a set of potential target images of the sequence of low-resolution images of the scene; and

receiving, via an input device, a selection of the target image from the set of potential target images.

10. A non-transitory computer-readable medium having instructions encoded thereon which, when executed by one or more processors of an electronic device, cause the electronic device to:

obtain a first image having a first resolution and comprising a plurality of first pixels having a plurality of corresponding first pixel values;

obtain a second image having a second resolution and comprising a plurality of second pixels having a plurality of corresponding second pixel values; and

generate a third image based on the first image and the second image, the third image having the second resolution and comprising a plurality of third pixels having a plurality of corresponding third pixel values, wherein generating the third image comprises:

upscaling the first image from the first resolution to the second resolution to generate an upscaled first image having the second resolution and comprising a plurality of upscaled first pixels having a plurality of corresponding upscaled first pixel values; and

determining, for a particular third pixel, a corresponding third pixel value based on the upscaled first pixel value of a particular upscaled first pixel corresponding to the particular third pixel and the second pixel value of a particular second pixel corresponding to the particular third pixel.

11. The non-transitory computer-readable medium of claim 10 , wherein the third pixel value is selected as either the upscaled first pixel value or the second pixel value.

12. The non-transitory computer-readable medium of claim 10 , wherein the third pixel value is a weighted sum of the upscaled first pixel value and the second pixel value.

13. The non-transitory computer-readable medium of claim 10 , wherein the third pixel value is determined based on comparing a neighborhood of pixels around the particular upscaled first pixel to a neighborhood of pixels around the particular second pixel.

14. The non-transitory computer-readable medium of claim 13 , wherein the comparing the neighborhood of pixels around the particular upscaled first pixel to the neighborhood of pixels around the particular second pixel comprises determining a normalized cross-correlation (NCC) between the neighborhood of pixels around the particular upscaled first pixel and the neighborhood of pixels around the particular second pixel.

15. The non-transitory computer-readable medium of claim 10 , wherein the instructions, when executed, further cause the electronic device to obtain a fourth image having the second resolution and comprising a plurality of fourth pixels having a plurality of corresponding fourth pixel values, wherein determining the corresponding third pixel value is further based on the fourth pixel value of a particular fourth pixel corresponding to the particular third pixel.

16. The non-transitory computer-readable medium of claim 15 , wherein determining the third pixel value is further based on a sharpness of a neighborhood of pixels around the particular second pixel and a sharpness of a neighborhood of pixels around the particular fourth pixel.

17. A system comprising:

a non-transitory memory; and

one or more processors configured to:

obtain a first image having a first resolution and comprising a plurality of first pixels having a plurality of corresponding first pixel values;

obtain a second image having a second resolution and comprising a plurality of second pixels having a plurality of corresponding second pixel values; and

generate a third image based on the first image and the second image, the third image having the second resolution and comprising a plurality of third pixels having a plurality of corresponding third pixel values, wherein generating the third image comprises:

upscaling the first image from the first resolution to the second resolution to generate an upscaled first image having the second resolution and comprising a plurality of upscaled first pixels having a plurality of corresponding upscaled first pixel values; and

determining, for a particular third pixel, a corresponding third pixel value based on the upscaled first pixel value of a particular upscaled first pixel corresponding to the particular third pixel and the second pixel value of a particular second pixel corresponding to the particular third pixel.

18. The system of claim 17 , wherein the third pixel value is selected as either the upscaled first pixel value or the second pixel value.

19. The system of claim 17 , wherein the third pixel value is a weighted sum of the upscaled first pixel value and the second pixel value.

20. The system of claim 17 , wherein the third pixel value is determined based on comparing a neighborhood of pixels around the particular upscaled first pixel to a neighborhood of pixels around the particular second pixel.