Generating an enhanced image of a predetermined scene from a plurality of images of the predetermined scene
A method, device, system, and article of manufacture are provided for generating an enhanced image of a predetermined scene from images. In one embodiment, a method comprises receiving, by a computing device, a first indication associated with continuous image capture of a predetermined scene being enabled; in response to the continuous image capture being enabled, receiving, by the computing device, from an image sensor, a reference image and a first image, wherein each of the reference image and the first image is of the predetermined scene and has a first resolution; determining an estimated second resolution of an enhanced image of the predetermined scene using the reference image and the first image; and in response to the continuous image capture being disabled, determining the enhanced image using the reference image and the first image, wherein the enhanced image has a second resolution that is at least the first resolution and about the estimated second resolution.
1. A method, comprising:
receiving a plurality of images of a predetermined scene, wherein each of the plurality of images has a first resolution;
determining a reference image from the plurality of images;
determining a sub-pixel motion vector for each of the plurality of images relative to the reference image;
aligning and combining pixels from the plurality of images using corresponding sub-pixel motion vectors to form an enhanced image; and
in response to identifying an empty sub-pixel location in the enhanced image, interpolating the enhanced image to determine a pixel value for the empty sub-pixel location.
2. The method of claim 1 , further comprising:
removing one of two of the plurality of images responsive to two of the plurality of images having a same sub-pixel motion vector.
3. The method of claim 1 , further comprising:
responsive to any of the plurality of images being association with motion of subject matter in the predetermined scene, removing a corresponding image.
4. The method of claim 1 , wherein capture of the plurality of images is initiated by a user depressing a button of a camera and capture of the plurality of images ends when the user releases the button of the camera.
5. The method of claim 1 , wherein capture of the plurality of images is initiated by a user providing input to a presence-sensitive input device and capture of the plurality of images ends when the user stops providing the input to the presence-sensitive input device.
6. The method of claim 1 , wherein determining the sub-pixel motion vector for each of the plurality of images relative to the reference image includes:
decomposing at least a portion of each of the plurality of images into macroblocks, wherein each macroblock includes a set of pixels;
determining, for each macroblock, a best match to an image block of the reference image; and
performing interpolation to determine the sub-pixel motion vector.
7. The method of claim 1 , wherein determining the reference image from the plurality of images includes a first captured image of the plurality of images.
8. The method of claim 1 , further comprising:
responsive to a first sub-pixel motion vector for a current image of the plurality of images being different from a second sub-pixel motion vector, increasing a second resolution for the enhanced image.
9. A portable communication device, comprising:
a memory configured to store data and computer-executable instructions; and
a processor operatively coupled to the memory, wherein the processor is configured to:
receive a plurality of images of a predetermined scene;
determine a reference image from the plurality of images;
determine a sub-pixel motion vector for each of the plurality of images relative to the reference image;
align and combine pixels from the plurality of images using corresponding sub-pixel motion vectors to form an enhanced image; and
in response to identifying an empty sub-pixel location in the enhanced image, interpolate the enhanced image to determine a pixel value for the empty sub-pixel location.
10. The portable communication device of claim 9 , wherein the processor is further configured to:
remove one of two of the plurality of images responsive to two of the plurality of images having a same sub-pixel motion vector.
11. The portable communication device of claim 9 , wherein the processor is further configured to:
responsive to any of the plurality of images being association with motion of subject matter in the predetermined scene, remove a corresponding image.
12. The portable communication device of claim 9 , wherein capture of the plurality of images is initiated by a user depressing a button of a camera and capture of the plurality of images ends when the user releases the button of the camera.
13. The portable communication device of claim 9 , wherein capture of the plurality of images is initiated by a user providing input to a presence-sensitive input device and capture of the plurality of images ends when the user stops providing the input to the presence-sensitive input device.
14. The portable communication device of claim 9 , wherein determining the sub-pixel motion vector for each of the plurality of images relative to the reference image includes:
decomposing at least a portion of each of the plurality of images into macroblocks, wherein each macroblock includes a set of pixels;
determining, for each macroblock, a best match to an image block of the reference image; and
performing interpolation to determine the sub-pixel motion vector.
15. The portable communication device of claim 9 , wherein determining the reference image from the plurality of images includes a first captured image of the plurality of images.
16. A non-transitory computer readable medium with instructions stored thereon that, when executed by one or more computers, cause the one or more computers to perform operations, the operations comprising:
receiving a plurality of images of a scene, wherein each of the plurality of images has a resolution;
determining a reference image from the plurality of images;
determining a sub-pixel motion vector for each of the plurality of images relative to the reference image;
aligning and combining pixels from the plurality of images using corresponding sub-pixel motion vectors to form an enhanced image; and
in response to identifying an empty sub-pixel location in the enhanced image, interpolating the enhanced image to determine a pixel value for the empty sub-pixel location.
17. The computer-readable medium of claim 16 , wherein the operations further comprise:
removing one of two of the plurality of images responsive to two of the plurality of images having a same sub-pixel motion vector.
18. The computer-readable medium of claim 16 , wherein the operations further comprise:
responsive to any of the plurality of images being association with motion of subject matter in the scene, removing a corresponding image.
19. The computer-readable medium of claim 16 , wherein capture of the plurality of images is initiated by a user depressing a button of a camera and capture of the plurality of images ends when the user releases the button of the camera.
20. The computer-readable medium of claim 16 , wherein capture of the plurality of images is initiated by a user providing input to a presence-sensitive input device and capture of the plurality of images ends when the user stops providing the input to the presence-sensitive input device.