Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
View Patent ↗Systems and methods for synthesizing high resolution images using image deconvolution and depth information in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory, wherein an image deconvolution application configures the processor to obtain light field image data, determine motion data based on metadata contained in the light field image data, generate a depth-dependent point spread function based on the synthesized high resolution image, the depth map, and the motion data, measure the quality of the synthesized high resolution image based on the generated depth-dependent point spread function, and when the measured quality of the synthesized high resolution image is within a quality threshold, incorporate the synthesized high resolution image into the light field image data.
1. An array camera, comprising:
a processor; and
a memory connected to the processor and configured to store an image deconvolution application;
wherein the image deconvolution application configures the processor to:
obtain light field image data, where the light field image data comprises a synthesized high resolution image having a plurality of pixels, a depth map, and metadata describing the motion associated with a capturing device that captured the light field image data;
determine motion data based on the metadata contained in the light field image data;
generate a depth-dependent point spread function based on the synthesized high resolution image, the depth map, and the motion data, where the depth-dependent point spread function describes the blurriness of points within the synthesized high resolution image based on the motion of the capturing device and the depth of the pixels described in the depth map;
measure the quality of the synthesized high resolution image based on the generated depth-dependent point spread function;
when the measured quality of the synthesized high resolution image is within a quality threshold, incorporate the synthesized high resolution image into the light field image data; and
when the measured quality of the synthesized high resolution image is outside the quality threshold;
determine updated motion data based on the measured quality and the depth-dependent point spread function;
generate an updated depth-dependent point spread function based on the updated motion data; and
synthesize a new high resolution image based on the updated depth-dependent point spread function.
2. The array camera of claim 1 , further comprising an array camera module comprising an imager array having multiple focal planes and an optics array configured to form images through separate apertures on each of the focal planes;
wherein the array camera module is configured to communicate with the processor; and
wherein the obtained light field image data comprises image data captured by the imager array.