Phase disparity correction for image sensors

1. An imaging device, comprising:

an image sensor including an array of pixels, wherein,

at least one pixel in the array of pixels includes an array of phase disparity subpixels; and

the array of pixels includes a set of filter elements arranged in a filter pattern, with different subsets of pixels receiving light through different types of filter elements in the set of filter elements; and

an image processor configured to,

receive values measured by at least the phase disparity subpixels;

estimate phase disparities between the received values;

generate, using the estimated phase disparities, a set of corrected values for the phase disparity subpixels; and

performing a demosaicing operation using values for all of the pixels in the array of pixels, including the set of corrected values for the phase disparity subpixels, to generate a set of demosaiced values for each image plane in a set of image planes;

wherein,

each image plane is associated with a different type of filter element in the set of filter elements.

2. The imaging device of claim 1 , wherein:

each pixel in the array of pixels includes an array of phase disparity subpixels; and

the filter pattern comprises a Bayer color filter pattern.

3. The imaging device of claim 1 , wherein the array of phase disparity subpixels is a 2×2 array of phase disparity subpixels.

4. The imaging device of claim 3 , wherein:

the image processor is configured to,

correct the received values for only three of four phase disparity subpixels in each array of phase disparity subpixels.

5. The imaging device of claim 1 , wherein the image processor is configured to estimate phase disparities, between the values measured by at least a first set of phase disparity subpixels of a pixel, using the values measured by at least:

the first set of phase disparity subpixels of the pixel; and

a second set of phase disparity subpixels of at least one neighboring pixel; wherein,

the first set of phase disparity subpixels and the second set of phase disparity subpixels receive light through a same type of filter element in the set of filter elements.

6. The imaging device of claim 1 , further comprising:

a first memory block configured to store the values measured by at least the phase disparity subpixels;

a second memory block configured to store the estimated phase disparities; and

a third memory block configured to store the set of corrected values for the phase disparity subpixels.

7. The imaging device of claim 1 , wherein:

the image processor is further configured to,

perform pre-demosaic operations on the set of corrected values before performing the demosaicing operation to generate the set of demosaiced values; and

perform post-demosaic operations on the set of demosaiced values.

8. The imaging device of claim 1 , wherein:

the image processor is configured to estimate the phase disparities using a normalized cross correlation function.

9. The imaging device of claim 1 , wherein:

the image processor is configured to,

combine the received values measured by the phase disparity subpixels disposed along a first direction within a pixel;

filter the combined values;

estimate a relative shift of the combined values along a second direction within the pixel, the second direction orthogonal to the first direction; and

limit estimation of the phase disparities to out-of-focus areas of an image.

10. The imaging device of claim 9 , wherein the out-of-focus areas are areas that are out-of-focus more than a threshold amount.

11. The imaging device of claim 9 , wherein the image processor has a set of programmable thresholds defining the out-of-focus areas of the image.

12. The imaging device of claim 1 , wherein:

the image processor is configured to,

bin received values of phase disparity subpixels disposed along a first direction within a pixel; and

estimate, using the binned values, phase disparities within the pixel along a second direction.

13. The imaging device of claim 12 , wherein:

the image processor is configured to,

correct, using the estimated phase disparities along the second direction,

the values of the phase disparity subpixels disposed along the second direction within the pixel; and

values of the phase disparity subpixels disposed along the first direction within the pixel; and

the second direction is orthogonal to the first direction.

14. The imaging device of claim 13 , wherein:

the image processor is configured to,

correct the values of the phase disparity subpixels disposed along the first direction within the pixel using a two-dimensional interpolation.

15. The imaging device of claim 14 , wherein the two-dimensional interpolation comprises at least one of bilinear interpolation or a bicubic interpolation.

16. A method of processing an image, comprising:

acquiring values from phase disparity subpixels in a quad Bayer color filter array image sensor, in which each pixel of the quad Bayer color filter array image sensor comprises a 2×2 array of phase disparity subpixels;

estimating phase disparities between the values measured by the phase disparity subpixels;

correcting the values using the estimated phase disparities; and

performing a demosaicing operation using values for all of the pixels in the quad Bayer color filter array image sensor, including the corrected values for the phase disparity subpixels, to generate a demosaiced set of image planes; wherein,

each image plane is associated with a different color in a Bayer color filter.

17. The method of claim 16 , further comprising:

after correcting the values using the estimated phase disparities, blurring the corrected values in areas of the image that are out-of-focus more than a threshold amount.

18. An imaging device comprising an image processing pipeline, the image processing pipeline comprising:

a phase disparity estimator configured to receive a set of values acquired by at least a set of phase disparity subpixels in an image sensor and estimate phase disparities between the values;

a phase disparity corrector configured to correct the values using the estimated phase disparities; and

a demosaicer configured to operate on values for all of the pixels in the image sensor, including the corrected values, to generate a set of demosaiced values for each image plane in a set of image planes.

19. The imaging device of claim 18 , wherein:

the phase disparity estimator is configured to,

combine, for a pixel, the received values acquired by the phase disparity subpixels disposed along a first direction; and

estimate a relative shift of the combined values along a second direction within the pixel, the second direction orthogonal to the first direction.

20. The imaging device of claim 18 , wherein the phase disparity estimator is configured to estimate the phase disparities using a normalized cross correlation function.