Granted Patent B2

US 9,100,635 · App. 13/931,724 · Granted Aug 4, 2015

Abstract

Claims (41)

1. A method for detecting a defective camera array using an image processing system, where the camera array comprises a plurality of cameras, the method comprising:

capturing image data of a known target using the plurality of cameras, where the image data forms a plurality of images;

dividing each of the plurality of images into a plurality of corresponding image regions using the image processing system;

identifying the presence of at least one localized defect in at least one of the plurality of the cameras by evaluating the image regions in the plurality of images in accordance with at least one predetermined localized defect criterion using the image processing system;

detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by:

a common corresponding image region from at least a subset of the plurality of images; and

any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image, where the epipolar line is defined by the relative location of the center of the camera that captured the given image and a predetermined viewpoint.

2. The method of claim 1 , wherein identifying the presence of at least one localized defect in at least one of the plurality of the cameras by evaluating the image regions in the plurality of images in accordance with at least one predetermined localized defect criterion using the image processing system comprises identifying a plurality of defective pixels within an image region that satisfies at least one predetermined criterion.

3. The method of claim 2 , wherein the predetermined criterion is that the plurality of defective pixels within the image region exceeds a predetermined number of defective pixels.

4. The method of claim 2 , wherein the predetermined criterion is that the plurality of defective pixels includes a cluster of defective pixels that exceeds a predetermine size.

5. The method of claim 2 , wherein defective pixels comprise hot pixels, bright pixels and dark pixels.

6. The method of claim 1 , wherein identifying the presence of at least one localized defect in at least one of the plurality of the cameras by evaluating the image regions in the plurality of images in accordance with at least one predetermined localized defect criterion using the image processing system comprises:

measuring the Modulation Transfer Function (MTF) within an image region; and

determining that the MTF of the image region fails to satisfy a predetermined criterion.

7. The method of claim 6 , wherein the predetermined criterion is that the on-axis MTF at a predetermined spatial frequency exceeds a first predetermined threshold, the off-axis tangential MTF at a predetermined spatial frequency exceeds a second predetermined threshold, and the off-axis sagittal MTF at a predetermined spatial frequency exceeds a third predetermined threshold.

8. The method of claim 1 , wherein said plurality of corresponding images portions forms a first plurality of corresponding image regions and the method further comprises:

dividing each of the plurality of images into a second plurality of corresponding image regions using the image processing system, where the number of image regions in the first plurality of corresponding image regions differs from the number of image regions in the second plurality of corresponding image regions; and

identifying the presence of at least one localized defect in at least one of the plurality of the cameras by evaluating the image regions in the second plurality of images in accordance with at least one additional predetermined localized defect criterion using the image processing system.

9. The method of claim 1 , wherein:

the plurality of images forms a reference image and a plurality of alternate view images;

the specific set of image regions is formed by:

a specific image region from the reference image;

the image regions from each of the alternate view images that correspond to the specific image region from the reference image; and

any additional image region in a given alternate view image from the plurality of alternate view images that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within the image region of the given alternate view image that corresponds to the selected image region from the reference image, where the epipolar line is defined by the relative location of the center of the camera that captured the reference image and the center of the camera that captured the given alternate view image.

10. The method of claim 1 , wherein:

the plurality of images forms a plurality of images in each of a plurality of color channels; and

a specific set of image regions is formed by image regions from the plurality of images within one of the plurality of color channels.

11. The method of claim 10 , wherein:

the plurality of images forms a reference image and a plurality of alternate view images and said plurality of images from one of the plurality of color channels does not include the reference image; and

the specific set of image regions is further formed by:

the image regions from each of the alternate view images within said one of the plurality of color channels that correspond to a specific image region from the reference image; and

any additional image region in a given alternate view image from said one of the plurality of color channels that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within the image region of the given alternate view image that corresponds to the selected image region from the reference image, where the epipolar line is defined by the relative location of the center of the camera that captured the reference image and the center of the camera that captured the given alternate view image.

12. The method of claim 10 , further comprising detecting a defective camera array using the image processing system when the number of localized defects in a second set of image regions exceeds a second predetermined threshold, where the second set of image regions is formed by image regions from the plurality of images within a second of the plurality of color channels.

13. The method of claim 12 , wherein said predetermined criterion used with respect to said specific set of image regions from said one of the plurality of color channels is different from said second predetermined criterion used with respect to said second set of image regions from said second of the plurality of color channels.

14. A method for detecting a defective optic array using an image processing system, where the optic array comprises a plurality of lens stacks, the method comprising:

dividing the image field of each of the plurality of lens stacks into a plurality of corresponding regions when using an optical test instrument;

measuring the Modulation Transfer Function (MTF) of a known target using the optical test instrument in each of the regions;

identifying the presence of at least one localized defect in at least one of the plurality of the lens stacks by evaluating the MTF measurements of the regions in the plurality of lens stacks in accordance with at least one predetermined localized defect criterion using the optical test instrument;

detecting a defective optic array using the image processing system when the number of localized defects in a specific set of regions exceeds a predetermined threshold, where the specific set of regions is formed by:

a common corresponding region from at least a subset of the plurality of lens stacks; and

any additional region in a given lens stack that forms an image within a predetermined maximum parallax shift distance along an epipolar line from said common corresponding region within the given lens stack, where the epipolar line is defined by the relative location of the center of the given lens stack and a predetermined viewpoint.

Assignments (12)