IP Library Granted Patent US 10,127,682
Granted Patent B2
US 10,127,682 · App. 15/682,064 · Granted Nov 13, 2018

System and methods for calibration of an array camera

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,127,682
App. No.
15/682,064
Granted
Nov 13, 2018
Kind
B2
Abstract

Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the detecting of defects in the imaging components of the array camera and determining whether the detected defects may be tolerated by image processing algorithms. The calibration process also determines translation information between imaging components in the array camera for use in merging the image data from the various imaging components during image processing. Furthermore, the calibration process may include a process to improve photometric uniformity in the imaging components.

Claims (35)

1. A method of manufacturing an array camera device, the method comprising:

assembling an array of cameras comprising a plurality of imaging components that capture images of a scene from different viewpoints, where the components include:

a set of one or more reference imaging components, each having a reference viewpoint, and

a set of one or more associate imaging components;

configuring the array of cameras to communicate with at least one processor;

configuring the processor to communicate with at least one display;

configuring the processor to communicate with at least one type of memory; and

performing a calibration process for the array of cameras, where the calibration process comprises:

performing a defect detection process that includes:

identifying pixel defects in each of the plurality imaging components, and determining whether pixel defects in a particular imaging component may be corrected in image processing using image data from at least one other one of the plurality of imaging components by:

selecting a defect in a first one of the plurality of imaging components in the array camera and determining a parallax translation path of the defect over a range of supported distances,

determining a parallax translation path over the range of supported distances from defects in other ones of the plurality of imaging components of the array camera,

determining whether a predetermined number of parallax translation paths of defects in other ones of the plurality of imaging components intersect the parallax translation path of the selected defect, and

generating a disposition output for the first one of the imaging components having the selected defect if a predetermined number of parallax translation paths for defects from other images components intersect the parallax translation path of the selected defect; and

performing a geometric calibration process that includes determining translation information that relates image data from particular pixels in a reference imaging component to image data from corresponding pixels in each associate imaging component associated with the reference imaging component.

2. The method of claim 1 further comprising performing a Modulation Transfer Function (MTF) calibration process on each of the plurality of imaging components in the array camera that includes determining MTF data over the Field of View (FoV) or the Field Height (FH) for each of the imaging components.

3. The method of claim 2 wherein the MTF calibration process further comprises:

capturing image data of a target with each of the plurality imaging components;

analyzing the image data captured by the plurality of imaging components to determine MTF data over one of a FoV and FH for each of the imaging components wherein the MTF data for each of the imaging components is generated from the MTF detected in the image data; and

storing the MTF data for each of the imaging components.

4. The method of claim 1 further comprising performing a photometric calibration process of each of the plurality of imaging components in the array camera that includes determining image data adjustments for each of the imaging components that provide image data from each of the imaging components with a uniform intensity profile.

5. The method of claim 4 wherein the performing the photometric calibration comprises:

capturing image data of a flat field target under controlled lighting conditions with each of the plurality of imaging components in the array camera;

analyzing the image data of each of the imaging components to determine a per pixel adjustment needed to match cos^4 fall-off response for an image; and

generating a grid of adjustments for each of the plurality of imaging components wherein each adjustment in the grid indicates the adjustment information for data from a set of pixels in the particular imaging component needed to match the cos^4 fall-off response for an image.

6. The method of claim 1 wherein the identifying of defects in each of the imaging components comprises:

capturing a first set of image data of a field target under high intensity lighting with each of the plurality of imaging components;

capturing a second set of image data of a field target under low intensity lighting;

analyzing the first and second sets of image data to identify each pixel having an unexpected response value in each imaging component;

flagging the identified pixels with a category indicating the category unexpected response received for each imaging component; and

storing the identified pixels with the flagged categories.

7. The method of claim 6 wherein the detecting of defects in each imaging component further comprises:

determining the number of each category of defects identified in each imaging component;

comparing the number of each category of defects to a threshold; and

generating a disposition output for a particular imaging component in response to the number of defects in a category for the particular imaging component being greater than the threshold.

Assignments (2)
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2018
From: FOTONATION CAYMAN LIMITED
To: FOTONATION LIMITED
Reel/Frame 046539/0815 →
Cited By (10)
US 12,226,074 US 12,243,190 US 12,293,535 US 12,340,538 US 12,380,568 US 12,437,432 US 12,501,023 US 12,549,701 US 12,563,310 US 12,590,799