IP Library Granted Patent US 8,866,912
Granted Patent B2
US 8,866,912 · App. 13/792,143 · Granted Oct 21, 2014

System and methods for calibration of an array camera using a single captured image

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,866,912
App. No.
13/792,143
Granted
Oct 21, 2014
Kind
B2
Abstract

Systems and methods for calibrating an array camera are disclosed. Systems and methods for calibrating an array camera in accordance with embodiments of this invention include the capturing of an image of a test pattern with the array camera such that each imaging component in the array camera captures an image of the test pattern. The image of the test pattern captured by a reference imaging component is then used to derive calibration information for the reference component. A corrected image of the test pattern for the reference component is then generated from the calibration information and the image of the test pattern captured by the reference imaging component. The corrected image is then used with the images captured by each of the associate imaging components associated with the reference component to generate calibration information for the associate imaging components.

Claims (36)

1. A method for calibrating an array camera including a plurality of imaging components where the plurality of imaging components include a reference imaging component and a plurality of associate imaging components associated with the reference imaging component, the method comprising:

capturing an image of a test pattern using each of the plurality of imaging components of the array camera;

generating scene independent geometric corrections for the image data captured by the reference imaging component using data of the image of the test pattern captured by the reference component and data describing the test pattern using a processor;

generating a corrected image of the test pattern for the reference component based on the scene independent geometric corrections for the image data captured by the reference imaging component and the image of the test pattern captured by the reference imaging component using the processor; and

generating scene independent geometric corrections for the image data captured by each of the associate imaging components associated with the reference imaging component using the data of image of the test pattern captured by each associate imaging component and the corrected image of the reference component using the processor.

2. The method of claim 1 wherein the test pattern includes a low-contrast slanted edge pattern.

3. The method of claim 2 wherein the test pattern includes a plurality of Macbeth Color Chart type patterns inset at different positions in the low-contrast slanted pattern.

4. The method of claim 1 wherein the test pattern is at a distance of at least 70 percent of the hyperfocal distance of the array camera away from the array camera during the capturing of the image of the test pattern.

5. The method of claim 1 wherein the test pattern is at a distance of at 50 percent of the hyperfocal distance of the array camera away from the array camera during the capturing of the image of the test pattern.

6. The method of claim 1 further comprising performing at least one pass/fail test of the array camera based on images of the test pattern captured by the plurality of imaging components in the array camera.

7. The method of claim 1 wherein generating scene independent geometric corrections for the image data captured by the reference imaging component using data of the image of the test pattern captured by the reference component and data describing the test pattern comprises:

identifying intersection points in the image of the test pattern captured by the reference imaging component;

determining the uniformity characteristics of the reference imaging component from the identified intersection points in the image of the test pattern captured by the reference imaging component and the test pattern; and

deriving a set of geometric corrections for the reference imaging component to compensate for low frequency aberrations in the captured image of the test pattern.

8. The method of claim 1 wherein generating scene independent geometric corrections for the image data captured by each of the associate imaging components associated with the reference imaging component comprises:

identifying intersection points in the test pattern image captured by each of the associate imaging components;

translating the intersection points from the captured test pattern images captured by each of the associate plurality of imaging components associated with the reference component in accordance with an expected parallax shift for each of the plurality of associate imaging components relative to the reference component; and

deriving a set of geometric corrections for each of the plurality of associate imaging components associated with the reference component to compensate for low frequency aberrations in the captured image of the test pattern by comparing the translated intersections points in the images captured by each of the plurality of associate imaging components to corresponding intersection points in the corrected image for the reference component.

9. The method of claim 8 wherein the expected parallax shift for each of the plurality of associate imaging components is based upon at least one of the physical offset of a particular imaging component to the reference imaging component, the behavior of sensor optics in the particular associate imaging component, and distance of the test pattern from the array camera.

10. The method of claim 1 further comprising storing the images captured by the plurality of imaging components to perform the calibration of the reference component and each of the plurality of associate imaging components at a later time.

11. The method of claim 1 further comprising storing the scene dependent geometric correction information for the image data captured by the reference component in a memory.

12. The method of claim 1 further comprising storing the scene dependent geometric correction information for the image data captured by each of the plurality of associated imaging components associated with the reference component in a memory.

13. The method of claim 1 , further comprising generating colorimetric corrections for the image data captured by each imaging component in the array camera using data of the image of the test pattern captured by the each imaging component using the processor.

14. The method of claim 1 , further comprising generating photometric corrections for the image data captured by each imaging component in the array camera using data of the image of the test pattern captured by the reference component using the processor.

15. A device for calibrating an array camera including a plurality of imaging components where the plurality of imaging components include a reference imaging component and a plurality of associate imaging components associated with the reference imaging component comprising:

a memory; and

a processor configured via one or more applications stored in the memory to:

receive an image of a test pattern from each of the plurality of imaging components of the array camera;

generate scene independent geometric corrections for the image data captured by the reference imaging component using data of the image of the test pattern captured by the reference component and data describing the test pattern;

generate a corrected image of the test pattern for the reference component based on the scene independent geometric corrections for the image data captured by the reference imaging component and the image of the test pattern captured by the reference imaging component; and

generate scene independent geometric corrections for the image data captured by each of the associate imaging components associated with the reference imaging component using the data of image of the test pattern captured by each associate imaging component and the corrected image of the reference component using the processor.

16. A non-transitory machine readable device containing processor instructions, where execution of the instructions by a processor causes the processor to perform a process for calibrating an array camera including a plurality of imaging components where the plurality of imaging components include a reference imaging component and a plurality of associate imaging components associated with the reference imaging component, the process comprising:

receiving an image of a test pattern using each of the plurality of imaging components of the array camera;

generating scene independent geometric corrections for the image data captured by the reference imaging component using data of the image of the test pattern captured by the reference component and data describing the test pattern;

generating a corrected image of the test pattern for the reference component based on the scene independent geometric corrections for the image data captured by the reference imaging component and the image of the test pattern captured by the reference imaging component; and

generating scene independent geometric corrections for the image data captured by each of the associate imaging components associated with the reference imaging component using the data of image of the test pattern captured by each associate imaging component and the corrected image of the reference component.

Assignments (13)
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2018
From: FOTONATION CAYMAN LIMITED
To: FOTONATION LIMITED
Reel/Frame 046539/0815 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: PELICAN IMAGING CORPORATION
To: FOTONATION CAYMAN LIMITED
Reel/Frame 040675/0025 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: KIP PELI P1 LP
To: PELICAN IMAGING CORPORATION
Reel/Frame 040674/0677 →
CHANGE OF NAME Recorded Oct 19, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE SPECIAL OPPORTUNITIES FUND LP
Reel/Frame 040494/0930 →
CHANGE OF NAME Recorded Oct 19, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE SPECIAL OPPORTUNITIES FUND LP
Reel/Frame 040423/0725 →
SECURITY INTEREST Recorded Jun 13, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE OPPORTUNITIES FUND LP
Reel/Frame 039117/0345 →
SECURITY INTEREST Recorded Jun 13, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE OPPORTUNITIES FUND LP
Reel/Frame 038982/0151 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR AND ASSIGNEE PREVIOUSLY RECORDED AT REEL: 037565 FRAME: 0439. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 25, 2016
From: KIP PELI P1 LP
To: DBD CREDIT FUNDING LLC
Reel/Frame 037591/0377 →
SECURITY INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: KIP PELI P1 LP
Reel/Frame 037565/0439 →
SECURITY INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: DBD CREDIT FUNDING LLC
Reel/Frame 037565/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: KIP PELI P1 LP
Reel/Frame 037565/0385 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2013
From: MULLIS, ROBERT
To: PELICAN IMAGING CORPORATION
Reel/Frame 031499/0868 →