IP Library Granted Patent US 8,514,491
Granted Patent B2
US 8,514,491 · App. 12/952,106 · Granted Aug 20, 2013

Capturing and processing of images using monolithic camera array with heterogeneous imagers

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,514,491
App. No.
12/952,106
Granted
Aug 20, 2013
Kind
B2
Abstract

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. Lens stack arrays in accordance with many embodiments of the invention include lens elements formed on substrates separated by spacers, where the lens elements, substrates and spacers are configured to form a plurality of optical channels, at least one aperture located within each optical channel, at least one spectral filter located within each optical channel, where each spectral filter is configured to pass a specific spectral band of light, and light blocking materials located within the lens stack array to optically isolate the optical channels.

Claims (40)

1. A lens stack array configured to form multiple images of a scene, comprising:

lens elements formed on substrates separated by spacers, where the lens elements, substrates and spacers are configured to form a plurality of optical channels, where the optical channels are configured to form an image of an object space within a scene from slightly different viewpoints so that the images formed by each of the optical channels include a view of the same object space within the scene and contain non-redundant information about the object space;

at least one aperture located within each optical channel;

at least one spectral filter located within each optical channel, where each spectral filter is configured to pass a specific spectral band of light;

light blocking materials located within the lens stack array to optically isolate the optical channels; and

wherein the shape of at least one lens surface of at least one lens element within at least a first optical channel is a function of a first spectral band of light;

wherein the shape of at least one lens surface of at least one lens element within at least a second optical channel is also a function of the first spectral band of light; and

wherein the shape of at least one lens surface of at least one lens element within at least a third optical channel is a function of a second spectral band of light.

2. The lens stack array of claim 1 , wherein the light blocking materials are selected from the group consisting of opaque materials, reflective materials and combinations thereof.

3. The lens stack array of claim 1 , wherein each spectral filter is selected from the group consisting of an organic color filter, an absorptive material, a dielectric coating, an interference filter, a multilayer coating, and combinations thereof.

4. The lens stack array of claim 1 , further comprising at least one polarizing filter located within each optical channel.

5. The lens stack array of claim 1 , wherein the radius of curvature of the shape of the at least one lens surface of the at least one lens element within the first optical channel is a function of the first spectral band of light.

6. The lens stack array of claim 1 , wherein the shape of the at least one lens surface of the at least one lens element within the first optical channel is rotationally symmetric and aspheric, and is described by an aspheric lens equation, wherein the coefficients of the aspheric lens equation are a function of the first spectral band of light.

7. The lens stack array of claim 1 , wherein the back focal length of each of the at least two optical channels in the lens stack array that have a spectral filter is the same irrespective of the spectral band of light passed by the spectral filter within the optical channel.

8. The lens stack array of claim 1 , wherein a combination of high and low Abbe number materials is used in the construction of each of the lens elements in an optical channel to reduce chromatic aberrations.

9. The lens stack array of claim 1 , further comprising:

at least one aperture stop located within each optical channel;

wherein each spectral filter is located within each optical channel so that the spectral filter is proximate the aperture stop.

10. The lens stack array of claim 9 , wherein each aperture stop is formed by a light blocking material selected from the group consisting of metal materials, oxide materials, black particle filled photoresists and combinations thereof.

11. The lens stack array of claim 1 , wherein:

at least one lens surface is selected from the group consisting of diffractive, Fresnel, refractive and combinations thereof.

12. The lens stack array of claim 11 , wherein the radii of curvature of at least two lens surfaces differ based upon the specific spectral band of light passed by the spectral filter within each of the at least two optical channels that have spectral filters.

13. The lens stack array of claim 11 , wherein each of the optical channels have the same back focal length.

14. The lens stack array of claim 1 , wherein at least one of the lens elements in an optical channel is a negative lens element, and the negative lens element is proximate the image formed by the optical channel.

15. The lens stack array of claim 1 , wherein at least two of the optical channels have different focal lengths.

16. The lens stack array of claim 1 , further comprising a mechanical zoom mechanism within an optical channel configured to smoothly transition between different fields of view.

17. The lens stack array of claim 1 , wherein the lens stack array comprises an N×M array of optical channels, where at least one of N and M is greater than 2.

18. The lens stack array of claim 1 , wherein the lens stack array is fabricated using techniques consisting of wafer level optics techniques, injection molding, glass molding and combinations thereof.

19. The lens stack array of claim 1 , wherein the light blocking materials located within the lens stack array to optically separate the optical channels comprise at least two opaque surfaces located on a substrate within an optical channel, where the two opaque surfaces have openings arranged in axial alignment with the optical channel.

20. The lens stack array of claim 1 , wherein the light blocking materials located within the lens stack array to optically separate the optical channels comprise opaque walls disposed at the boundaries between the optical channels.

21. The lens stack array of claim 20 , wherein the opaque walls are cavities between the optical channels filled with light blocking material.

22. The lens stack array of claim 1 , wherein a plurality of the spacers are constructed from light blocking materials and are located within the lens stack array to optically separate the optical channels.

23. The lens stack array of claim 1 , wherein a plurality of the spacers are coated in light blocking materials and are located within the lens stack array to optically isolate the optical channels.

24. The lens stack array of claim 1 , further comprising at least one spectral filter located within a plurality of the optical channels, where each spectral filter is configured to pass a specific spectral band of light, such that a first spectral filter located in the first optical channel defines the first spectral band of light, and a second spectral filter located in the third optical channel defines the second spectral band of light.

25. The lens stack array of claim 24 , further comprising a third spectral filter located in a fourth optical channel that defines a third spectral band of light.

26. The lens stack array of claim 1 , wherein the substrates are coated with the light blocking materials so as to define at least two aperture stops within at least a first optical channel and two aperture stops within at least an adjacent second optical channel, such that at least the first optical channel and at least the second optical channel are optically isolated from one another.

27. The lens stack array of claim 1 , wherein at least one spectral filter is located within the space defined by the substrates separated by spacers.

28. The lens stack array of claim 27 , wherein at least one spectral filter is disposed on the surface of a lens element.

29. The lens stack array of claim 1 , wherein at least one spectral filter is disposed external to the space defined by the substrates separated by spacers.

30. The lens stack array of claim 1 , wherein the lens stack array is configured to be integrated with a sensor that includes an imager for each optical channel to form a camera module assembly, such that each optical channel focuses light onto one imager, wherein at least one spectral filter within an optical channel is located on the surface of a corresponding imager.

Assignments (13)
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2018
From: FOTONATION CAYMAN LIMITED
To: FOTONATION LIMITED
Reel/Frame 046539/0815 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: KIP PELI P1 LP
To: PELICAN IMAGING CORPORATION
Reel/Frame 040674/0677 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: PELICAN IMAGING CORPORATION
To: FOTONATION CAYMAN LIMITED
Reel/Frame 040675/0025 →
CHANGE OF NAME Recorded Oct 19, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE SPECIAL OPPORTUNITIES FUND LP
Reel/Frame 040423/0725 →
CHANGE OF NAME Recorded Oct 19, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE SPECIAL OPPORTUNITIES FUND LP
Reel/Frame 040494/0930 →
SECURITY INTEREST Recorded Jun 13, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE OPPORTUNITIES FUND LP
Reel/Frame 038982/0151 →
SECURITY INTEREST Recorded Jun 13, 2016
From: DBD CREDIT FUNDING LLC
To: DRAWBRIDGE OPPORTUNITIES FUND LP
Reel/Frame 039117/0345 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR AND ASSIGNEE PREVIOUSLY RECORDED AT REEL: 037565 FRAME: 0439. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 25, 2016
From: KIP PELI P1 LP
To: DBD CREDIT FUNDING LLC
Reel/Frame 037591/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: KIP PELI P1 LP
Reel/Frame 037565/0385 →
SECURITY INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: KIP PELI P1 LP
Reel/Frame 037565/0439 →
SECURITY INTEREST Recorded Jan 22, 2016
From: PELICAN IMAGING CORPORATION
To: DBD CREDIT FUNDING LLC
Reel/Frame 037565/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2011
From: DUPARRE, JACQUES
To: PELICAN IMAGING CORPORATION
Reel/Frame 025630/0001 →