IP Library Granted Patent US 9,172,853
Granted Patent B2
US 9,172,853 · App. 14/456,132 · Granted Oct 27, 2015

Microlens array architecture for avoiding ghosting in projected images

Inventors: Colvin Pitts (Snohomish, WA); Timothy James Knight (Palo Alto, CA); Chia-Kai Liang (San Jose, CA); Yi-Ren Ng (Palo Alto, CA)
Assignee: Lytro, Inc.
H04N5/217G02B27/0018H04N5/211H04N5/2254H04N17/002G02B3/0056
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,172,853
App. No.
14/456,132
Granted
Oct 27, 2015
Kind
B2
Abstract

Light-field image data is processed in a manner that reduces projection artifacts in the presence of variation in microlens position by calibrating microlens positions. Approximate centers of disks in a light-field image are identified, and gridded calibration is performed, by fitting lines to disk centers along orthogonal directions, and then fitting a rigid grid to the light-field image. For each grid region, a corresponding disk center is computed, and a displacement vector is generated. For each grid region, the final disk center is computed as the vector sum of the grid region's geometric center and displacement vector. Calibration data, including displacement vectors, is then used in calibrating disk centers for more accurate projection of light-field images. In at least one embodiment, the imaging geometry is arranged so that disks are separated by a gap, so as to limit or eliminate ghosting.

Claims (24)

1. A light-field image capture device, comprising:

a microlens array comprising a plurality of microlenses;

optics, configured to direct incoming light toward the microlens array; and

an image sensor, comprising a plurality of pixel sensors;

wherein:

the microlens array is disposed between the optics and the image sensor; and

each microlens in the microlens array is configured to project light onto a different region of the image sensor, each region comprising a subset of the pixel sensors, each region being horizontally separated from all other regions by a gap comprising at least one pixel sensor.

2. The device of claim 1 , wherein each region comprises a disk.

3. The device of claim 1 , wherein each region is circular.

4. The device of claim 1 , wherein no region touches any other region.

5. The device of claim 1 , wherein the optics comprise:

an aperture, configured to receiving incoming light; and

a main lens, configured to focus incoming light from the aperture toward the microlens array.

6. The device of claim 1 , wherein each pixel sensor is associated with a microlens based on calibrated coordinates of light passing through the microlens.

7. In a light-field image capture device comprising a microlens array comprising a plurality of microlenses, optics configured to direct incoming light toward the microlens array, and an image sensor comprising a plurality of pixel sensors, a configuration method, comprising:

positioning the microlens array between the optics and the image sensor; and

configuring each microlens in the microlens array to project light onto a different region of the image sensor, each region comprising a subset of the pixel sensors, each region being horizontally separated from all other regions by a gap comprising at least one pixel sensor.

8. The configuration method of claim 7 , wherein each region comprises a disk.

9. The configuration method of claim 7 , wherein each region is circular.

10. The configuration method of claim 7 , wherein no region touches any other region.

11. The configuration method of claim 7 , wherein the optics comprise:

an aperture, configured to receiving incoming light; and

a main lens, configured to focus incoming light from the aperture toward the microlens array.

12. The configuration method of claim 7 , further comprising associating each pixel sensor with a microlens based on calibrated coordinates of light passing through the microlens.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2019
From: LYTRO, INC.
To: GOOGLE LLC
Reel/Frame 050009/0829 →
SECURITY INTEREST Recorded Jul 23, 2015
From: LYTRO, INC. (GRANTOR)
To: TRIPLEPOINT CAPITAL LLC (GRANTEE)
Reel/Frame 036167/0081 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2014
From: KNIGHT, TIMOTHY JAMES
To: LYTRO, INC.
Reel/Frame 033967/0154 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2014
From: PITTS, COLVIN; LIANG, CHIA-KAI; NG, YI-REN
To: LYTRO, INC.
Reel/Frame 033504/0968 →
Continuity (7)
Continuation 13774971 · Feb 22, 2013
Continuation In Part 13688026 · Nov 28, 2012
Provisional Application 61604155 · Feb 28, 2012
Provisional Application 61604175 · Feb 28, 2012
Provisional Application 61604195 · Feb 28, 2012
Provisional Application 61655790 · Jun 5, 2012
Related Publication 20150029386A1 · Jan 29, 2015