IP Library Granted Patent US 8,547,475
Granted Patent B2
US 8,547,475 · App. 13/717,397 · Granted Oct 1, 2013

Imaging arrangements and methods therefor

Inventors: Yi-Ren Ng (San Mateo, CA); Patrick M. Hanrahan (Portola Valley, CA); Mark A. Horowitz (Menlo Park, CA); Marc S. Levoy (Stanford, CA)
Assignee: The Board of Trustees of the Leland Stanford Junior Univeristy
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,547,475
App. No.
13/717,397
Granted
Oct 1, 2013
Kind
B2
Abstract

Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.

Claims (33)

1. A digital imaging system for generating a virtual image of a scene, wherein the virtual image includes a plurality of pixels, the system comprising:

a photosensor array, having a plurality of photosensors, configured to detect light including a plurality of light rays from the scene, wherein each photosensor, in response to detecting the light incident thereon, generates light data, the photosensor array further configured to detect a set of the plurality of light rays that concurrently arrive at the particular portion of the physical focal plane at different angles of incidence;

an optics arrangement, having a physical focus, configured to direct light rays from the scene to the photosensor array via a physical focal plane; and

processing circuitry to compute a pixel value of each pixel of the virtual image by combining light data from selected photosensors based on angles of incidence of the light rays detected by each photosensor, as characterized by the location of each photosensor relative to the physical focal plane, the virtual image having a virtual focus and a virtual focal plane that are respectively different from the physical focus and the physical focal plane, wherein the virtual focal plane comprises one of a planar focal plane and a non-planar focal plane, wherein the processing circuitry further determines the angles of incidence of light upon each photosensor using a position of each photosensor relative to the microlens, wherein the processing circuitry is configured to generate a virtual image of the scene by combining selected light rays based on aberrations in the optics arrangement.

2. The system of claim 1 , wherein the processing circuitry is configured to:

determine an angle of incidence of the detected light rays as characterized by the location of each photosensor detecting the light;

determine aberrated rays using the angle of incidence of the detected light rays, re-sort the aberrated rays to correct for aberrations in the optics arrangement; and

generate the virtual image of the scene by combining selected light rays and resorted aberrated rays.

3. The system of claim 1 , wherein the processing circuitry is further configured to:

determine an angle of incidence of the detected light rays as characterized by the location of each photosensor detecting the light;

map the path of the light rays using the angle of incidence of the detected light rays and tracing of rays through the optics arrangement;

determine aberrated rays using the mapped light rays;

re-sort the aberrated rays, and

generate a virtual image of the scene by combining selected light rays and resorted aberrated rays to reduce the effect of aberrations in the optics arrangement.

4. A digital imaging system for generating a virtual image of a scene, the system comprising:

optics, having a physical focus, to direct light from the scene onto a physical focal plane, wherein the light includes a set of light rays;

a photosensor array, having a plurality of photosensors, to detect the set of light rays, wherein each photosensor detects different ones of the set of light rays;

a microlens array, disposed between the optics and the photosensor array, and configured to physically direct the set of light rays from the optics to the photosensor array; and

processing circuitry configured to generate a virtual image of the scene using the detected set of light rays by selectively combining data representing the light rays based on directional characteristics of the light rays, wherein the virtual image includes a virtual focus at a virtual focal plane that comprises one of a planar virtual plane and a non-planar virtual plane, and wherein the virtual focus and the virtual focal plane are different from the physical focus and the physical focal plane, respectively, wherein the processing circuitry is further configured to combine selected light rays based on aberrations in the optic arrangement.

5. A method of imaging a scene using a digital imaging device which includes an optics unit and a light ray sensor, the method comprising:

focusing light from the scene upon a physical focal plane;

detecting light rays from the scene which are incident on the physical focal plane;

determining directional characteristics of the detected light rays;

and generating a virtual image of the scene having a virtual focus at a virtual focal plane using the detected light by combining selected light rays based on the directional characteristics of the light rays, wherein the virtual focus and the virtual focal plane are different from the physical focus and physical focal plane, respectively, wherein generating the virtual image of the scene by combining selected light rays to provide the virtual image of the scene having a virtual focus at a virtual focal plane further includes generating the virtual image of the scene by combining selected light rays based on aberrations in at least one of the optics unit and the light ray sensor.

6. The method of claim 5 further including:

determining aberrated rays using the determined light rays corresponding to the detected light and the directional characteristics of the light arriving at different locations on the physical focal plane;

re-sorting the aberrated rays to correct for aberrations in one or more of the optics unit and light ray sensor; and

wherein generating the virtual image of the scene further includes combining selected light rays and re-sorted aberrated rays.

7. The method of claim 5 further including:

mapping the light rays corresponding to the light using the directional characteristics of the light and tracing of rays through one or more of the optics unit and light ray sensor;

determining aberrated rays using the mapped light rays;

re-sorting the aberrated rays; and

wherein generating the virtual image of the scene further includes combining selected light rays and re-sorted aberrated rays to reduce the affect of aberrations in the optics unit and/or light ray sensor.

Assignments (2)
CONFIRMATORY LICENSE Recorded Aug 7, 2014
From: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 033492/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2013
From: NG, YI-REN; HANRAHAN, PATRICK; LEVOY, MARC; HOROWITZ, MARK
To: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
Reel/Frame 031443/0611 →
Continuity (5)
Continuation 13078909 · Apr 1, 2011
Division 11576438
Provisional Application 60647492 · Jan 27, 2005
Provisional Application 60615179 · Oct 1, 2004
Related Publication 20130169855A1 · Jul 4, 2013