IP Library Granted Patent US 9,160,894
Granted Patent B2
US 9,160,894 · App. 14/105,085 · Granted Oct 13, 2015

Lensless imaging camera performing image formation in software and employing micro-optic elements that impose light diffractions

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,160,894
App. No.
14/105,085
Granted
Oct 13, 2015
Kind
B2
Abstract

An approach is presented for a lensless imaging camera wherein image formation is implemented in software image processing operations rather than by means of a lens. The image formation operations are coordinated with an array of micro-optical elements that impose light diffraction. The array of micro-optical elements can comprise one or more micro-optic layers, and micro-optic layers can be configured so that different portions of the micro-optic layer affect light in different ways. The image formation operation can include deconvolution based on an impulse response determined by the array of micro-optical elements which can be configured to produce a desired spatial light intensity pattern on the array of photosensors so as to optimize detection characteristics. The image formation operation can comprise include frequency-domain division operations, and the system can be configured to avoid division by zero values of the frequency-domain impulse response of the array of micro-optical elements.

Claims (41)

1. A system for image formation

comprising: a plurality of photosensor elements arranged

in an array;

a micro-optic structure comprising a plurality of micro-optic elements, each of the micro-optic elements configured to direct light from a portion of a distant non-adjacent object onto a respective plurality of the photo sensor elements, the distant non-adjacent object separated from the micro-optic elements by empty space, wherein each of the photosensor elements configured to generate a photosensor output signal in response to light received, and wherein the plurality of micro-optic elements is configured to direct light to the plurality of the photosensor elements in an overlapping manner so that each of the photosensor elements receives source light from overlapping segments of an area of view, the resulting light detection overlap responsive to the micro-optic elements, the resulting light detection overlap having an associated pixel overlap function;

a capture control circuit configured to capture the output signals generated by the photosensor elements; and

an image processing unit configured to:

receive from the capture control circuit the photosensor output signals,

perform an image formation-operation on the photosensor output signals, the image formation operation being performed based on a pixel overlap function; and

based on the signals generated by the image formation operation, provide respective output image signals, each of which represents a respective portion of an image of the object,

wherein the plurality of micro-optic elements is configured

to create diffraction, and

wherein the respective image signals are responsive to received light from the object.

2. The system of claim 1 , wherein the image formation operation comprises a deconvolution operation.

3. The system of claim 2 , wherein the deconvolution operation comprises a two- dimensional deconvolution operation.

4. The system of claim 1 , wherein the plurality of micro-optic elements comprises apertures.

5. The system of claim 4 , wherein the micro-optic structure is configured in portions wherein each of the portions affect light in different ways.

6. The system of claim 1 , wherein the micro-optic structure is configured to optimize detection characteristics.

7. The system of claim l, wherein the plurality of micro-optic elements is configured to produce a desired spatial light intensity pattern on the array of photosensors.

8. The system of claim 1 , wherein the plurality of micro-optic elements is configured to direct light received from a portion of the object onto multiple photosensors.

9. The system of claim 1 , wherein the image formation operation comprises a frequency-domain division operation involving the impulse response associated with the micro-optic structure.

10. The system of claim 1 , wherein the system is configured so that division by zero values of the frequency-domain impulse response is not incurred.

11. A system for image formation comprising:

an array of photosensor elements, each configured to generate a photosensor output signal in response to light received thereon from a distant non-adjacent object, the distant non-adjacent object separated from the micro-optic elements by empty space;

a micro-optic structure comprising a plurality of micro-optic elements, each of which is configured to direct light from a portion of the distant non-adjacent object onto a respective plurality of the photosensor elements, wherein the plurality of micro-optic elements is configured to direct light to the plurality of the photosensor elements in an overlapping manner so that each of the photosensor elements receives source light from overlapping segments of an area of view, the resulting light detection overlap responsive to the micro-optic elements, the resulting light detection overlap having an associated pixel overlap function;; and

at least one signal processor configured to:

receive photosensor output signals from the array of photosensor elements,

perform an image formation operation on the received photosensor output signals to create first image data, the image formation operation being performed based on a pixel overlap function, perform a digital processing operation on the first image data to produce second image data, the digital processing operation including at least one of

an edge effect handling operation to remove edge

effects, a sharpening operation and an aggregation

operation, and

provide output image data based on the second image data, the output image data representing a portion of an image of the object,

wherein the plurality of micro-optic elements is configured to create diffraction.

12. The system of claim 11 , wherein the image formation operation comprises a deconvolution operation.

13. The system of claim 12 , wherein the deconvolution operation comprises a two-dimensional deconvolution operation.

14. The system of claim 11 , wherein the plurality of micro-optic elements comprises apertures.

15. The system of claim 14 , wherein the micro-optic structure is configured in portions wherein each of the portions affect light in different ways.

16. The system of claim 14 , wherein the micro-optic structure is configured to optimize detection characteristics.

17. The system of claim 11 , wherein the plurality of micro-optic elements is configured to produce a desired spatial light intensity pattern on the array of photosensors.

18. The system of claim 11 , wherein the plurality of micro-optic elements is configured to direct light received from a portion of object onto multiple photosensors.

19. The system of claim 11 , wherein the image formation operation comprises a frequency-domain division operation involving the impulse response associated with the micro-optic structure.

20. The system of claim 11 , wherein the system is configured so that division by zero values of the frequency-domain impulse response is not incurred.

Assignments (2)
SECURITY INTEREST Recorded Jun 14, 2018
From: NRI R&D PATENT LICENSING, LLC
To: PBLM ADVT LLC
Reel/Frame 046091/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2017
From: LUDWIG, LESTER F
To: NRI R&D PATENT LICENSING, LLC
Reel/Frame 042745/0063 →