IP Library Granted Patent US 11,178,349
Granted Patent B2
US 11,178,349 · App. 15/547,235 · Granted Nov 16, 2021

Lensless imaging system using an image sensor with one or more attenuating layers

Inventors: Aswin Sankaranarayanan (Houston, TX); Ashok Veeraraghavan (Houston, TX); Lisa A. Hendricks (Houston, TX); Richard Baraniuk (Houston, TX); Ali Ayremlou (Houston, TX); M. Salman Asif (Houston, TX)
Assignee: William Marsh Rice University
H04N5/378G01T1/295G02B27/42H04N5/225H04N5/30G02B2207/129
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,178,349
App. No.
15/547,235
Granted
Nov 16, 2021
Kind
B2
Abstract

A lens-free imaging system for generating an image of a scene includes an electromagnetic (EM) radiation sensor; a mask disposed between the EM radiation sensor and the scene; an image processor that obtains signals from the EM radiation sensor while the EM radiation sensor is exposed to the scene; and estimates the image of the scene based on, at least in part, the signals and a transfer function between the scene and the EM radiation sensor.

Claims (54)

1. A lens-free imaging system for generating an image of a scene, comprising:

an electromagnetic (EM) radiation sensor that senses visible light, short-wave infrared light, mid-wave infrared light, long-wave infrared light, terahertz, millimeter wave, or wireless;

only one mask that is disposed between the EM radiation sensor and the scene; and

an image processor configured to:

obtain signals from the EM radiation sensor while the EM radiation sensor is exposed to the scene, and

estimate the image of the scene based on, at least in part, the signals and a transfer function between the scene and the EM radiation sensor,

wherein the mask is disposed at a distance less than 0.5 times a width of the EM radiation sensor from the EM radiation sensor and is fixed, static, and non-dynamic,

wherein the mask comprises a first plurality of regions and a second plurality of regions,

wherein a distribution of the first plurality of regions and the second plurality of regions is based on a convolution of a first one dimensional sequence and a second one dimensional sequence.

2. The system of claim 1 , wherein:

the first plurality of regions are opaque to EM radiation; and

the second plurality of regions are transparent to EM radiation.

3. The system of claim 1 , wherein the mask comprises:

a first plurality of regions comprising a material having a first refractive index; and

a second plurality of regions comprising a second material having a second refractive index,

wherein the first refractive index is different than the second refractive index.

4. The system of claim 2 , wherein the first plurality of regions and second plurality of regions are disposed on a two dimensional surface.

5. The system of claim 4 , wherein the two dimensional surface is curved, wherein the EM radiation sensor is curved.

6. The system of claim 2 , wherein there are a first number of regions of the first plurality of regions and a second number of regions of the second plurality of regions.

7. The system of claim 6 , wherein the first number and second number are the same.

8. The system of claim 1 , where in the regions of the first plurality of regions and the regions of the second plurality of regions are distributed randomly across the mask.

9. The system of claim 1 , wherein the first one dimensional sequence and the second one dimensional sequence are random sequences.

10. The system of claim 1 , wherein the first one dimensional sequence is a maximum length sequence and the second one dimensional pattern is a second maximum length sequence.

11. The system of claim 10 , wherein the maximum length sequence and the second maximum length sequence are the same.

12. The system of claim 1 , wherein the transfer function comprises a first binary sequence and a second binary sequence.

13. The system of claim 12 , wherein the first binary sequence has a number of entries equal to the number of regions across a width of the mask.

14. The system of claim 1 , wherein the mask is disposed directly on the EM radiation sensor.

15. The system of claim 1 , wherein the mask is disposed at a distance greater than zero from the EM radiation sensor.

16. A method of generating an image using a lens-free imaging system comprising:

an electromagnetic (EM) radiation sensor that senses visible light, short-wave infrared light, mid-wave infrared light, long-wave infrared light, terahertz, millimeter wave, or wireless;

only one mask that is disposed between the EM radiation sensor and a scene; and

an image processor configured to:

obtain signals from the EM radiation sensor while the EM radiation sensor is exposed to the scene, and

estimate the image of the scene based on, at least in part, the signals and a transfer function between the scene and the EM radiation sensor,

wherein the mask is disposed at a distance less than 0.5 times a width of the EM radiation sensor from the EM radiation sensor and is fixed, static, and non-dynamic,

wherein the mask comprises a first plurality of regions and a second plurality of regions,

wherein a distribution of the first plurality of regions and the second plurality of regions is based on a convolution of a first one dimensional sequence and a second one dimensional sequence;

the method comprising:

obtaining, by the lens-free imaging system, a transfer matrix that relates electrical signals generated by the EM radiation sensor when exposed to electromagnetic (EM) radiation from the scene to the image of the scene; and

generating, by the lens-free imaging system, the image of the scene based on the transfer matrix and the electrical signals generated by the EM radiation sensor when exposed to the scene.

17. The method of claim 16 , wherein obtaining the transfer matrix comprises:

obtaining, by the lens-free imaging system, a first plurality of electrical signals generated by the electromagnetic (EM) radiation sensor, wherein each electrical signal of the first plurality of electrical signals is generated by the EM radiation sensor while exposed to one of a plurality of patterns;

obtaining, by the lens-free imaging system, a second plurality of electrical signals generated by the electromagnetic (EM) radiation sensor, wherein each electrical signal of the second plurality of electrical signals is generated by the EM radiation sensor while exposed to one of a second plurality of patterns;

determining, by the lens-free imaging system, the first one dimensional convolution sequence based on the first plurality of electrical signals;

determining, by the lens-free imaging system, the second one dimensional convolution sequence based on the second plurality of electrical signals; and

generating, by the lens-free imaging system, the transfer matrix based on the first one dimensional convolution sequence and the second one dimensional convolution sequence.

18. The method of claim 16 , wherein obtaining the transfer matrix comprises:

simulating an electromagnetic characteristic of the mask of the lens-free imaging system; and

generating, by the lens-free imaging system, the transfer matrix based on the electromagnetic characteristic of the mask.

19. The method of claim 16 , wherein the image of the scene is based on, at least in part, solving a least-squares problem that relates the electrical signal and the transfer matrix.

20. The method of claim 16 , wherein the image of the scene is based on, at least in part, solving a regularized least-squares problem that relates the electrical signal and the transfer matrix.

21. The method of claim 20 , where the regularization is one selected from the group consisting of Total variation, Tikhonov, and Wavelet sparsity.

22. The method of claim 16 , wherein each pattern of the plurality of patterns is a one-dimensional pattern.

23. The method of claim 16 , wherein each pattern of the plurality of patterns is a unique Hadamard pattern.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2017
From: SANKARANARAYANAN, ASWIN; VEERARAGHAVAN, ASHOK; HENDRICKS, LISA A.; BARANIUK, RICHARD; AYREMLOU, ALI; ASIF, M. SALMAN
To: WILLIAM MARSH RICE UNIVERSITY
Reel/Frame 043958/0816 →
Continuity (2)
Provisional Application 62109358 · Jan 29, 2015
Related Publication 20180027201A1 · Jan 25, 2018
Cited By (1)
US 12,401,869