IP Library Granted Patent US 10,217,235
Granted Patent B2
US 10,217,235 · App. 15/647,230 · Granted Feb 26, 2019

Advanced lensless light-field imaging systems and methods for enabling a wide range of entirely new applications

Inventor: Lester F. Ludwig (San Antonio, TX)
Assignee: NRI R&D PATENT LICENSING, LLC
G06T7/557H01L27/28H01L27/288H01L27/30H01L27/307H04N5/225H04N5/22541H04N5/378H04N5/3745H04N9/045G06T2207/10024G06T2207/10052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,217,235
App. No.
15/647,230
Granted
Feb 26, 2019
Kind
B2
Abstract

Continuing a sequence of lensless light-field imaging camera patents beginning 1999, the present invention adds light-use efficiency, predictive-model design, distance-parameterized interpolation, computational efficiency, arbitrary shaped surface-of-focus, angular diversity/redundancy, distributed image sensing, plasmon surface propagation, and other fundamentally enabling features. Embodiments can be fabricated entirely by printing, transparent/semi-transparent, layered, of arbitrary size/curvature, flexible/bendable, emit light, focus and self-illuminate at zero-separation distance between (planar or curved) sensing and observed surfaces, robust against damage/occulation, implement color sensing without use of filters or diffraction, overlay on provided surfaces, provided color and enhanced multi-wavelength color sensing, wavelength-selective imaging of near-infrared/near-ultraviolet, and comprise many other fundamentally enabling features. Embodiments can be thinner, larger/smaller, more light-use efficient, and higher-performance than recently-popularized coded aperture imaging cameras. Vast ranges of diverse previously-impossible applications are enabled: credit-card cameras/phones, in-body monitoring of healing/disease, advanced biomarker analysis systems, perfect eye-contact video conferencing, seeing fabrics/skin/housings, and manufacturing-monitoring, wear-monitoring, and machine vision capabilities.

Claims (37)

1. A lensless light-field imaging system, comprising:

an array of light sensing elements, each light-sensing element comprising a light-sensing area and each light-sensing element configured to generate an electrical photocurrent responsive to an amplitude of incoming light striking a light-sensing surface, each light-sensing surface arranged to experience angularly-varying sensitivity responsive to a direction of each path of the incoming light striking the light-sensing surface;

first electronics configured to interface the array of light sensing elements with second electronics, the first electronics further configured to provide a plurality of voltage levels, each of the plurality of voltage level responsive to one of the light-sensing element in the array of light sensing elements;

the second electronics configured to convert each of the plurality of voltage levels into a corresponding electronically-represented digital number, a result comprising a plurality of electronically-represented digital numbers; and

an algorithm configured to execute on a computational processor, the algorithm for computing a two-dimensional image representation from the plurality of electronically-represented digital numbers, the two-dimensional image representation corresponding to portion of a focused image at a separation distance value measured perpendicular to the light-sensing surface of the one of the light sensing elements in the array of light sensing elements, there being a plurality of separation distance values,

wherein each of the electronically-represented digital numbers are responsive to the amplitude of incoming light striking the light-sensing surface of an associated light sensing element in the array of light sensing elements and a plurality of focused image portions, and

wherein the plurality of separation distance values are not a substantially same numeric value.

2. The lensless light-field imaging system of claim 1 , wherein the light sensing elements of the array of light sensing elements are oriented in space to form a curved surface.

3. The lensless light-field imaging system of claim 1 , wherein spatial positions of the plurality of focused image portions form a planar surface.

4. The lensless light-field imaging system of claim 1 , wherein the light sensing elements of the array of light sensing elements are oriented in space to form a planar surface.

5. The lensless light-field imaging system of claim 1 , wherein spatial positions of the plurality of focused image portions form a curved surface.

6. The lensless light-field imaging system of claim 1 , wherein the light sensing elements of the array of light sensing elements are oriented in space to form a first curved surface and spatial positions of the plurality of focused image portions form a second curved surface.

7. The lensless light-field imaging system of claim 1 , wherein the algorithm is controlled by at least one separation distance parameter.

8. The lensless light-field imaging system of claim 1 , wherein the algorithm is controlled by a plurality of localized separation distance parameters.

9. The lensless light-field imaging system of claim 1 , wherein the first electronics comprises multiplexing electronics.

10. The lensless light-field imaging system of claim 1 , wherein the first electronics comprises at least one transimpedance amplifier circuit.

11. The lensless light-field imaging system of claim 1 , wherein the light sensing elements comprise organic photodiodes.

12. The lensless light-field imaging system of claim 1 , wherein the light sensing elements comprise organic light emitting diodes.

13. The lensless light-field imaging system of claim 1 , wherein the light sensing elements comprise organic diodes that are co-optimized for both light emission and light sensing.

14. The lensless light-field imaging system of claim 1 , wherein the light sensing elements are arranged to emit light for an interval of time.

15. The lensless light-field imaging system of claim 14 , wherein the light sensing elements are arranged to emit light for the interval of time under control of the first electronics.

16. The lensless light-field imaging system of claim 1 , wherein the angularly-varying sensitivity of the light sensing elements results at least in part from a structure of the light sensing elements.

17. The lensless light-field imaging system of claim 1 , wherein the angularly-varying sensitivity of the light sensing elements results at least in part from a structure attached to the array of light sensing elements.

18. The lensless light-field imaging system of claim 1 , wherein the array of light sensing elements are fabricated by a printing process.

19. The lensless light-field imaging system of claim 17 , wherein the structure attached to the array of light sensing elements is fabricated by a printing process.

20. The lensless light-field imaging system of claim 17 , wherein the structure attached to the array of light sensing elements comprises segregated optical paths.

21. The lensless light-field imaging system of claim 20 , wherein the segregated optical paths are created by separating surfaces.

22. The lensless light-field imaging system of claim 21 , wherein the separating surfaces are at least partially-reflective.

23. The lensless light-field imaging system of claim 21 , wherein the separating surfaces are configured to facilitate surface plasmon propagation.

24. The lensless light-field imaging system of claim 21 , wherein at least one of the light sensing elements is color selective.

25. The lensless light-field imaging system of claim 23 , wherein a color selective property results from a band gap property of a semiconductor device element comprised by the at least one of the light sensing elements.

26. The lensless light-field imaging system of claim 1 , wherein the algorithm comprises array multiplication of numerical values responsive to the plurality of electronically-represented digital numbers.

27. The lensless light-field imaging system of claim 1 , wherein the algorithm comprises array multiplication of numerical values obtained from calculation of a generalized inverse matrix.

28. The lensless light-field imaging system of claim 1 , wherein the algorithm comprises array multiplication of numerical values obtained from an interpolation.

29. The lensless light-field imaging system of claim 1 , wherein the algorithm comprises array multiplication of numerical values obtained from a predictive analytical model.

30. The lensless light-field imaging system of claim 1 , wherein the algorithm comprises array multiplication of numerical values derived from a predictive analytical model.

31. The lensless light-field imaging system of claim 1 , wherein the algorithm comprises array multiplication of numerical values derived from empirical measurements.

Assignments (2)
SECURITY INTEREST Recorded Jun 14, 2018
From: NRI R&D PATENT LICENSING, LLC
To: PBLM ADVT LLC
Reel/Frame 046091/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2017
From: LUDWIG, LESTER F.
To: NRI R&D PATENT LICENSING, LLC
Reel/Frame 043447/0692 →
Continuity (3)
Provisional Application 62528384 · Jul 3, 2017
Provisional Application 62360472 · Jul 11, 2016
Related Publication 20180165823A1 · Jun 14, 2018
Cited By (1)
US 12,205,264