IP Library Granted Patent US 9,735,303
Granted Patent B2
US 9,735,303 · App. 13/072,588 · Granted Aug 15, 2017

Color imaging using color OLED or LED array as color light-field imaging sensor

Inventor: Lester Ludwig (San Antonio, TX)
Assignee: NRI R&D PATENT LICENSING, LLC
H01L31/105H04N9/045H01L27/146H01L27/3211H01L51/5036
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,735,303
App. No.
13/072,588
Granted
Aug 15, 2017
Kind
B2
Abstract

A color light field imaging sensor array for use as a lensless imaging camera, tactile or proximate gesture user interface, image display, or combination. Each sensor array pixel comprises groups of at least three LEDs, OLEDs, or similar devices having differing emission color wavelengths configured to provide light amplitude measurement signals. For each pixel, a first output signal is produced by subtracting a function of the light amplitude measurement signal from an LED of a mid-value color wavelength from a function of a light amplitude measurement signal from an LED of a higher-value color wavelength. A second output signal is produced by subtracting a function of a light amplitude measurement signal from lower-value color wavelength LED from a function of the light amplitude measurement signal obtained from mid-value color wavelength LED. A third output signal is produced from function of light amplitude measurement signal associated with lowest-value color wavelength LED.

Claims (65)

1. A method for implementing a color lensless camera without any lenses, without any visible-band light-frequency selective optical filters, and at most an ultraviolet light-frequency optical filter, the method comprising:

receiving light from a light field, the received light comprising a color composition and an amplitude distribution;

applying at least a portion of the received light to an array of at least three LEDs of differing emission colors to create respectively associated light amplitude measurement signals, the emission colors comprising a lowest-value wavelength, a highest-value wavelength, and at least one mid-value wavelength having wavelength value between the lowest-value wavelength and the highest-value wavelength;

producing a first output signal by subtracting a first function of the light amplitude measurement signal associated with the mid-value wavelength LED from a function of the light amplitude measurement signal associated with the highest-value wavelength LED;

producing a second output signal by subtracting a second function of the light amplitude measurement signal associated with the lowest-value wavelength LED from a function of the light amplitude measurement signal associated with the mid-value wavelength LED; and

producing a third output signal by taking a third function of the light amplitude measurement signal associated with the lowest-value wavelength LED, wherein the first output signal, second output signal, and third output signal are responsive to the color composition and amplitude distribution of received light,

wherein no visible-band light-frequency selective optical filters are introduced between the light field and the array of at least three LEDs of differing emission colors,

wherein no lenses are introduced between the light filed and the array of at least three LEDs of differing emission colors, and

wherein no lenses are introduced between the light field and the array of at least three LEDs of differing emission colors, and providing resulting signals of the first output signal, the second output signal, and the third output signal to a synthetic optics image formation algorithm so as to implement a lensless camera for imaging objects physically separated from the array of at least three LEDs.

2. The method of claim 1 , wherein the lowest-value wavelength light is visible blue light.

3. The method of claim 1 , wherein the mid-value wavelength light is visible green light.

4. The method of claim 1 , wherein the highest-value wavelength light is visible red light.

5. The method of claim 1 , further comprising processing the first output signal to produce a first gamma corrected signal, processing the second output signal to produce a second gamma corrected signal, and processing the third output signal to produce a third gamma corrected signal.

6. The method of claim 1 , wherein the at least three LEDs of differing colors are inorganic LEDs.

7. The method of claim 1 , wherein the at least three LEDs of differing colors are OLEDs.

8. The method of claim 1 , wherein the at least three LEDs of differing colors are part of the array of LEDs used as a display.

9. The method of claim 1 wherein the at least three LEDs of differing colors are part of the array of LEDs, the array of LEDs and the first output signal, the second output signal, and the third output signal are used to implement a tactile user interface.

10. The method of claim 1 , wherein the at least three LEDs of differing colors are part of the array of LEDs, the method further comprising using the array of LEDs, the first output signal, the second output signal, and the third output signal to implement a proximate gesture user interface.

11. The method of claim 1 , further comprising: implementing a tactile user interface using the array of LEDs and the first output signal, second output signal, and third output signal.

12. The method of claim 1 , further comprising: implementing a proximate gesture user interface using the array of LEDs and the first output signal, second output signal, and third output signal.

13. The method of claim 1 , further comprising processing the first output signal, by a first nonlinear operation to produce a first linearized signal, processing the second output signal by a second nonlinear operation to produce a second linearized signal, and processing the third output signal by a third nonlinear operation to produce a third linearized signal.

14. The method of claim 1 , further comprising using an ultraviolet filter to block shorter wavelength ultraviolet light from the at least three LEDs.

15. The method of claim 1 , wherein the first function, second function, and third function are linear functions.

16. The method of claim 1 , wherein the first function, second function, and third function are nonlinear functions.

17. A color lensless camera wherein no visible-band without wavelength-selective optical filters are used, comprising:

a light receiver for receiving light from a light field, the received light comprising color composition and amplitude distribution;

an array of at least three LEDs of differing emission colors operable to absorb at least a portion of the received light and to create respectively associated light amplitude measurement signals, the emission colors comprising a lowest-value wavelength, a highest-value wavelength, and at least one mid-value wavelength having wavelength-value between the lowest-value wavelength and the highest-value wavelength; and

a processing unit for:

producing a first output signal by subtracting a first function of the light amplitude measurement signal associated with the mid-value wavelength LED from a function of the light amplitude measurement signal associated with the highest-value wavelength LED,

producing a second output signal by subtracting a second function of the light amplitude measurement signal associated with the highest-value wavelength LED from a function of the light amplitude measurement signal associated with the mid-value wavelength LED, and

producing a third output signal by taking a third function of the light amplitude measurement signal associated with the lowest-value wavelength LED, wherein the first output signal, second output signal, and third output signal are responsive to the color composition and amplitude distribution of received light, and

executing a synthetic optics image formation algorithm,

wherein no visible-band light-frequency selective optical filters are introduced between the light field and the array of at least three LEDs of differing emission colors,

wherein no lenses are introduced between the light field and the array of at least three LEDs of differing emission colors, and wherein resulting signals of the first output signal, the second output signal, and the third output signal are provided to a synthetic optics image formation algorithm so as to implement a lensless camera for imaging objects physically separated from the array of at least three LEDs.

18. The color lensless camera of claim 17 , wherein the lowest-value wavelength light is visible blue light.

19. The color lensless camera of claim 17 , wherein the mid-value wavelength light is visible green light.

20. The color lensless camera of claim 17 , wherein the highest-value wavelength light is visible red light.

21. The color lensless camera of claim 17 , wherein the processing unit is further configured for processing the first output signal to produce a first gamma corrected signal, processing the second output signal to produce a second gamma corrected signal, and processing the third output signal to produce a third gamma corrected signal.

22. The color lensless camera of claim 17 , wherein the at least three LEDs of differing colors are inorganic LEDs.

23. The color lensless camera of claim 17 , wherein the at least three LEDs of differing colors are OLEDs.

24. The color lensless camera of claim 23 , wherein the OLEDs are fabricated by at least one printed electronic fabrication method.

25. The color lensless camera of claim 23 , wherein the at least three LEDs of differing colors are part of the array of LEDs used as a display.

26. The color lensless camera of claim 17 , wherein the at least three LEDs of differing colors are part of the array of LEDs and wherein the array of LEDs and the first output signal, the second output signal, and the third output signal are used to implement a tactile user interface.

27. The color lensless camera of claim 17 , wherein the at least three LEDs of differing colors are part of the array of LEDs and wherein the array of LEDs, the first output signal, the second output signal, and the third output signal are used to implement a proximate gesture user interface.

28. The color lensless camera of claim 27 , wherein the array of LEDs is also used as a display.

29. The color lensless camera of claim 17 , wherein the array of LEDs is also used as a display.

30. The color lensless camera of claim 29 , wherein the array of LEDs and the first output signal, second output signal, and third output signal are used to implement a tactile user interface.

31. The color lensless camera of claim 17 , wherein the array of LEDs and the first output signal, second output signal, and third output signal are used to implement a proximate gesture user interface.

32. The color lensless camera of claim 17 , wherein the first output signal is processed by a first nonlinear operation to produce a first linearized signal, the second output signal is processed by a second nonlinear operation to produce a second linearized signal, and the third output signal is processed by a second nonlinear operation to produce a third linearized signal.

33. The color lensless camera of claim 17 , further comprising an ultraviolet filter for blocking shorter wavelength ultraviolet light from the at least three LEDs.

34. The color lensless camera of claim 17 , wherein the first function, second function, and third function are linear functions.

35. The color lensless camera of claim 17 , wherein the first function, second function, and third function are nonlinear functions.

36. The color light field sensor of claim 17 , wherein the at least three LEDs of differing colors are comprised within a Stacked OLED (“SOLED”).

37. A display device having a color light field sensor capability, comprising:

an array of LEDs;

a control logic operable to drive the array of LEDs;

a light receiver for receiving light from a light field, the received light comprising color composition and amplitude distribution, wherein the array of LED comprises at least three LEDs of differing emission colors operable to absorb at least a portion of the received light and to create respectively associated light amplitude measurement signals, the emission colors comprising a lowest-value wavelength, a highest-value wavelength, and at least one mid-value wavelength having wavelength-value between the lowest-value wavelength and the highest-value wavelength; and

a processing unit for:

producing a first output signal by subtracting a first function of the light amplitude measurement signal associated with the mid-value wavelength LED from a function of the light amplitude measurement signal associated with the highest-value wavelength LED,

producing a second output signal by subtracting a second function of the light amplitude measurement signal associated with the lowest-value wavelength LED from a function of the light amplitude measurement signal associated with the mid-value wavelength LED, and

producing a third output signal by taking a third function of the light amplitude measurement signal associated with the lowest-value wavelength LED, wherein the first output signal, second output signal, and third output signal are responsive to the color composition and amplitude distribution of received light, and

executing a synthetic optics image formation algorithm,

wherein no visible-band light-frequency selective optical filters are introduced between the light field and the array of at least three LEDs of differing emission colors,

wherein no lenses are introduced between the light field filed and the array of at least three LEDs of differing emission colors, and

wherein the array of at least three LEDs is configured to operate as a color image display and as a lensless camera for imaging objects physically separated from the array of at least three LEDs.

Assignments (4)
SECURITY INTEREST Recorded Jun 14, 2018
From: NRI R&D PATENT LICENSING, LLC
To: PBLM ADVT LLC
Reel/Frame 046091/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2017
From: LUDWIG, LESTER F
To: NRI R&D PATENT LICENSING, LLC
Reel/Frame 042745/0063 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2012
From: AVISTAR COMMUNICATIONS CORPORATION
To: LUDWIG, LESTER F.
Reel/Frame 029226/0078 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2011
From: LUDWIG, LESTER
To: AVISTAR COMMUNICATIONS CORPORATION
Reel/Frame 026025/0637 →
Continuity (2)
Provisional Application 61341011 · Mar 25, 2010
Related Publication 20110234558A1 · Sep 29, 2011