LED/OLED array approach to integrated display, lensless-camera, and touch-screen user interface devices and associated processors
View Patent ↗A system for implementing a display which also serves as one or more of a tactile user interface touchscreen, light field sensor, proximate hand gesture sensor, and lensless imaging camera. In an implementation, an OLED array can be used for light sensing as well as light emission functions. In one implementation a single OLED array is used as the only optoelectronic user interface element in the system. In another implementation two OLED arrays are used, each performing and/or optimized from different functions. In another implementation, an LCD and an OLED array are used in various configurations. The resulting arrangements allow for sharing of both optoelectric devices as well as associated electronics and computational processors, and are accordingly advantageous for use in handheld devices such as cellphone, smartphones, PDAs, tablet computers, and other such devices.
1. A system for implementing the function of a visual display, light field sensor, and a user interface, the system comprising:
an organic light emitting diode (OLED) array comprising at least a plurality of OLEDs;
an optical vignetting arrangement overlaid on the OLED array to provide a plurality of distinct vignettes of a distant incoming light field structured by the vignetting arrangement, wherein the vignetting arrangement is configured to implement a lensless imaging camera, wherein each distinct vignette of the incoming light field is directed to an associated individual OLED from the plurality of OLEDs, wherein each of the individual OLED performs a light detection function at least for an interval of time, the light detection function comprising a photoelectric effect;
a light emitting arrangement associated with the OLED array, the light emitting arrangement to provide the visual display; and
a processor operatively coupled to an electrical interface and configured to:
receive, via the electrical interface, the photoelectric effect; and
obtain light field measurement information responsive to the incoming light field based on the photoelectric effect.
2. The system of claim 1 wherein the light emitting arrangement is provided by OLEDs in the OLED array.
3. The system of claim 1 wherein the light emitting arrangement is provided by another OLED array.
4. The system of claim 1 wherein the organic light emitting diode (OLED) array is transparent and the light emitting arrangement is provided by a liquid crystal display (LCD).
5. The system of claim 1 wherein the light field measurement information is used to create light field sensor output information.
6. The system of claim 5 wherein the light field sensor output information is used to implement a proximity hand gesture user interface.
7. The system of claim 5 wherein light field sensor output information is used to implement a tactile user interface.
8. The system of claim 1 wherein the light emitting arrangement comprises a plurality of OLEDs, wherein each OLED is operated in at least two of: a light emission state, a light detection state, and an idle state.
9. The system of claim 1 wherein the system is configured to operate as both an image display and light-field sensor.
10. The system of claim 1 where the system is configured to implement a tactile user interface.
11. The system of claim 1 where the system is configured to implement a user interface touch screen.
12. The system of claim 1 wherein the system is configured to implement a proximate image user interface sensor.
13. The system of claim 1 where the system is configured to implement a lensless imaging camera.
14. The system of claim 1 where the system is comprised within a cellphone.
15. The system of claim 1 where the system is comprised within a smartphone.
16. The system of claim 1 where the system is comprised within a Personal Digital Assistant (“PDA”).
17. The system of claim 1 where the system is comprised within a tablet computer.
18. The system of claim 1 wherein the system is configured to operate simultaneously as a camera and as a display.
19. The system of claim 18 wherein the system is further configured to provide improved eye-contact in video conferencing applications.
20. The system of claim 1 wherein the system is configured to operate simultaneously as a video camera.