Computer vision based touch screen
View Patent ↗A self-contained interactive video display system. A projector projects a visual image onto a screen for displaying the visual image, wherein the projector projects the visual image onto a back side of the screen for presentation to a user on a front side of the screen. An illuminator illuminates an object near the front side of the screen. A camera detects interaction of an illuminated object with the visual image, wherein the screen is at least partially transparent to light detectable to the camera, allowing the camera to detect the illuminated object through the screen. A computer system directs the projector to change the visual image in response to the interaction.
1. An interactive video display system, comprising:
means for displaying an image, the means for displaying having a front side and a back side;
transparent means located in front of the means for displaying;
means for emitting a beam of non-visible wavelength light into the transparent means so that the non-visible wavelength light is substantially reflected within the transparent means;
detection means configured to acquire images of the transparent means, the detection means configured to detect non-visible wavelength light escaping from the transparent means in response to an object contacting the transparent means; and
computing means configured to:
analyze information generated by the detection means in response to detection of non-visible wavelength light escaping from the transparent means, and
generate a responsive image for display on the means for displaying, the responsive image based on the analyzed information.
2. The interactive video display system of claim 1 , further comprising an illumination means configured to emit a beam of non-visible wavelength light onto an object proximate to the transparent means and wherein a second detection means is configured to detect the object proximate to the transparent means.
3. An interactive video display system, comprising:
a display screen configured to display an image, the display screen having a front side and a back side;
a transparent panel located in front of the display screen, the transparent panel having a front and a back side with an interior therebetween;
an illuminator located proximate to an edge of the transparent panel located between the front and the back side of the transparent panel, the illuminator configured to emit a beam of non-visible wavelength light into the interior of the transparent panel via the edge of the transparent panel;
a camera configured to generate images of the transparent panel through the display screen, the camera configured to detect non-visible wavelength light escaping from the transparent panel in response to an object contacting the front side of the transparent panel; and
a computing device configured to:
analyze information generated by the camera in response to detection of non-visible wavelength light escaping from the transparent panel, and
generate a responsive image for display on the display screen, the responsive image based on the analyzed information.
4. The interactive video display system of claim 3 , wherein the beam of non-visible wavelength light has a high angle of incidence relative to the front and back side of the transparent panel.
5. The interactive video display system of claim 4 , wherein the beam of non-visible wavelength light repeatedly reflects off the front and back side of the interior of the transparent panel as a result of the high angle of incidence.
6. The interactive video display system of claim 3 , wherein the non-visible wavelength light includes infrared light.
7. The interactive video display system of claim 3 , further comprising a projector, the projector configured to project the responsive image onto the back side of the display screen for presentation to a user on the front side of the display screen.
8. The interactive video display system of claim 7 , wherein the projector generates polarized light.
9. The interactive video display system of claim 8 , wherein the display screen includes material translucent to the polarized light of the projector.
10. The interactive video display system of claim 8 , wherein the display screen includes material transparent to light of a polarization opposite that of the polarized light generated by the projector.
11. The interactive video display system of claim 3 , wherein the display screen includes a material that changes from substantially translucent to substantially transparent based on a time cycle.
12. The interactive video display system of claim 11 , wherein the display screen is substantially translucent when a projector is projecting the responsive image onto the back side of the display screen.
13. The interactive video display system of claim 11 , wherein the display screen is substantially transparent when the camera is detecting objects contacting the front side of the display screen.
14. The interactive video display system of claim 7 , wherein the display screen includes a material that is substantially translucent at a first angle and substantially transparent at a second angle.
15. The interactive video display system of claim 14 , wherein the projector projects the responsive image onto the back side of the display screen from the first angle.
16. The interactive video display system of claim 3 , wherein the display screen includes a liquid crystal display and a backlight.
17. The interactive video display system of claim 16 , wherein the liquid crystal display includes a material translucent to the polarization of visible light that can pass through the liquid crystal display.
18. The interactive video display system of claim 17 , wherein the material is transparent to infrared light of an opposite polarization of the visible light that can pass through the liquid crystal display.
19. The interactive video display system of claim 3 , wherein the camera is sensitive to infrared light.
20. The interactive video display system of claim 19 , wherein the display screen includes a scattering polarizer.
21. The interactive video display system of 19 , wherein the display screen includes a material configured to scatter visible light to a greater extent than infrared light.
22. The interactive video display system of claim 19 , wherein the display screen includes a material that substantially scatters light of wavelengths emitted by a projector but not those detectable by the camera.
23. The interactive video display system of claim 3 , further comprising a second illuminator configured to emit a beam of non-visible wavelength light onto an object proximate to but not in contact with the transparent panel, and wherein the camera is further configured to detect the object proximate to but not in contact with the transparent panel.
24. A method comprising:
displaying an image on a display screen having a front side and a back side;
emitting a beam of non-visible wavelength light into an edge of a panel located in front of the display screen so that the light reflects within the panel;
detecting non-visible wavelength light escaping from the panel in response to an object contacting a front side of the panel, wherein detection of the non-visible light occurs at a camera imaging the panel;
analyzing information generated by the camera in response to detection of non-visible wavelength light escaping from the panel; and
generating a responsive image for display on the display screen, the responsive image based on the analyzed information.
25. The method of claim 24 , wherein the non-visible wavelength-light includes infrared light.
26. The method of claim 24 , wherein the responsive image is projected onto the back side of the display screen for presentation to a user on the front side of the display screen.
27. The method of claim 24 , further comprising:
emitting a beam of non-visible wavelength light onto an object proximate to, but not in contact with the panel; and
detecting the object proximate to but not in contact with the panel.