Method and system for touch-free control of devices
The present invention provides a system and computerized method for receiving image information and translating it to computer inputs. In an embodiment of the invention, image information is received for a predetermined action space to identify an active body part. From such image information, depth information is extracted to interpret the actions of the active body part. Predetermined gestures can then be identified to provide input to a computer. For example, gestures that can be interpreted to mimic computerized touchscreen operation. Also, touchpad or mouse operations can be mimicked.
1. A method for providing input to a device, comprising:
receiving multiple image information for a first predetermined space, wherein image information is received from a camera positioned substantially near a display device, wherein the camera receives light from a direction substantially perpendicular to the display device, and wherein the camera receives light from a light-bending apparatus positioned substantially near the camera so as to bend light emanating from substantially near and in front of the display device;
displaying an image on the display device, wherein the image includes at least one predetermined area corresponding to at least one predetermined input;
identifying at least one active part from the image information;
receiving depth cue information for the at least one active part;
identifying a three-dimensional gesture of the at least one active part;
generating action information for the at least one active part in the first predetermined space based on the identified three-dimensional gesture when the at least one active part is determined to be substantially close to at least one of the at least one predetermined areas, wherein the action information includes depth of field information for the at least one active part, and wherein the action information includes at least one of the at least one predetermined input;
performing a predetermined computing action based on the generated action information.
2. The method of claim 1 , further including performing a predetermined operation responsive to the identified three-dimensional gesture.
3. The method of claim 1 , wherein the method is performed in real-time.
4. The method of claim 1 , wherein substantially close to at least one of the at least one predetermined areas includes touching at least one of the at least one predetermined areas.
5. The method of claim 1 , wherein predetermined space is a space above a keyboard.
6. The method of claim 1 , wherein the first predetermined space is a space between a user and a display device.
7. The method of claim 1 , further comprising mapping the first predetermined space to a second predetermined space.
8. The method of claim 7 , wherein the second predetermined space corresponds to the display device.
9. The method of claim 1 , wherein the active part includes a hand.
10. The method of claim 1 , wherein the active part includes a fingertip.
11. The method of claim 1 , wherein the active part includes a prop.
12. The method of claim 1 , wherein a multiple gesture hypothesis is implemented.
13. The method of claim 1 , wherein the at least one active part includes multiple parts of a human body.
14. The method of claim 1 , wherein the at least one active part includes a upper body part.
15. The method of claim 1 , wherein the light-bending apparatus is chosen form a group including a mirror or prism.
16. The method of claim 1 , wherein the three-dimensional gesture initiates further identification of three-dimensional gestures.
17. The method of claim 1 , wherein the three-dimensional gesture is a finger movement.
18. The method of claim 1 , wherein the three-dimensional gesture is a hand movement.
19. The method of claim 1 , wherein the multiple image information is video information.
20. A system for providing input to a device, comprising:
a computer system;
a camera configured to receive image information from predetermined part in a predetermined space;
a display device;
wherein the computer system is configured to:
receive multiple image information for a first predetermined space, wherein image information is received from the camera positioned substantially near the display device, wherein the camera receives light from a direction substantially perpendicular to the display device, and wherein the camera receives light from a light-bending apparatus positioned substantially near the camera so as to bend light emanating from substantially near and in front of the display device;
display an image on the display device, wherein the image includes at least one predetermined area corresponding to at least one predetermined input;
identify at least one active part from the image information;
receive depth cue information for the at least one active part;
identifying a three-dimensional gesture of the at least one active part;
generate action information for the at least one active part in the first predetermined space for the at least one active part in the first predetermined space based on the identified three-dimensional gesture when the at least one active part is determined to be substantially close to at least one of the at least one predetermined areas, wherein the action information includes depth of field information for the at least one active part, and wherein the action information includes at least one of the at least one predetermined input;
perform a predetermined computing action based on the generated action information.
21. The system of claim 20 , wherein the camera is a webcam.
22. The system of claim 20 , wherein the camera is a time-of-flight camera.
23. The system of claim 20 , wherein the camera is a stereoscopic camera.
24. The system of claim 20 , wherein the first predetermined space is a space above a keyboard.
25. The system of claim 20 , wherein the first predetermined space is a space between a user and a display device.
26. The system of claim 20 , wherein the active part includes a prop.
27. The system of claim 20 , wherein the at least one active part includes a human body part.
28. The system of claim 20 , further the light bending apparatus is chosen form a group including a mirror or prism.