Touch screen-like user interface that does not require actual touching
A system may be controlled by directing at least a portion of a field-of-view of one or more cameras across a screen of a display for the system, using the one or more cameras to track in three dimensions an object moving in a space in front of the screen, and providing input to the system based on the tracking of the object. A system may also be controlled by directing a first portion of a field-of-view of a camera in a first direction, directing a second portion of the field-of-view of the camera in a second direction across a screen of a display for the system, tracking an object moving in front of the screen with the second portion of the field-of-view of the camera, and providing input to the system based on the tracking of the object.
1. A method for use in controlling a system, comprising the steps of:
directing a first portion of a field-of-view of a camera in a first direction;
directing a second portion of the field-of-view of the camera in a second direction across a screen of a display for the system;
using the camera to track in three dimensions an object moving in a space in front of the screen with the second portion of the field of view of the camera; and
providing input to the system based on the tracking of the object; and
wherein the first portion of the field-of-view of the camera is not used for tracking the object;
wherein the tracking in three dimensions is based on determining a position of the object in a video image of one of the camera and a distance between the object and the one camera; and
wherein the tracking in three dimensions is based on only one view across the screen of the display of the system.
2. A method in accordance with claim 1 , further comprising the step of:
providing an indication to a user that the object is within a certain distance from the screen.
3. A method in accordance with claim 2 , wherein the indication comprises an audio indication.
4. A method in accordance with claim 2 , wherein the indication comprises a visual indication.
5. A method in accordance with claim 1 , further comprising the step of:
moving a cursor on the screen in response to the input provided to the system.
6. A method in accordance with claim 1 , further comprising the step of:
selecting an item on the screen in response to the input provided to the system.
7. A method in accordance with claim 6 , wherein the step of selecting is performed in response to movement of the object comprising a sharp poke and withdraw motion at the screen.
8. A method in accordance with claim 1 , further comprising the step of:
dragging an item on the screen in response to the input provided to the system.
9. A method in accordance with claim 8 , wherein the step of dragging is performed in response to movement of the object comprising a sharp poke at the item on the screen and then movement substantially parallel to a surface of the screen.
10. A method in accordance with claim 1 , wherein the object comprises a person's finger.
11. An apparatus for use in controlling a system, comprising:
a camera that is configured so that a first portion of its field-of-view is directed in a first direction and a second portion of its field-of-view is directed in a second direction across a screen of a display for the system;
wherein the camera is configured to track in three dimensions an object moving in a space in front of the screen with the second portion of the field-of-view of the camera; and
means for providing input to the system based on the tracking of the object; and
wherein the first portion of the field-of-view of the camera is not used for tracking the object;
wherein the camera is configured to track in three dimensions based on determining a position of the object in a video image of the camera and a distance between the object and the one camera; and
wherein the tracking in three dimensions is based on only one view across the screen of the display of the system.
12. An apparatus in accordance with claim 11 , further comprising:
means for providing an indication to a user that the object is within a certain distance from the screen.
13. An apparatus in accordance with claim 12 , wherein the indication comprises an audio indication.
14. An apparatus in accordance with claim 12 , wherein the indication comprises a visual indication.
15. An apparatus in accordance with claim 11 , further comprising:
means for moving a cursor on the screen in response to the input provided to the system.
16. An apparatus in accordance with claim 11 , further comprising:
means for selecting an item on the screen in response to the input provided to the system.
17. An apparatus in accordance with claim 16 , wherein the means for selecting is configured to perform the selecting in response to movement of the object comprising a sharp poke and withdraw motion at the screen.
18. An apparatus in accordance with claim 11 , further comprising:
means for dragging an item on the screen in response to the input provided to the system.
19. An apparatus in accordance with claim 18 , wherein the means for dragging is configured to perform the dragging in response to movement of the object comprising a sharp poke at the item on the screen and then movement substantially parallel to a surface of the screen.
20. An apparatus in accordance with claim 11 , wherein the object comprises a person's finger.
21. A method for use in controlling a system, comprising the steps of:
directing a first portion of a field-of-view of a camera in a first direction;
directing a second portion of the field-of-view of the camera in a second direction across a screen of a display for the system;
tracking in three dimensions an object moving in front of the screen with the second portion of the field-of-view of the camera; and
providing input to the system based on the tracking of the object;
wherein the first portion of the field-of-view of the camera is not used for tracking the object; and
wherein the tracking in three dimensions is based on only one view across the screen of the display of the system.
22. A method in accordance with claim 21 , wherein the step of directing a second portion of the field-of-view of the camera comprises:
using a prism to direct the second portion of the field-of-view of the camera in the second direction across the screen of the display.
23. A method in accordance with claim 21 , wherein the first direction comprises a direction that is substantially perpendicular to a surface of the screen.
24. A method in accordance with claim 21 , further comprising the step of:
providing an indication to a user that the object is within a certain distance from the screen.
25. A method in accordance with claim 21 , further comprising the step of:
moving a cursor on the screen in response to the input provided to the system.
26. A method in accordance with claim 21 , further comprising the step of:
selecting an item on the screen in response to the input provided to the system.
27. A method in accordance with claim 21 , further comprising the step of:
dragging an item on the screen in response to the input provided to the system.
28. A method in accordance with claim 21 , wherein the object comprises a person's finger.
29. An apparatus for use in controlling a system, comprising:
a camera that is configured so that a first portion of its field-of-view is directed in a first direction and a second portion of its field-of-view is directed in a second direction across a screen of a display for the system;
wherein the camera is further configured to track in three dimension an object moving in front of the screen with the second portion of the field-of-view of the camera;
means for providing input to the system based on the tracking of the object; and
wherein the first portion of the field-of-view of the camera is not used for tracking the object; and
wherein the tracking in three dimensions is based on only one view across the screen of the display of the system.
30. An apparatus in accordance with claim 29 , further comprising:
a prism that is used in configuring the camera to direct the second portion of the field-of-view of the camera in the second direction across the screen of the display.
31. An apparatus in accordance with claim 29 , wherein the first direction comprises a direction that is substantially perpendicular to a surface of the screen.
32. An apparatus in accordance with claim 29 , further comprising:
means for moving a cursor on the screen in response to the input provided to the system.
33. An apparatus in accordance with claim 29 , further comprising:
means for selecting an item on the screen in response to the input provided to the system.
34. An apparatus in accordance with claim 29 , further comprising:
means for dragging an item on the screen in response to the input provided to the system.
35. An apparatus in accordance with claim 29 , wherein the object comprises a person's finger.