System and method for gesture control
A system with a processing system, an input device integrated within the processing system and coupled with the processing system, and a sensor arrangement integrated with the processing system and configured to monitor an area above the input device, and a controller coupled with the sensor arrangement to detect predefined input actions, wherein the controller is coupled with the processing system and wherein the predefined input actions are combined with inputs from the input device.
1. A system comprising:
a processing system;
an input device integrated within the processing system and coupled with the processing system; and
a sensor arrangement integrated with the processing system and configured to monitor an area above said input device for detection of non-touching gestures, and a controller coupled with the sensor arrangement to detect said non-touching gestures, wherein the controller is coupled with the processing system and wherein the controller is further configured to detect predefined non-touching input actions and forward associated commands to the processing system;
wherein:
the predefined non-touching input actions include a sequence of multiple, identical non-touching gestures performed in succession; and
the controller is configured to detect the sequence of multiple, identical non-touching input gestures performed in succession and to forward an associated command to the processing system;
wherein the sensor arrangement is configured to detect a double movement of a hand from a keyboard towards the input device and, based upon the detection, the controller is configured to identify the movement as a gesture to close an application.
2. The system according to claim 1 , wherein the sensor arrangement is an electrode arrangement comprising a plurality of electrodes arranged such that the electrodes surround the input device.
3. The system according to claim 2 , wherein the electrode arrangement is configured to detect a gesture performed in a 3D space above the electrode arrangement, wherein the electrode arrangement comprises a transmission electrode for generating a quasi-static electric field and a plurality of reception electrodes arranged around said input device.
4. The system according to claim 3 , wherein the reception electrodes around said input device can be configured to operate as non-touching gesture detection sensors in a first operating mode and as touch sensors in a second operating mode.
5. The system according to claim 4 , wherein the operating modes are time-multiplexed.
6. The system according to claim 2 , wherein the electrode arrangement comprises a plurality of electrode sensors around said input device that can be configured to operate as touch sensors arranged.
7. The system according to claim 2 , wherein a touch detection on one of said electrodes combined with an input on said input device performs a predefined function of the processing system.
8. The system according to claim 2 , wherein the input device is a touchpad and the input action is a touch detection on an electrode of said electrode arrangement and the input from said input device is a touch movement performed on said touch pad.
9. The system according to claim 8 , wherein the electrode arrangement comprises a plurality of electrodes and a touched electrode defines the predefined function which is selected from the group consisting of horizontal scrolling, vertical scrolling, and zooming.
10. The system according to claim 1 , wherein the sensor arrangement comprises infra-red sensors.
11. The system according to claim 1 , wherein the sensor arrangement comprises ultrasound sensors.
12. The system according to claim 1 , wherein the input device is a touch sensor comprising a matrix of capacitive sensor elements, wherein in one operating mode the matrix of capacitive sensor elements operate as a touch sensor and wherein in a second operating mode predefined sets of sensor elements can be combined to form individual elongated sensor elements, wherein in the second operating mode, the individual elongated sensor elements of the input device form the sensor arrangement to monitor the area above the input device.
13. The system according to claim 1 , wherein the predefined non-touching input actions are used to block or unblock said input device based on a detection of predefined non-touching adjacent to said input device.
14. The system according to claim 1 , wherein the predefined non-touching are used to perform predefined functions of the processing system.
15. The system according to claim 1 , wherein the identical predefined non-touching gestures are moving a hand vertically across the input device twice.
16. The system according to claim 1 , wherein a first predefined function is a copy function and a second predefined function is a paste function.
17. The system according to claim 1 , wherein:
the sensor arrangement is an electrode arrangement comprising a plurality of electrodes arranged such that the electrodes surround the input device;
the electrode arrangement is configured to detect a gesture performed in a 3D space above the electrode arrangement; and
the electrode arrangement comprises a transmission electrode formed on a first side of a substrate of the sensor arrangement and a reception electrode formed on an opposite, second side of the substrate of the sensor arrangement.
18. The system according to claim 1 , wherein the sensor arrangement is configured to detect a proximity of a hand of a user on an outside of the input device and, based upon the detection, the controller is configured to block input to the input device.
19. The system according to claim 1 , wherein the sensor arrangement is configured to detect a proximity of a hand of a user on an outside of the input device and, based upon the detection, the controller is configured to block input to another input device.
20. The system according to claim 1 , wherein the sensor arrangement is configured to detect a proximity of a hand of a user while the system is in a standby mode and, based upon the detection, the controller is configured to activate a backlight of a keyboard.
21. The system according to claim 1 , wherein:
the sensor arrangement includes an electrode arrangement comprising a plurality of electrodes arranged such that the electrodes surround the input device;
the sensor arrangement includes is configured to detect a simultaneous touch of the input device and proximity to portions of the electrodes surrounding the input device; and
the controller is configured to, based upon the detection of a simultaneous touch of the input device and proximity to portions of the electrodes surrounding the input device, identify a gesture for scrolling.
22. The system according to claim 1 , wherein:
the sensor arrangement is configured to detect two consecutive movements towards the input device and to detect two consecutive movements away from the input device; and
the controller is configured to, based upon detection of the two consecutive movements away the input device, identify a gesture to copy data from an application executing on the system; and
the controller is further configured to, based upon detection of the two consecutive movements towards the input device, identify a gesture to paste the data copied from the application executing on the system.
23. The system according to claim 1 , wherein the sequence of multiple, identical non-touching gestures must be performed within a predetermined time period for detection.
24. A system comprising:
a processing system;
an input device integrated within the processing system and coupled with the processing system; and
a sensor arrangement integrated with the processing system and configured to monitor an area around said input device, and a controller coupled with the sensor arrangement to detect predefined non-touching input actions, wherein the controller is coupled with the processing system, wherein the controller is configured only upon detection of a predefined non-touching input action to forward an associated command to the processing system, wherein a predefined non-touching input action comprises a predefined sequence of at least two non-touching gestures thereby discarding unintentional movements in the area around said input device, wherein the sensor arrangement is configured to detect a double movement of a hand from a keyboard towards the input device and, based upon the detection, the controller is configured to identify the movement as a gesture to close an application.
25. The system according to claim 24 , wherein the sensor arrangement is an electrode arrangement comprising a plurality of electrodes arranged such that the electrodes surround the input device, and wherein the electrode arrangement is configured to detect a gesture performed in a 3D space above the electrode arrangement, wherein the electrode arrangement comprises a transmission electrode for generating a quasi-static electric field and a plurality of reception electrodes arranged around said input device.
26. The system according to claim 24 , wherein the sensor arrangement comprises infra-red sensors or ultrasound sensors.
27. The system according to claim 24 , wherein the non-touching input actions are detected by the controller and said command is forwarded to the processing system to perform predefined functions of the processing system.
28. The system according to claim 24 , wherein the sequence of at least two non-touching gestures comprises multiple identical non-touching gestures.
29. The system according to claim 28 , wherein the identical non-touching gestures are moving a hand vertically across the input device twice.
30. The system according to claim 24 , wherein the input device is a touch sensor comprising a matrix of capacitive sensor elements, wherein in one operating mode the matrix of capacitive sensor elements operate as a touch sensor and wherein in a second operating mode predefined sets of sensor elements can be combined to form individual elongated sensor elements, wherein in the second operating mode, the input device forms the sensor arrangement to monitor the area above the input device.
31. The system according to claim 24 , wherein the predefined sequence of at least two non-touching gestures must be performed within a predetermined time period for detection.
32. A method for operating a data processing device, wherein the data processing device comprises an input device integrated within the processing system; the method comprising the steps of:
integrating a sensor arrangement within the data processing device such that an area surrounding said input device is monitored by the sensor arrangement,
detecting predefined non-touching gestures by a controller coupled with the sensor arrangement, wherein the non-touching gestures include a sequence of multiple, identical non-touching gestures performed in succession,
detecting the sequence of multiple, identical non-touching gestures performed in succession, including detecting a double movement of a hand from a keyboard towards the input device, and
forwarding an associated command to the processing system.
33. The method according to claim 32 , wherein the sensor arrangement is an electrode arrangement comprising a plurality of electrodes arranged such that the electrodes surround the input device.
34. The method according to claim 33 , wherein the electrode arrangement is configured to detect a non-touching gesture performed in a 3D space above the electrode arrangement, wherein the electrode arrangement comprises a transmission electrode for generating a quasi-static electric field and a plurality of reception electrodes arranged around said input device.
35. The method according to claim 34 , further comprising configuring the reception electrodes around said input device to operate as non-touching gesture detection sensors in a first operating mode and as touch sensors in a second operating mode.
36. The method according to claim 35 , wherein the operating modes are time-multiplexed.
37. The method according to claim 33 , wherein the electrode arrangement comprises a plurality of electrode sensors around said input device, and the method comprises configuring the electrode sensors to operate as touch sensors.
38. The method according to claim 33 , further comprising:
detecting a touch on one of the electrodes and combining the touch detection with an input on said input device to generate an associated command;
forwarding the associated command to the processing system; and
in response, performing a predefined function by the processing system.
39. The method according to claim 38 , wherein the input device is a touchpad and wherein the input from said input device is a touch movement performed on said touch pad.
40. The method according to claim 39 , wherein the electrode arrangement comprises a plurality of electrodes and the touched electrode defines the predefined function which is selected from the group consisting of horizontal scrolling, vertical scrolling, and zooming.
41. The method according to claim 32 , wherein the sensor arrangement comprises infra-red sensors.
42. The method according to claim 32 , wherein the sensor arrangement comprises ultrasound sensors.
43. The method according to claim 32 , wherein the input actions are used to block or unblock said input device based on a detection of input actions adjacent to said input device.
44. The method according to claim 32 , wherein the input actions are used to perform predefined functions of the processing system.
45. The method according to claim 32 , wherein the identical non-touching gestures are moving a hand vertically across the input device twice and wherein the identical non-touching gestures must be performed within a predetermined time period for detection.
46. The method according to claim 32 , wherein a first predefined function is a copy function and a second predefined function is a paste function.