Multi-touch interface gestures for keyboard and/or mouse inputs
A mouse-and-keyboard based user interface is updated based on gestures made on a touch screen that is displaying the mouse-and-keyboard based user interface. The user interface update process includes the steps of receiving one or more touch events in response to a gesture made on the touch screen, translating the touch events to a mouse-and-keyboard based command, transmitting the mouse-and-keyboard based command to an operating system, and receiving an updated display in response thereto.
1. A method of interpreting gestures made on a touch screen that is displaying a mouse-and-keyboard based user interface (UI), comprising:
receiving a press-and-hold event in combination with a tap event in response to gestures made on the touch screen, wherein the press-and-hold event is detected in response to a user placing and holding a finger in contact with the touch screen beyond a first threshold amount of time, and wherein the tap event occurs after the press-and-hold event is detected;
translating the received events to a mouse right-click command responsive to determining that the press-and-hold event in combination with the tap event was performed in less than a second threshold of time and determining that a location of the tap event is greater than a threshold distance from the location of the press-and-hold event;
transmitting the mouse right-click command to an operating system; and
receiving from the operating system, in response to the transmitted mouse right-click command, an updated mouse-and-keyboard based UI.
2. The method of claim 1 , wherein the operating system is executing on a remote machine.
3. The method of claim 1 , wherein the operating system is a guest operating system executing in a virtual machine.
4. The method of claim 1 , wherein the updated mouse-and-keyboard based UI includes a display of a context menu at a location of the press-and-hold event.
5. A computing device comprising:
a touch screen; and
a processing unit configured to:
receive a press-and-hold event in combination with a tap event in response to gestures made on the touch screen, wherein the press-and-hold event is detected in response to a user placing and holding a finger in contact with the touch screen beyond a first threshold amount of time, and wherein the tap event occurs after the press-and-hold event is detected;
translating the received events to a mouse right-click command responsive to determining that the press-and-hold event in combination with the tap event was performed in less than a second threshold amount of time and determining that a location of the tap event is greater than a threshold distance from the location of the press-and-hold event;
transmitting the mouse right-click command to an operating system; and
receiving from the operating system, in response to the transmitted mouse right-click command, an updated mouse-and-keyboard based UI.
6. The computing device of claim 5 , wherein the operating system is configured to execute on a remote machine.
7. The computing device of claim 5 , wherein the operating system is a guest operating system executing in a virtual machine.
8. The computing device of claim 5 , wherein the updated mouse-and-keyboard based UI includes a display of a context menu at a location of the press-and-hold event.
9. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform a method, the method comprising:
receiving a press-and-hold event in combination with a tap event in response to gestures made on the touch screen, wherein the press-and-hold event is detected in response to a user placing and holding a finger in contact with the touch screen beyond a first threshold amount of time, and wherein the tap event occurs after the press-and-hold event is detected;
translating the received events to a mouse right-click command responsive to determining that the press-and-hold event in combination with the tap event was performed in less than a second threshold amount of time and determining that a location of the tap event is greater than a threshold distance from the location of the press-and-hold event;
transmitting the mouse right-click command to an operating system; and
receiving from the operating system, in response to the transmitted mouse right-click command, an updated mouse-and-keyboard based UI.
10. The non-transitory computer-readable medium of claim 9 , wherein the operating system is executing on a remote machine.
11. The non-transitory computer-readable medium of claim 9 , wherein the operating system is a guest operating system executing in a virtual machine.
12. The non-transitory computer-readable medium of claim 9 , wherein the updated mouse-and-keyboard based UI includes a display of a context menu at a location of the press-and-hold event.