System for and method of translating motion-based user input between a client device and an application host computer
View Patent ↗A system that translates motion-based user input between a client device and an application host computer. In various embodiments, the system and methods enable an application host computer, application server, or cloud server that supports a first type of input/output (I/O) devices (e.g., mouse, keyboard, and display) to interpret I/O commands from a client device that supports a second type of I/O devices (e.g., touchscreen display), wherein the I/O commands of the client device support motion-based user input. The operations of the interpreted I/O commands are then returned from the application host computer, application server, or cloud server to the client device and rendered on the display thereof. The system and methods enable cross-platform application execution by translating I/O operations that are native to the user's remote device to I/O operations that are native to the application host computer, application server, or cloud server.
1. A method for translating user input between devices having different input/output systems, the method comprising:
receiving user input from a user of a client device via a touchscreen, wherein the user input is associated with a touchscreen command and occurs at an identified location on the touchscreen;
transmitting the touchscreen command and the identified location from the client device to a host device, wherein the host device does not support touchscreen commands;
receiving at the client device an operation sent from the host device, the received operation associated with a set of one or more host commands being executed at a host display location corresponding to the identified touchscreen location, wherein the set is identified as equivalent to the touchscreen command based on a table stored in memory indicating that each of a plurality of client commands is equivalent to a corresponding set of one or more host commands; and
rendering a display of the client device based on the received operation.
2. The method of claim 1 , further comprising identifying the identified location based on at least a size of the touchscreen.
3. The method of claim 1 , wherein the identified location corresponds to a control or field in a display of the host device.
4. The method of claim 1 , further comprising storing client command library in memory, wherein the client command library comprises a plurality of touchscreen commands, each touchscreen command stored in association with the associated set of one or more host commands.
5. The method of claim 1 , wherein the one or more host commands comprises mouse commands.
6. The method of claim 1 , wherein the one or more host commands comprises keyboard commands.
7. The method of claim 1 , wherein the one or more host commands are specific to an application executing on the host device.
8. The method of claim 1 , wherein the user input comprises one or more gestures.
9. The method of claim 1 , wherein the client device has a different operating system than the host device.
10. An apparatus for translating user input between devices having different input/output systems, the apparatus comprising:
a touchscreen that receives user input from a user of a client device, wherein the user input is associated with a touchscreen command and occurs at an identified location on the touchscreen;
a communication interface that:
transmits the touchscreen command and the identified location from the client device to a host device, wherein the host device does not support touchscreen commands, and
receives an operation sent from the host device, the received operation associated with a set of one or more host commands being executed at a host display location corresponding to the identified touchscreen location, wherein the set is identified as equivalent to the touchscreen command based on a table stored in memory indicating that each of a plurality of client commands is equivalent to a corresponding set of one or more host commands; and
a processor for executing the received operation, wherein execution of the received operation renders an updated display.
11. The apparatus of claim 10 , wherein the processor executes further instructions to identify the identified location based on at least a size of the touchscreen.
12. The apparatus of claim 10 , wherein the identified location corresponds to a control or field in a display of the host device.
13. The apparatus of claim 10 , further comprising a memory that stores a client command library comprising a plurality of touchscreen commands, each touchscreen command stored in association with the associated set of one or more host commands.
14. The apparatus of claim 10 , wherein the one or more host commands comprises mouse commands.
15. The apparatus of claim 10 , wherein the one or more host commands comprises keyboard commands.
16. The apparatus of claim 10 , wherein the one or more host commands are specific to an application executing on the host device.
17. The apparatus of claim 10 , wherein the user input comprises one or more gestures.
18. The apparatus of claim 10 , wherein the client device has a different operating system than the host device.
19. A non-transitory computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for translating user input between devices having different input/output systems, the method comprising:
receiving user input from a user of a client device, wherein the user input is associated with a touchscreen command and occurs at an identified location on the touchscreen;
transmitting the touchscreen command and the identified location to a host device, wherein the host device does not support touchscreen commands;
receiving an operation sent from the host device, the received operation associated with a set of one or more host commands being executed at a host display location corresponding to the identified touchscreen location, wherein the set is identified as equivalent to the touchscreen command based on a table stored in memory indicating that each of a plurality of client commands is equivalent to a corresponding set of one or more host commands; and
rendering a display of the client device based on the received operation.