Multimodal Touchscreen Interaction Apparatuses, Methods and Systems
The MULTIMODAL TOUCHSCREEN INTERACTION APPARATUSES, METHODS AND SYSTEMS (“MTI”) transform multi-user, multi-modal touchscreen input gestures via MTI components into user-customized computation result displays. In one implementation, the MTI obtains, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen. The MTI determines location coordinates of the user touch event from the sensor signal. The MTI identifies a touch type of the user touch event from the sensor signal, and determines a user touchscreen gesture using the touch type of the user touch event. The MTI queries a memory for a user command associated with the user touchscreen gesture, and executing the user command via a processor.
1 . A multimodal touchscreen interaction processor-implemented method, comprising:
obtaining, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen;
determining, via a processor, location coordinates of the user touch event from the sensor signal;
identifying a touch type of the user touch event from the sensor signal; and
determining, via the processor, a user touchscreen gesture using the touch type of the user touch event.
2 . The method of claim 1 , further comprising:
querying a memory for a user command associated with the user touchscreen gesture; and
executing, via the processor the user command.
3 . The method of claim 2 , further comprising:
querying a memory for a prior user touch event within a predetermined time window; and
identifying a gesture pattern using the prior user touch event and the user touchscreen gesture.
4 . The method of claim 3 , wherein the query for the user command associated with the user touchscreen gesture is based on the identified gesture pattern.
5 . The method of claim 2 , further comprising:
identifying a modification to the user command associated with the user touchscreen gesture, based on the identified touch type of the user touch event; and
wherein executing, via the processor the user command is based on the modification to the user command based on the identified touch type.
6 . The method of claim 1 , wherein the user touch event includes a finger touch and a stylus touch.
7 . The method of claim 6 , wherein the user touch event includes a multiple-finger touch and a stylus touch.
8 . A multimodal touchscreen interaction system, comprising:
a processor; and
a memory disposed in communication with the processor and storing processor-issuable instructions to:
obtain, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen;
determine, via the processor, location coordinates of the user touch event from the sensor signal;
identify a touch type of the user touch event from the sensor signal; and
determine, via the processor, a user touchscreen gesture using the touch type of the user touch event.
9 . The system of claim 8 , the memory further storing instructions to:
query a memory for a user command associated with the user touchscreen gesture; and
execute, via the processor the user command.
10 . The system of claim 9 , the memory further storing instructions to:
query a memory for a prior user touch event within a predetermined time window; and
identify a gesture pattern using the prior user touch event and the user touchscreen gesture.
11 . The system of claim 10 , wherein the query for the user command associated with the user touchscreen gesture is based on the identified gesture pattern.
12 . The system of claim 9 , the memory further storing instructions to:
identify a modification to the user command associated with the user touchscreen gesture, based on the identified touch type of the user touch event; and
wherein executing, via the processor the user command is based on the modification to the user command based on the identified touch type.
13 . The system of claim 8 , wherein the user touch event includes a finger touch and a stylus touch.
14 . The system of claim 13 , wherein the user touch event includes a multiple-finger touch and a stylus touch.
15 . A processor-readable tangible medium storing processor-issuable multimodal touchscreen interaction instructions to:
obtain, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen;
determine, via the processor, location coordinates of the user touch event from the sensor signal;
identify a touch type of the user touch event from the sensor signal; and
determine, via the processor, a user touchscreen gesture using the touch type of the user touch event.
16 . The medium of claim 15 , further storing instructions to:
query a memory for a user command associated with the user touchscreen gesture; and
execute, via the processor the user command.
17 . The medium of claim 16 , further storing instructions to:
query a memory for a prior user touch event within a predetermined time window; and
identify a gesture pattern using the prior user touch event and the user touchscreen gesture.
18 . The medium of claim 17 , wherein the query for the user command associated with the user touchscreen gesture is based on the identified gesture pattern.
19 . The medium of claim 16 , further storing instructions to:
identify a modification to the user command associated with the user touchscreen gesture, based on the identified touch type of the user touch event; and
wherein executing, via the processor the user command is based on the modification to the user command based on the identified touch type.
20 . The medium of claim 15 , wherein the user touch event includes a finger touch and a stylus touch.
21 . The medium of claim 20 , wherein the user touch event includes a multiple-finger touch and a stylus touch.