General user interface gesture lexicon and grammar frameworks for multi-touch, high dimensional touch pad (HDTP), free-space camera, and other user interfaces
View Patent ↗A method for a multi-touch gesture-based user interface wherein a plurality of gestemes are defined as functions of abstract space and time and further being primitive gesture segments that can be concatenated over time and space to construct gestures. Various distinct subset of the gestemes can be concatenated in space and time to construct a distinct gestures. Real-time multi-touch gesture-based information provided by user interface is processed to at least a recognized sequence of specific gestemes and that the sequence of gestemes that the user's execution a gesture has been completed. The specific gesture rendered by the user is recognized according to the sequence of gestemes. Many additional features are then provided from this foundation, including gesture grammars, structured-meaning gesture-lexicon, context, and the use of gesture prosody.
1. A method for a multi-touch gesture- based user interface, the method comprising:
concatenating a first subset of gestemes from a plurality of gestemes based on at least temporal logic and at least one parameter associated with a space function for constructing a first gesture, each gesteme being primitive gesture segments;
concatenating a second subset of gestemes from the plurality of gestemes based on at least function for temporal logic and at least one parameter associated with the space function for constructing a second gesture;
receiving real-time multi-touch gesture-based information from a multi-touch gesture-based user interface;
processing the real-time multi-touch gesture-based information to sequentially identify over intervals of real-time at least a recognized sequence of specific gestemes belonging to the plurality of gestemes;
determining from the sequence of gestemes that the user's execution of at least one gesture has been completed;
determining from the sequence of gestemes a specific gesture represented by the sequence of gestemes;
wherein the gesture is recognized as either the first gesture or the second gesture according to the sequence of gestemes.
2. The method of claim 1 wherein gesture grammars are provided using the sequence of gestemes.
3. The method of claim 1 wherein structured-meaning gesture- lexicon frameworks are provided using the sequence of gestemes.
4. The method of claim 1 wherein gesture context frameworks are provided using the sequence of gestemes.
5. The method of claim 1 wherein the use of gesture prosody is provided.
6. A method for controlling an application operating on a processor with a multi-touch gesture-based user interface, the method comprising:
receiving a gesture in real time from a high-definition touch pad (HDTP); deconstructing the gesture into a sequence of gestemes as the gesture is received, each gesteme comprising distinct primitive gesture segments;
determining from the sequence of gestemes that the gesture has been completed;
recognizing the sequence of gesteme as a particular command to the application; and
transmitting the particular command to the application operating on the processor.
7. The method of claim 6 wherein gesture grammars are provided using the sequence of gestemes.
8. The method of claim 6 wherein structured-meaning gesture-lexicon frameworks are provided using the sequence of gestemes.
9. The method of claim 6 wherein gesture context frameworks are provided using the sequence of gestemes.
10. The method of claim 6 wherein the use of gesture prosody is provided.