Systems And Methods For Gesture-Based Control
Systems and methods for gesture-based control are provided. A system may include a wearable device configured to be worn on a wrist of a person and comprising one or more sensors and a display. The wearable device being configured to obtain at least physiological data being configured to indicate a state of a person's hand and wrist location data comprising information relating to a position of the person's wrist. The system may be configured to transition between states in response to gestures detected based on the physiological data and/or the wrist location data.
1 . (canceled)
2 . A system for gesture-based control, the system comprising:
a wearable device configured to be worn by a user, the wearable device comprising one or more sensors configured to obtain physiological data relating to nerve and/or muscle activations;
a processor; and
memory storing instructions that, when executed by the processor, cause the system to:
provide a graphical user interface;
receive, via the graphical user interface, a user selection of a gesture from a set of predefined gestures or a user-defined custom gesture;
receive, via the graphical user interface, a user selection of a device action;
associate the selected gesture with the selected device action;
store the association between the selected gesture and the selected device action;
detect, using the one or more sensors, a performed gesture;
determine that the performed gesture matches the selected gesture; and
in response to determining that the performed gesture matches the selected gesture, execute the device action associated with the selected gesture.
3 . The system of claim 2 , wherein the one or more sensors comprise an inertial measurement unit (IMU).
4 . The system of claim 2 , wherein the one or more sensors comprise a biopotential sensor configured to detect biopotentials.
5 . The system of claim 2 , wherein the user selection of the gesture comprises selection of a gesture from a set of predefined gestures.
6 . The system of claim 2 , wherein the user selection of the gesture comprises input of a user-defined custom gesture.
7 . The system of claim 2 , wherein the user selection of the device action comprises selection of a device action from a set of predefined device actions.
8 . The system of claim 2 , wherein the user selection of the device action comprises input of a custom-defined device action.
9 . The system of claim 2 , wherein the graphical user interface is configured to display a visual representation of the selected gesture and the associated device action.
10 . The system of claim 2 , wherein the selected device action comprises launching an application.
11 . The system of claim 2 , wherein the selected device action comprises opening a home screen.
12 . A method for gesture-based control, the method comprising:
providing a graphical user interface;
receiving, via the graphical user interface, a user selection of a gesture from a set of predefined gestures or a user-defined custom gesture;
receiving, via the graphical user interface, a user selection of a device action;
associating the selected gesture with the selected device action;
storing the association between the selected gesture and the selected device action;
detecting, using one or more sensors of a wearable device worn by a user, a performed gesture, wherein the one or more sensors are configured to obtain physiological data relating to nerve and/or muscle activations;
determining that the performed gesture matches the selected gesture; and
in response to determining that the performed gesture matches the selected gesture, executing the device action associated with the selected gesture.
13 . The method of claim 12 , wherein the one or more sensors comprise an inertial measurement unit (IMU).
14 . The method of claim 12 , wherein the one or more sensors comprise a biopotential sensor configured to detect biopotentials.
15 . The method of claim 12 , wherein the user selection of the gesture comprises selection of a gesture from a set of predefined gestures.
16 . The method of claim 12 , wherein the user selection of the gesture comprises input of a user-defined custom gesture.
17 . The method of claim 12 , wherein the user selection of the device action comprises selection of a device action from a set of predefined device actions.
18 . The method of claim 12 , wherein the user selection of the device action comprises input of a custom-defined device action.
19 . The method of claim 12 , wherein the graphical user interface is configured to display a visual representation of the selected gesture and the associated device action.
20 . The method of claim 12 , wherein the selected device action comprises launching an application.
21 . The method of claim 12 , wherein the selected device action comprises opening a home screen.