Gesture-based user interface
A computer-implemented method for enabling gesture-based interactions between a computer program and a user is disclosed. According to certain embodiments, the method may include initiating the computer program. The method may also include detecting that a condition has occurred. The method may also include activating a gesture-based operation mode of the computer program. The method may also include receiving gesture data generated by a sensor, the gesture data representing a gesture performed by the user. The method may further include performing a task based on the gesture data.
1 . A system for enabling gesture-based interactions between a computer program and a user, the system comprising:
one or more processors; and
one or more non-transitory, computer-readable media storing instructions that, when executed by the one or more processors, cause operations comprising:
determining an identity of the user based on a user-identifying extremity-based gesture movement received during a first gesture-based operation mode, wherein the identity of the user is determined based on a match between the user-identifying extremity-based gesture movement and a stored extremity-based gesture movement signature of the user;
in response to determining the identity of the user is a disabled user based on the stored extremity-based gesture movement signature associated with the disabled user, activating a second gesture-based operation mode by activating one or more gesture detection sensors;
in response to receiving gesture data from the one or more activated gesture detection sensors in connection with the activation of the second gesture-based operation mode, generating one or more suggested commands for presentation to the user via a user interface; and
executing a first command of the one or more suggested commands in response to a user selection of the first command via the user interface.
2 . A method comprising:
determining an identity of a user based on a user-identifying extremity-based gesture movement received during a first gesture-based operation mode, wherein the identity of the user is determined based on a match between the user-identifying extremity-based gesture movement and a stored extremity-based gesture movement signature of the user;
in response to determining the identity of the user is a disabled user based on the stored extremity-based gesture movement signature associated with the disabled user, activating a second gesture-based operation mode by activating one or more gesture detection sensors;
receiving gesture data from the user;
in response to receiving the gesture data from the one or more activated gesture detection sensors in connection with the activation of the second gesture-based operation mode, generating one or more suggested commands for presentation to the user via a user interface; and
executing a first command of the one or more suggested commands in response to a user selection of the first command via the user interface.
3 . The method of claim 2 , further comprising receiving an input from the user, wherein the second gesture-based operation mode is activated based on the received input.
4 . The method of claim 2 , wherein generating the one or more suggested commands comprises:
determining an inability to identify a command corresponding to the gesture data; and
based on determining the inability, generating the one or more suggested commands.
5 . The method of claim 2 , wherein generating the one or more suggested commands comprises determining the one or more suggested commands based on data regarding behaviors of the user.
6 . The method of claim 2 , wherein generating the one or more suggested commands comprises:
receiving, from a server, data regarding behaviors of multiple users; and
determining an additional suggested command based on the data.
7 . The method of claim 2 , wherein executing the first command comprises saving a relationship between the gesture data and the first command.
8 . The method of claim 2 , wherein receiving the gesture data comprises:
presenting, through the user interface, a prompt for the user to perform a gesture; and
receiving the gesture data within a predetermined amount of time after the prompt is presented.
9 . The method of claim 2 , wherein executing the first command comprises:
determining a quality score based on the gesture data; and
generating, based on the quality score, suggestions for the user to improve performance of a gesture associated with the gesture data.
10 . The method of claim 2 , comprising:
determining whether the gesture data represents a gesture; and
based on determining that the gesture data represents the gesture, saving a relationship between the gesture and a predetermined command.
11 . One or more non-transitory, computer-readable media storing instructions that, when executed by one or more processors, cause operations comprising:
determining an identity of a user based on a user-identifying extremity-based gesture movement received during a first gesture-based operation mode, wherein the identity of the user is determined based on a match between the user-identifying extremity-based gesture movement and a stored extremity-based gesture movement signature of the user;
in response to determining the identity of the user is a disabled user based on the stored extremity-based gesture movement signature associated with the disabled user, activating a second gesture-based operation mode by activating one or more gesture detection sensors;
in response to receiving gesture data from the one or more activated gesture detection sensors in connection with the activation of the second gesture-based operation mode, generating one or more suggested commands for presentation to the user via a user interface; and
executing a first command of the one or more suggested commands in response to a user selection of the first command via the user interface.
12 . The one or more non-transitory, computer-readable media of claim 11 , wherein the instructions cause operations further comprising receiving an input from the user, wherein the second gesture-based operation mode is activated based on the received input.
13 . The one or more non-transitory, computer-readable media of claim 11 , wherein the instructions for generating the one or more suggested commands cause operations comprising:
determining an inability to identify a command corresponding to the gesture data; and
based on determining the inability, generating the one or more suggested commands.
14 . The one or more non-transitory, computer-readable media of claim 11 , wherein the instructions for generating the one or more suggested commands cause operations comprising determining the one or more suggested commands based on data regarding behaviors of the user.
15 . The one or more non-transitory, computer-readable media of claim 11 , wherein the instructions for generating the one or more suggested commands cause operations comprising:
receiving, from a server, data regarding behaviors of multiple users; and
determining an additional suggested command based on the data.
16 . The one or more non-transitory, computer-readable media of claim 11 , wherein the instructions for executing the first command cause operations comprising saving a relationship between the gesture data and the first command.
17 . The one or more non-transitory, computer-readable media of claim 11 , wherein the instructions for receiving the gesture data cause operations comprising:
presenting, through the user interface, a prompt for the user to perform a gesture; and
receiving the gesture data within a predetermined amount of time after the prompt is presented.
18 . The one or more non-transitory, computer-readable media of claim 11 , wherein the instructions for executing the first command cause operations comprising:
determining a quality score based on the gesture data; and
generating, based on the quality score, suggestions for the user to improve performance of a gesture associated with the gesture data.