Gesture-based user interface

1. A computer-implemented method used in a computer program to enable gesture-based interactions between the computer program and a user, the method comprising:

initiating the computer program;

detecting that a condition has occurred by:

determining an identity of a user based on facial changes associated with speech of the user; and

determining that the user is a disabled user;

automatically activating, based on the detection that the condition occurred, a gesture-based operation mode of the computer program;

receiving first gesture data generated by a sensor, the first gesture data representing a first one of a plurality of gestures;

determining that the first gesture does not correspond to a command; and

performing a task based on the first gesture data, wherein performing the task comprises:

determining a plurality of suggested commands using a machine-learning algorithm to analyze historical patterns of user behavior, the commands being determined based on first behavior data regarding a behavior related to the user;

presenting, through a user interface, information regarding the commands;

receiving an input from the user for selecting one of the commands; and

executing the selected command.

2. The method of claim 1 , wherein detecting that the condition has occurred further comprises:

receiving a signal indicating that an emergency has occurred.

3. The method of claim 1 , wherein detecting that the condition has occurred further comprises:

receiving a second input from the user for activating the gesture-based operation mode.

4. The method of claim 1 , further comprising:

receiving, from a server, second behavior data regarding behaviors of multiple users that use the computer program; and

determining the commands based on the second behavior data.

5. The method of claim 1 , further comprising:

presenting a prompt for the user to perform a second gesture, the prompt comprising the selected command;

receiving second gesture data generated by the sensor, the second gesture data representing a second one of the gestures;

determining the second gesture based on the second gesture data; and setting a corresponding relationship between the second gesture and the selected command.

6. The method of claim 1 , wherein performing the task further comprises:

determining a plurality of gesture candidates based on a collective usage trend for a plurality of second gestures of multiple users, the collective usage trend being determined by evaluating how often the second gestures are used by the multiple users;

presenting, through a user interface, information regarding the gesture candidates; and

receiving a second input from the user for selecting a gesture candidate.

7. The method of claim 1 , wherein:

receiving the gesture data comprises:

presenting, through a user interface, a prompt for the user to perform the first gesture, and

within a predetermined amount of time after the prompt is presented, receiving the first gesture data; and

performing the task comprises:

determining whether the first gesture data represents the first gesture; and

when it is determined that the gesture data represents the first gesture, setting a corresponding relationship between the first gesture and a predetermined command.

8. The method of claim 1 , wherein performing the task comprises:

determining a quality score based on the first gesture data; and

generating, based on the quality score, suggestions for the user to improve performance of the first gesture.

9. The method of claim 1 , wherein determining an identity of the user is based on at least one of unique hand or finger positioning patterns related to a gesture of the user.

10. A non-transitory computer readable medium having stored instructions, which when executed, cause at least one processor to perform a method for enabling gesture-based interactions between a computer program and a user, the method comprising:

initiating the computer program;

detecting that a condition has occurred by:

determining an identity of a user based on facial changes associated with speech of the user; and

indicating that the user is a disabled user;

automatically activating, based on the detection that the condition occurred, a gesture-based operation mode of the computer program;

receiving first gesture data generated by a sensor, the first gesture data representing a first one of a plurality of gestures;

determining that the first gesture does not correspond to a command; and

performing a task based on the gesture data, wherein performing the task comprises:

determining a plurality of suggested commands using a machine-learning algorithm to analyze historical patterns of user behavior, the commands being determined based on first behavior data regarding a behavior related to the user;

presenting, through a user interface, information regarding the commands;

receiving an input from the user for selecting one of the commands; and

executing the selected command.

11. The medium of claim 10 , wherein detecting that the condition has occurred further comprises:

receiving a signal indicating that an emergency has occurred.

12. The medium of claim 10 , wherein performing the task further comprises:

receiving, from a server, second behavior data regarding behaviors of multiple users that use the computer program; and

determining the commands based on the second behavior data.

13. The medium of claim 10 , wherein performing the task further comprises:

presenting a prompt for the user to perform a second gesture, the prompt comprising the selected command;

receiving new gesture data generated by the sensor, the new gesture data representing the second gesture performed by the user;

determining the second gesture based on the new gesture data; and

setting a corresponding relationship between the second gesture and the suggested command that is selected.

14. The medium of claim 10 , further comprising determining an identity of the user based on at least one of unique hand or finger positioning patterns related to a gesture of the user.

15. The medium of claim 10 , wherein performing the task further comprises:

determining a plurality of gesture candidates based on a collective usage trend for a plurality of second gestures of multiple users, the collective usage trend being determined by evaluating how often the second gestures are used by the multiple users;

presenting, through a user interface, information regarding the gesture candidates; and

receiving a second input from the user for selecting a gesture candidate.

16. The medium of claim 10 , wherein presenting information regarding the suggested commands comprises providing an audio message.

17. A terminal, comprising:

a memory storing instructions, the instructions being part of a computer program; and

a processor configured to executed the instructions to perform operations comprising:

initiating the computer program;

detecting that a condition has occurred by:

determining an identity of a user based on facial changes associated with speech of the user; and

determining that the user is a disabled user;

automatically activating, based on the detection that the condition occurred, a gesture-based operation mode of the computer program;

receiving first gesture data generated by a sensor, the first gesture data representing a first one of a plurality of gestures;

determining that the first gesture does not correspond to a command; and

performing a task based on the first gesture data, wherein performing the task comprises:

determining a plurality of suggested commands using a machine-learning algorithm to analyze historical patterns of user behavior, the commands being determined based on behavior data regarding a behavior related to the user;

presenting, through a user interface, information regarding the suggested commands;

receiving an input from the user for selecting one of the commands; and

executing the selected command.

18. The terminal of claim 17 , wherein determining an identity of the user is based on at least one of unique hand or finger positioning patterns related to a gesture of the user.

19. The terminal of claim 17 , wherein performing the task further comprises:

determining a plurality of gesture candidates based on a collective usage trend for a plurality of second gestures of multiple users, the collective usage trend being determined by evaluating how often the second gestures are used by the multiple users;

presenting, through a user interface, information regarding the gesture candidates; and

receiving a second input from the user for selecting a gesture candidate.

20. The terminal of claim 17 , the operations further comprising providing an audio cue prompting the user to perform a gesture.