Gesture coach
A capture device may capture a user's motion and a display device may display a model that maps to the user's motion, including gestures that are applicable for control. A user may be unfamiliar with a system that maps the user's motions or not know what gestures are applicable for an executing application. A user may not understand or know how to perform gestures that are applicable for the executing application. User motion data and/or outputs of filters corresponding to gestures may be analyzed to determine those cases where assistance to the user on performing the gesture is appropriate.
1. A method for providing assistance regarding a user-performed gesture, comprising:
receiving data captured by a capture device, the data corresponding to a user motion or pose;
analyzing the data to produce an output corresponding to whether the data corresponds to input recognized by a system;
determining from the output that it is unlikely that the user correctly performed a user motion or pose that invokes the input recognized by the system;
determining from the output that the user likely intended to perform the user motion or pose that invokes the input recognized by the system;
adjusting the output to have a new value, the new value being more indicative of invoking the input recognized by the system than the old value is indicative of invoking the input recognized by the system; and
sending the adjusted output to an application that is configured to process the input recognized by the system.
2. The method of claim 1 , further comprising:
determining that the output may be adjusted before adjusting the output;
receiving second data captured by the capture device, the second data corresponding to a second user motion or pose;
analyzing the second data to produce second output corresponding to whether the second data corresponds to a second input recognized by a system;
determining from the second output that it is unlikely that the user correctly performed a user motion or pose that invokes the second input recognized by the system;
determining from the second output that the user likely intended to perform the a user motion or pose that invokes the input recognized by the system;
providing assistance regarding the a user motion or pose that invokes the input recognized by the system; and
in response to determining that the second output may not be adjusted, sending the second output to the application without adjusting the second output.
3. The method of claim 1 , wherein the output comprises a confidence level that the user correctly performed the user motion or pose that invokes the input recognized by the system.
4. The method of claim 3 , wherein it is unlikely that the user correctly performed the system-recognized gesture when the confidence level is below a threshold.
5. The method of claim 1 , further comprising:
suspending an application corresponding to the input recognized by the system in response to determining from the output that it is unlikely that the user correctly performed a user motion or pose that invokes the input recognized by the system.
6. The method of claim 1 , wherein the output comprises a value, and further comprising:
displaying the value of the output to the user on a display device.
7. The method of claim 1 , further comprising:
displaying a representation of the user motion or pose corresponding to the data and a demonstration of the user motion or pose that invokes the input recognized by the system.
8. The method of claim 7 , further comprising:
displaying a difference between the user motion or pose corresponding to the data and the demonstration of the user motion or pose that invokes the input recognized by the system.
9. A system for providing assistance regarding a user-performed gesture, comprising:
a processor; and
a memory communicatively coupled to the processor when the system is operational, the memory bearing processor-executable instructions that, when executed on the processor, cause the system to at least:
receive data captured by a camera, the data corresponding to a user motion or pose;
analyze the data to produce an output corresponding to whether the data corresponds to input recognized by a system;
determine from the output that it is unlikely that the user correctly performed a user motion or pose that invokes the input recognized by the system;
determine from the output that the user likely intended to perform the user motion or pose that invokes the input recognized by the system;
adjust the output to have a new value, the new value being more indicative of invoking the input recognized by the system than the old value is indicative of invoking the input recognized by the system; and
send the adjusted output to an application that is configured to process the input recognized by the system.
10. The system of claim 9 , wherein the output comprises a confidence level the user correctly performed the user motion or pose that invokes the input recognized by the system.
11. The system of claim 10 , wherein it is unlikely that the user correctly performed the system-recognized gesture when the confidence level is below a threshold.
12. A computer readable storage medium, comprising computer readable instructions that when executed on a computer, cause the computer to perform operations comprising:
receiving data captured by a depth camera, the data corresponding to a user motion or pose;
analyzing the data to produce an output corresponding to whether the data corresponds to input recognized by a system;
determining from the output that it is unlikely that the user correctly performed a user motion or pose that invokes the input recognized by the system;
determining from the output that the user likely intended to perform the user motion or pose that invokes the input recognized by the system;
adjusting the output to have a new value, the new value being more indicative of invoking the input recognized by the system than the old value is indicative of invoking the input recognized by the system; and
sending the adjusted output to an application that is configured to process the input recognized by the system.
13. The computer readable storage medium of claim 12 , further comprising computer readable instructions that when executed on the computer cause the computer to perform operations comprising:
determining that the output may be adjusted before adjusting the output;
receiving second data captured by the capture device, the second data corresponding to a second user motion or pose;
analyzing the second data to produce second output corresponding to whether the second data corresponds to a second input recognized by a system;
determining from the second output that it is unlikely that the user correctly performed a user motion or pose that invokes the second input recognized by the system;
determining from the second output that the user likely intended to perform the a user motion or pose that invokes the input recognized by the system;
providing assistance regarding the a user motion or pose that invokes the input recognized by the system; and
in response to determining that the second output may not be adjusted, sending the second output to the application without adjusting the second output.
14. The computer readable storage medium of claim 12 , wherein the output comprises a confidence level that the user correctly performed the user motion or pose that invokes the input recognized by the system.
15. The computer readable storage medium of claim 14 , wherein it is unlikely that the user correctly performed the system-recognized gesture when the confidence level is below a threshold.
16. The computer readable storage medium of claim 12 , further comprising computer readable instructions that when executed on the computer cause the computer to perform operations comprising:
suspending an application corresponding to the input recognized by the system in response to determining from the output that it is unlikely that the user correctly performed a user motion or pose that invokes the input recognized by the system.
17. The computer readable storage medium of claim 12 , wherein the output comprises a value, and further comprising:
displaying the value of the output to the user on a display device.
18. The computer readable storage medium of claim 12 , further comprising computer readable instructions that when executed on the computer cause the computer to perform operations comprising:
displaying a representation of the user motion or pose corresponding to the data and a demonstration of the user motion or pose that invokes the input recognized by the system.
19. The computer readable storage medium of claim 18 , further comprising computer readable instructions that when executed on the computer cause the computer to perform operations comprising:
displaying a difference between the user motion or pose corresponding to the data and the demonstration of the user motion or pose that invokes the input recognized by the system.