Spatial Gesture Recognition using Inputs from Different Devices to Control a Computing Device

1 . A method, comprising:

communicating with at least one input module attached to a user, the at least one input module having at least one inertial measurement unit and at least one sensor separate from the inertial measurement unit;

receiving, from the at least one sensor, at least one indicator of time instance;

identifying, based on the at least one indicator, a segment of motion inputs generated by the at least one inertial measurement unit; and

determining a gesture classification from the segment of motion inputs.

2 . The method of claim 1 , wherein the at least one indicator includes at least one of:

a first indicator of a beginning of the segment; and

a second indicator of an end of the segment.

3 . The method of claim 2 , further comprising:

recording the segment of motion input in response to the first indicator of the beginning of the segment; and

stopping the recording in response to the second indicator of the end of the segment.

4 . The method of claim 3 , wherein the sensor is configured to detect a voice command or an audio signal to generate the at least one indicator.

5 . The method of claim 3 , wherein the sensor is configured to detect a touch input from the user, and the touch input including a touch, a removal of touch, a tap, a double tap, or a long tap, or any combination thereof.

6 . The method of claim 3 , wherein the sensor includes a button; and the at least one indicator is based on an event at the button, the event including a button click, a button press, a button release, a double click, or a long click, or any combination thereof.

7 . The method of claim 3 , wherein the sensor includes a biological response sensor, a neural activity sensor, or an electromyography sensor, or any combination thereof, the sensor configured to generate the at least one indicator according to an activity of the user.

8 . The method of claim 3 , wherein the sensor is configured on the input module configured to be attached to a hand, a finger or an arm of the user.

9 . The method of claim 3 , wherein the at least one input module includes a first module having the inertial measurement unit, and a second module having the sensor; and the first module and the second module are configured on different parts of the user.

10 . A system, comprising:

at least one input module adapted to be attached to a user, the at least one input module having at least one inertial measurement unit and at least one sensor separate from the inertial measurement unit; and

a computing device in communication with the at least one input module and configured to:

receive, from the at least one sensor, at least one indicator of time instance;

identify, based on the at least one indicator, a segment of motion inputs generated by the at least one inertial measurement unit; and

determine a gesture classification from the segment of motion inputs.

11 . The system of claim 10 , wherein the at least one indicator includes at least one of:

a first indicator of a beginning of the segment; and

a second indicator of an end of the segment.

12 . The system of claim 11 , further comprising:

recording the segment of motion input in response to the first indicator of the beginning of the segment; and

stopping the recording in response to the second indicator of the end of the segment.

13 . The system of claim 12 , wherein the sensor is configured to detect a voice command or an audio signal to generate the at least one indicator.

14 . The system of claim 12 , wherein the sensor is configured to detect a touch input from the user, and the touch input including a touch, a removal of touch, a tap, a double tap, or a long tap, or any combination thereof.

15 . The system of claim 12 , wherein the sensor includes a button; and the at least one indicator is based on an event at the button, the event including a button click, a button press, a button release, a double click, or a long click, or any combination thereof.

16 . The system of claim 12 , wherein the sensor includes a biological response sensor, a neural activity sensor, or an electromyography sensor, or any combination thereof, the sensor configured to generate the at least one indicator according to an activity of the user.

17 . The system of claim 12 , wherein the sensor is configured on the input module configured to be attached to a hand, a finger or an arm of the user.

18 . The system of claim 12 , wherein the at least one input module includes a first module having the inertial measurement unit, and a second module having the sensor; and the first module and the second module are configured on different parts of the user.

19 . A non-transitory computer storage medium storing instruction which, when executed in a computing device, cause the computing device to perform a method, comprising:

communicating with at least one input module attached to a user, the at least one input module having at least one inertial measurement unit and at least one sensor separate from the inertial measurement unit;

receiving, from the at least one sensor, at least one indicator of time instance;

identifying, based on the at least one indicator, a segment of motion inputs generated by the at least one inertial measurement unit; and

determining a gesture classification from the segment of motion inputs.

20 . The non-transitory computer storage medium of claim 19 , wherein the at least one indicator includes at least one of:

a first indicator of a beginning of the segment; and

a second indicator of an end of the segment; and

wherein the method further comprises:

recording the segment of motion input in response to the first indicator of the beginning of the segment; and

stopping the recording in response to the second indicator of the end of the segment.