Dynamic user interactions for display control and measuring degree of completeness of user gestures
The technology disclosed relates to distinguishing meaningful gestures from proximate non-meaningful gestures in a three-dimensional (3D) sensory space. In particular, it relates to calculating spatial trajectories of different gestures and determining a dominant gesture based on magnitudes of the spatial trajectories. The technology disclosed also relates to uniformly responding to gestural inputs from a user irrespective of a position of the user. In particular, it relates to automatically adapting a responsiveness scale between gestures in a physical space and resulting responses in a gestural interface by automatically proportioning on-screen responsiveness to scaled movement distances of gestures in the physical space, user spacing with the 3D sensory space, or virtual object density in the gestural interface. The technology disclosed further relates to detecting if a user has intended to interact with a virtual object based on measuring a degree of completion of gestures and creating interface elements in the 3D space.
1. A method comprising:
detecting a waving motion of an arm waving in a three-dimensional (3D) sensory space, wherein:
a hand is attached to the waving arm, the hand including a finger making a motion, and
the arm moves a greater distance through the 3D sensory space than a distance that the finger moves relative to the hand;
detecting one or more locations of the arm, the hand attached to the arm, and fingers attached to the hand in the 3D sensory space;
calculating, from the one or more detected locations, a spatial trajectory of the waving motion of the arm and the motion made by the finger;
determining, based on magnitudes of the respective spatial trajectories, whether a gesture is to be associated with (a) the waving motion or (b) the motion made by the finger;
recognizing the gesture as a dominant gesture in accordance with the determination of whether the gesture is to be associated with (a) the waving motion or (b) the motion made by the finger; and
manipulating an on-screen item in response to the recognized dominant gesture and not in response to a non-dominant gesture.
2. The method of claim 1 , wherein the finger moves a distance of 1 to 5 millimeters relative to the hand.
3. The method of claim 1 , wherein the gesture is associated with the motion made by the finger.
4. The method of claim 1 , where in the gesture is associated with the waving motion of the arm.
5. The method of claim 1 , where in the determining of whether the gesture is to be associated with (a) the waving motion or (b) the motion made by the finger is based on magnitudes of the respective spatial trajectories.
6. A non-transitory computer-readable recording medium having computer instructions recorded thereon, the computer instructions, when executed on one or more processors, causing the one or more processors to implement operations comprising:
detecting a waving motion of an arm waving in a three-dimensional (3D) sensory space, wherein:
a hand is attached to the waving arm, the hand including a finger making a motion, and
the arm moves a greater distance through the 3D sensory space than a distance that the finger moves relative to the hand;
detecting one or more locations of the arm, the hand attached to the arm, and fingers attached to the hand in the 3D sensory space;
calculating, from the one or more detected locations, a spatial trajectory of the waving motion of the arm and the motion made by the finger;
determining, based on magnitudes of the respective spatial trajectories, whether a gesture is to be associated with (a) the waving motion or (b) the motion made by the finger;
recognizing the gesture as a dominant gesture in accordance with the determination of whether the gesture is to be associated with (a) the waving motion or (b) the motion made by the finger; and
manipulating an on-screen item in response to the recognized dominant gesture and not in response to a non-dominant gesture.
7. The non-transitory computer-readable recording medium of claim 6 , wherein the finger moves a distance of 1 to 5 millimeters relative to the hand.
8. The non-transitory computer-readable recording medium of claim 6 , wherein the gesture is associated with the motion made by the finger.
9. The non-transitory computer-readable recording medium of claim 6 , where in the gesture is associated with the waving motion of the arm.
10. The non-transitory computer-readable recording medium of claim 6 , where in the determining of whether the gesture is to be associated with (a) the waving motion or (b) the motion made by the finger is based on magnitudes of the respective spatial trajectories.
11. A system including one or more processors coupled to memory, the memory loaded with computer instructions that, when executed on the one or more processors, implement actions comprising:
detecting a waving motion of an arm waving in a three-dimensional (3D) sensory space, wherein:
a hand is attached to the waving arm, the hand including a finger making a motion, and
the arm moves a greater distance through the 3D sensory space than a distance that the finger moves relative to the hand;
detecting one or more locations of the arm, the hand attached to the arm, and fingers attached to the hand in the 3D sensory space;
calculating, from the one or more detected locations, a spatial trajectory of the waving motion of the arm and the motion made by the finger;
determining, based on magnitudes of the respective spatial trajectories, whether a gesture is to be associated with (a) the waving motion or (b) the motion made by the finger;
recognizing the gesture as a dominant gesture in accordance with the determination of whether the gesture is to be associated with (a) the waving motion or (b) the motion made by the finger; and
manipulating an on-screen item in response to the recognized dominant gesture and not in response to a non-dominant gesture.
12. The system of claim 11 , wherein the finger moves a distance of 1 to 5 millimeters relative to the hand.
13. The system of claim 11 , wherein the gesture is associated with the motion made by the finger.
14. The system of claim 11 , where in the gesture is associated with the waving motion of the arm.
15. The system of claim 11 , where in the determining of whether the gesture is to be associated with (a) the waving motion or (b) the motion made by the finger is based on magnitudes of the respective spatial trajectories.