Dynamic user interactions for display control and measuring degree of completeness of user gestures
The technology disclosed relates to distinguishing meaningful gestures from proximate non-meaningful gestures in a three-dimensional (3D) sensory space. In particular, it relates to calculating spatial trajectories of different gestures and determining a dominant gesture based on magnitudes of the spatial trajectories. The technology disclosed also relates to uniformly responding to gestural inputs from a user irrespective of a position of the user. In particular, it relates to automatically adapting a responsiveness scale between gestures in a physical space and resulting responses in a gestural interface by automatically proportioning on-screen responsiveness to scaled movement distances of gestures in the physical space, user spacing with the 3D sensory space, or virtual object density in the gestural interface. The technology disclosed further relates to detecting if a user has intended to interact with a virtual object based on measuring a degree of completion of gestures and creating interface elements in the 3D space.
1. A method of creating interface elements in a three-dimensional (3D) sensory space, the method including: detecting a first motion made by a finger in a three-dimensional (3D) sensory space using an electronic sensor including capturing the first motion made by the finger and any motions made by other fingers; determining that the first motion by the finger includes a first swirl gesture and determining therefrom any gestures made by individual ones of the other fingers, wherein: the finger making the first motion is a finger that is determined to be moving in a swirling motion; and the finger is attached to a hand that is determined to not move along with the finger that is determined to be moving in the swirling motion; determining, based on magnitudes of theft respective spatial trajectories, whether to recognize a gesture associated with (a) the first motion of the finger and (b) lack of motion of the other fingers of the hand to which the finger is attached; recognizing a gesture associated with the first motion of the finger without motion of the other fingers or the hand to which the finger is attached; constructing an on-screen puck that is constructed having at least one associated function, wherein the on-screen puck is constructed responsive to the first motion made by the finger without motion of the other fingers or the hand to which the finger is attached; detecting using the electronic sensor, a subsequent second motion of both the finger and an extended second finger in the 3D sensory space, wherein: the finger making the first motion and the extended second finger are determined to be moving in second motion; and the subsequent second motion as detected being different from the first motion; determining, based on magnitudes of their respective spatial trajectories, whether to recognize a gesture associated with (a) the second motion of the finger and (b) the extended second finger; recognizing a gesture associated with the second motion of the finger and the extended second finger that is different from the gesture associated with the first motion of the finger and the extended second finger; and rotating the on-screen puck responsive to the subsequent second motion of the finger and the extended second finger moving in the 3D sensory space and performing the at least one associated function.
2. The method of claim 1 , further including capturing motion of a hand portion other than the finger.
3. The method of claim 1 , further including detecting a repeatedly performed clockwise or anti-clockwise movement of the finger in free space at least substantially concurrent with an upward or downward movement of the finger.
4. The method of claim 1 , further including the on-screen puck continuing to move for a period of time after a user ceases making the subsequent second motion of the finger.
5. The method of claim 1 , further including the on-screen puck springing back to a fixed position after a user ceases making the subsequent second motion of the finger.
6. A system including one or more processors coupled to memory storing computer instructions to create interface elements in a three-dimensional (3D) sensory space, which computer instructions, when executed on the processors, implement actions comprising: detecting a first motion made by a finger in a three-dimensional (3D) sensory space using an electronic sensor including capturing the first motion made by the finger and any motions made by other fingers; determining that the first motion by the finger includes a first swirl gesture and determining therefrom any gestures made by individual ones of the other fingers, wherein: the finger making the first motion is a finger that is determined to be moving in a swirling motion; and the finger is attached to a hand that is determined to not move along with the finger that is determined to be moving in the swirling motion; determining, based on magnitudes of their respective spatial trajectories, whether to recognize a gesture associated with (a) the first motion of the finger and (b) lack of motion of the other fingers or the hand to which the finger is attached; recognizing a gesture associated with the first motion of the finger without motion of the other fingers or the hand to which the finger is attached; constructing an on-screen puck that is constructed having at least one associated function, wherein the on-screen puck is constructed responsive to the first motion made by the finger without motion of the other fingers or the hand to which the finger is attached; detecting using the electronic sensor, a subsequent second motion of both the finger and an extended second finger in the 3D sensory space, wherein: the finger making the first motion and the extended second finger are determined to be moving in second motion; and the subsequent second motion as detected being different from the first motion; determining, based on magnitudes of their respective spatial trajectories, whether to recognize a gesture associated with (a) the second motion of the finger and (b) the extended second finger; recognizing a gesture associated with the second motion of the finger and the extended second finger that is different from the gesture associated with the first motion of the finger and the extended second finger; and rotating the on-screen puck responsive to the subsequent second motion of the finger and the extended second finger moving in the 3D sensory space and performing the at least one associated function.
7. The system of claim 6 , implementing actions comprising capturing motion of a hand portion other than the finger.
8. The system of claim 6 , further implementing actions comprising detecting a repeatedly performed clockwise or anti-clockwise movement of the finger in tree space at least substantially concurrent with an upward or downward movement of the finger.
9. The system of claim 6 , further implementing actions comprising the on-screen puck continuing to move for a period of time after a user ceases making the subsequent second motion of the finger.
10. The system of claim 6 , further implementing actions comprising the on-screen puck springing back to a fixed position after a user ceases making the subsequent second motion of the finger.
11. A non-transitory computer readable storage medium impressed with computer program instructions to create interface elements in a three-dimensional (3D) sensory space, which computer program instructions, when executed on one or more processors, implement actions comprising: detecting a first motion made by a finger in a three-dimensional (3D) sensory space using an electronic sensor including capturing the first motion made by the finger and any motions made by other fingers; determining that the first motion by the finger includes a first swirl gesture and determining therefrom any gestures made by individual ones of the other fingers, wherein: the finger making the first motion is a finger that is determined to be moving in a swirling motion; and the finger is attached to a hand that is determined to not move along with the finger that is determined to be moving in the swirling motion; determining, based on magnitudes of their respective spatial trajectories, whether to recognize a gesture associated with (a) the first motion of the finger and (b) lack of motion of the other fingers or the hand to which the finger is attached; recognizing a gesture associated with the first motion of the finger without motion of the other fingers or the hand to which the finger is attached; constructing an on-screen puck that is constructed having at least one associated function, wherein the on-screen puck is constructed responsive to the first motion made by the finger without motion of the other fingers or the hand to which the finger is attached; detecting using the electronic sensor, a subsequent second motion of both the finger and an extended second finger in the 3D sensory space, wherein: the finger making the first motion and the extended second finger are determined to be moving in second motion; and the subsequent second motion as detected being different from the first motion; determining, based on magnitudes of their respective spatial trajectories, whether to recognize a gesture associated with (a) the second motion of the finger and (b) the extended second finger; recognizing a gesture associated with the second motion of the finger and the extended second finger that is different from the gesture associated with the first motion of the finger and the extended second finger; and rotating the onscreen puck responsive to the subsequent second motion of the finger and the extended second finger moving in the 3D sensory space and performing the at least one associated function.
12. The non-transitory computer readable storage medium of claim 11 , further Including instructions that implement capturing motion of a hand portion other than the finger.
13. The non-transitory computer readable storage medium of claim 11 , further including instructions that implement detecting a repeatedly performed clockwise or anti-clockwise movement of the finger in free space at least substantially concurrent with an upward or downward movement of the finger.
14. The non-transitory computer readable storage medium of claim 11 , further including instructions that implement the on-screen puck continuing to move for a period of time after a user ceases making the subsequent second motion of the finger.
15. The non-transitory computer readable storage medium of claim 11 , further including instructions that implement the onscreen puck springing back to a fixed position after a user ceases making the subsequent second motion of the finger.