Dynamic user interactions for display control and scaling responsiveness of display objects
The technology disclosed relates to distinguishing meaningful gestures from proximate non-meaningful gestures in a three-dimensional (3D) sensory space. In particular, it relates to calculating spatial trajectories of different gestures and determining a dominant gesture based on magnitudes of the spatial trajectories. The technology disclosed also relates to uniformly responding to gestural inputs from a user irrespective of a position of the user. In particular, it relates to automatically adapting a responsiveness scale between gestures in a physical space and resulting responses in a gestural interface by automatically proportioning on-screen responsiveness to scaled movement distances of gestures in the physical space, user spacing with the 3D sensory space, or virtual object density in the gestural interface. The technology disclosed further relates to detecting if a user has intended to interact with a virtual object based on measuring a degree of completion of gestures and creating interface elements in the 3D space.
1. A method of uniformly responding to gestural inputs from a user irrespective of a position of the user in a three-dimensional (3D) sensory space, the method including:
automatically adapting a responsiveness scale between one or more hand gestures in a physical space and resulting responses in a gestural interface, including:
continuously calculating a distance of a user's hand from a camera electronically coupled to the gestural interface;
identifying an apparent angle traversed by movement of the user's hand with respect to the camera and in a field of view of the camera;
determining whether the apparent angle traversed is above an angle threshold value or below the angle threshold value;
scaling the apparent angle traversed by the movement of the user's hand based on the continuously calculated distance of the user's hand from the camera;
determining a scaled movement distance of the user's hand based on the scaled apparent angle traversed by the movement of the user's hand;
automatically proportioning responses to the scaled movement distance of the user's hand rather than the apparent angle traversed, while making the one or more hand gestures in the physical space;
decreasing on-screen responsiveness of the gestural interface when the apparent angle traversed is below a threshold value, such that responsiveness to a gesture, where the apparent angle traversed by the movement of the user's hand is below the threshold value, is decreased; and
amplifying on-screen responsiveness of the gestural interface when the apparent angle traversed is above the threshold value, such that responsiveness to a gesture, where the apparent angle traversed by the movement of the user's hand is above the threshold value, is increased, whereby smaller gestures decrease the on-screen responsiveness and larger gestures increase on-screen responsiveness.
2. The method of claim 1 , further including:
automatically adjusting a responsiveness scale between gestures in a physical space and resulting responses of virtual objects in a gestural interface, including:
calculating a virtual object density of the gestural interface based on a numerosity of the virtual objects; and
automatically proportioning on-screen responsiveness of the virtual objects to the gestures responsive to the virtual object density in the gestural interface.
3. The method of claim 2 , further including automatically specifying a low on-screen responsiveness of virtual objects in response to a particular gesture whenever a detected content density is above a threshold value.
4. The method of claim 2 , further including automatically specifying a high on-screen responsiveness of virtual objects in response to a particular gesture when a detected content density is below a threshold value.
5. The method of claim 1 , further including:
detecting a presence of multiple user hands present within a field of view of a camera electronically coupled to the gestural interface.
6. The method of claim 1 , further including:
automatically adapting a responsiveness scale between gestures in a physical space from multiple user hands and resulting responses in a shared gestural interface by:
calculating a spacing within a three-dimensional (3D) sensory space based on a spacing of user hands detected in the three-dimensional (3D) sensory space; and
automatically proportioning on-screen responsiveness of the shared gestural interface responsive to the user hand spacing when interpreting movement distances of the gestures in the physical space.
7. The method of claim 1 , wherein the automatically proportioning includes:
computing a scaling factor between movement made by a user in a field of view of a camera electronically coupled to the gestural interface to a scaled movement distance in the three-dimensional (3D) sensory space.
8. The method of claim 7 , further including:
altering the scaling factor to reflect a restricted range of motion, thereby enabling small physical movements to correspond to larger on-screen movements.
9. The method of claim 7 , further including:
altering the scaling factor to reflect a distance between the camera and user.
10. The method of claim 7 , further including:
altering the scaling factor to reflect a quantity of rendered items on a display.
11. The method of claim 7 , wherein the scaling factor includes:
a ratio of the user's actual movement m to a pixel size M in a captured image captured by the camera.
12. A non-transitory computer readable storage medium storing computer program instructions to uniformly respond to gestural inputs from a user irrespective of a position of the user in a three-dimensional (3D) sensory space, which computer program instructions, when executed by a processor, perform automatically adapting a responsiveness scale between one or more hand gestures in a physical space and resulting responses in a gestural interface, including:
continuously calculating a distance of a user's hand from a camera electronically coupled to the gestural interface;
identifying an apparent angle traversed by movement of the user's hand with respect to the camera and in a field of view of the camera;
determining whether the apparent angle traversed is above an angle threshold value or below the angle threshold value;
scaling the apparent angle traversed by the movement of the user's hand based on the continuously calculated distance of the user's hand from the camera;
determining a scaled movement distance of the user's hand based on the scaled apparent angle traversed by the movement of the user's hand;
automatically proportioning responses to the scaled movement distance of the user's hand rather than the apparent angle traversed, while making the one or more hand gestures in the physical space;
decreasing on-screen responsiveness of the gestural interface when the apparent angle traversed is below a threshold value, such that responsiveness to a gesture, where the apparent angle traversed by the movement of the user's hand is below the threshold value, is decreased; and
amplifying on-screen responsiveness of the gestural interface when the apparent angle traversed is above the threshold value, such that responsiveness to a gesture, where the apparent angle traversed by the movement of the user's hand is above the threshold value, is increased, whereby smaller gestures decrease the on-screen responsiveness and larger gestures increase on-screen responsiveness.
13. The non-transitory computer readable storage medium of claim 12 , further including:
detecting a presence of multiple user hands present within a field of view of a camera electronically coupled to the gestural interface.
14. The non-transitory computer readable storage medium of claim 12 , wherein automatically proportioning responses includes computing a scaling factor between movement made by a user in a field of view of a camera electronically coupled to the gestural interface to a scaled movement distance in the three-dimensional (3D) sensory space.
15. The non-transitory computer readable storage medium of claim 14 , further including:
altering the scaling factor to reflect a restricted range of motion, thereby enabling small physical movements to correspond to larger on-screen movements.
16. The non-transitory computer readable storage medium of claim 14 , further including:
altering the scaling factor to reflect a distance between the camera and the user.
17. The non-transitory computer readable storage medium of claim 14 , further including:
altering the scaling factor to reflect a quantity of rendered items on a display.
18. The non-transitory computer readable storage medium of claim 14 , wherein the scaling factor includes:
a ratio of a users' actual movement m to a pixel size M in a captured image captured by the camera.
19. A system for uniformly responding to gestural inputs from a user irrespective of a position of the user in a three-dimensional (3D) sensory space, the system including:
a camera; and
one or more processors coupled to the camera and to a non-transitory computer-readable medium storing instructions thereon, which when executed by the processors perform:
automatically adapting a responsiveness scale between one or more hand gestures in a physical space and resulting responses in a gestural interface, including:
continuously calculating a distance of a user's hand from a camera electronically coupled to the gestural interface;
identifying an apparent angle traversed by movement of the user's hand with respect to the camera and in a field of view of the camera;
determining whether the apparent angle traversed is above an angle threshold value or below the angle threshold value;
scaling the apparent angle traversed by the movement of the user's hand based on the continuously calculated distance of the user's hand from the camera;
determining a scaled movement distance of the user's hand based on the scaled apparent angle traversed by the movement of the user's hand;
automatically proportioning responses to the scaled movement distance of the user's hand rather than the apparent angle traversed, while making the one or more hand gestures in the physical space;
decreasing on-screen responsiveness of the gestural interface when the apparent angle traversed is below a threshold value, such that responsiveness to a gesture, where the apparent angle traversed by the movement of the user's hand is below the threshold value, is decreased; and
amplifying on-screen responsiveness of the gestural interface when the apparent angle traversed is above the threshold value, such that responsiveness to a gesture, where the apparent angle traversed by the movement of the user's hand is above the threshold value, is increased, whereby smaller gestures decrease the on-screen responsiveness and larger gestures increase on-screen responsiveness.