Granted Patent B2

US 10,281,992 · App. 15/861,578 · Granted May 7, 2019

Inventors: Isaac Cohen (Oakland, CA); Maxwell Sills (San Francisco, CA); Paul Durdik (Foster City, CA)

Assignee: Leap Motion, Inc.

G06F3/017G06F3/011G06F3/0304G06F3/04815G06F3/04842G06F3/04845G06T15/20H05K999/99G06F2203/04806

Abstract

Claims (55)

1. A method of interacting with a virtual vector field in a three-dimensional (3D) sensor space, the method including:

defining a vector field at least responsive to curling of fingers of a hand and degrees of freedom between fingers of the curled fingers;

constructing a virtual sphere along a plurality of points on contour of curled fingers in the 3D sensor space;

extending radially, inward or outward, one or more interaction vectors on the virtual sphere, wherein magnitudes of the interaction vectors are determined by a radius of the virtual sphere;

compounding interactions of the vector field with the interaction vectors based on their respective magnitudes; and

providing for display a user manipulable persistent rendering of the constructed virtual sphere, wherein a radius of the persistent rendering of the constructed virtual sphere increases and decreases in proportion to the inward or outward extending of the one or more interaction vectors of the virtual sphere.

2. The method of claim 1 , wherein a motion of the displayable rendering varies in proportion to the compounding interactions of the vector field with the one or more interaction vectors of the virtual sphere.

3. A method of manipulating virtual objects in a three-dimensional (3D) sensor space, the method including:

creating a virtual vector field in response to a control gesture that makes swirling motions in a 3D sensor space, wherein the virtual vector field is a vortex;

creating a plurality of virtual objects in response to subsequent control gestures that make circular sweeps in the 3D sensor space and define object vectors on respective virtual objects;

compounding interactions of the vector field with the object vectors based on their respective magnitudes; and

adjusting a whirlpool effect of the vortex on the virtual objects in proportion to the interactions of the vector field and the object vectors to cause the object vectors of the respective virtual objects to bring one or more of the virtual objects closer to a center of the vortex or to push one or more of the virtual objects away from the center of the vortex.

4. The method of claim 3 , further comprising:

determining from the plurality of virtual objects a set of virtual objects within the vortex based upon the size of the vortex; and

moving members of the set of virtual objects in unison responsive to the control gesture.

5. The method of claim 3 , further comprising determining from a compounding of the size of the vortex and curling of fingers of a hand an appropriate velocity of motion for the virtual objects.

6. The method of claim 3 , further comprising determining from a compounding of the size of the vortex and degrees of freedom between fingers of curled fingers of a hand an appropriate velocity of motion for the virtual objects.

7. The method of claim 3 , further comprising determining a repulsive vortex in which virtual objects move further apart from one another.

8. A non-transitory computer-readable recording medium having a program recorded thereon for interacting with a virtual vector field in a three-dimensional (3D) sensor space, the program, when executed on a processor, implementing a method comprising:

defining a vector field at least responsive to curling of fingers of a hand and degrees of freedom between fingers of the curled fingers;

constructing a virtual sphere along a plurality of points on contour of curled fingers in the 3D sensor space;

extending radially, inward or outward, one or more interaction vectors on the virtual sphere, wherein magnitudes of the interaction vectors are determined by a radius of the virtual sphere;

compounding interactions of the vector field with the interaction vectors based on their respective magnitudes; and

providing for display a user manipulable persistent rendering of the constructed virtual sphere, wherein a radius of the persistent rendering of the constructed virtual sphere increases and decreases in proportion to the inward or outward extending of the one or more interaction vectors of the virtual sphere.

9. The non-transitory computer-readable recording medium of claim 8 , wherein a motion of the displayable rendering varies in proportion to the compounding interactions of the vector field with the one or more interaction vectors of the virtual sphere.

10. A non-transitory computer-readable recording medium having a program recorded thereon for manipulating virtual objects in a three-dimensional (3D) sensor space, the program, when executed on a processor, implementing a method comprising:

creating a virtual vector field in response to a control gesture that makes swirling motions in a 3D sensor space, wherein the virtual vector field is a vortex;

creating a plurality of virtual objects in response to subsequent control gestures that make circular sweeps in the 3D sensor space and define object vectors on respective virtual objects;

compounding interactions of the vector field with the object vectors based on their respective magnitudes; and

adjusting a whirlpool effect of the vortex on the virtual objects in proportion to the interactions of the vector field and the object vectors to cause the object vectors of the respective virtual objects to bring one or more of the virtual objects closer to a center of the vortex or to push one or more of the virtual objects away from the center of the vortex.

11. The non-transitory computer-readable recording medium method of claim 10 , further comprising:

determining from the plurality of virtual objects a set of virtual objects within the vortex based upon the size of the vortex; and

moving members of the set of virtual objects in unison responsive to the control gesture.

12. The non-transitory computer-readable recording medium of claim 10 , wherein the method further includes determining from a compounding of the size of the vortex and curling of fingers of a hand an appropriate velocity of motion for the virtual objects.

13. The non-transitory computer-readable recording medium of claim 10 , wherein the method further includes determining from a compounding of the size of the vortex and degrees of freedom between fingers of curled fingers of a hand an appropriate velocity of motion for the virtual objects.

14. The non-transitory computer-readable recording medium of claim 10 , wherein the method further includes determining a repulsive vortex in which virtual objects move further apart from one another.

15. A smart phone having an interface that identifies fingers of a hand moving in a three-dimensional (3D) sensor space, the smart phone comprising:

a hardware controller storing instructions that, when executed, implement actions including:

defining a vector field at least responsive to curling of the fingers of the hand, as viewed by a camera having a particular vantage point, and degrees of freedom between fingers of the curled fingers;

constructing a virtual sphere along a plurality of points on contour of curled fingers in the 3D sensor space;

extending radially, inward or outward, one or more interaction vectors on the virtual sphere, wherein magnitudes of the interaction vectors are determined by a radius of the virtual sphere;

compounding interactions of the vector field with the interaction vectors based on their respective magnitudes; and

providing for display a user manipulable persistent rendering of the constructed virtual sphere, wherein a radius of the persistent rendering of the constructed virtual sphere increases and decreases in proportion to the inward or outward extending of the one or more interaction vectors of the virtual sphere.

16. The smart phone of claim 15 , wherein a motion of the displayable rendering varies in proportion to the compounding interactions of the vector field with the one or more interaction vectors of the virtual sphere.

17. A smart phone having an interface that manipulates virtual objects in a three-dimensional (3D) sensor space, the smart phone comprising:

a hardware controller storing instructions that, when executed, implement actions including:

creating a virtual vector field in response to a control gesture, as viewed by a camera having a particular vantage point, that makes swirling motions in a 3D sensor space, wherein the virtual vector field is a vortex;

creating a plurality of virtual objects in response to subsequent control gestures that make circular sweeps in the 3D sensor space and define object vectors on respective virtual objects;

compounding interactions of the vector field with the object vectors based on their respective magnitudes; and

adjusting a whirlpool effect of the vortex on the virtual objects in proportion to the interactions of the vector field and the object vectors to cause the object vectors of the respective virtual objects to bring one or more of the virtual objects closer to a center of the vortex or to push one or more of the virtual objects away from the center of the vortex.

18. The smart phone of claim 17 , wherein the actions further include:

determining from the plurality of virtual objects a set of virtual objects within the vortex based upon the size of the vortex; and

moving members of the set of virtual objects in unison responsive to the control gesture.

19. The smart phone of claim 17 , wherein the actions further include determining from a compounding of the size of the vortex and curling of fingers of a hand an appropriate velocity of motion for the virtual objects.

20. The smart phone of claim 17 , wherein the actions further include determining from a compounding of the size of the vortex and degrees of freedom between fingers of curled fingers of a hand an appropriate velocity of motion for the virtual objects.

Assignments (13)

Continuity (3)

Cited By (5)

US 12,229,342 US 12,236,512 US 12,443,335 US 12,572,261 US 12,670,674