Granted Patent B2

US 9,552,075 · App. 15/213,899 · Granted Jan 24, 2017

Abstract

Claims (39)

1. A gesture-recognition system comprising:

an image-capture device for obtaining digital images of an object in 3D space;

a processor-executable analysis module for computationally determining a path of movement of the object based on the captured images;

a computer memory for storing a digital representation of the path of movement; and

a processor-executable mode-control module configured for:

interpreting user gestures in accordance with a first mode of operation;

analyzing the path of movement to determine an intent of a user to change modes of operation by determining a direction of curvature of the path of movement based upon which side of a virtual reference plane a midpoint of the path of movement is on; and

upon determining the intent of the user to change modes of operation, interpreting user gestures in accordance with a second mode of operation.

2. The system of claim 1 , wherein the mode-control module is further configured to analyze the path of movement by determining an amount of curvature of the path of movement.

3. The system of claim 2 , wherein determining the amount of curvature includes determining a maximum distance the path of movement is from a straight line between a starting point and ending point of the path of movement.

4. The system of claim 1 , wherein the mode-control module is configured to analyze the path of movement by determining whether the path intersects a virtual reference plane.

5. The system of claim 4 , wherein the mode-control module is configured to create the virtual reference plane based on prior gestures.

6. The system of claim 1 , wherein the mode-control module is configured to determine if a velocity, acceleration, or range of motion of the movement crosses a threshold to overcome a hysteresis effect associated with the first mode.

7. The system of claim 6 , wherein the hysteresis effect is based on a physics-based model of the first and second modes.

8. The system of claim 1 , wherein the mode-control module is configured to analyze a second path of movement to determine the intent of the user to perform a multi-object gesture and change the modes of operation, the mode-control module subsequently interpreting user gestures in accordance with the second mode of operation based on the intent.

9. The system of claim 1 , wherein the mode-control module is further configured to determine the intent of the user to change modes based on prior gestures.

10. A method of computationally recognizing and interpreting gestures, the method comprising:

obtaining, using an image-capture device, digital images of a real-world object in 3D space;

computationally determining a path of movement of the object based on the captured images;

storing, in a computer memory, a digital representation of the path of movement;

interpreting user gestures in accordance with a first mode of operation;

analyzing the path of movement to determine an intent of a user to change modes of operation by determining a direction of curvature of the path of movement based upon which side of a virtual reference plane a midpoint of the path of movement is on; and

upon determining the intent of the user to change modes of operation, interpreting user gestures in accordance with a second mode of operation.

11. The method of claim 10 , wherein analyzing the path of movement further comprises determining an amount of curvature of the path of movement.

12. The method of claim 11 , wherein determining the amount of curvature includes determining a maximum distance the path of movement is from a straight line between a starting point and ending point of the path of movement.

13. The method of claim 10 , wherein analyzing the path of movement comprises determining whether the path intersects a virtual reference plane.

14. The method of claim 13 , wherein the virtual reference plane is created based on prior gestures.

15. The method of claim 10 , wherein analyzing the path of movement comprises determining if a velocity, acceleration, or range of motion of the movement crosses a threshold to overcome a hysteresis effect associated with the first mode.

16. The method of claim 15 , wherein the hysteresis effect is based on a physics-based model of the first and second modes.

17. The method of claim 10 , further comprising analyzing a second path of movement to determine the intent of the user to perform a multi-object gesture and changing from the first mode to the second mode based on the intent.

18. The method of claim 10 , wherein the intent of the user to change modes is inferred based on prior gestures.

19. A non-transitory computer readable storage medium impressed with computer program instructions to computationally interpret gestures, the instructions, when executed on a processor, implement a method comprising:

obtaining, using an image-capture device, digital images of a real-world object in 3D space;

computationally determining a path of movement of the object based on the captured images;

storing, in a computer memory, a digital representation of the path of movement;

interpreting user gestures in accordance with a first mode of operation;

analyzing the path of movement to determine an intent of a user to change modes of operation by determining a direction of curvature of the path of movement based upon which side of a virtual reference plane a midpoint of the path of movement is on; and

upon determining the intent of the user to change modes of operation, interpreting user gestures in accordance with a second mode of operation.

20. The non-transitory computer readable storage medium of claim 19 , wherein analyzing the path of movement further comprises determining an amount of curvature of the path of movement.

Assignments (12)