Velocity field interaction for free space gesture interface and control
The technology disclosed relates to automatically interpreting motion of a control object in a three dimensional (3D) sensor space by sensing a movement of the control object in the (3D) sensor space, interpreting movement of the control object, and presenting the interpreted movement as a path on a display. The path may be displayed once the speed of the movement exceeds a pre-determined threshold measured in cm per second. Once the path is displayed, the technology duplicates a display object that intersects the path on the display. In some implementations, the control object may be a device, a hand, or a portion of a hand (such as a finger).
1. A method of manipulating one or more objects depicted in a display based on interpreting a movement of a control object, the method including:
sensing a movement of the control object through a 3D sensor space using a 3D sensor;
interpreting, by a computing device, the movement of the control object through the 3D sensor space and comparing the movement of the control object to a control plane defined as tangential to a surface of the control object;
presenting the interpreted movement as a path on a display; and
duplicating a display object, of one or more objects depicted in the display, that intersects the path on the display.
2. The method of claim 1 , wherein
the duplicated display object is pre-selected before the movement that is interpreted as the path is sensed.
3. The method of claim 1 , wherein
the movement is interpreted and presented as the path on the display when a speed of the movement exceeds a pre-determined threshold.
4. The method of claim 3 , wherein
the pre-determined threshold is 20 cm per second.
5. The method of claim 3 , wherein
the pre-determined threshold is 30 cm per second.
6. The method of claim 3 , wherein
the pre-determined threshold is 40 cm per second.
7. The method of claim 1 , wherein
the duplicating of the display object only duplicates display objects, of the one or more objects depicted in the display, that intersect the path.
8. The method of claim 1 , wherein
the path, as interpreted, intersects only two display objects of the one or more objects depicted in the display, and wherein
the duplicating of the display object duplicates the only two display objects that are intersected by the path as interpreted.
9. The method of claim 1 , wherein
the control object is a hand, and the movement is a gesture of the hand.
10. The method of claim 9 , wherein
the hand includes a detected sub-object that is a portion of the hand, and wherein
the method further includes:
processing a sensed movement of the sub-object and interpreting the sensed movement of the sensed sub-object as a gesture interacting with a multi-layer presentation tree.
11. The method of claim 10 , wherein
the sub-object is a finger of the hand.
12. The method of claim 1 , wherein
the path on the display is interpreted according to the sensed movement of the control object, such that the display object and the duplicated display object are simultaneously displayed.
13. The method of claim 1 , wherein
the 3D sensor comprises one or more cameras that capture images of the 3D sensor space.
14. The method of claim 13 , wherein
the 3D sensor space is illuminated by one or more infrared LEDs, and the cameras are sensitive to infrared light.
15. The method of claim 1 , wherein
the 3D sensor space is provided with ultrasound waves from sonic sources.
16. The method of claim 15 , wherein
the 3D sensor comprises one or more sonic sensors that capture sonic shadows or deflections in the 3D sensor space of the ultrasound waves.
17. A non-transitory computer-readable recording medium having computer instructions recorded thereon, the computer instructions, when executed by one or more processors, cause the one or more processors to perform the method of claim 1 .
18. A system comprising a memory storing computer instructions and one or more processors, the computer instructions, when executed by the one or more processors, cause the one or more processors to perform the method of claim 1 .