VELOCITY FIELD INTERACTION FOR FREE SPACE GESTURE INTERFACE AND CONTROL
The technology disclosed relates to automatically interpreting motion of a control object in a three dimensional (3D) space by sensing a movement of the control object in the (3D) space, interpreting movement of the control object, and presenting the interpreted movement as a path on a display. The path may be displayed once the speed of the movement exceeds a pre-determined threshold measured in cm per second. Once the path is displayed, the technology duplicates a display object that intersects the path on the display. In some implementations, the control object may be a device, a hand, or a portion of a hand (such as a finger).
1 . A method comprising:
detecting a movement of a first object through a three-dimensional (3D) space using a 3D sensor;
determining a control plane associated with a surface of the first object;
comparing the movement of the first object to the control plane; and
determining a level of engagement of the first object with a virtual control based, at least in part, on a location of the first object.
2 . The method of claim 1 , comprising:
sensing a movement of a sub-object of the first object through the 3D space using the 3D sensor;
processing the movement of the sub-object of the first object; and
identifying a gesture as controlling the virtual control based, at least in part, on a direction of the movement of the sub-object.
3 . The method of claim 2 , wherein
the sub-object is a portion of the first object.
4 . The method of claim 2 , wherein
the first object is a hand and the sub-object is a finger of the hand.
5 . The method of claim 2 , wherein
the first object is a hand and the sub-object of the first object is at least one of:
a finger, a palm, or a back of the hand.
6 . The method of claim 1 , wherein
the virtual control is pre-selected before the movement is sensed.
7 . The method of claim 1 , comprising:
comparing a speed of the movement to a threshold; and
presenting the movement as a path on a display based, at least in part on, the speed of the movement satisfying the threshold.
8 . The method of claim 7 , wherein
the threshold is at least 20 cm per second.
9 . The method of claim 7 , wherein
the threshold is at least 30 cm per second.
10 . The method of claim 7 , wherein
the threshold is at least 40 cm per second.
11 . The method of claim 1 , wherein
the first object is a part of a body.
12 . The method of claim 1 , wherein
the first object is a hand, and the movement is a gesture of the hand.
13 . The method of claim 1 , wherein
the 3D sensor comprises one or more cameras that capture images of the 3D space.
14 . The method of claim 1 , wherein
the 3D sensor comprises one or more cameras that capture images of the 3D space;
the 3D space is illuminated by one or more infrared light-emitting diodes (LEDs); and
the cameras are sensitive to infrared light.
15 . The method of claim 1 , wherein
the 3D space is provided with sound waves from sonic sources.
16 . The method of claim 1 , wherein
the 3D space is provided with sound waves from sonic sources; and
the 3D sensor comprises one or more sonic sensors that capture sonic shadows or deflections in the 3D space of the sound waves.
17 . A non-transitory computer-readable medium having computer instructions recorded thereon that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
detecting a movement of a first object through a three-dimensional (3D) space using a 3D sensor;
determining a control plane associated with a surface of the first object;
comparing the movement of the first object to the control plane; and
determining a level of engagement of the first object with a virtual control based, at least in part, on a location of the first object.
18 . The non-transitory computer-readable medium of claim 17 , wherein the operations include:
sensing a movement of a sub-object of the first object through the 3D space using the 3D sensor;
processing the movement of the sub-object of the first object; and
identifying a gesture as controlling the virtual control based, at least in part, on a direction of the movement of the sub-object.
19 . A system comprising one or more processors and a memory storing computer instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
detecting a movement of a first object through a three-dimensional (3D) space using a 3D sensor;
determining a control plane associated with a surface of the first object;
comparing the movement of the first object to the control plane; and
determining a level of engagement of the first object with a virtual control based, at least in part, on a location of the first object.
20 . The system of claim 19 , wherein the operations include:
sensing a movement of a sub-object of the first object through the 3D space using the 3D sensor;
processing the movement of the sub-object of the first object; and
identifying a gesture as controlling the virtual control based, at least in part, on a direction of the movement of the sub-object.