Method and apparatus for ego-centric 3D human computer interface
In the method, a processor generates a three dimensional interface with at least one virtual object, defines a stimulus of the interface, and defines a response to the stimulus. The stimulus is an approach to the virtual object with a finger or other end-effector to within a threshold of the virtual object. When the stimulus is sensed, the response is executed. Stimuli may include touch, click, double click, peg, scale, and swipe gestures. The apparatus includes a processor that generates a three dimensional interface with at least one virtual object, and defines a stimulus for the virtual object and a response to the stimulus. A display outputs the interface and object. A camera or other sensor detects the stimulus, e.g. a gesture with a finger or other end-effector, whereupon the processor executes the response. The apparatus may be part of a head mounted display.
1. A method, comprising:
generating, by a processing device, a three-dimensional (3D) interface;
generating a virtual object in the interface;
defining a stimulus of the interface;
associating a response with the stimulus, wherein the stimulus includes a first finger of a hand and a second finger of the hand;
sensing the stimulus;
determining that the stimulus is within a first threshold distance of the virtual object for a first time threshold;
determining that the stimulus is outside the first threshold distance of the virtual object for a second time threshold;
determining that the first finger is a second threshold distance from the second finger during the first time threshold and the second time threshold; and
in response to the stimulus being within the first threshold distance of the virtual object for the first time threshold, the stimulus being outside the first threshold distance of the virtual object for the second time threshold, and the first finger being the second threshold distance from the second finger, executing the response.
2. The method of claim 1 , wherein the response comprises the processing device registering a touch input.
3. The method of claim 1 , wherein the first threshold distance comprises a distance between the first finger or the second finger and the virtual object.
4. The method of claim 1 , wherein the first threshold distance comprises contact between the first finger or the second finger and the virtual object.
5. The method of claim 1 , comprising:
defining an interaction zone associated with the virtual object; and
the first threshold distance comprises contact with the interaction zone.
6. The method of claim 1 , wherein the stimulus further comprises a stylus.
7. The method of claim 1 , wherein the stimulus further comprises the hand.
8. The method of claim 1 , wherein the stimulus further comprises a third finger.
9. The method of claim 1 , wherein the virtual object defines the response therefor.
10. The method of claim 1 , wherein the response comprises the processing device registering a single-click input.
11. The method of claim 1 , wherein the stimulus further comprises:
repeating the approach to the virtual object with stimulus to within the first threshold distance within a third time threshold; and
repeating the withdrawal of the stimulus from the virtual object to at least the first threshold distance within a fourth time threshold.
12. The method of claim 11 , wherein the response comprises the processing device registering a double-click input.
13. The method of claim 1 , wherein the stimulus further comprises maintaining the stimulus within the first threshold distance of the virtual object for at least a third time threshold.
14. The method of claim 13 , wherein the response comprises the processing device registering a swipe input or scale input.
15. The method of claim 13 , wherein the response comprises engaging a location of the virtual object with the end-effector.
16. The method of claim 13 , comprising when the stimulus is withdrawn from the virtual object beyond the first threshold distance, terminating the response.
17. The method of claim 13 , wherein the stimulus comprises determining that the stimulus is within the first threshold distance of the virtual object while the first finger and the second finger remain separated by the second threshold distance.
18. The method of claim 17 , wherein the response comprises the processing device registering a swipe input or scale input.
19. A device, comprising:
a sensing device configured to sense a stimulus, wherein the stimulus comprises a first finger of a hand and a second finger of the hand;
a processing device coupled to the sensing device, wherein the processing device is configured to:
generate a three-dimensional (3D) interface;
generate a virtual object in the interface;
define a stimulus of the interface;
associate a response with the stimulus;
determine that the stimulus is within a first threshold distance of the virtual object for a first time threshold;
determine that the stimulus is outside the first threshold distance of the virtual object for a second time threshold;
determine that the first finger is a second threshold distance from the second finger during the first time threshold and the second time threshold; and
in response to the stimulus being within the first threshold distance of the virtual object for the first time threshold, the stimulus being outside the first threshold distance of the virtual object for the second time threshold, and the first finger being the second threshold distance from the second finger, execute the response.
20. An apparatus, comprising:
a sensing device configured to sense a first finger of a hand that is a threshold distance from a second finger of the hand;
a processing device coupled to the sensing device, wherein the processing device is configured to:
generate a three-dimensional (3D) interface;
generate a virtual object in the interface;
associate a response with a position of the first finger and the second finger;
determine that at least one of the first finger or the second finger is within a first threshold distance of the virtual object for a first time threshold;
determine that at least one of the first finger or the second finger is outside the first threshold distance of the virtual object for a second time threshold; and
in response to at least one of the first finger or the second finger being within the first threshold distance of the virtual object for the first time threshold and at least one of the first finger or the second finger being outside the first threshold distance of the virtual object for the second time threshold, execute the response.