Method and apparatus for ego-centric 3D human computer interface
In the method, a processor generates a three dimensional interface with at least one virtual object, defines a stimulus of the interface, and defines a response to the stimulus. The stimulus is an approach to the virtual object with a finger or other end-effector to within a threshold of the virtual object. When the stimulus is sensed, the response is executed. Stimuli may include touch, click, double click, peg, scale, and swipe gestures. The apparatus includes a processor that generates a three dimensional interface with at least one virtual object, and defines a stimulus for the virtual object and a response to the stimulus. A display outputs the interface and object. A camera or other sensor detects the stimulus, e.g. a gesture with a finger or other end-effector, whereupon the processor executes the response. The apparatus may be part of a head mounted display.
1. A method, comprising:
generating, by a processing device, a virtual object within a three-dimensional (3D) interface;
defining an interaction zone corresponding to the virtual object within the 3D interface;
detecting a first end-effector as entering the interaction zone, being within the interaction zone for a first qualifying threshold time, and withdrawing from the interaction zone;
detecting a second end-effector within a qualifying threshold distance relative to the first end-effector; and
executing a response corresponding to the virtual object.
2. The method of claim 1 , wherein the response corresponds to a characteristic of the virtual object.
3. The method of claim 1 , further comprising detecting a movement of the first end-effector within the interaction zone.
4. The method of claim 3 , wherein the response corresponding to the virtual object comprises a swipe input response.
5. The method of claim 1 , wherein the response corresponding to the virtual object comprises a tap input response.
6. The method of claim 1 , wherein the response corresponding to the virtual object comprises a translational response.
7. The method of claim 1 , wherein the response corresponding to the virtual object comprises a rotational response.
8. The method of claim 1 , wherein the response corresponding to the virtual object comprises a scaling response based on the qualifying threshold distance of the second end-effector relative to the first end-effector.
9. The method of claim 1 , wherein at least one of the first end-effector or the second end-effector comprises a finger.
10. The method of claim 1 , wherein the response comprises movement of the virtual object constrained to be within the interaction zone.
11. The method of claim 1 , wherein the response comprises movement of the virtual object not constrained by the interaction zone.
12. The method of claim 1 , wherein the response comprises a compound movement of the virtual object.
13. The method of claim 1 , wherein the response is different based on the first end-effector being within the interaction zone for a second qualifying threshold time that is greater than the first qualifying threshold time.
14. The method of claim 1 , wherein the response comprises a change in a geometry of the virtual object.
15. The method of claim 1 , wherein the response corresponds to a characteristic of the 3D interface.
16. The method of claim 1 , wherein the response comprises a pegging operation corresponding to the virtual object.
17. The method of claim 1 , wherein the response is determined based on a change in the qualifying threshold distance of the second end-effector relative to the first end-effector and/or a change in a orientation of the second end-effector relative to the first end-effector.
18. The method of claim 1 , wherein the response is terminated in response to a distance of the second end-effector relative to the first end-effector being outside of the qualifying threshold distance.
19. A device, comprising:
a sensing device configured to sense a stimulus; and
a processing device coupled to the sensing device, wherein the processing device is configured to:
generate a virtual object within a three-dimensional (3D) interface;
define an interaction zone corresponding to the virtual object within the 3D interface;
detect the stimulus based on a first end-effector as being within the interaction zone for a first qualifying threshold time;
detect a second end-effector within a qualifying threshold distance relative to the first end-effector; and
execute a response corresponding to the virtual object.
20. An apparatus, comprising:
a sensing device; and
a processing device coupled to the sensing device, wherein the processing device is configured to:
generate a virtual object within a three-dimensional (3D) interface;
monitor an interaction zone corresponding to the virtual object within the 3D interface;
sensing a first end-effector as being within the interaction zone for a first qualifying threshold time;
sensing a second end-effector within a qualifying threshold distance relative to the first end-effector; and
execute a response corresponding to the virtual object.