Method and apparatus for ego-centric 3D human computer interface

1. A method, comprising:

generating, by a processing device, a three-dimensional (3D) interface;

generating a virtual object in the interface;

sensing a stimulus that is associated with an instruction for the virtual object, wherein the stimulus includes a first end effector and a second end effector;

determining that the stimulus is within a first threshold distance of the virtual object;

sensing, as the stimulus is within the first threshold distance of the virtual object, that a spacing between the first end effector and the second end effector is changing;

determining that the spacing between the first end effector and the second end effector changed by a threshold amount during a first time threshold;

determining that the stimulus is outside the first threshold distance of the virtual object for a second time threshold;

initiating the instruction in response to:

the stimulus being within the first threshold distance of the virtual object for the first time threshold; and

sensing the spacing between the first end effector and the second end effector is changing; and

completing the instruction in response to:

determining that the spacing between the first end effector and the second end effector changed by the threshold amount during the first time threshold; and

the stimulus being outside the first threshold distance of the virtual object for a second time threshold.

2. The method of claim 1 , wherein the instruction comprises the processing device registering a touch input.

3. The method of claim 1 , wherein the first threshold distance comprises a distance between the first end effector or the second end effector and the virtual object.

4. The method of claim 1 , wherein the first threshold distance comprises contact between:

the first end effector or the second end effector; and

the virtual object.

5. The method of claim 1 , comprising:

defining an interaction zone associated with the virtual object; and

the first threshold distance comprises contact with the interaction zone.

6. The method of claim 1 , wherein the first end effector or the second end effector comprises a stylus.

7. The method of claim 1 , wherein:

the first end effector comprises a first finger of a hand; and

the second end effector comprises a second finger of the hand.

8. The method of claim 1 , wherein:

the first end effector comprises a first finger of a first hand; and

the second end effector comprises a second finger of a second hand.

9. The method of claim 1 , wherein the instruction is based on a type of the virtual object.

10. The method of claim 1 , wherein the response comprises the processing device registering a scaling input.

11. The method of claim 10 , wherein:

the instruction scales the virtual object to be larger or zooms in on the virtual object as the spacing between the first end effector and the second end effector increases; or

the instruction scales the virtual object to be smaller or zooms out on the virtual object as the spacing between the first end effector and the second end effector decreases.

12. The method of claim 1 , further comprising:

after initiating the instruction, sensing the first end effector or the second end effector is outside the first threshold distance from the virtual object before the first time threshold has elapsed

resetting the virtual object to a state of the virtual object before initializing the response; and

repeating:

determining the stimulus is within the first threshold distance of the virtual object;

sensing, as the stimulus is within the first threshold distance of the virtual object, that the spacing between the first end effector and the second end effector is changing; and

initiating the response.

13. The method of claim 1 , wherein the stimulus further comprises the first end effector being stationary relative to the virtual object as the second end effector moves relative to the virtual object.

14. The method of claim 13 , wherein the instruction comprises the processing device registering a swipe input.

15. The method of claim 13 , wherein the instruction comprises engaging a location of the virtual object with the first end effector.

16. The method of claim 13 , wherein completing the instruction further comprises sensing the first end effector being withdrawn from the virtual object beyond the first threshold distance.

17. A device, comprising:

a sensing device configured to sense a stimulus, wherein the stimulus comprises a first end effector and a second end effector;

a processing device coupled to the sensing device, wherein the processing device is configured to:

generate a three-dimensional (3D) interface;

generate a virtual object in the interface;

determine, by the sensing device, that a stimulus of the interface is within a first threshold distance of the virtual object, wherein the stimulus is associated with an instruction for the virtual object;

determine, by the sensing device and as the stimulus is within the first threshold distance of the virtual object, that a spacing between the first end effector and the second end effector has changed;

determine that the spacing between the first end effector and the second end effector changed by a threshold amount during a first time threshold;

determine that the stimulus is outside the first threshold distance of the virtual object for a second time threshold; and

in response to the stimulus being within the first threshold distance of the virtual object for the first time threshold, the spacing between the first end effector and the second end effector changing by the threshold amount during the first time threshold, and the stimulus being outside the first threshold distance of the virtual object for the second time threshold, execute the response.

18. An apparatus, comprising:

a sensing device configured to sense a first end effector and a second end effector;

a processing device coupled to the sensing device, wherein the processing device is configured to:

generate a three-dimensional (3D) interface;

generate a virtual object in the interface;

associate an instruction with a motion of the first end effector or the second end effector;

determine, by the sensing device, that at least one of the first end effector or the second end effector is within a threshold distance of the virtual object for a first time threshold;

sense, by the sensing device, a change in a spacing between the first end effector and the second end effector;

determine that at least one of the first end effector or the second end effector is outside the threshold distance of the virtual object for a second time threshold; and

in response to at least one of the first end effector or the second end effector being within the threshold distance of the virtual object for the first time threshold, the spacing between the first end effector and the second end effector changing, and at least one of the first end effector or the second end effector being outside the threshold distance of the virtual object for the second time threshold, execute the response.

19. The device of claim 17 , wherein:

the first end effector is a first finger and the second end effector is a second finger, the first finger and the second finger being on the same hand; or

the first end effector is the first finger of a first hand and the second end effector is the same finger on a second hand.

20. The device of claim 18 , wherein:

the first end effector is a first finger on a hand;

the second end effector is a second finger on the hand; and

the first finger and the second finger:

directly neighbor each other; or

are separated by a third finger that directly neighbors the first finger and the second finger.