Converting a 2D positional input into a 3D point in space

1. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:

determining a head pose of a user associated with a wearable display device;

determining a cursor screen position at a first distance from the wearable display device;

determining a cursor plane position at a second distance from the wearable display device, the second distance representing a maximum distance;

determining a two-dimensional position on the cursor screen, wherein the two-dimensional position on the cursor screen is a default two-dimensional position;

determining a one-dimensional position defined by at least one of the cursor plane or a mesh;

and displaying a virtual object to the user at a three-dimensional position comprised of the two-dimensional position and the one-dimensional position.

2. The computerized method of claim 1 , wherein the head pose of the user determines a view frustum.

3. The computerized method of claim 2 , wherein the cursor screen is positioned closer to the wearable display device than to the cursor plane.

4. The computerized method of claim 3 , wherein the cursor screen bisects the view frustum.

5. The computerized method of claim 1 , wherein the cursor plane is configured to have a maximum and minimum distance from the user.

6. The computerized method of claim 1 , wherein the default two-dimensional position is a center of the cursor screen.

7. The computerized method of claim 1 , wherein the one-dimensional position is further defined by a first intersection of a ray cast orthogonal from a head pose origin associated with a position and a rotation.

8. The computerized method of claim 7 , wherein the first intersection is with at least one of the cursor plane or the mesh.

9. The computerized method of claim 8 , wherein the mesh comprises one or more real world, virtual, or mixed objects.

10. The computerized method of claim 1 , wherein the virtual object is a cursor.

11. The computerized method of claim 1 , wherein the virtual object is a point or a line.

12. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:

determining a head pose of a wearable headset;

determining a two-dimensional position based at least on a detected interaction between a contactor operated by the user and a touch sensitive surface of an input device;

receiving a range status indicating whether the contactor is within a predetermined distance of the touch sensitive surface;

receiving a pressure status indicating a pressure of the contactor on the touch sensitive surface;

determining a three-dimensional position within an augmented reality environment that includes one or more virtual objects and one or more real-world objects;

determining a two-dimensional position on a cursor screen;

determining a one-dimensional position on a cursor plane or a mesh associated with one of the virtual objects or real-world objects;

identifying an intersection of the determined one-dimensional position within the augmented reality environment where an axis orthogonal to the determined two-dimensional position on the cursor screen intersects the cursor plane or the mesh associated with one of the virtual objects or real-world objects;

determining an updated three-dimensional position within the augmented reality environment; and

displaying a virtual object at the updated three-dimensional position within the augmented reality environment to the user in the wearable headset.

13. The computerized method of claim 12 , wherein at least one of the cursor plane or the mesh is fixed at the updated three-dimensional position.

14. The computerized method of claim 13 , further comprising displaying annotations at the updated three-dimensional position based on user interactions with the input device.

15. The computerized method of claim 13 , wherein the user draws on at least one of the cursor plane or the mesh.

16. The computerized method of claim 12 , further comprising:

determining a head movement compensation based on a change in at least one of an orientation and a position from a previous head pose and the head pose.

17. The computerized method of claim 16 , wherein the determined head movement compensation is a two-dimensional offset.

18. The computerized method of claim 17 , wherein the three-dimensional position is back projected on to the two-dimensional cursor screen by using the determined head movement compensation offset.

19. The computerized method of claim 12 , further comprising:

determining an input device movement based on a change in a previous two-dimensional position and the two-dimensional position, based at least on a detected interaction between a contactor operated by the user and a touch sensitive surface of an input device.

20. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:

determining a head pose of a user associated with a wearable display device, wherein the head pose of the user determines a view frustum;

determining a cursor screen position at a first distance from the wearable display device;

determining a cursor plane position at a second distance from the wearable display device, the second distance representing a maximum distance,

wherein the cursor screen is positioned closer to the wearable display device than to the cursor plane, and wherein the cursor screen bisects the view frustum;

determining a two-dimensional position on the cursor screen;

determining a one-dimensional position defined by at least one of the cursor plane or a mesh;

and displaying a virtual object to the user at a three-dimensional position comprised of the two-dimensional position and the one-dimensional position.

21. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:

determining a head pose of a user associated with a wearable display device;

determining a cursor screen position at a first distance from the wearable display device;

determining a cursor plane position at a second distance from the wearable display device, the second distance representing a maximum distance;

determining a two-dimensional position on the cursor screen;

determining a one-dimensional position defined by at least one of the cursor plane or a mesh, wherein the one-dimensional position is further defined by a first intersection of a ray cast orthogonal from a head pose origin associated with a position and a rotation;

and displaying a virtual object to the user at a three-dimensional position comprised of the two-dimensional position and the one-dimensional position.