Content movement and interaction using a single controller

1. An augmented reality (AR) system, comprising:

an AR display configured to present virtual content to a user of the AR system;

one or more sensors configured to sense movement of the user; and

a hardware processor in communication with the AR display and the one or more sensors, the hardware processor programmed to:

receive a first indication via the one or more sensors;

determine a first pointing vector of a handheld controller that indicates a first direction within a three-dimensional (3D) environment of the handheld controller held by the user based on the first indication received via the one or more sensors;

determine a first location within the 3D environment pointed to by the handheld controller based on the first pointing vector of the handheld controller;

display on the AR display a first interactive content object at the first location in the 3D environment, wherein the first interactive content object is a control menu in which the user can select, highlight, or otherwise interact with the control menu or information associated with the control menu, or a prism that includes one or more interactive virtual objects;

receive a second indication via the one or more sensors;

determine a second pointing vector of the handheld controller that indicates a second direction within the 3D environment of the handheld controller held by the user based on the second indication received via the one or more sensors;

determine a second location within the 3D environment of the user based on the second pointing vector, wherein the second location is different from the first location;

determine a bounded area or volume associated with the first interactive content object;

determine whether the second pointing vector of the handheld controller intersects the bounded area or volume associated with the first interactive content object;

if the second pointing vector of the handheld controller intersects the bounded area or volume associated with the first interactive content object, select content within the control menu or at least one of the one or more interactive virtual objects included in the prism; and

if the second pointing vector of the handheld controller does not intersect the bounded area or volume associated with the first interactive content object, display on the AR display the first interactive content object at the second location in the 3D environment of the user.

2. The system of claim 1 , wherein the first indication is a gesture or pose of the user.

3. The system of claim 1 , wherein the one or more sensors include an outward facing camera, wherein the first indication is received via the outward facing camera, and wherein the first location is in a center of a field of view of the user.

4. The system of claim 1 , wherein the first indication is a press of a button of the handheld controller, wherein the first direction within the 3D environment is an indicated direction of the handheld controller, and wherein the first location is a predetermined distance away from the handheld controller along the first pointing vector.

5. The system of claim 4 , wherein the hardware processor is programmed to:

display on the AR display an animation that appears to come out of the handheld controller towards the first location within the 3D environment of the user.

6. The system of claim 1 , wherein the hardware processor is programmed to:

if the second location in the 3D environment of the user corresponds to within a boundary area that is larger than an area of the first interactive content object and that surrounds the first interactive content object, select the content within the control menu or the at least one of the one or more interactive virtual objects included in the prism; and

if the second location in the 3D environment of the user corresponds to outside of the boundary area, display on the AR display the first interactive content object at the second location in the 3D environment of the user.

7. The system of claim 1 , wherein the hardware processor is programmed to:

receive a third indication via the one or more sensors; and

stop displaying the first interactive content object in response to receiving the third indication.

8. The system of claim 1 , wherein the hardware processor is programmed to:

display on the AR display the first interactive content object at a first orientation, and then display on the AR display the first interactive content object at a second orientation based on movement of the user, wherein the second orientation is different from the first orientation.

9. The system of claim 1 , wherein the hardware processor is programmed to:

receive a third indication via the one or more sensors; and

display on the AR display a second interactive content object based on the third indication,

wherein the third indication is different from the first indication, and the second interactive content object is different from the first interactive content object.

10. The system of claim 1 , the hardware processor is programmed to:

receive a third indication via the one or more sensors; and

determine the first pointing vector that indicates the first direction within the 3D environment based on the first indication and the third indication,

wherein the first indication indicates an orientation of a handheld controller, and the third indication indicates an eye gaze direction of the user.

11. A method of displaying interactive content, the method comprising:

receiving a first indication via one or more sensors of an augmented reality (AR) system;

determining a first pointing vector of a handheld controller that indicates a first direction within a three-dimensional (3D) environment of the handheld controller held by a user of the AR system based on the first indication;

determining a first location within the 3D environment pointed to by the handheld controller based on the first pointing vector of the handheld controller

displaying on an AR display a first interactive content object at the first location in the 3D environment, wherein the first interactive content object is a control menu in which the user can select, highlight, or otherwise interact with the control menu or information associated with the control menu, or a prism that includes one or more interactive virtual objects;

receiving a second indication via the one or more sensors;

determining a second pointing vector of the handheld controller that indicates a second direction within the 3D environment of the handheld controller held by the user based on the second indication received via the one or more sensors;

determining a second location within the 3D environment of the user based on the second pointing vector, wherein the second location is different from the first location;

determining a bounded area or volume associated with the first interactive content object;

determining whether the second pointing vector of the handheld controller intersects the bounded area or volume associated with the first interactive content object;

if the second pointing vector of the handheld controller intersects the bounded area or volume associated with the first interactive content object, selecting content within the control menu or at least one of the one or more interactive virtual objects included in the prism; and

if the second pointing vector of the handheld controller does not intersect the bounded area or volume associated with the first interactive content object, displaying on the AR display the first interactive content object at the second location in the 3D environment of the user.

12. The method of claim 11 , wherein the first indication is a gesture or pose of the user of the AR system.

13. The method of claim 11 , wherein the one or more sensors include an outward facing camera, and the first indication is received via the outward facing camera, and wherein the first location is in a center of a field of view of the user of the AR system.

14. The method of claim 11 , wherein the first indication is a press of a button of a handheld controller, wherein the first direction within the 3D environment is an indicated direction of the handheld controller, and wherein the first location is a predetermined distance away from the handheld controller along the first pointing vector.

15. The method of claim 14 , further comprising:

displaying on the AR display an animation that appears to come out of the handheld controller towards the first location within the 3D environment of the user.

16. The method of claim 11 , further comprising:

if the second location in the 3D environment of the user corresponds to within a boundary area that is larger than an area of the first interactive content object and that surrounds the first interactive content object, selecting the content within the control menu or the at least one of the one or more interactive virtual objects included in the prism; and

if the second location in the 3D environment of the user corresponds to outside of the boundary area, displaying on the AR display the first interactive content object at the second location in the 3D environment of the user.

17. The method of claim 11 , further comprising:

receiving a third indication via the one or more sensors; and

stopping display of the first interactive content object in response to the receiving the third indication.

18. The method of claim 11 , further comprising:

displaying on the AR display the first interactive content object at a first orientation, and then displaying on the AR display the first interactive content object at a second orientation based on movement of the user, wherein the second orientation is different from the first orientation.

19. The method of claim 11 , further comprising:

receiving a third indication via the one or more sensors; and

displaying on the AR display a second interactive content object based on the third indication,

wherein the third indication is different from the first indication, and the second interactive content object is different from the first interactive content object.

20. The method of claim 11 , further comprising:

receiving a third indication via the one or more sensors; and

determining the first pointing vector that indicates the first direction within the 3D environment based on the first indication and the third indication,

wherein the first indication indicates an orientation of a handheld controller, and the third indication indicates an eye gaze direction of the user of the AR system.