Content movement and interaction using a single controller
Examples of systems and methods for interacting with content and updating the location and orientation of that content using a single controller. The system may allow a user to use the same controller for moving content around the room and interacting with that content by tracking a range of the motion of the controller.
1. An augmented reality (AR) system comprising:
an AR display configured to present virtual content to a user of the AR system;
an outward facing camera configured to capture one or more images of an environment of the user;
a handheld controller defining a pointing vector indicating a pointing direction of the handheld controller; and
a hardware processor in communication with the AR display, the outward facing camera, and the handheld controller, the hardware processor programmed to:
display an interactive content object via the AR display;
in a first interaction mode, while the pointing vector remains within the interactive content object, indicating movements of the handheld controller within the interactive content object and allowing interactions with the interactive content object via the handheld controller;
monitoring changes of the pointing vector with reference to the interactive content object;
in response to detecting movement of the pointing vector outside the interactive content object, updating the system to a second interaction mode wherein the handheld controller causes movement of the interactive content object such that the interactive content object follows movements of the handheld controller in the virtual environment; and
in response to detecting movement of the pointing vector of the handheld controller inside the interactive content object, updating the system to the first interaction mode.
2. The system of claim 1 , wherein the interactive content object comprises a bounded volume containing a virtual object.
3. The system of claim 2 , wherein at least one edge of the interactive content object is 10 degrees further away from the center of the virtual object than a corresponding edge of the virtual object.
4. The system of claim 1 , wherein the hardware processor is configured to receive an indication to display the interactive content at a first content location.
5. The system of claim 4 , wherein the indication comprises a press and release of a button on the controller.
6. The system of claim 4 , wherein the hardware processor is configured to alert the user to the display of interactive content at the first content location.
7. The system of claim 6 , wherein the alert comprises at least one of: graphics, haptic feedback, or sounds.
8. The system of claim 1 , wherein the hardware processor is configured to receive an indication to stop displaying the interactive content in the environment of the user.
9. The system of claim 8 , wherein the indication comprises a press and release of a button on the controller.
10. The system of claim 1 , wherein the hardware processor is configured to:
determine a first user head pose;
identify a first user gaze vector based on the first user head pose; and
orient the interactive content so that a surface of the interactive content object is perpendicular to the first user gaze vector.
11. The system of claim 10 , wherein the hardware processor is configured to:
determine a second user head pose;
identify a second user gaze vector based on the second user head pose; and
orient the interactive content object so that a surface of the interactive content object is perpendicular to the second user gaze vector.
12. The system of claim 1 , wherein a pitch of the interactive content object is fixed with respect to a head height of the user.
13. The system of claim 1 , wherein the hardware processor is configured to:
receive an indication to stop moving the interactive content; and
in response to receiving the indication to stop moving, maintain display of the interactive content at a current content location within the environment of the user.
14. The system of claim 13 , wherein the hardware processor is configured to:
receive an indication to begin moving the interactive content; and
in response to receiving the indication to begin moving, allow the interactive content to be displayed at a new location within the environment of the user.
15. An augmented reality (AR) system comprising:
an AR display configured to present virtual content to a user of the AR system;
a handheld controller having at least six degrees of freedom; and
a hardware processor in communication with the AR display, and the handheld controller, the hardware processor programmed to:
display interactive content at a first content location;
determine a first pointing vector comprising a direction indicated by the controller;
determine whether the first pointing vector intersects with a bounded volume associated with the interactive content;
in response to determining that the first pointing vector does not intersect the bounded volume, move the interactive content to a second content location associated with a point along the direction of the first pointing vector; and
in response to determining that the first pointing vector intersects the bounded volume, receive an indication to interact with the interactive content at the first content location.
16. The system of claim 15 , wherein the interactive content comprises a bounded volume containing a virtual object.
17. The system of claim 16 , wherein at least one edge of the interactive content is 10 degrees further away from the center of the virtual object than a corresponding edge of the virtual object.
18. The system of claim 15 , wherein the hardware processor is configured to receive an indication to display the interactive content at the first content location.
19. The system of claim 18 , wherein the indication comprises a press and release of a button on the controller.
20. The system of claim 18 , wherein the hardware processor is configured to alert the user to the display of interactive content at the first content location.