Selecting virtual objects in a three-dimensional space
Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.
1 . A method for selecting an interactable object located in three-dimensional (3D) space, the method comprising:
under control of an augmented reality (AR) system comprising computer hardware, the AR system configured to permit user interaction with interactable object in a field of regard (FOR) of a user, the FOR comprising a portion of the environment around the user that is capable of being perceived by the user via the AR system, the AR system further comprising a user input device:
determining a group of interactable objects associated with virtual objects in the FOR of the user;
determining a pose of the user;
selecting a target interactable object from among the group of interactable objects based at least partly on the pose of the user;
associating a focus indicator to the selected target interactable object; and
initiating a selection event on the selected target surface based at least partly on an input of the user input device.
2 . The method of claim 1 , wherein determining a target interactable object is performed by a ray casting.
3 . The method of claim 2 , wherein the ray casting comprises casting a pencil ray.
4 . The method of claim 2 , wherein the ray casting comprises casting a ray with substantial transverse width.
5 . The method of claim 1 , wherein the focus indicator is visible to the user.
6 . The method of claim 5 , further comprising displaying the focus indicator to the user.
7 . The method of claim 1 , further comprising: determining a field of view (FOV) of the user based at least partly on the pose of the user, the FOV comprising a portion of the FOR that is perceived at a given time by the user; accessing contextual information of one or more interactable objects in the field of view (FOV); and providing one or more options for a user input mode based at least partly on the contextual information.
8 . The method of claim 7 , further comprising: receiving a selection of an option for the user input mode; determining a current user input mode; and updating the current user input mode to the selected option in response to a determination that the current user input mode is different from the selected option.
9 . The method of claim 8 , further comprising updating the focus indicator to indicate that the current user input mode has changed.
10 . The method of claim 9 , wherein the user input mode comprises one or more of the following: pose of the user or user input device.
11 . The method of claim 1 , wherein the group of interactable objects comprises one or more virtual user interface planes.
12 . The method of claim 1 , wherein the pose of the user comprises at least one of eye pose, head pose, or body pose.
13 . A method for interacting with virtual objects in a three-dimensional (3D) environment, the method comprising:
under control of an augmented reality (AR) system comprising computer hardware, the AR system configured to permit user interaction with interactable object in a field of regard (FOR) of a user, the FOR comprising a portion of the environment around the user that is capable of being perceived by the user via the AR system, the AR system further comprising a user input device:
determining a pose of a user;
displaying a first focus indicator associated with a target interactable object in a direction related to the pose of the user, wherein the target interactable object comprises a plurality of virtual objects;
receiving a selection of the target interactable object; displaying the plurality of virtual objects;
displaying a second focus indicator associated with a target virtual object; and
updating the second focus indicator based at least partly on input from the user input device.
14 . The method of claim 13 , wherein the first focus indicator comprises a cursor in a first shape and the second focus indicator comprises the cursor in a second shape.
15 . The method of claim 14 , wherein the first shape comprises a reticle and the second shape comprises an arrow.
16 . The method of claim 13 , wherein the pose of the user comprises at least one of the following: head pose, eye pose, or body pose.
17 . The method of claim 13 , wherein the user input device is a thumb pad, trackpad, d-pad, or touch screen.