Granted Patent B2

US 12,474,788 · App. 18/744,145 · Granted Nov 18, 2025

Inventors: James M. Powderly (Ft. Lauderdale, FL); Savannah Niles (Ft. Lauderdale, FL); Frank Hamilton (Martinsburg, WV); Marshal A. Fontaine (St. Augustine, FL); Rony Abovitz (Weston, FL); Alysha Naples (London, GB)

Assignee: MAGIC LEAP, INC.

G06F3/0346G06F1/163G06F3/011G06F3/012G06F3/013G06F3/016G06F3/017G06F3/04815G06F3/0482G06F3/04883

Abstract

Claims (29)

1 . A method for selecting an interactable object located in three-dimensional (3D) space, the method comprising:

under control of an augmented reality (AR) system comprising computer hardware, the AR system configured to permit user interaction with interactable object in a field of regard (FOR) of a user, the FOR comprising a portion of the environment around the user that is capable of being perceived by the user via the AR system, the AR system further comprising a user input device:

determining a group of interactable objects associated with virtual objects in the FOR of the user;

determining a pose of the user;

selecting a target interactable object from among the group of interactable objects based at least partly on the pose of the user;

associating a focus indicator to the selected target interactable object; and

initiating a selection event on the selected target surface based at least partly on an input of the user input device.

2 . The method of claim 1 , wherein determining a target interactable object is performed by a ray casting.

3 . The method of claim 2 , wherein the ray casting comprises casting a pencil ray.

4 . The method of claim 2 , wherein the ray casting comprises casting a ray with substantial transverse width.

5 . The method of claim 1 , wherein the focus indicator is visible to the user.

6 . The method of claim 5 , further comprising displaying the focus indicator to the user.

7 . The method of claim 1 , further comprising: determining a field of view (FOV) of the user based at least partly on the pose of the user, the FOV comprising a portion of the FOR that is perceived at a given time by the user; accessing contextual information of one or more interactable objects in the field of view (FOV); and providing one or more options for a user input mode based at least partly on the contextual information.

8 . The method of claim 7 , further comprising: receiving a selection of an option for the user input mode; determining a current user input mode; and updating the current user input mode to the selected option in response to a determination that the current user input mode is different from the selected option.

9 . The method of claim 8 , further comprising updating the focus indicator to indicate that the current user input mode has changed.

10 . The method of claim 9 , wherein the user input mode comprises one or more of the following: pose of the user or user input device.

11 . The method of claim 1 , wherein the group of interactable objects comprises one or more virtual user interface planes.

12 . The method of claim 1 , wherein the pose of the user comprises at least one of eye pose, head pose, or body pose.

13 . A method for interacting with virtual objects in a three-dimensional (3D) environment, the method comprising:

under control of an augmented reality (AR) system comprising computer hardware, the AR system configured to permit user interaction with interactable object in a field of regard (FOR) of a user, the FOR comprising a portion of the environment around the user that is capable of being perceived by the user via the AR system, the AR system further comprising a user input device:

determining a pose of a user;

displaying a first focus indicator associated with a target interactable object in a direction related to the pose of the user, wherein the target interactable object comprises a plurality of virtual objects;

receiving a selection of the target interactable object; displaying the plurality of virtual objects;

displaying a second focus indicator associated with a target virtual object; and

updating the second focus indicator based at least partly on input from the user input device.

14 . The method of claim 13 , wherein the first focus indicator comprises a cursor in a first shape and the second focus indicator comprises the cursor in a second shape.

15 . The method of claim 14 , wherein the first shape comprises a reticle and the second shape comprises an arrow.

16 . The method of claim 13 , wherein the pose of the user comprises at least one of the following: head pose, eye pose, or body pose.

17 . The method of claim 13 , wherein the user input device is a thumb pad, trackpad, d-pad, or touch screen.

Assignments (2)

Continuity (9)

References Cited (400)