Granted Patent B2

US 12,406,454 · App. 18/746,617 · Granted Sep 2, 2025

Inventors: James M. Powderly (Ft. Lauderdale, FL); Savannah Niles (Ft. Lauderdale, FL); Frank Alexander Hamilton, IV (Martinsburg, WV); Marshal Ainsworth Fontaine (St. Augustine, FL); Paul Armistead Hoover (Bothell, WA)

Assignee: MAGIC LEAP, INC.

G06T19/006G06F3/011G06F3/0346G06F1/163

Abstract

Claims (38)

1. A system comprising:

a display system of a wearable device configured to provide a three-dimensional (3D) view to a user and permit a user interaction with objects in a field of view (FOV) of the user, the FOV comprising a portion of an environment around the user that is capable of being perceived by the user via the display system;

a user input device;

a hardware processor in communication with the display system and the user input device, the hardware processor programmed to:

determine an indication of user input;

initiate a cone cast of a virtual cone based on the indication of user input, the virtual cone having an aperture that is dynamic based at least partly on the indication of user input;

determine one or more objects within the virtual cone; and

perform an action on one or more of the objects within the virtual cone.

2. The system of claim 1 , wherein the hardware processor is further programmed to evaluate a pose of the user and to determine the indication of user input based on the pose of the user.

3. The system of claim 2 , further comprising a sensor configured to acquire data associated with the pose of the user for evaluation by the hardware processor to determine the indication of user input.

4. The system of claim 1 , wherein the hardware processor is further programmed to determine the indication of user input based a signal from the user input device.

5. The system of claim 1 , wherein the hardware processor is further programmed to:

determine a display state associated with a virtual object;

based at least in part on the determined display state of the virtual object, determine a visual representation of the virtual cone; and

cause the display system to render the determined visual representation of the virtual cone.

6. The system of claim 5 , wherein the determined state of the virtual object is a hover state, wherein the virtual object is movable or selectable.

7. The system of claim 5 , wherein the determined state of the virtual object is a resting state.

8. The system of claim 5 , wherein the visual representation of the virtual cone is determined based in part on a detected change in state of the virtual object.

9. The system of claim 5 , wherein the visual representation of the virtual cone is changed from visible to hidden based in part on a detected change in state of the virtual object from a hover state to a selected state.

10. The system of claim 5 , wherein the visual representation of the virtual cone is determined based in part on a detected change in state of the virtual object from a hover state to a selected state.

11. The system of claim 5 , wherein the determined visual representation of the virtual cone comprises a determined visual representation of the aperture of the virtual cone, a surface of the virtual cone, or a central ray of the virtual cone.

12. The system of claim 5 , wherein the determined visual representation of the virtual cone comprises a determined visual representation of the aperture of the virtual cone, the aperture having a minimum size of a single ray.

13. The system of claim 5 , wherein the determined visual representation of the virtual cone comprises the determined visual representation of a portion of the virtual cone that interacts with the virtual object.

14. The system of claim 5 , wherein the system is configured to increase contrast between the virtual cone and one or more objects in environment.

15. A method comprising:

under control of an AR system comprising, a user input device and a display system of a wearable device configured to present a three-dimensional (3D) view to a user and permit a user interaction with virtual objects in a field of regard (FOR) of a user, the FOR comprising a portion of an environment around the user that is capable of being perceived by the user via the display system;

determining an indication of user input;

initiating a cone cast of a virtual cone based on the indication of user input, wherein the virtual cone having an aperture with a size or shape that dynamically adjustable based at least partly on the indication of user input;

determining one or more objects within the virtual cone; and

performing an action on one or more of the objects within the virtual cone.

16. The method of claim 15 , wherein the determining the indication of user input includes evaluating a pose of the user and to determine the indication of user input based on the pose of the user.

17. The method of claim 16 , further comprising acquiring data from a sensor with the pose of the user.

18. The method of claim 15 , wherein the determining the indication of user input includes evaluating a signal from the user input device.

19. The method of claim 15 , further comprising:

determine a display state associated with a virtual object;

based at least in part on the determined display state of the virtual object, determine a visual representation of the virtual cone; and

cause the display system to render the determined visual representation of the virtual cone.

20. The system of claim 1 , wherein a size or shape of the aperture is dynamically adjustable based at least partly on the indication of user input.

Assignments (5)

Continuity (10)

References Cited (400)