IP Library Granted Patent US 12,020,381
Granted Patent B2
US 12,020,381 · App. 17/584,042 · Granted Jun 25, 2024

Object interactivity in virtual space

Inventor: Edmund Graves Brown, IV (Los Angeles, CA)
Assignee: Magic Leap, Inc.
G06T19/006G06F3/011G06F3/0482G06T19/20G06T2200/24G06T2219/2016G06T2219/2024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,020,381
App. No.
17/584,042
Granted
Jun 25, 2024
Kind
B2
Abstract

A method performed by an augmented reality (AR) system includes receiving a command that is input by the user through the AR system. The augmented reality (AR) system includes a hardware processor and an AR display configured to present virtual content in an environment of a user. The command specifies a type of virtual object to be presented in the environment. In response to the command, virtual objects of the specified type are presented in the environment, and a presentation of at least one of the virtual objects is altered in response to detecting a movement of the user in proximity to the at least one virtual object.

Claims (40)

1. A computer-implemented method, comprising:

receiving, by one or more processors of an augmented reality (AR) device, a command that is input by a user and that identifies a particular location in a physical environment surrounding the user in which, through presentation of a virtual object in an AR display of the AR device, the virtual object is to appear to be;

in response to receiving the command, presenting, by the one or more processors, the virtual object at a position on the AR display, the position corresponding to the particular location;

performing, by the virtual object and after presenting the virtual object at the position on the AR display, a predetermined action; and

in response to determining that the user has performed an action with respect to the particular location, altering, by the one or more processors, a presentation of the virtual object in the AR display, wherein an altered presentation of the virtual object in the AR display is based partly on two or more characteristics of the action, and wherein at least one characteristic of the two or more characteristics of the action affects a second characteristic of the two or more characteristics.

2. The computer-implemented method of claim 1 , comprising receiving data indicating a particular action with respect to the particular location, the particular action comprising a gesture, a user interface command, or a voice command that references the particular location.

3. The computer-implemented method of claim 1 , comprising specifying a type of the virtual object.

4. The computer-implemented method of claim 3 , wherein receiving the command comprises activating a totem.

5. The computer-implemented method of claim 1 , wherein receiving the command comprises activating a totem for a predetermined length of time in a selected direction that is associated with the particular location.

6. The computer-implemented method of claim 1 , comprising altering the position of the virtual object on the AR display.

7. The computer-implemented method of claim 1 , wherein the virtual object is presented for a predetermined or random length of time and then removed from the AR display.

8. The computer-implemented method of claim 1 , comprising:

receiving data identifying a further action of the user, and

determining a predetermined behavior for the virtual object based on the further action of the user.

9. The computer-implemented method of claim 1 , wherein the particular location comprises a particular physical surface within the physical environment.

10. The computer-implemented method of claim 1 , wherein the two or more characteristics of the action are a particular radius of interaction and a speed of movement.

11. A computer-implemented system comprising:

one or more processors; and

one or more non-transitory machine-readable storage devices storing instructions that are executable by the one or more processors to perform operations, comprising:

receiving, by an augmented reality (AR) device, a command that is input by a user and that identifies a particular location in a physical environment surrounding the user in which, through presentation of a virtual object in an AR display of the AR device, the virtual object is to appear to be;

in response to receiving the command, presenting, by the AR device, the virtual object at a position on the AR display, the position corresponding to the particular location;

performing, by the virtual object and after presenting the virtual object at the position on the AR display, a predetermined action; and

in response to determining that the user has performed an action with respect to the particular location, altering, by the AR device, a presentation of the virtual object in the AR display, wherein an altered presentation of the virtual object in the AR display is based partly on two or more characteristics of the action, and wherein at least one characteristic of the two or more characteristics of the action affects a second characteristic of the two or more characteristics.

12. The computer-implemented system of claim 11 , wherein the virtual object is presented for a predetermined or random length of time and then removed from the AR display.

13. The computer-implemented system of claim 11 , wherein the two or more characteristics of the action are a particular radius of interaction and a speed of movement.

14. A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations, comprising:

receiving, by an augmented reality (AR) device, a command that is input by a user and that identifies a particular location in a physical environment surrounding the user in which, through presentation of a virtual object in an AR display of the AR device, the virtual object is to appear to be;

in response to receiving the command, presenting, by the AR device, the virtual object at a position on the AR display, the position corresponding to the particular location;

performing, by the virtual object and after presenting the virtual object at the position on the AR display, a predetermined action; and

in response to determining that the user has performed an action with respect to the particular location, altering, by the AR device, a presentation of the virtual object in the AR display, wherein an altered presentation of the virtual object in the AR display is based partly on two or more characteristics of the action, and wherein at least one characteristic of the two or more characteristics of the action affects a second characteristic of the two or more characteristics.

15. The non-transitory computer storage medium of claim 14 , wherein the command comprises a pointing gesture toward the particular location.

16. The non-transitory computer storage medium of claim 14 , wherein the command comprises a voice comment that references the particular location.

17. The non-transitory computer storage medium of claim 14 , wherein the operations comprise specifying a type of the virtual object.

18. The non-transitory computer storage medium of claim 14 , wherein receiving the command comprises activating a totem for a predetermined length of time in a selected direction that is associated with the particular location.

19. The non-transitory computer storage medium of claim 14 , wherein the operations comprise altering the position of the virtual object on the AR display.

20. The non-transitory computer storage medium of claim 14 , wherein the operations comprise:

receiving data identifying a further action of the user, and

determining a predetermined behavior for the virtual object based on the further action of the user.

21. The non-transitory computer storage medium of claim 14 , wherein the virtual object is presented for a predetermined or random length of time and then removed from the AR display.

22. The non-transitory computer storage medium of claim 14 , wherein the two or more characteristics of the action are a particular radius of interaction and a speed of movement.

Assignments (3)
SECURITY INTEREST Recorded Oct 24, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073255/0581 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2022
From: BROWN, EDMUND GRAVES, IV
To: MAGIC LEAP, INC.
Reel/Frame 058764/0317 →
Continuity (3)
Continuation 17018735 · Sep 11, 2020
Provisional Application 62901130 · Sep 16, 2019
Related Publication 20220148274A1 · May 12, 2022