IP Library Granted Patent US 12,020,391
Granted Patent B2
US 12,020,391 · App. 18/324,824 · Granted Jun 25, 2024

Spatial instructions and guides in mixed reality

Inventors: Tushar Arora (Hollywood, FL); Scott Kramarich (Venice, CA)
Assignee: Magic Leap, Inc.
G06T19/006G06F3/011H04W4/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,020,391
App. No.
18/324,824
Granted
Jun 25, 2024
Kind
B2
Abstract

Exemplary systems and methods for creating spatial contents in a mixed reality environment are disclosed. In an example, a location associated with a first user in a coordinate space is determined. A persistent virtual content is generated. The persistent virtual content is associated with the first user's associated location. The first user's associated location is determined and is associated with the persistent virtual content. A location of a second user at a second time in the coordinate space is determined. The persistent virtual content is presented to the second user via a display at a location in the coordinate space corresponding to the first user's associated location.

Claims (42)

1. A method comprising:

receiving, in a recording session at a first time, a first input from a first user, the first input indicative of a movement of the first user during the recording session;

determining, using a sensor of a first wearable head device, a first location associated with the first user in a coordinate space of a virtual environment;

generating a persistent virtual content corresponding to the first input, wherein the persistent virtual content comprises video of the movement of the first user, wherein the persistent virtual content is associated with the first location;

determining, at a second time, a second location of a second user in the coordinate space;

presenting, via a first display, the persistent virtual content to the second user, wherein the presenting the persistent virtual content to the second user comprises presenting the persistent virtual content at a third location in the coordinate space based on the first location; and

presenting, via a second display, the persistent virtual content to a third user, wherein the presenting the persistent virtual content to the third user comprises presenting the persistent virtual content at a fourth location in the coordinate space, the fourth location based on the first location and based further on the second location.

2. The method of claim 1 , wherein the fourth location comprises the second location.

3. The method of claim 1 , wherein the fourth location comprises the first location.

4. The method of claim 1 , wherein the fourth location is associated with an average of the first location and the second location.

5. The method of claim 4 , wherein the average is based on a weighted average of the first location and the second location according to an accuracy of first location and an accuracy of the second location.

6. The method of claim 1 , wherein the second location is determined via GPS.

7. The method of claim 1 , wherein the second location is determined via a 5G base station.

8. The method of claim 1 , wherein the first input comprises at least one of a head movement of the first user, a hand movement of the first user, and a handheld controller input.

9. The method of claim 1 , wherein the sensor comprises at least one of a position sensor and a camera.

10. The method of claim 1 , wherein the virtual content comprises a virtual marking.

11. The method of claim 1 , wherein the determining whether to present the persistent virtual content to the second user comprises determining, using a sensor of a second wearable head device, whether a field of view of the second user includes the first location.

12. The method of claim 1 , further comprising receiving a filter selection from the second user, wherein determining whether to present the persistent virtual content to the second user comprises determining whether the persistent virtual content is associated with the filter selection.

13. The method of claim 1 , wherein the first location comprises a physical location of the first user in the coordinate space.

14. The method of claim 1 , wherein the first location comprises a virtual location of the first user in the coordinate space, the virtual location different from a physical location of the first wearable head device.

15. A system comprising:

a sensor;

a first display;

a second display; and

one or more processors configured to execute a method comprising:

receiving, in a recording session at a first time, a first input from a first user, the first input indicative of a movement of the first user during the recording session;

determining, using the sensor, a first location associated with the first user in a coordinate space of a virtual environment;

generating a persistent virtual content corresponding to the first input, wherein the persistent virtual content comprises video of the movement of the first user, wherein the persistent virtual content is associated with the first location;

determining, at a second time, a second location of a second user in the coordinate space;

presenting, via the first display, the persistent virtual content to the second user, wherein the presenting the persistent virtual content to the second user comprises presenting the persistent virtual content at a location in the coordinate space based on the first location; and

presenting, via the second display, the persistent virtual content to a third user, wherein the presenting the persistent virtual content to the third user comprises presenting the persistent virtual content at a fourth location in the coordinate space, the fourth location based on the first location and based further on the second location.

16. The system of claim 15 , wherein the second location is determined via GPS.

17. The system of claim 15 , wherein the first input comprises at least one of a head movement of the first user, a hand movement of the first user, and a handheld controller input.

18. The system of claim 15 , wherein the sensor comprises at least one of a position sensor and a camera.

19. The system of claim 15 , further comprising a second sensor, wherein the determining whether to present the persistent virtual content to the second user comprises determining, using the second sensor, whether a field of view of the second user includes the first location.

20. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:

receiving, in a recording session at a first time, a first input from a first user, the first input indicative of a movement of the first user during the recording session;

determining, using a sensor of a first wearable head device, a first location associated with the first user in a coordinate space of a virtual environment;

generating a persistent virtual content corresponding to the first input, wherein the persistent virtual content comprises video of the movement of the first user, wherein the persistent virtual content is associated with the first location;

determining, at a second time, a second location of a second user in the coordinate space;

presenting, via a first display, the persistent virtual content to the second user, wherein the presenting the persistent virtual content to the second user comprises presenting the persistent virtual content at a location in the coordinate space based on the first location; and

presenting, via a second display, the persistent virtual content to a third user, wherein the presenting the persistent virtual content to the third user comprises presenting the persistent virtual content at a fourth location in the coordinate space, the fourth location based on the first location and based further on the second location.

Assignments (2)
SECURITY INTEREST Recorded Oct 24, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073255/0581 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: ARORA, TUSHAR; KRAMARICH, SCOTT
To: MAGIC LEAP, INC.
Reel/Frame 067156/0507 →
Continuity (4)
Continuation 16987144 · Aug 6, 2020
Provisional Application 62894448 · Aug 30, 2019
Provisional Application 62884153 · Aug 7, 2019
Related Publication 20230326153A1 · Oct 12, 2023
Cited By (1)
US 12,430,860