IP Library Granted Patent US 11,830,151
Granted Patent B2
US 11,830,151 · App. 17/241,977 · Granted Nov 28, 2023

Methods and system for managing and displaying virtual content in a mixed reality system

Inventors: June Tate-Gans (Tamarac, FL); Eric Norman Yiskis (Boca Raton, FL); Mark Ashley Rushton (Fort Lauderdale, FL); David William Hover (Tamarac, FL); Praveen Babu J D (Plantation, FL)
Assignee: Magic Leap, Inc.
G06T19/006G06T7/70G06T15/08G06T19/20G06T2210/12G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,830,151
App. No.
17/241,977
Granted
Nov 28, 2023
Kind
B2
Abstract

Disclosed is an approach for managing and displaying virtual content in a mixed reality environment on a one-on-one basis independently by each application, each virtual content is rendered by its respective application into a bounded volume referred herein as a “Prism.” Each Prism may have characteristics and properties that allow a universe application to manage and display the Prism in the mixed reality environment such that the universe application may manage the placement and display of the virtual content in the mixed reality environment by managing the Prism itself.

Claims (50)

1. A method for displaying virtual content in a 3D spatial environment, the method comprising:

receiving, from an application, a request to display a virtual content in a 3D spatial environment;

creating a prism, wherein the prism is a volume of space configured to bound the virtual content inside a boundary of the prism, the prism having pre-programmed key-values callable by the application for managing the display of the virtual content by the application;

receiving the virtual content from the application; and

rendering the virtual content inside the boundaries of the prism.

2. The method of claim 1 , wherein boundaries of the prism are not displayed.

3. The method of claim 1 , wherein the 3D spatial environment is a physical real world environment of a user.

4. The method of claim 1 , wherein the prism is created automatically having a set of functionalities.

5. The method of claim 1 , further comprising:

associating the prism to an object in the 3D spatial environment.

6. The method of claim 5 , wherein the prism is created automatically having a set of functionalities and the set of functionalities comprises an association between the prism and the object in the 3D spatial environment.

7. The method of claim 6 , wherein the set of functionalities further comprises one or more of: a minimum size allowed for the prism; maximum size allowed for the prism; and an aspect ratio for resizing the prism.

8. The method of claim 1 , further comprising:

creating a second prism different from the prism, wherein the second prism is a 3D volume of space configured to provide an outer boundary for the display of a second virtual content therein; and

the application rendering the second virtual content into the second prism.

9. The method of claim 8 , wherein the prism and the second prism do not overlap with each other.

10. The method of claim 1 , wherein the prism is placed in context to an object in the 3D spatial environment.

11. The method of claim 10 , wherein the object is a user of an augmented reality device.

12. The method of claim 1 , wherein the prism comprises:

one or more universal features;

one or more application-specific features; and

wherein the one or more universal features and the one or more application-specific features are selected from a list of pre-approved options.

13. The method of claim 12 , wherein the one or more universal features ensure different applications interact in a consistent manner with one another.

14. The method of claim 1 , wherein the prism occupies less than an entire user's landscape being displayed to a user.

15. A display system for displaying virtual content in a 3D spatial environment, the display system comprising:

an augmented reality head-mounted display system; and

one or more modules for processing data, wherein the one or more modules are stored in one or more memory, the one or more modules configured to perform the following process:

receiving, from an application, a request to display a virtual content in a 3D spatial environment,

creating a prism, wherein the prism is a volume of space configured to bound the virtual content inside a boundary of the prism, the prism having pre-programmed key-values callable by the application for managing the display of the virtual content by the application,

receiving the virtual content from the application, and

rendering the virtual content inside the boundaries of the prism.

16. The display system of claim 15 , wherein boundaries of the prism are not displayed.

17. The display system of claim 15 , wherein the 3D spatial environment is a physical real world environment of a user.

18. The display system of claim 15 , wherein the prism is created automatically having a set of functionalities.

19. The display system of claim 15 , wherein the process further comprises:

associating the prism to an object in the 3D spatial environment.

20. The display system of claim 19 , wherein the prism is created automatically having a set of functionalities and the set of functionalities comprises an association between the prism and the object in the 3D spatial environment.

21. The display system of claim 20 , wherein the set of functionalities further comprises one or more of: a minimum size allowed for the prism; maximum size allowed for the prism; and an aspect ratio for resizing the prism.

22. The display system of claim 15 , wherein the process further comprises:

creating a second prism different from the prism, wherein the second prism is a 3D volume of space configured to provide an outer boundary for the display of a second virtual content therein; and

the application rendering the second virtual content into the second prism.

23. The display system of claim 22 , wherein the prism and the second prism do not overlap with each other.

24. The display system of claim 15 , wherein the prism is placed in context to an object in the 3D spatial environment.

25. The display system of claim 24 , wherein the object is a user of an augmented reality device.

26. The display system of claim 15 , wherein the prism comprises:

one or more universal features;

one or more application-specific features; and

wherein the one or more universal features and the one or more application-specific features are selected from a list of pre-approved options.

27. The display system of claim 26 , wherein the one or more universal features ensure different applications interact in a consistent manner with one another.

28. The display system of claim 15 , wherein the prism occupies less than an entire user's landscape being displayed to the user.

Assignments (2)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0476 →
Continuity (3)
Continuation 16224719 · Dec 18, 2018
Provisional Application 62610101 · Dec 22, 2017
Related Publication 20210248831A1 · Aug 12, 2021