Granted Patent B2

US 11,562,542 · App. 17/115,536 · Granted Jan 24, 2023

Inventors: Haiyan Zhang (Richmond Hill, CA); Robert John Cummings MacDonald (White Rock, CA)

Assignee: Magic Leap, Inc.

G06T19/006G06F3/0482G06F3/04815G06F3/04817G06F9/542G06F9/547G06F16/954G06F16/9558

Abstract

Claims (61)

1. A method of operating a mixed reality system configured to render virtual content generated by executing an application, wherein the virtual content for the application is rendered within a prism managed by the system so as to be associated with the application, the method comprising:

receiving user input associated with a first application;

determining whether the first application is a native application or whether the first application is a browser;

in response to determining that the first application is a browser, rendering content from a link, with the browser by:

obtaining, with the link, information in a standardized form representing the content;

launching an instance of the browser linked to a prism, wherein the prism is a volume managed by the mixed reality system within which the content is to be displayed; and

based on the obtained information, rendering the content within the prism using the instance of the browser,

wherein receiving the user input associated with the first application comprises receiving a user selection of an icon associated with the link in a program launcher menu, wherein the program launcher menu also comprises at least one icon associated with the native application.

2. The method of claim 1 , wherein:

the mixed reality system comprises a portable electronic device;

the browser is executing on the portable electronic device; and

the method further comprises generating a prompt to a user of the portable electronic device to confirm rendering of the content.

3. The method of claim 1 , further comprising:

processing an installable entity, the processing comprising:

generating the icon associated with the link based on the installable entity; and

creating an entry in a registry associating the icon with the link.

4. The method of claim 3 , wherein:

the installable entity comprises a specification of the icon; and

generating the icon comprises rendering the icon based on the specification of the icon.

5. The method of claim 3 , wherein:

the installable entity comprises data specifying a web application; and

generating the icon comprises forming the icon based on the data specifying the web application.

6. The method of claim 3 , further comprising:

generating the installable entity based on user input associated with the installable entity, the generating comprising a command to install on the mixed reality system a web application associated with the link.

7. The method of claim 1 , wherein rendering the content within the prism comprises:

rendering the content free of navigation controls of the browser.

8. The method of claim 1 , wherein rendering the content within the prism comprises:

rendering 3D content based on a 3D model of the content downloaded from the link.

9. The method of claim 1 , wherein rendering the content within the prism comprises:

generating dynamic 3D content with the browser based on an animated 3D model of the content downloaded from the link.

10. The method of claim 1 , wherein rendering the content within the prism comprises:

at a first time, downloading and caching, on the mixed reality system, information specifying the content; and

at a second time, after the first time, rendering the content based on the cached information.

11. The method of claim 1 , wherein:

the information from the link in the standardized form representing the content is based in part on information obtained from a component of the mixed reality system; and

rendering the content from the link comprises prompting a user of the mixed reality system to authorize access to the component of the mixed reality system.

12. The method of claim 1 , wherein the prism comprises a user interface generated by the mixed reality system and configured to enable a user to control the prism.

13. A mixed reality system configured to render virtual content generated by a first application, wherein the virtual content for the application is rendered within a volume managed by the mixed reality system so as to be associated with the first application, the mixed reality system comprising:

a portable electronic device comprising:

one or more processors;

at least one computer readable medium comprising computer executable instructions that, when executed by a processor of the one or more processors:

receive user input associated with a first application, wherein the user input comprises receiving a user selection of an icon in a program launcher menu, the program launcher menu comprising an icon associated with a link and at least one icon associated with a native application;

determine whether the first application is the native application or whether the first application is a browser; and

render the virtual content within the volume using the first application by:

in response to determining that the first application is a browser, rendering content from the link, with the browser by:

obtaining information from the link in a standardized form representing the content; and

based on the obtained information, rendering the content within the volume, wherein the volume is managed by the mixed reality system so as to be associated with the browser; or

in response to determining that the first application is a native application, rendering virtual content generated by execution of the native application within the volume.

14. The mixed reality system of claim 13 , wherein the mixed reality system is configured such that the browser has access to hardware components of the portable electronic device.

15. The mixed reality system of claim 14 , wherein the hardware components of the portable electronic device to which the browser has access comprise hardware configured to obtain audio, video, or image data, or any combination thereof.

16. The mixed reality system of claim 15 , wherein the mixed reality system is configured such that the browser conditionally has access to the hardware components of the portable electronic device based on a permission received from a user of the portable electronic device prior to enabling access to the hardware components of the portable electronic device.

17. The mixed reality system of claim 13 , wherein the computer executable instructions, when executed by the processor of the one or more processors:

process an installable entity, the processing comprising:

generating an icon associated with the link based on the installable entity; and

creating an entry in a registry associating the icon with the link.

18. The mixed reality system of claim 17 , wherein:

the installable entity comprises a specification of the icon; and

generating the icon comprises rendering the icon based on the specification of the icon.

19. The mixed reality system of claim 17 , wherein:

the installable entity comprises data specifying a web application; and

generating the icon comprises forming an icon with information identifying the web application.

Assignments (3)

Continuity (2)

Cited By (10)

US 12,243,178 US 12,283,011 US 12,283,012 US 12,293,471 US 12,307,004 US 12,315,097 US 12,430,861 US 12,499,618 US 12,585,939 US 12,670,675