Granted Patent B2

US 12,495,094 · App. 18/444,315 · Granted Dec 9, 2025

Inventors: Praveen Babu J D (Plantation, FL); Karen Stolzenberg (Fort Lauderdale, FL); Jehangir Tajik (Fort Lauderdale, FL); Rohit Anil Talwalkar (Weston, FL); Colman Thomas Bryant (Fort Lauderdale, FL); Leonid Zolotarev (Weston, FL)

Assignee: Magic Leap, Inc.

H04L67/131G02B27/017G06T19/006H04L63/10H04L67/51H04L67/75H04W4/021

Abstract

Claims (56)

1 . A method comprising:

at a first wearable head device having a first processor, executing a first application via the first processor;

receiving, via one or more sensors of the first wearable head device, a first sensor input;

determining, based on the first sensor input, a first state of the first application;

generating a first scenegraph corresponding to the first state of the first application;

at a second wearable head device having a second processor, executing a second application via the second processor;

generating a second scenegraph corresponding to a first state of the second application;

at a host device, receiving 3D data, wherein the 3D data comprises data associated with the first scenegraph and data associated with the second scenegraph;

generating a centralized scenegraph based on the 3D data;

displaying, at the first wearable head device, first virtual content associated with the first application, the first virtual content rendered based on the centralized scenegraph; and

displaying, at the second wearable head device, second virtual content associated with the second application, the second virtual content rendered based on the centralized scenegraph, wherein:

the first application is configured to forgo displaying the second virtual content, and

the second application is configured to forgo displaying the first virtual content.

2 . The method of claim 1 , wherein the first application is installed on the first wearable head device and the first application is not installed on the second wearable head device.

3 . The method of claim 1 , wherein said generating the centralized scenegraph comprises traversing the centralized scenegraph by a renderer of the host device.

4 . The method of claim 3 , wherein the renderer is configured to apply one or more of lighting effects, shadow effects, shaders, particle effects, and physical effects to the centralized scenegraph.

5 . The method of claim 1 , further comprising writing information corresponding to the 3D data to a memory.

6 . The method of claim 1 , further comprising:

presenting the centralized scenegraph to the first wearable head device, and

in response to receiving a third scenegraph at the first device, rendering a view corresponding to the third scenegraph on a display of the first wearable head device.

7 . The method of claim 6 , further comprising receiving, from the first wearable head device, a request to present the centralized scenegraph, wherein:

the request to present the centralized scenegraph is generated in response to an interaction between the first wearable head device and a trigger, and

the first scenegraph is presented to the first wearable head device in response to receiving the request.

8 . The method of claim 7 , wherein the trigger comprises location information associated with the first wearable head device or a QR code.

9 . The method of claim 7 , wherein the request comprises an identification of the first application.

10 . The method of claim 1 , further comprising:

at the host device, receiving input from the first wearable head device;

determining, based on the input, a second state of the first application, the second state different than the first state;

generating a third scenegraph corresponding to the second state, the third scenegraph different than the first scenegraph;

at the host device, receiving second 3D data comprising data associated with the third scenegraph; and

updating the centralized scenegraph based on the second 3D data.

11 . The method of claim 10 , further comprising presenting the updated centralized scenegraph to the second wearable head device, wherein the second wearable head device is configured to, in response to receiving the updated centralized scenegraph, render to a display of the second wearable head device a view corresponding to the updated centralized scenegraph without executing the first application.

12 . The method of claim 10 , wherein the second 3D data comprises data representative of a change between the third scenegraph and the first scenegraph.

13 . The method of claim 1 , wherein the 3D data is received via a multi-threading technique.

14 . The method of claim 1 , wherein the host device comprises a server.

15 . The method of claim 1 , further comprising:

receiving, via the one or more sensors of the first wearable head device, a second sensor input, the second sensor input indicating an interaction with the first virtual content;

determining, based on the second sensor input, a second state of the first application; and

displaying, at the first wearable head device, third virtual content, the third virtual content rendered based on the centralized scenegraph and further based on the second state of the first application.

16 . A non-transitory machine readable medium storing instructions, which, when executed by a host device having one or more processors, cause the host device to perform a method comprising:

receiving 3D data, wherein the 3D data comprises data associated with a first scenegraph and data associated with a second scenegraph; and

generating a centralized scenegraph based on the 3D data,

wherein:

the first scenegraph corresponds to a first state of a first application executed at a first processor of a first wearable head device;

the first state of the first application is determined based on a first sensor input, the first sensor input received via one or more sensors of the first wearable head device;

the second scenegraph corresponds to a first state of a second application executed at a second processor of a second wearable head device;

first virtual content associated with the first application is displayed at the first wearable head device, the first virtual content rendered based on the centralized scenegraph;

second virtual content associated with the second application is displayed at the second wearable head device, the second virtual content rendered based on the centralized scenegraph;

the first application is configured to forgo displaying the second virtual content; and

the second application is configured to forgo displaying the first virtual content.

17 . The non-transitory machine readable medium of claim 16 , wherein the method further comprises presenting the centralized scenegraph to the first wearable head device and the second wearable head device.

18 . The non-transitory machine readable medium of claim 16 , wherein said generating the centralized scenegraph comprises traversing the centralized scenegraph by a renderer of the host device.

19 . The non-transitory machine readable medium of claim 16 , wherein the method further comprises:

receiving second 3D data comprising data associated with a third scenegraph, wherein the third scenegraph corresponds to a second state of the first application, the second state different than the first state; and

updating the centralized scenegraph based on the second 3D data.

20 . The non-transitory machine readable medium of claim 19 , wherein the second 3D data comprises data representative of a change between the third scenegraph and the first scenegraph.

Assignments (2)

Continuity (7)

References Cited (336)