Granted Patent B2

US 12,474,767 · App. 18/306,387 · Granted Nov 18, 2025

Inventor: Rony Abovitz (Plantation, FL)

Assignee: Magic Leap, Inc.

G06F3/011G06F3/016G06F3/017A63F2300/10A63F2300/8082G09G2340/12G09G2340/125G09G2340/14G09G2354/00

Abstract

Claims (30)

1 . A system for enabling one or more users to interact with a virtual world, the system comprising:

a first wearable user device that includes:

memory;

processing circuitry;

software stored in the memory and executable by the processing circuitry to render at least a portion of the virtual world from virtual world data received, at least in part, from a computer network;

a structure that is attachable to body part of a first user;

a display operable to present the virtual world to the first user in a view of the first user;

a communications interface operable to communicate at least a portion of the virtual world data over a data network; and

a sensing system operable to sense and map one or more elements of a physical environment around the first user by detecting and registering a respective 3D reference frame in the physical environment of at least one static object of the physical environment, and at least one dynamic object of the physical environment or at least one gesture of the physical environment that moves relative to the at least one static object,

wherein the processing circuitry is operable to execute the software to render a change in the virtual world that includes a movement of a virtual object in the view of the first user with a location that is anchored to the respective 3D reference frame of the at least one dynamic object in the physical environment or the at least one gesture in the physical environment that moves relative to the at least one static object in the physical environment in the view of the first user and moves with and in response to the movement of the at least one dynamic object in the physical environment or the at least one gesture in the physical environment that moves relative to the at least one static object in the physical environment in the view of the first user, while tracking the movement and the location of the virtual object anchored to the respective 3D reference frame.

2 . The system according to claim 1 , wherein the communications interface is operable to communicate the virtual object to the computer network.

3 . The system according to claim 1 , wherein the virtual world is presented in at least one of a two-dimensional format or three-dimensional format in the view of the first user.

4 . The system according to claim 1 , wherein the first user device enables interaction in at least one of an augmented reality mode, a virtual reality mode, or a combination of augmented and virtual reality mode in the view of the first user.

5 . The system according to claim 1 , wherein the first user device further comprises a device for providing a haptic or tactile feedback.

6 . The system according to claim 1 , wherein at least a portion of the virtual world data is communicated between a gateway.

7 . The system according to claim 1 , the computer network comprising one or more computer servers, the one or more computer servers comprising memory, processing circuitry, and software stored in the memory and executable by the processing circuitry to process at least a portion of the virtual world data, the computer network operable to transmit the virtual world data to the first wearable user device for presentation to the first user in the view of the first user.

8 . The system according to claim 7 , further comprising:

a gateway operatively coupled to, and distinct from, the first wearable user device and the computer network and configured to monitor and regulate an exchange of virtual world data between the first wearable user device and the computer network to allow an optimum data processing of the first wearable user device, wherein the optimum data processing comprises prioritizing a plurality of renderings, such that processing a rendering of a dynamic virtual object is prioritized over a rendering of a static virtual object and processing a rendering of data in a field of view having less than sixty degrees forward of the angular measurement of the first user's pupil is prioritized over a rendering of data outside the field of view, where the plurality of renderings are performed by the gateway device and transmitted to the first wearable user device.

9 . The system according to claim 7 , wherein the sensing system is connected to the first wearable user device and includes a camera positioned to detect an angular measurement of a pupil of an eye of the first user.

10 . The system of claim 7 , wherein the sensing system is an environment-sensing system coupled to the first wearable user device configured to obtain data from the physical environment around the first user.

11 . The system of claim 10 , wherein the environment-sensing system detects key features of the static physical object external to the first user.

12 . The system of claim 11 , wherein the computer network receives data from the environment-sensing system to trigger a transmission of the virtual world data to the first wearable user device.

13 . The system according to claim 1 , wherein the system is configured such that at least a portion of the virtual world changes in the view of the first user in response to a change in the virtual world data in the view of the first user.

14 . The system according to claim 13 , wherein, in conjunction with the virtual world changes in response to a change in the virtual world data, at least a portion of the virtual world data is changed in the view of the first user in response to a static physical object external to the first user and sensed by the first wearable user device.

15 . The system according to claim 14 , wherein the static physical object external to the first user comprises a mapped object in a physical environment in vicinity of the first user.

16 . The system according to claim 13 , wherein the change in virtual world data represents rendering at least one of the dynamic virtual object and the static virtual object with the static physical object external to the first user according to a predetermined relationship.

17 . The system according to claim 1 , wherein the change in virtual world data is presented to a second user device for presentation to a second user according to the predetermined relationship.

18 . The system according to claim 1 , wherein the virtual world is operable to be rendered by at least one of the computer servers or the first wearable user device.

19 . The system according to claim 1 , wherein the first wearable user device is operable to provide an interface for enabling interaction between the first user and the virtual world in at least one of an augmented reality mode, a virtual reality mode, or a combination of augmented and virtual reality mode.

20 . The system of claim 1 , wherein the structure that is attachable to body part of the first user is configured to be a head-worn structure.

Assignments (2)

Continuity (7)

References Cited (319)