Granted Patent B2

US 12,689,666 · App. 18/805,776 · Granted Jul 21, 2026

Inventor: Samuel A. Miller (Hollywood, FL)

Assignee: Magic Leap, Inc.

H04L65/4015A63F13/35A63F13/92G06F3/013G06F3/016G06F3/017G06F16/954G06T19/006H04L67/02H04L67/131A63F2300/1093A63F2300/5553A63F2300/577A63F2300/6607A63F2300/695A63F2300/8082G02B2027/0141G06F3/005H04L69/14

Abstract

Claims (44)

1 . A method comprising:

receiving, at a computer network comprising one or more computing devices, a gesture input from an interface of a touch screen in communication with a user device, the user device in communication with the computer network via a wireless mobile network connection, the gesture input representing a user interaction with a virtual world;

receiving, at the computer network, a second input via an environment-sensing system of the user device, from a local environment of the user device; and

generating second virtual world data based on first virtual world data and further based on the gesture input and the second input;

wherein:

the touch screen is configured to present, based on the second virtual world data, virtual content of the virtual world to a user of the user device,

said presenting the virtual content to the user comprises presenting a visual rendering of the virtual content in a 3D format, and

presenting the visual rendering of the virtual content in the 3D format comprises presenting the visual rendering to the user via the touch screen based on a position and an orientation of the user device.

2 . The method of claim 1 , wherein the user device comprises a tablet that comprises the touch screen.

3 . The method of claim 1 , wherein the user device comprises a smartphone that comprises the touch screen.

4 . The method of claim 1 , wherein the gesture input comprises a finger gesture.

5 . The method of claim 4 , wherein the gesture input comprises typing.

6 . The method of claim 4 , wherein said generating second virtual world data comprises creating a new virtual object in the virtual world based on the finger gesture.

7 . The method of claim 1 , wherein the gesture input comprises motion capture data received via a motion capture system.

8 . The method of claim 7 , further comprising presenting a visual rendering of the user based on data provided via the motion capture system.

9 . The method of claim 1 , further comprising presenting a rendering of the gesture input to the user via a virtual monitor.

10 . The method of claim 1 , wherein the second input received via the environment-sensing system of the user device comprises a second gesture input different from the first gesture input.

11 . A system comprising:

a computer network configured to communicate with a user device via a wireless mobile network connection, the computer network comprising:

one or more computing devices; and

one or more processors configured to perform a method comprising:

receiving a gesture input from an interface of a touch screen in communication with the user device, the gesture input representing a user interaction with a virtual world;

receiving a second input via an environment-sensing system of the user device from a local environment of the user device; and

generating second virtual world data based on first virtual world data and further based on the gesture input and the second input;

wherein:

the touch screen is configured to present, based on the second virtual world data, virtual content of the virtual world to a user of the user device,

said presenting the virtual content to the user comprises presenting a visual rendering of the virtual content in a 3D format, and

presenting the visual rendering of the virtual content in the 3D format comprises presenting the visual rendering to the user via the touch screen based on a position and an orientation of the user device.

12 . The system of claim 11 , wherein the user device comprises a tablet that comprises the touch screen.

13 . The system of claim 11 , wherein the user device comprises a smartphone that comprises the touch screen.

14 . The system of claim 11 , wherein the gesture input comprises a finger gesture.

15 . The system of claim 14 , wherein the gesture input comprises typing.

16 . The system of claim 14 , wherein said generating second virtual world data comprises creating a new virtual object in the virtual world based on the finger gesture.

17 . The system of claim 11 , wherein the gesture input comprises motion capture data received via a motion capture system.

18 . The system of claim 11 , further comprising presenting a rendering of the gesture input to the user via a virtual monitor.

19 . The system of claim 11 , wherein the second input received via the environment-sensing system of the user device comprises a second gesture input different from the first gesture input.

20 . A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:

receiving, at a computer network comprising one or more computing devices, a gesture input from an interface of a touch screen in communication with a user device, the user device in communication with the computer network via a wireless mobile network connection, the gesture input representing a user interaction with a virtual world;

receiving, at the computer network, a second input via an environment-sensing system of the user device, from a local environment of the user device; and

generating second virtual world data based on first virtual world data and further based on the gesture input and the second input;

wherein:

the touch screen is configured to present, based on the second virtual world data, virtual content of the virtual world to a user of the user device,

said presenting the virtual content to the user comprises presenting a visual rendering of the virtual content in a 3D format, and

presenting the visual rendering of the virtual content in the 3D format comprises presenting the visual rendering to the user via the touch screen based on a position and an orientation of the user device.

Assignments (2)

Continuity (13)

References Cited (215)