Granted Patent B2

US 12,386,417 · App. 18/168,797 · Granted Aug 12, 2025

Inventor: Michael Woods (Mountain View, CA)

Assignee: Magic Leap, Inc.

G06F3/012G01S19/42G06F3/017G06F3/0304G06F3/0346G06T19/006G02B27/017G02B2027/0187

Abstract

Claims (61)

1. An augmented reality (AR) display system, comprising:

a first component comprising an electromagnetic field emitter to emit a known magnetic field;

a second component comprising an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor as a result of the emitted known magnetic field;

a camera coupled to one of the first and second components, and which captures image data;

a controller for:

determining pose information relative to the electromagnetic field emitter based at least in part on the measured parameter related to the magnetic flux at the electromagnetic sensor, and

determining head pose information utilizing the image data;

communicating and adding the pose information and head pose information to a passable world model;

consulting the passable world model to determine virtual content to be displayed to a user based on the determined head pose and hand pose; and

a display system to display the determined virtual content to the user based at least in part on both the determined pose information relative to the electromagnetic field emitter and the head pose information,

wherein the pose information is different than the head pose information.

2. The system of claim 1 , wherein the first component is a hand-held component, and wherein the second component is a head-mounted component.

3. The system of claim 2 , wherein the hand-held component comprises a totem.

4. The system of claim 2 , wherein the head-mounted component comprises the display system.

5. The system of claim 1 , wherein the first component is a head-mounted component, and wherein the second component is a handheld component.

6. The system of claim 5 , wherein the hand-held component comprises a totem.

7. The system of claim 5 , wherein the hand-held component comprises a gaming component.

8. The system of claim 1 , wherein:

the electromagnetic sensor comprises at least three coils to measure magnetic flux in three directions; and

the at least three coils are integrated into the second component at different locations in the second component.

9. The system of claim 1 , wherein the head pose information determined utilizing the image data, is determined based at least in part on a SLAM analysis utilizing the image data.

10. The system of claim 1 , wherein the controller is configured to determine world coordinates of the electromagnetic sensor based at least in part on a SLAM analysis of the image data utilized to determine head pose information.

11. The system of claim 9 , further comprising inertial measurement units (IMUs) and wherein the head pose information determined utilizing the image data, is determined based at least in part on a SLAM analysis utilizing IMU data.

12. The system of claim 1 , wherein the pose information corresponds to at least a position and orientation of the electromagnetic field emitter relative to the world, and

the head pose information corresponds to at least a location and orientation of the user's head relative to the world.

13. The system of claim 1 , wherein the controller is configured to analyze the pose information to determine world coordinates corresponding to the electromagnetic field emitter.

14. The system of claim 1 , wherein the controller is configured to

detect an interaction with one or more virtual contents based at least in part on the pose information corresponding to the electromagnetic field emitter, and

instruct the display system to display virtual content to the user based at least in part on the detected interaction.

15. The system of claim 1 , further comprising an additional localization resource, wherein the controller is configured to determine world coordinates of the electromagnetic field emitter using at least additional localization information from the localization resource.

16. The system of claim 15 , wherein the additional localization resource comprises a GPS receiver.

17. The system of claim 15 , wherein the additional localization resource comprises a beacon.

18. The system of claim 1 , wherein the electromagnetic sensor comprises at least one of: a stack of ferrite disks; a plurality of ferrite rods each having a polymer coating; and a time division multiplexing switch.

19. An augmented reality (AR) display system, comprising:

an electromagnetic field emitter that emits a known magnetic field;

an electromagnetic sensor that measures a parameter related to a magnetic flux at the electromagnetic sensor as a result of the emitted known magnetic field;

a camera coupled to a head-mounted component, and which captures image data;

a controller that:

determines pose information relative to the electromagnetic field emitter based at least in part on the measured parameter related to the magnetic flux at the electromagnetic sensor, and

determines head pose information utilizing the image data; and

a display system that displays virtual content on to a user based at least in part on both the determined pose information relative to the electromagnetic field emitter and the head pose information, and

a control and release module adapted to decouple the head-mounted component from the electromagnetic sensor,

wherein the pose information is different than the head pose information.

20. An augmented reality (AR) display system, comprising:

a hand-held component comprising an electromagnetic field emitter to emit a known magnetic field;

a head-mounted component comprising an electromagnetic sensor that measures a parameter related to a magnetic flux at the electromagnetic sensor as a result of the emitted known magnetic field;

a camera coupled to the head-mounted component to capture image data;

a controller to:

receive magnetic field data from said hand-held component;

receive sensor data from the electromagnetic sensor of the head-mounted component;

determine pose information relative to the electromagnetic field emitter based at least in part on the measured parameter related to the magnetic flux at the electromagnetic sensor, and

determine head pose information utilizing the image data; and

a display system that displays virtual content to a user based at least in part on both the determined pose information relative to the electromagnetic field emitter and the head pose information,

wherein the pose information is different than the head pose information and

wherein the controller further determines a hand pose based at least in part on the received magnetic field data and the received sensor data and the display system modifies the virtual content displayed to the user based at least in part on the determined hand pose; and

a control and release module adapted to decouple the head-mounted component from the magnetic field emitted by the electromagnetic sensor, wherein the release module comprises an internal magnetic interface load.

21. The system of claim 19 , wherein the release module comprises an internal magnetic interface load.

22. The system of claim 19 , wherein the pose information corresponds to at least a position and orientation of the electromagnetic field emitter relative to the world, and

the head pose information corresponds to at least a location and orientation of the user's head relative to the world.

23. The system of claim 1 , wherein the communicating and adding the pose information and head pose information to a passable world model includes communicating wirelessly with a cloud network that contains the passable world model.

24. The system of claim 1 , wherein the electromagnetic sensor comprises a time division multiplexing switch.

Assignments (2)

Continuity (6)

References Cited (400)