IP Library Granted Patent US 12,131,500
Granted Patent B2
US 12,131,500 · App. 18/455,459 · Granted Oct 29, 2024

Systems and methods for augmented reality

Inventors: Michael Janusz Woods (Mountain View, CA); Andrew Rabinovich (San Francisco, CA)
Assignee: Magic Leap, Inc.
G06T7/74G06F3/011G06F3/012G06F3/013G06F3/014G06F3/0346G06F3/0481G06F3/04815G06F3/0482G06F3/0483G06F3/0484G06F3/04842G06T7/277G06T7/73G06T19/006G06T3/18G06T2207/10016G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,131,500
App. No.
18/455,459
Granted
Oct 29, 2024
Kind
B2
Abstract

Systems and methods for reducing error from noisy data received from a high frequency sensor by fusing received input with data received from a low frequency sensor by collecting a first set of dynamic inputs from the high frequency sensor, collecting a correction input point from the low frequency sensor, and adjusting a propagation path of a second set of dynamic inputs from the high frequency sensor based on the correction input point either by full translation to the correction input point or dampened approach towards the correction input point.

Claims (45)

1. A visualization system comprising:

a Helmholtz coil pair;

a current control system to activate current through the Helmholtz coil pair in an alternating manner between current at a direct current level and current at an alternating current level;

a magnetometer component positioned relative to the Helmholtz coil pair to produce a directly-readable output when the Helmholtz coil pair is activated at the direct current level;

an electromagnetic localization receiver coil positioned relative to the Helmholtz coil pair to produce a directly-readable output when the Helmholtz coil pair is activated at the alternating current level; and

a calibration system connected to the magnetometer component and the electromagnetic localization receiver coil and operable to characterize an orientation of the magnetometer component and the electromagnetic localization receiver coil relative to one another based on the directly readable outputs from the magnetometer component and the electromagnetic localization receiver coil.

2. The visualization system of claim 1 , wherein the calibration system characterizes the orientation of the magnetometer component and the electromagnetic localization receiver coil relative to one another based on an assumption that an orientation of an electromagnetic field created by the Helmholtz coil pair remains the same when switching between the current at the direct current level and the current at the alternating current level.

3. The visualization system of claim 1 , further comprising:

a head-mounted component, wherein the magnetometer component and the electromagnetic localization receiver coil are mounted to the head-mounted component.

4. The visualization system of claim 3 , further comprising:

a head-mounted component reorientation device connected between the head-mounted component and the Helmholtz coil pair and operable to reorient the head-mounted component relative to the Helmholtz coil pair.

5. The visualization system of claim 4 , wherein the head-mounted component reorientation device is an electromagnetic device.

6. The visualization system of claim 1 , further comprising:

fiducials connected to the Helmholtz coil pair; and

a sensor that detects the fiducials, wherein the calibration system determines an orientation of the Helmholtz coil pair based on locations of the fiducials.

7. The visualization system of claim 6 , wherein the fiducials are optical fiducials and the sensor is a camera sensor.

8. The visualization system of claim 1 , further comprising:

a first transmitter operable to transmit a first signal;

an ultrasound transmitter operable to transmit an ultrasound signal;

a first sensor operable to sense the first signal wherein the magnetometer component forms part of the first sensor;

an ultrasound microphone operable to sense the ultrasound signal, wherein the electromagnetic localization receiver coil forms part of the ultrasound microphone;

a delay measurement device connected between the first sensor and the ultrasound microphone and operable to determine a delay between receiving the first signal and receiving the ultrasound signal, wherein the calibration system is connected to the delay measurement device and operable to calibrate the first signal based on the delay; and

a sensor digital processing unit connected to the first sensor to receive the first signal and operable to analyze the first signal to determine a location of the first transmitter and the first sensor relative to one another.

9. The visualization system of claim 7 , further comprising:

a head-mounted display unit; and

a hand-held totem, wherein the first transmitter is located on the hand-held totem and the first sensor is located on the head-mounted display unit.

10. The visualization system of claim 9 , wherein the second transmitter is located on the a hand-held totem and the second sensor is located on the head-mounted display unit.

11. The visualization system of claim 9 , wherein the head-mounted display unit has a see-through display for a user to see the totem.

12. The visualization system of claim 1 , further comprising:

a head-mounted display unit; and

a processing module that creates a display object though a display of the head-mounted display unit based on an output of the sensor digital processing unit.

13. A visualization system comprising:

a head-mounted component;

a Helmholtz coil pair;

a current control system to activate current through the Helmholtz coil pair in an alternating manner between current at a direct current level and current at an alternating current level;

a magnetometer component mounted to the head-mounted component and positioned relative to the Helmholtz coil pair to produce a directly-readable output when the Helmholtz coil pair is activated at the direct current level;

an electromagnetic localization receiver coil mounted to the head-mounted component and positioned relative to the Helmholtz coil pair to produce a directly-readable output when the Helmholtz coil pair is activated at the alternating current level;

a calibration system connected to the magnetometer component and the electromagnetic localization receiver coil and operable to characterize an orientation of the magnetometer component and the electromagnetic localization receiver coil relative to one another based on the directly readable outputs from the magnetometer component and the electromagnetic localization receiver coil, wherein the calibration system characterizes the orientation of the magnetometer component and the electromagnetic localization receiver coil relative to one another based on an assumption that an orientation of an electromagnetic field created by the Helmholtz coil pair remains the same when switching between the current at the direct current level and the current at the alternating current level;

an electromagnetic head-mounted component reorientation device connected between the head-mounted component and the Helmholtz coil pair and operable to reorient the head-mounted component relative to the Helmholtz coil pair.

14. A visualization method comprising:

activating current through a Helmholtz coil pair in an alternating manner between current at a direct current level and current at an alternating current level;

producing a directly-readable output from a magnetometer component positioned relative to the Helmholtz coil pair when the Helmholtz coil pair is activated at the direct current level;

producing a directly-readable output from an electromagnetic localization receiver coil positioned relative to the Helmholtz coil pair when the Helmholtz coil pair is activated at the alternating current level; and

characterizing an orientation of the magnetometer component and the electromagnetic localization receiver coil relative to one another based on the directly readable outputs from the magnetometer component and the electromagnetic localization receiver coil.

15. The method of claim 14 , wherein the orientation of the magnetometer component and the electromagnetic localization receiver coil relative to one another is characterized based on an assumption that an orientation of an electromagnetic field created by the Helmholtz coil pair remains the same when switching between the current at the direct current level and the current at the alternating current level.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073430/0225 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073008/0696 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2023
From: WOODS, MICHAEL JANUSZ; RABINOVICH, ANDREW
To: MAGIC LEAP, INC.
Reel/Frame 064833/0084 →