IP Library › Granted Patent US 12,207,888
Granted Patent B2
US 12,207,888 · App. 17/345,392 · Granted Jan 28, 2025

Magnetic tracking calibration via distortion correction for electromagnetic fields using inside-out tracking

Inventors: Mark Robert Schneider (Williston, VT); Alec Duling (Milton, VT); Syamprasad Karyattuparambil Rajagopalan (Burlington, VT)
Assignee: Northern Digital Inc.
A61B34/20A61B5/062A61B90/39G01D5/12A61B2034/2051A61B2034/2055A61B2034/2061A61B2034/2063A61B2090/397
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,207,888
App. No.
17/345,392
Granted
Jan 28, 2025
Kind
B2
Abstract

A magnetic tracking device is configured to track an object in an environment by receiving a measurement of the non-magnetic signal and a corresponding measurement of the magnetic signal for a location of the magnetic tracking device in the environment. The magnetic tracking device estimates, based on the measurement of the non-magnetic signal, a non-magnetic pose of the magnetic tracking device in the environment for the location. The device estimates, based on the measurement of the magnetic signal, a magnetic pose of the magnetic tracking device in the environment for the location. The device determines a difference between the magnetic pose estimate and the non-magnetic pose estimate for the location. The device determines a magnetic distortion correction value for the location based on the difference. The magnetic tracking device generates a distortion correction model including the distortion value and outputs a representation of the distortion correction model.

Claims (39)

1. A magnetic tracking system for determining an object pose of a tracked object in an environment of the magnetic tracking system, the magnetic tracking system comprising:

a scaffold;

a magnetic tracking device comprising:

a non-magnetic signal detector configured to measure a non-magnetic signal in the environment, wherein the non-magnetic signal is generated using a set of optical markers that are reconfigurable for placement at different locations within the environment; and

a magnetic signal detector configured to measure a magnetic signal in the environment, the magnetic signal detector being coupled to the non-magnetic signal detector, wherein the non-magnetic signal detector comprises a camera, and wherein the camera and the magnetic signal detector are movable to different portions of the scaffold within the environment to capture images of the optical markers at the different locations within the environment that are placed at known relative distances to one another based on a position of the scaffold;

a computing device configured to perform operations comprising:

receive a set of measurements of the non-magnetic signal and a corresponding measurement of the magnetic signal by moving the magnetic tracking device to a set of different locations in the environment at which one or more optical markers of the set of optical markers that are placed;

estimate, based on the set of measurements of the non-magnetic signal, a non-magnetic pose of the magnetic tracking device at the set of different locations in the environment,

estimate, based on the measurement of the magnetic signal, a magnetic pose of the magnetic tracking device in the environment for the set of different locations,

determine a difference between the magnetic pose estimate and the non-magnetic pose estimate for each location of the set of different locations;

determine a magnetic distortion correction value for each location of the set of different locations based on the difference at each of the different locations;

generate a distortion correction model including the magnetic distortion correction value for each of the different locations;

refine the distortion correction model by:

rearranging one or more sources of the non-magnetic signal in the environment;

receiving an updated a measurement of the non-magnetic signal based on the rearranged one or more sources of the non-magnetic signal; and

updating the distortion correction model using the updated measurement; and

output a representation of the distortion correction model.

2. The magnetic tracking system of claim 1 , wherein the marker comprises an outer shape, the outer shape being distinct from other outer shapes of other markers of a plurality of markers in the environment.

3. The magnetic tracking system of claim 1 , wherein the marker comprises an adhesive configured to removably affix the marker to another surface in the environment.

4. The magnetic tracking system of claim 1 , wherein the marker comprises an infrared retroreflector, and wherein the non-magnetic signal detector comprises an infrared source.

5. The magnetic tracking system of claim 1 , wherein the non-magnetic signal comprises one of an ArUco pattern, a ChArUco pattern, a light source, an ultrasonic source, a radio signal source, or an outer shape of a transmitter assembly.

6. The magnetic tracking system of claim 1 , wherein the magnetic signal is generated by a transmitter assembly comprising:

a memory configured to store calibration data related to the transmitter assembly;

a processing device configured to control transmission of the magnetic signal from the transmitter assembly;

a communication interface for sending and receiving data from the computing device; and

a power source configured to provide electrical power to the memory, the processing device, and the communication interface.

7. The magnetic tracking system of claim 1 , wherein the operations further comprise:

tracking a tracked object by performing operations comprising:

receiving a measurement of the magnetic signal at a particular location in the environment;

retrieving the distortion correction model from a memory in communication with the computing device;

determining a particular pose estimate for the tracked object;

correcting the particular pose estimate based on a value of the distortion correction model corresponding to the particular location; and

outputting a representation of the corrected particular pose estimate.

8. The magnetic tracking system of claim 7 , wherein the tracked object comprises one of a catheter, an endoscope, or a surgical instrument.

9. The magnetic tracking system of claim 1 , wherein the operations further comprise:

receiving a plurality of measurements of the magnetic signal corresponding to a planar surface of the environment, the planar surface being associated with the scaffold that is positioned at a known location in the environment;

for each measurement of the plurality of measurements of the magnetic signal, retrieving a predetermined correction value associated with a location of the measurement in the environment;

determining, a distortion correction value for each measurement; and

including the distortion correction value for each measurement in the distortion correction model.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE THIRD ASSIGNOR'S NAME ON THE COVER SHEET PREVIOUSLY RECORDED AT REEL: 063090 FRAME: 0457. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 11, 2023
From: SCHNEIDER, MARK ROBERT; DULING, ALEC; KARYATTUPARAMBIL RAJAGOPALAN, SYAMPRASAD
To: ASCENSION TECHNOLOGY CORPORATION
Reel/Frame 063422/0681 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2023
From: SCHNEIDER, MARK ROBERT; DULING, ALEC; KARYATTUPARAMBIL RAJAGOPALAN, SYAMPRASAD KARYATTUPARAMBIL
To: ASCENSION TECHNOLOGY CORPORATION
Reel/Frame 063090/0457 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2021
From: ASCENSION TECHNOLOGY CORPORATION
To: NORTHERN DIGITAL, INC.
Reel/Frame 057505/0669 →
Continuity (2)
Provisional Application 63038702 · Jun 12, 2020
Related Publication 20210386485A1 · Dec 16, 2021
References Cited (34)
US 6288785B1 · Frantz et al. · 2001 [cited by applicant]
US 8526688B2 · Groszmann et al. · 2013 [cited by applicant]
US 8700376B2 · Ophir et al. · 2014 [cited by applicant]
US 9165114B2 · Jain et al. · 2015 [cited by applicant]
US 9733336B2 · Shen et al. · 2017 [cited by applicant]
US 10064687B2 · Haimerl et al. · 2018 [cited by applicant]
US 10095815B2 · Efrat et al. · 2018 [cited by applicant]
US 20050027192A1 · Govari et al. · 2005 [cited by applicant]
US 20060258938A1 · Hoffman et al. · 2006 [cited by applicant]
US 20090264740A1 · Markowitz et al. · 2009 [cited by applicant]
US 20100168556A1 · Shen et al. · 2010 [cited by applicant]
US 20190242952A1 · Schneider et al. · 2019 [cited by applicant]
US 20200242339A1 · Bustan · 2020 [cited by examiner]
US 20200372409A1 · Srivastava · 2020 [cited by examiner]
US 20210096001A1 · Schneider · 2021 [cited by applicant]
CN 1901835 · 2007 [cited by applicant]
CN 1976638 · 2007 [cited by applicant]
CN 102871662 · 2013 [cited by applicant]
CN 105030331 · 2015 [cited by applicant]
CN 105222772 · 2016 [cited by applicant]
CN 103313675 · 2017 [cited by applicant]
CN 107072740 · 2017 [cited by applicant]
CN 210077846 · 2020 [cited by applicant]
CN 109620408 · 2020 [cited by applicant]
EP 3351201 · 2018 [cited by applicant]
Borst, “Tracker calibration using tetrahedral mesh and tricubic spline models of warp,” IEEE Virtual Reality 2004, Chicago, IL, USA, Mar. 27-31, 2004, pp. 19-26. [cited by applicant]
Bryson, “Measurement and calibration of static distortion of position data from 3D trackers,” Proceedings of the SPIE, Jun. 1992, 1669;244-255. [cited by applicant]
Ikits et al., “An Improved Calibration Framework for Electromagnetic Tracking Devices,” Proceedings IEEE Virtual Reality 2001, Mar. 13-17, 2001, 8 pages. [cited by applicant]
Kindratenko, “A survey of electromagnetic position tracker calibration techniques,” Virtual Reality, Sep. 2000, 5;169-182. [cited by applicant]
Matinfar et al., “Absolute vs relative error characterization of electromagnetic tracking accuracy,” Proceedings vol. 7625, Medical Imaging 2010: Visualization, Image-Guided Procedures, and Modeling, Feb. 23, 2010, 9 pa… [cited by applicant]
Much “Error Classification and Propagation for Electromagnetic Tracking,” Technische Universität München Fakultät für Informatik, Jan. 14, 2008, 102 pages. [cited by applicant]
Raymond-Jean-Baptiste, “Méthode de correction des erreurs de mesure appliquée à un système Fastrak 3SPACE,” École De Technologie Supérieure Université Du Québec, Nov. 11, 2009, 280 pages (Machine Translation). [cited by applicant]
Wu et al., “A Framework for Calibration of Electromagnetic Surgical Navigation Systems,” Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, Nevada, Oct. 27-31, 2003, 547-552. [cited by applicant]
Zachmann, “Distortion correction of magnetic fields for position tracking,” Proceedings Computer Graphics International, Jun. 23-27, 1997, pp. 213-220. [cited by applicant]