IP Library › Granted Patent US 12,390,280
Granted Patent B2
US 12,390,280 · App. 14/903,381 · Granted Aug 19, 2025

Device and method for connecting a medical instrument to a position-detecting system

Inventors: Timo Kruger (Berlin, DE); Dirk Mucha (Berlin, DE)
Assignee: FIAGON GMBH
A61B34/20A61B2017/00477A61B2017/00725A61B2034/2051A61B2034/2068A61B2034/2072A61B2090/3983
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,390,280
App. No.
14/903,381
Granted
Aug 19, 2025
Kind
B2
Abstract

The invention relates to a device for connecting a medical instrument to a position-detecting system, the device having a localization element. The medical instrument has an instrument shaft, an instrument tip and an operating point. At least one localization element for determining position information for the device within a coordinate system of the position-detecting system can be provided on the device, the device having at least one retaining means for attaching the localization element to the medical instrument.

Claims (19)

1. A location-detecting system for determining location information of a medical instrument intraoperatively, the location-detecting system comprising:

a reference point, wherein a location of the reference point within a coordinate system of the location-detecting system is determinable; and

an instrument tracking device comprising at least one holding means for fastening the instrument tracking device to the medical instrument so that the medical instrument is connected to the location-detecting system, wherein said medical instrument comprises an instrument shaft and an instrument tip having a working point, said instrument tracking device comprising at least one localization element arranged on the instrument tracking device that is configured for use with the reference point and working point, wherein said reference point and said working point are not the same, to calibrate the at least one localization element to the working point, the at least one localization element comprising a sensor coil; and

a control unit for recording location data of the at least one localization element, wherein the instrument tracking device is connectable by a cable to the control unit so that the at least one localization element can transmit sensor signals representing said location data of the instrument tracking device and the medical instrument fastened thereto to the control unit, and wherein the location-detecting system is configured:

to detect location and orientation of the instrument tracking device within the coordinate system of the location-detecting system and

to automatically calibrate said localization element of the instrument tracking device to the working point of said medical instrument when the location-detecting system detects that the reference point lies within a search sector of the at least one localization element of the instrument tracking device fastened to the medical instrument, wherein the search sector is configured in a wedge shape, wherein the wedge is aligned coaxially with a longitudinal axis of the instrument, or aligned coaxially with a channel of the holding means, or both.

2. The location-detecting system according to claim 1 , wherein the at least one holding means comprises an instrument holder, wherein at least a subsection of the medical instrument is engageable with the instrument holder and is fastenable to the instrument holder by at least one fixing means of the instrument tracking device.

3. The location-detecting system according to claim 2 , wherein the fixing means comprises a screw, which is configured to be screwed into the instrument tracking device such that a flattened tip of the screw presses against a section of the instrument shaft thereby holding the medical instrument in the instrument holder.

4. The location-detecting system according to claim 2 , wherein the fixing means comprises a clamping device.

5. The location-detecting system according to claim 1 , wherein the instrument tracking device comprises a sensor holder configured to hold the localization element.

6. The location-detecting system according to claim 1 , wherein the localization element is arranged irreleasably on the at least one holding means.

7. The location-detecting system according to claim 1 , wherein the instrument tracking device comprises a cylindrical outer surface.

8. The location-detecting system according to claim 1 , wherein the at least one holding means comprises a channel extending in a longitudinal direction, wherein the channel is open at both end sides of the at least one holding means, and wherein at least the instrument tip of the medical instrument is passable through the channel.

9. The location-detecting system according to claim 8 , wherein the channel comprises an oval cross section.

10. A method for using the instrument tracking device of the location-detecting system according to claim 1 , wherein the instrument tracking device is fastened to the medical instrument and wherein the at least one localization element is calibrated to the working point of the medical instrument, the method comprising: approaching a reference point with the working point of the instrument tip, and simultaneously detecting the location and orientation of the localization element held on the medical instrument, and wherein when the working point of the instrument tip reaches the reference point, the working point is automatically calibrated, or automatic calibration is carried out when the working point remains at the reference point for a predetermined time.

11. The location-detecting system according to claim 1 , wherein the location-detecting system is configured to have as a starting condition for calibration of the localization element to the instrument tip to determine whether the reference point to be approached lies within the search sector.

12. The location-detecting system according to claim 1 , wherein the reference point is formed to have a depression configured to receive and self-center a corresponding medical instrument.

13. The location-detecting system according to claim 12 , wherein the depression further comprises a local indentation at a midpoint of the depression, wherein the local indentation has a radius smaller than the depression and is configured to receive an instrument tip.

14. The method according to claim 10 , wherein the search sector wedge has a tip that points toward, lies at a center of the localization element, or both.

Assignments (3)
CHANGE OF NAME Recorded Nov 29, 2023
From: INTERSECT ENT GMBH
To: FIAGON GMBH
Reel/Frame 065710/0229 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2022
From: FIAGON GMBH
To: INTERSECT ENT GMBH
Reel/Frame 059137/0218 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2016
From: KRUGER, TIMO; MUCHA, DIRK
To: FIAGON GMBH
Reel/Frame 037862/0532 →
Priority Claims (1)
DE 102013214067.3 · Jul 17, 2013 · national
Continuity (1)
Related Publication 20160143700A1 · May 26, 2016
References Cited (345)
US 4905698A · Strohl, Jr. et al. · 1990 [cited by applicant]
US 5554155A · Awh et al. · 1996 [cited by applicant]
US 5586989A · Bray, Jr. · 1996 [cited by applicant]
US 5840024A · Taniguchi et al. · 1998 [cited by applicant]
US 5944023A · Johnson et al. · 1999 [cited by applicant]
US 5964759A · Yamanashi et al. · 1999 [cited by applicant]
US 5971997A · Guthrie · 1999 [cited by examiner]
US 6011987A · Barnett · 2000 [cited by applicant]
US 6052610A · Koch · 2000 [cited by applicant]
US 6161032A · Acker · 2000 [cited by applicant]
US 6235038B1 · Hunter et al. · 2001 [cited by applicant]
US 6248074B1 · Ohno et al. · 2001 [cited by applicant]
US 6301495B1 · Gueziec et al. · 2001 [cited by applicant]
US 6347460B1 · Forrer · 2002 [cited by examiner]
US 6369564B1 · Khalfin · 2002 [cited by applicant]
US 6370420B1 · Kraft · 2002 [cited by applicant]
US 6432041B1 · Taniguchi et al. · 2002 [cited by applicant]
US 6611141B1 · Schulz et al. · 2003 [cited by applicant]
US 6618612B1 · Acker et al. · 2003 [cited by applicant]
US 6661571B1 · Shioda et al. · 2003 [cited by applicant]
US 6690960B2 · Chen et al. · 2004 [cited by applicant]
US 7043961B2 · Pandey · 2006 [cited by examiner]
US 7346417B2 · Luth et al. · 2008 [cited by applicant]
US 7474327B2 · Davidson et al. · 2009 [cited by applicant]
US 7491198B2 · Kockro · 2009 [cited by applicant]
US 8067726B2 · Groszmann · 2011 [cited by examiner]
US 8207863B2 · Neubauer et al. · 2012 [cited by applicant]
US 9208561B2 · Kruger et al. · 2015 [cited by applicant]
US 9333047B2 · Mucha · 2016 [cited by applicant]
US 9410802B2 · Mucha et al. · 2016 [cited by applicant]
US 9471850B2 · Krueger et al. · 2016 [cited by applicant]
US 9641808B2 · Rose et al. · 2017 [cited by applicant]
US 10022525B2 · Hanson et al. · 2018 [cited by applicant]
US 10238846B2 · Ressemann et al. · 2019 [cited by applicant]
US 10362966B2 · Kruger et al. · 2019 [cited by applicant]
US 10368851B2 · Tuma et al. · 2019 [cited by applicant]
US 10398512B2 · Mucha · 2019 [cited by applicant]
US 10512522B2 · Verard et al. · 2019 [cited by applicant]
US 10568713B2 · Kruger et al. · 2020 [cited by applicant]
US 11065061B2 · Makower · 2021 [cited by applicant]
US 11109915B2 · Mucha · 2021 [cited by applicant]
US 11123144B2 · Bustan et al. · 2021 [cited by applicant]
US 11337661B2 · Timo et al. · 2022 [cited by applicant]
US 11357574B2 · Timo et al. · 2022 [cited by applicant]
US 20010021806A1 · Gueziec et al. · 2001 [cited by applicant]
US 20030040670A1 · Govari · 2003 [cited by applicant]
US 20030059097A1 · Abovitz et al. · 2003 [cited by applicant]
US 20030066538A1 · Martinelli et al. · 2003 [cited by applicant]
US 20030069588A1 · Vilsmeier et al. · 2003 [cited by applicant]
US 20030209096A1 · Pandey · 2003 [cited by examiner]
US 20030229279A1 · Amstutz et al. · 2003 [cited by applicant]
US 20030231793A1 · Crampton · 2003 [cited by applicant]
US 20040019274A1 · Galloway, Jr. et al. · 2004 [cited by applicant]
US 20040024309A1 · Ferre et al. · 2004 [cited by applicant]
US 20040054489A1 · Moctezuma De La Barrera · 2004 [cited by examiner]
US 20040073279A1 · Malackowski et al. · 2004 [cited by applicant]
US 20040082849A1 · Schweikard · 2004 [cited by applicant]
US 20040143183A1 · Toyoda et al. · 2004 [cited by applicant]
US 20040169673A1 · Crampe et al. · 2004 [cited by applicant]
US 20040199072A1 · Sprouse et al. · 2004 [cited by applicant]
US 20040230199A1 · Jansen et al. · 2004 [cited by applicant]
US 20040263535A1 · Birkenbach et al. · 2004 [cited by applicant]
US 20050020909A1 · Moctezuma De La Barrera et al. · 2005 [cited by applicant]
US 20050024043A1 · Govari · 2005 [cited by applicant]
US 20050054895A1 · Hoeg et al. · 2005 [cited by applicant]
US 20050085717A1 · Shahidi · 2005 [cited by applicant]
US 20050085720A1 · Jascob et al. · 2005 [cited by applicant]
US 20050101966A1 · Lavallee · 2005 [cited by applicant]
US 20050107687A1 · Anderson · 2005 [cited by applicant]
US 20050119639A1 · McCombs et al. · 2005 [cited by applicant]
US 20050149050A1 · Stifter et al. · 2005 [cited by applicant]
US 20050187562A1 · Grimm · 2005 [cited by examiner]
US 20050215854A1 · Ozaki et al. · 2005 [cited by applicant]
US 20050228270A1 · Lloyd et al. · 2005 [cited by applicant]
US 20050228274A1 · Boese et al. · 2005 [cited by applicant]
US 20050288576A1 · Fegert et al. · 2005 [cited by applicant]
US 20060033679A1 · Gunji · 2006 [cited by applicant]
US 20060058604A1 · Avinash et al. · 2006 [cited by applicant]
US 20060100526A1 · Yamamoto et al. · 2006 [cited by applicant]
US 20060122497A1 · Glossop · 2006 [cited by applicant]
US 20060161059A1 · Wilson · 2006 [cited by applicant]
US 20060211914A1 · Hassler, Jr. et al. · 2006 [cited by applicant]
US 20060241397A1 · Govari et al. · 2006 [cited by applicant]
US 20060264749A1 · Weiner et al. · 2006 [cited by applicant]
US 20060271056A1 · Terrill-Grisoni et al. · 2006 [cited by applicant]
US 20070034731A1 · Falco · 2007 [cited by applicant]
US 20070070194A1 · Abe · 2007 [cited by applicant]
US 20070106114A1 · Sugimoto et al. · 2007 [cited by applicant]
US 20070111726A1 · Lambert et al. · 2007 [cited by applicant]
US 20070135803A1 · Belson · 2007 [cited by applicant]
US 20070167754A1 · Okuno et al. · 2007 [cited by applicant]
US 20070182729A1 · Klingenbeck-Regn et al. · 2007 [cited by applicant]
US 20070197896A1 · Moll et al. · 2007 [cited by applicant]
US 20070287905A1 · Klingenbeck-Regn · 2007 [cited by applicant]
US 20080009697A1 · Haider et al. · 2008 [cited by applicant]
US 20080021317A1 · Sumanaweera · 2008 [cited by examiner]
US 20080071142A1 · Gattani et al. · 2008 [cited by applicant]
US 20080077158A1 · Haider et al. · 2008 [cited by applicant]
US 20080103509A1 · Goldbach · 2008 [cited by applicant]
US 20080121703A1 · Li et al. · 2008 [cited by applicant]
US 20080125720A1 · Kim · 2008 [cited by examiner]
US 20080132932A1 · Hoeppner et al. · 2008 [cited by applicant]
US 20080139916A1 · Maier et al. · 2008 [cited by applicant]
US 20080162074A1 · Schneider · 2008 [cited by applicant]
US 20080204000A1 · Groszmann · 2008 [cited by examiner]
US 20080218588A1 · Stetten · 2008 [cited by applicant]
US 20080221442A1 · Tolkowsky et al. · 2008 [cited by applicant]
US 20080228188A1 · Birkbeck et al. · 2008 [cited by applicant]
US 20080228195A1 · von Jako et al. · 2008 [cited by applicant]
US 20080255442A1 · Ashby et al. · 2008 [cited by applicant]
US 20080262345A1 · Fichtinger et al. · 2008 [cited by applicant]
US 20080275334A1 · Berting · 2008 [cited by applicant]
US 20080287802A1 · Li et al. · 2008 [cited by applicant]
US 20080294034A1 · Krueger et al. · 2008 [cited by applicant]
US 20080319448A1 · Lavallee et al. · 2008 [cited by applicant]
US 20090030428A1 · Omori et al. · 2009 [cited by applicant]
US 20090068620A1 · Knobel et al. · 2009 [cited by applicant]
US 20090069671A1 · Anderson · 2009 [cited by applicant]
US 20090154293A1 · Sengupta et al. · 2009 [cited by applicant]
US 20090192519A1 · Omori · 2009 [cited by applicant]
US 20090228813A1 · Sekiguchi · 2009 [cited by applicant]
US 20090234329A1 · Inamoto et al. · 2009 [cited by applicant]
US 20090306499A1 · Van Vorhis et al. · 2009 [cited by applicant]
US 20100019918A1 · Avital · 2010 [cited by examiner]
US 20100121174A1 · Osadchy et al. · 2010 [cited by applicant]
US 20100137707A1 · Hunter et al. · 2010 [cited by applicant]
US 20100160771A1 · Gielen et al. · 2010 [cited by applicant]
US 20100210939A1 · Hartmann et al. · 2010 [cited by applicant]
US 20100220914A1 · Iwase et al. · 2010 [cited by applicant]
US 20100228117A1 · Hartmann · 2010 [cited by examiner]
US 20100229118A1 · Dorn et al. · 2010 [cited by applicant]
US 20100234724A1 · Jacobsen · 2010 [cited by examiner]
US 20100249506A1 · Prisco · 2010 [cited by applicant]
US 20100274188A1 · Chang et al. · 2010 [cited by applicant]
US 20100307516A1 · Neubauer et al. · 2010 [cited by applicant]
US 20100312247A1 · Tuma · 2010 [cited by applicant]
US 20110015523A1 · Sabata · 2011 [cited by applicant]
US 20110054449A1 · Tien et al. · 2011 [cited by applicant]
US 20110060213A1 · Mire et al. · 2011 [cited by applicant]
US 20110066029A1 · Lyu et al. · 2011 [cited by applicant]
US 20110118557A1 · McKenna et al. · 2011 [cited by applicant]
US 20110137156A1 · Razzaque et al. · 2011 [cited by applicant]
US 20110178389A1 · Kumar et al. · 2011 [cited by applicant]
US 20110270083A1 · Shen · 2011 [cited by applicant]
US 20110288600A1 · Ritchey et al. · 2011 [cited by applicant]
US 20110295329A1 · Fitz et al. · 2011 [cited by applicant]
US 20110313414A1 · Liu et al. · 2011 [cited by applicant]
US 20120007747A1 · Boike et al. · 2012 [cited by applicant]
US 20120143050A1 · Heigl · 2012 [cited by applicant]
US 20120157887A1 · Fanson · 2012 [cited by examiner]
US 20120168587A1 · Karsak et al. · 2012 [cited by applicant]
US 20120188352A1 · Wittenberg et al. · 2012 [cited by applicant]
US 20130023730A1 · Kitamura et al. · 2013 [cited by applicant]
US 20130060146A1 · Yang et al. · 2013 [cited by applicant]
US 20130060278A1 · Bozung et al. · 2013 [cited by applicant]
US 20140005555A1 · Tesar · 2014 [cited by applicant]
US 20140051922A1 · Guthart et al. · 2014 [cited by applicant]
US 20140148808A1 · Inkpen et al. · 2014 [cited by applicant]
US 20140200621A1 · Malackowski et al. · 2014 [cited by applicant]
US 20140275985A1 · Walker · 2014 [cited by examiner]
US 20140275987A1 · Bzostek et al. · 2014 [cited by applicant]
US 20140303489A1 · Meier et al. · 2014 [cited by applicant]
US 20140317910A1 · Govari et al. · 2014 [cited by applicant]
US 20150182297A1 · Sandhu et al. · 2015 [cited by applicant]
US 20160100899A1 · Jinno et al. · 2016 [cited by applicant]
US 20160175543A1 · Frankhouser et al. · 2016 [cited by applicant]
US 20160213430A1 · Mucha · 2016 [cited by applicant]
US 20160249986A1 · Kruger et al. · 2016 [cited by applicant]
US 20160310041A1 · Jenkins et al. · 2016 [cited by applicant]
US 20160331269A1 · Kruger et al. · 2016 [cited by applicant]
US 20170028112A1 · Drontle et al. · 2017 [cited by applicant]
US 20170196508A1 · Hunter · 2017 [cited by applicant]
US 20170258526A1 · Lang · 2017 [cited by applicant]
US 20170270678A1 · Masumoto · 2017 [cited by applicant]
US 20180021092A2 · Tausch et al. · 2018 [cited by applicant]
US 20180093087A1 · Beach · 2018 [cited by applicant]
US 20180296811A1 · Chan et al. · 2018 [cited by applicant]
US 20190015644A1 · Thomspon Smith et al. · 2019 [cited by applicant]
US 20190038366A1 · Johnson et al. · 2019 [cited by applicant]
US 20190099141A1 · Garlow et al. · 2019 [cited by applicant]
US 20220020161A1 · Mucha et al. · 2022 [cited by applicant]
US 20220047338A1 · Mucha et al. · 2022 [cited by applicant]
US 20220104882A1 · Mucha · 2022 [cited by applicant]
US 20220192759A1 · Desinger et al. · 2022 [cited by applicant]
US 20220257322A1 · Krüger et al. · 2022 [cited by applicant]
US 20220273398A1 · Norman et al. · 2022 [cited by applicant]
DE 19641720A1 · 1998 [cited by applicant]
DE 19944981A1 · 2001 [cited by applicant]
DE 20220584U1 · 2004 [cited by applicant]
DE 102004058272A1 · 2005 [cited by applicant]
DE 202007004507U1 · 2007 [cited by applicant]
DE 102007059691A1 · 2008 [cited by applicant]
EP 0691663A1 · 1996 [cited by applicant]
EP 1080695A1 · 2001 [cited by applicant]
EP 1380266A1 · 2004 [cited by applicant]
EP 1523951A2 · 2005 [cited by applicant]
EP 1925265B1 · 2010 [cited by applicant]
EP 2186474A1 · 2010 [cited by applicant]
EP 2305115A1 · 2011 [cited by applicant]
EP 1278458B1 · 2011 [cited by applicant]
EP 3506278A1 · 2019 [cited by applicant]
JP 2004529679A · 2004 [cited by applicant]
JP 2011036600A · 2011 [cited by applicant]
WO WO9605768A1 · 1996 [cited by applicant]
WO WO9729678A2 · 1997 [cited by applicant]
WO WO9932033A1 · 1999 [cited by applicant]
WO WO02076302A2 · 2002 [cited by applicant]
WO WO2005039391A2 · 2005 [cited by applicant]
WO WO2006095027A1 · 2006 [cited by applicant]
WO WO2006122001A2 · 2006 [cited by applicant]
WO WO2007011314A2 · 2007 [cited by applicant]
WO WO2007017642A1 · 2007 [cited by applicant]
WO WO2007115825A1 · 2007 [cited by applicant]
WO WO2008030263A1 · 2008 [cited by applicant]
WO WO2008076079A1 · 2008 [cited by applicant]
WO WO2008095068A1 · 2008 [cited by applicant]
WO WO2008110553A2 · 2008 [cited by applicant]
WO WO2009150564A3 · 2010 [cited by applicant]
WO WO2010054645A2 · 2010 [cited by applicant]
WO WO2010054646A3 · 2010 [cited by applicant]
WO WO2010076676A1 · 2010 [cited by applicant]
WO WO2010123858A2 · 2010 [cited by applicant]
WO WO2010133320A1 · 2010 [cited by applicant]
WO WO2011081690A1 · 2011 [cited by applicant]
WO WO2011134083A1 · 2011 [cited by applicant]
WO WO2011148299A1 · 2011 [cited by applicant]
WO WO2012056034A1 · 2012 [cited by applicant]
WO WO2012109760A1 · 2012 [cited by applicant]
WO WO2012150567A1 · 2012 [cited by applicant]
WO WO2013010138A2 · 2013 [cited by applicant]
WO WO2013013718A1 · 2013 [cited by applicant]
WO WO2013072434A1 · 2013 [cited by applicant]
WO WO2013109527A1 · 2013 [cited by applicant]
WO WO2013144334A1 · 2013 [cited by applicant]
WO WO2014184382A1 · 2014 [cited by applicant]
WO WO2015085011A1 · 2015 [cited by applicant]
WO WO2017100180A1 · 2017 [cited by applicant]
WO WO2020221940A1 · 2020 [cited by applicant]
WO WO2021048439A1 · 2021 [cited by applicant]
Anonymous, Change System/Upgrade order 1110000092: Overview, Mar. 14, 2008, 1 page. [cited by applicant]
Anonymous, Configuration ZSY 11100000864: Result, Aug. 14, 2008, 1 page. [cited by applicant]
Anonymous, Configuration ZSY 11100000864: Result, Sep. 25, 2008, 1 page. [cited by applicant]
Anonymous, Endoscopic view of the brain, Figure 3, no date given, 1 page. [cited by applicant]
Anonymous: “Inertial navigation system”, Wikipedia, Mar. 8, 2019 (Mar. 8, 2019), XP055599140. [cited by applicant]
Bockholt, et al., Augmented Reality for Enhancement of Endoscopic Interventions, Proceedings of the IEEE Virtual Reality, 2003, 5 pages. [cited by applicant]
Brain Lab AG, Acceptance Protocol LGS, Purchase order No. 4500239188, Dec. 11, 2008, 1 page. [cited by applicant]
Brain Lab AG, Bod de Livraison, Aug. 5, 2008, 2 pages. [cited by applicant]
Brain Lab AG, Clinical User Guide, Vector Vision cranial / ENT, Version 7.8, 2008, 594 pages. [cited by applicant]
Brain Lab AG, Curve Dual Navigation Station—Technical User Guide Revision 1.1, Dec. 31, 2017Retrieved from the Internet: https:// userguides.brainlab.corn/wp-content/uploads/2019/12/Curve-1.2-Tech n i ca 1-User-Guide-En… [cited by applicant]
Brain Lab AG, Lieferschein, Sep. 22, 2008, 2 pages. [cited by applicant]
Dang, et al., Robust methods for automatic image-to-world registration in cone-beam CT interventional guidance; Medical Physics, AIP; vol. 39, No. 10; Oct. 2012; pp. 6484-6498. [cited by applicant]
Devernay, et al., 3D Reconstruction of the Operating Field for Image Overlay in 3D-Endoscopic Surgery, Nov. 2001, 1 page. [cited by applicant]
Devernay, Toward Endoscopic Augmented Reality for Robotically Assisted Minimally Invasive Cardiac Surgery, Feb. 2001, 6 pages. [cited by applicant]
European Patent Office, European Extended Search Report for EP 19169312.6, Jul. 3, 2019, 12 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for International (PCT)Patent Application No. PCT/EP2012/072783, Feb. 13, 2013, 10 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2010/002991,Sep. 6, 2010, 11 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2010/003822,Sep. 10, 2010, 13 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2011/003563,Nov. 14, 2014, 12 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2011/069065, Dec. 23, 2011, 8 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2013/056802, Jul. 12, 2013, 12 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2014/065030,Oct. 8, 2014, 12 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2014/068447, Feb. 5, 2015, 14 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2014/072282, Jan. 27, 2015, 12 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2015/058107,Oct. 22, 2015, 10 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2020/059643, May 12, 2020, 14 pages. [cited by applicant]
European Patent Office, International Search Report and Written Opinion for PCT/EP2020/062086, Aug. 7, 2020, 10 pages. [cited by applicant]
Fleig, et al., Surface Reconstruction of the Surgical Field from Stereoscopic Microscope Views in Neurosurgery, International Congress Series 1230, 2001, pp. 268-274. [cited by applicant]
Hirai, et al., Image-Guided Neurosurgery System Integrating AR-Based Navigation and Open-MRI monitoring, Computer Aided Surgery, Mar. 2005, pp. 59-71, vol. 10, No. 2. [cited by applicant]
International Search Report mailed on Jan. 20, 2015, for PCT Application No. PCT/EP2014/073493, filed on Oct. 31, 2014, 3 pages. [cited by applicant]
Jain, Fundamentals of Digital Image Processing, Prentice-Hall Inc., 1989,4 pages. [cited by applicant]
Jing et al., Navigating System for Endoscopic Sinus Surgery Based on Augmented Reality, IEEE/ICME International Conference on Complex Medical Engineering, 2007, pp. 185-188. [cited by applicant]
Konishi et al., Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography: Application to 20 clinical cases, International Congress Series 1281, 2005, pp. 5… [cited by applicant]
Lapeer, et al., Image-enhanced Surgical Navigation for Endoscopic Sinus Surgery: Evaluating Calibration, Registration and Tracking, The International Journal of Medica Robotics and Computer Assisted Surgery,2008, pp. 32… [cited by applicant]
Lee Seongpung et al: “A Simple and Accurate Camera-Sensor Calibration for Surgical Endoscopes and Microscopes”, Sep. 14, 2014 (Sep. 14, 2014), International Conference on Computer Analysis of Images and Patterns. CAIP 2… [cited by applicant]
Maintz et al. “A Survey of Medical Image Registration”, Medical Image Analysis, 2(1): 1-36, Mar. 1998. [cited by applicant]
Maurer et al., Registration Of Head Volume Images Using Implantable Fiducial Markers, IEEE Transactions on Medical Imaging 16.4 (1997): 447-462. [cited by applicant]
Mourgues, et al., 3D Reconstruction of the Operating Field for Image Overlay in 3D-Endoscopic Surgery, Proceedings IEEE and ACM International Symposium on Augmented Reality, Oct. 29-30, 2001, 1 page. [cited by applicant]
Mucha et al., Plausibility check for error compensation in electromagnetic navigation in endoscopic sinus surgery, Int. J. of Computer Assisted Radiology and Surgery (CARS), 2006, pp. 316-318. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/033,146 dated Mar. 10, 2022 , 6 pages. [cited by applicant]
Office action for U.S. Appl. No. 17/492,057, dated Mar. 9, 2022 8 pages. [cited by applicant]
Olwal, et al., Design and Evaluation of Interaction Technology for Medical Team Meetings; Interact 2011, Part 1; FIP International Federation for Information Processing 2011; 2011; pp. 505-522. [cited by applicant]
Olwal, et al., HybridSurface: Multi-user, multi-device, remote collaboration; Vimeo; https://vimeo.com/30581634; 2009; screen shots of video at five second intervals; entire video_. [cited by applicant]
Paul, et al., Augmented Virtuality Based on Stereoscopic Reconstruction in Multimodallmage-GuidedNeurosurgery: Methods and Performance Evaluation, Methods and Performance Evaluation, IEEE Transactions on Medical Imaging… [cited by applicant]
Pflugi Silvio et al: “Augmented marker tracking for peri-acetabular osteotomy surgery”, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE, Jul. 11, 2017 (Jul.… [cited by applicant]
Rogalla, et al., Virtual Endoscopy and Related 3D Techniques, Medical Radiology Diagnostic Imaging,2001, 8 pages. [cited by applicant]
Sielhorst, et al., Advanced Medical Displays: A Literature Review of Augmented Reality, Journal of Display Technology, Dec. 2008, pp. 451-467, vol. 4, No. 4. [cited by applicant]
The International Bureau of WIPO, International Preliminary Report onPatentability for PCT/EP2020/062086, Nov. 2, 2021, 7 pages. [cited by applicant]
The International Bureau of WIPO, International Preliminary Report onPatentability for PCT/EP2020/062349, Nov. 2, 2021, 9 pages. [cited by applicant]
Thormahlen, Professor of Philips-Universitat Marburg biography, retrieved on Oct. 8, 2019, 9 pages. [cited by applicant]
Thormahlen, Three-Dimensional Endoscopy, Kluwer Academic Publishers, Dec. 2002, pp. 199-214. [cited by applicant]
Tsai R Y et al: “A New Technique for Fully Autonomous and Efficient 3D Robotics Hand/Eye Calibration”, IEEE Transactions on Robotics and Automation, vol. 5, No. 3, Jun. 1, 1989 (Jun. 1, 1989), pp. 345-358, XP000028733. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 13/321,087, Oct. 21, 2015, 12 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 13/321,087, Sep. 21, 2017, 18 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 13/380,695, Jul. 16, 2014, 11 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 13/380,695, Jul. 29, 2015, 5 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 13/881,770, Nov. 20, 2015, 20 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/358,108, Jan. 29, 2016, 12 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/387,722, Dec. 28, 2018, 26 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/387,722, Dec. 31, 2019, 23 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/387,722, Jun. 30, 2021, 27 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/890,480, Aug. 30, 2018, 22 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/890,480, Aug. 4, 2017, 21 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/903,381, Jul. 3, 2019, 20 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/903,381, Jun. 20, 2018, 19 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/903,381, Jun. 23, 2020, 17 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 14/903,381, May 5, 2021, 21 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 15/033,146, Apr. 16, 2020, 14 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 15/033,146, Jul. 28, 2021, 21 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 15/033,146, Mar. 7, 2019, 12 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 15/303,793, Nov. 16, 2018, 33 pages. [cited by applicant]
United States Patent and Trademark Office, Final Office Action for U.S. Appl. No. 17/492,057, Dec. 9, 2021, 14 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 13/321,087, Apr. 22, 2015, 11 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 13/321,087, Dec. 9, 2016, 20 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 13/321,087, Jul. 13, 2018, 24 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 13/380,695, Dec. 4, 2013, 9 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 13/380,695, Dec. 9, 2014, 6 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 13/810,666, Dec. 18, 2015, 8 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 13/881,770, Jun. 18, 2015, 18 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/358,108, Jun. 12, 2015, 10 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/387,722, Apr. 13, 2018, 22 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/387,722, Aug. 25, 2017, 11 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/387,722, May 23, 2019, 24 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/890,480, Jan. 27, 2017, 20 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/890,480, Mar. 8, 2018, 20 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/903,381, Dec. 28, 2017, 18 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/903,381, Feb. 7, 2019, 21 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/903,381, Jan. 8, 2020, 17 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 14/903,381, Nov. 24, 2020, 17 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 15/033,146, Aug. 27, 2018, 16 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 15/033,146, Sep. 19, 2019, 15 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 15/033,146, Sep. 30, 2020, 13 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 15/303,793, Apr. 23, 2018, 31 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action for U.S. Appl. No. 15/303,793, Jun. 13, 2019, 52 pages. [cited by applicant]
United States Patent and Trademark Office, Non-Final Office Action in U.S. Appl. No. 17/374,865, mailed Oct. 13, 2022, 23 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 13/321,087, Apr. 26, 2019, 5 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 13/380,695, Feb. 17, 2016, 8 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 13/810,666, Apr. 8, 2016, 5 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 13/881,770, Jan. 20, 2017, 8 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 14/358,108, Jun. 15, 2016, 8 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 14/401,652, Sep. 1, 2015, 13 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 14/890,480, Apr. 9, 2019, 8 pages. [cited by applicant]
United States Patent and Trademark Office, Notice of Allowance for U.S. Appl. No. 15/303,793, Oct. 18, 2019, 8 pages. [cited by applicant]
Von F. Hagenmuller, et al., Medical Imaging in Gastroenterology and Hepatology (Falk Symposium ,Band 124), [Book Description], 2 pages. [cited by applicant]
Von F. Hagenmuller, et al., Medical Imaging in Gastroenterology and Hepatology (Falk Symposium, D Band 124), Dec. 2002, 3 pages. [cited by applicant]
Von F. Hagenmuller, et al., Medical Imaging in Gastroenterology and Hepatology, Kluwer Academic Publishers, 2002, 3 pages. [cited by applicant]