Fluoroscopy-based surgical device tracking method
A method for assisting a physician track a surgical device in a body organ of a subject during a procedure includes fluoroscopic based registration, and tracking. An initial registration step includes receiving a 3D image data of a subject in a first body position, receiving a real time fluoroscopy image data, and estimating a deformation model or field to match points in the real time fluoro image with a corresponding point in the 3D model. A tracking step includes computing the 3D location of the surgical device based on a reference mark present on the surgical device, and displaying the surgical device and the 3D model of the body organ in a fused arrangement.
1. A method for tracking a surgical device in a body organ of a subject during a surgical procedure, wherein the body organ is a non-rigid body organ that changes shape as a result of varying patient body posture or position thereby defining an anatomy of unknown shape, the body organ comprising at least one body lumen, and said surgical device comprising a distal section having at least one reference mark which is visible under fluoroscopy, the method comprising the steps of:
a) receiving a 3D image data set of the body organ and computing a 3D model of the body organ;
b) performing a pre-tracking registration prior to tracking the surgical device during the surgical procedure thereby registering an image derived from the 3D model of the body organ with a real-time fluoroscopy image; wherein the pre-tracking registration comprises the following steps:
receiving a pre-tracking position from a sensor indicating the position of a fluoroscopy unit;
receiving a pre-tracking fluoroscopy image corresponding to the pre-tracking position;
registering the pre-tracking fluoroscopy image with a pre-tracking image derived from the 3D model of the body organ; and
recording the pre-tracking position;
c) advancing the distal section of the surgical device outside of the at least one body lumen and into the anatomy of unknown shape;
d) receiving a real-time fluoroscopy image showing the reference mark of the surgical device outside of the at least one body lumen and in the anatomy of unknown shape; and
e) computing a 3D location of the surgical device in the 3D model based on a shape or pattern of the reference mark outside the at least one body lumen and within the anatomy of unknown shape and visible in the fluoroscopy image of step ( d ).
2. The method of claim 1 further comprising sending to a display the 3D location of the surgical device for displaying the 3D location of the surgical device in the 3D model of the body organ.
3. The method of claim 1 wherein the pre-tracking registration is determined based on identifying physical features of at least one of an anatomical feature and the surgical device.
4. The method of claim 3 wherein the pre-tracking registration is determined based on identifying anatomical features.
5. The method of claim 4 wherein the pre-tracking registration is determined based on identifying a spine.
6. The method of claim 4 wherein the pre-tracking registration is determined based on identifying one or more ribs.
7. The method of claim 1 wherein the pre-tracking registration is based on the surgical device being placed at a known location in the body organ.
8. The method of claim 7 wherein the pre-tracking registration is determined by minimizing the difference between a projected device location from the pre-tracking image and an actual device location shown in the pre-tracking fluoroscopy image.
9. The method of claim 1 wherein the step of receiving a 3D image data set of the body organ and computing a 3D model of the body organ comprises receiving a 3D image data set of the lung and computing a 3D model of the lung.
10. The method of claim 9 wherein computing a 3D model of the lung comprises computing a 3D model of a plurality of airways.
11. The method of claim 10 wherein the computing step is performed by a programmed processor.
12. The method of claim 1 comprising selecting the surgical device from the group consisting of a bronchoscope, interventional guide-sheath, needle, and probe.
13. The method of claim 12 wherein the selecting comprises selecting a surgical device based on the reference mark comprising a non-symmetrical pattern.
14. The method of claim 1 wherein the computing step is based on identifying the reference mark having a non-symmetrical shape.
15. The method of claim 14 further comprising determining the orientation of the surgical device based on the characteristics of the mark shown in the real-time fluoroscopy image.
16. The method of claim 1 wherein the computing step is based on identifying the reference mark comprising a first line segment and a second line segment perpendicular to the first line segment.
17. The method of claim 16 wherein the computing step is based on identifying the reference mark defining four arm segments and each of the segments having a different length.
18. The method of claim 1 wherein the step of receiving a real-time fluoroscopy image from a fluoroscopy unit comprises receiving only one fluoroscopy image showing the reference mark of the surgical device at the tracking location prior to moving.
19. The method of claim 1 comprising moving the surgical device, and repeating steps d) to e) subsequent to the surgical device being moved.
20. The method of claim 1 wherein the step of registering is based on monitoring the position of the fluoroscopy unit.
21. The method of claim 20 wherein the monitoring is carried out by observing a mark present on the fluoroscopy unit.
22. The method of claim 21 wherein the monitoring is carried out by observing a cross shaped mark.
23. The method of claim 1 wherein the step of computing the 3D location of the surgical device includes determining the orientation of the surgical device.
24. The method of claim 1 wherein the computing step is based on identifying the reference mark comprising a pattern.
25. The method of claim 1 further comprising deforming the 3D model of the body organ to match the body organ of the subject during the procedure prior to the registering step.
26. The method of claim 1 wherein the step of receiving a real-time image from the fluoroscopy unit comprises receiving a plurality of non-continuous discrete fluoroscopy images.
27. The method of claim 1 wherein computing the 3D location of the surgical device further comprises application of non-fluoroscopic constraints.
28. The method of claim 1 further comprising receiving a real-time endoscopic image of an airway and registering the real-time endoscopic image with the 3D model of the organ.
29. The method of claim 1 wherein the recording the pre-tracking position step is performed after the step of registering the pre-tracking fluoroscopy image.