Systems and methods for using registered fluoroscopic images in image-guided surgery
A method performed by a computing system comprises receiving a fluoroscopic image of a patient anatomy while a portion of a medical instrument is positioned within the patient anatomy. The fluoroscopic image has a fluoroscopic frame of reference. The portion has a sensed position in an anatomic model frame of reference. The method further comprises identifying the portion in the fluoroscopic image and identifying an extracted position of the portion in the fluoroscopic frame of reference using the identified portion in the fluoroscopic image. The method further comprises registering the fluoroscopic frame of reference to the anatomic model frame of reference based on the sensed position of the portion and the extracted position of the portion.
1 . A method performed by a computing system comprising:
receiving a set of model points for an anatomic model of passageways of a patient anatomy in a model frame of reference;
receiving fluoroscopic image data of the patient anatomy while an indicator portion of a medical instrument traverses the passageways of the patient anatomy, the fluoroscopic image data having a fluoroscopic frame of reference;
identifying from the fluoroscopic image data, a set of indicator portion position points for the indicator portion of the medical instrument in the fluoroscopic frame of reference;
matching each indicator portion position point to a model point in the set of model points to generate a set of matches; and
registering the model frame of reference to the fluoroscopic frame of reference based on the set of matches.
2 . The method of claim 1 , wherein identifying the set of indicator portion position points in the fluoroscopic frame of reference includes identifying an expected shape of the indicator portion in the fluoroscopic frame of reference.
3 . The method of claim 1 , wherein identifying the set of indicator portion positions in the fluoroscopic frame of reference includes comparing the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned within the patient anatomy to fluoroscopic image data recorded when the indicator portion of the medical instrument is not positioned within the patient anatomy.
4 . The method of claim 3 , wherein comparing the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned within the patient anatomy to the fluoroscopic image data recorded when the indicator portion of the medical instrument is not positioned within the patient anatomy includes identifying graphical components associated with the medical instrument which are unique to the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned within the patient anatomy.
5 . The method of claim 3 , wherein identifying the set of indicator portion positions in the fluoroscopic frame of reference includes comparing the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned at a first location within the patient anatomy to fluoroscopic image data of the patient anatomy recorded while the indicator portion of the medical instrument is positioned at a second location within the patient anatomy.
6 . The method of claim 2 , wherein the expected shape of the indicator portion is based on shape information received from a shape sensor.
7 . The method of claim 6 , wherein an initial search area within the fluoroscopic image data is identified based on the shape information.
8 . The method of claim 1 , further comprising displaying a co-registered image of a portion of a fluoroscopic image generated from the fluoroscopic image data, a portion of the anatomic model, and the indicator portion of the medical instrument.
9 . The method of claim 1 , wherein registering the model frame of reference to the fluoroscopic frame of reference based on the set of matches includes moving the set of indicator portion position points relative to the set of model points based upon the set of matches.
10 . The method of claim 1 , wherein the fluoroscopic image data comprises multi-planar images.
11 . The method of claim 1 , wherein the fluoroscopic image data comprises a two-dimensional image.
12 . A medical system, comprising:
a medical instrument; and
a control system comprising a memory and at least one processor, the control system configured to:
receive a set of model points for an anatomic model of passageways of a patient anatomy in a model frame of reference;
receive fluoroscopic image data of the patient anatomy while an indicator portion of the medical instrument traverses the passageways of the patient anatomy, the fluoroscopic image data having a fluoroscopic frame of reference;
identify from the fluoroscopic image data, a set of indicator portion position points for the indicator portion of the medical instrument in the fluoroscopic frame of reference;
match each indicator portion position point to a model point in the set of model points to generate a set of matches; and
register the model frame of reference to the fluoroscopic frame of reference based on the set of matches.
13 . The medical system of claim 12 , wherein the control system is configured to identify the set of indicator portion position points in the fluoroscopic frame of reference by identifying an expected shape of the indicator portion in the fluoroscopic frame of reference.
14 . The medical system of claim 13 , wherein the medical instrument comprises a shape sensor and the expected shape of the indicator portion is based on shape information received from the shape sensor.
15 . The medical system of claim 14 , wherein an initial search area within the fluoroscopic image data is identified based on the shape information.
16 . The medical system of claim 12 , wherein the control system is configured to identify the set of indicator portion positions in the fluoroscopic frame of reference by comparing the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned within the patient anatomy to fluoroscopic image data recorded when the indicator portion of the medical instrument is not positioned within the patient anatomy.
17 . The medical system of claim 16 , wherein the control system is configured to compare the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned within the patient anatomy to the fluoroscopic image data recorded when the indicator portion of the medical instrument is not positioned within the patient anatomy by identifying graphical components associated with the medical instrument which are unique to the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned within the patient anatomy.
18 . The medical system of claim 16 , wherein the control system is configured to identify the set of indicator portion positions in the fluoroscopic frame of reference by comparing the fluoroscopic image data of the patient anatomy while the indicator portion of the medical instrument is positioned at a first location within the patient anatomy to fluoroscopic image data of the patient anatomy recorded while the indicator portion of the medical instrument is positioned at a second location within the patient anatomy.
19 . The medical system of claim 12 , further comprising:
a display, wherein the control system is further configured to display a co-registered image of a portion of a fluoroscopic image generated from the fluoroscopic image data, a portion of the anatomic model, and the indicator portion of the medical instrument.
20 . The medical system of claim 12 , wherein the control system is further configured to register the model frame of reference to the fluoroscopic frame of reference based on the set of matches includes moving the set of indicator portion position points relative to the set of model points based upon the set of matches.