Methods and systems for using multi view pose estimation
The present invention is disclosing several methods related to intra-body navigation of radiopaque instrument through natural body cavities. One of the methods is disclosing the pose estimation of the imaging device using multiple images of radiopaque instrument acquired in the different poses of imaging device and previously acquired imaging. The other method allows to resolve the radiopaque instrument localization ambiguity using several approaches, such as radiopaque markers and instrument trajectory tracking.
1. A method, comprising:
receiving a three-dimensional map of a plurality of body cavities of a body of a patient;
obtaining, from an intraoperative imaging modality, a two-dimensional intraoperative image of a radiopaque instrument within the body of the patient,
wherein the radiopaque instrument has at least two markers attached to it,
wherein the at least two radiopaque markers have a defined distance between them,
wherein at least two of the plurality of body cavities are shown in the two-dimensional image, and
wherein the radiopaque instrument that may be perceived from the image as located in at least a first one of the plurality of body cavities of the patient or a second one of the plurality of body cavities of the patient;
obtaining a pose of the intraoperative imaging modality relative to the three-dimensional map;
identifying a first location of a first one of the at least two radiopaque markers on the two-dimensional intraoperative image;
identifying a second location of a second one of the at least two radiopaque markers on the two-dimensional intraoperative image;
projecting the first location of the first one of the at least two radiopaque markers on the three-dimensional map to identify (1) a possible three-dimensional location of the first one of the radiopaque markers in the first one of the plurality of body cavities and (2) a possible three-dimensional location of the first one of the radiopaque markers in the second one of the plurality of body cavities;
projecting the second location of the second one of the at least two radiopaque markers on the three-dimensional map to identify (1) a possible three-dimensional location of the second one of the radiopaque markers in the first one of the plurality of body cavities and (2) a possible three-dimensional location of the second one of the radiopaque markers in the second one of the plurality of body cavities;
measuring a first projected distance between (1) the possible three-dimensional location of the first one of the radiopaque markers in the first one of the plurality of body cavities and (2) the possible three-dimensional location of the second one of the radiopaque markers in the first one of the plurality of body cavities;
measuring a second projected distance between (1) the possible three-dimensional location of the first one of the radiopaque markers in the second one of the plurality of body cavities and (2) the possible three-dimensional location of the second one of the radiopaque markers in the second one of the plurality of body cavities; and
comparing the defined distance to each of the first and second projected distances to identify a true instrument location inside the body.
2. The method of claim 1 , wherein the radiopaque instrument comprises an endoscope, an endo-bronchial tool, or a robotic arm.
3. The method of claim 2 , further comprising:
identifying a depth of the radiopaque instrument by use of a trajectory of the radiopaque instrument.