Methods of determining tissue distances using both kinematic robotic tool position information and image-derived position information
In one embodiment of the invention, a method is disclosed to locate a robotic instrument in the field of view of a camera. The method includes capturing sequential images in a field of view of a camera. The sequential images are correlated between successive views. The method further includes receiving a kinematic datum to provide an approximate location of the robotic instrument and then analyzing the sequential images in response to the approximate location of the robotic instrument. An additional method for robotic systems is disclosed. Further disclosed is a method for indicating tool entrance into the field of view of a camera.
1. A method of determining a distance between first and second points on tissue, the method comprising:
touching tissue at a first point with a first tool tip of a first robotic tool;
touching the tissue at a second point with a second tool tip of a second robotic tool;
fusing kinematics derived position information and image derived position information of the first robotic tool in a state-space model by using a tool tracking system to estimate a first tool tip location;
fusing kinematics derived position information and image derived position information of the second robotic tool in a state-space model by using the tool tracking system to estimate a second tool tip location; and
comparing the first tool tip location and the second tool tip location by using the tool tracking system to determine a distance between the first and second points on the tissue.
2. The method of claim 1 , wherein
the tissue comprises a tumor;
the first point is on a first external surface of the tumor;
the second point is on a second external surface of the tumor; and
the comparing determines a diameter of the tumor.
3. The method of claim 1 , wherein
the tissue comprises an organ;
the first point is on a first external surface of the organ;
the second point is on a second external surface of the organ; and
the comparing determines a diameter of the organ.
4. The method of claim 1 , further comprising:
processing sensor data of the first robotic tool by using the tool tracking system to generate the kinematics derived position information of the first robotic tool; and
processing sensor data of the second robotic tool by using the tool tracking system to generate the kinematics derived position information of the second robotic tool.
5. The method of claim 1 , wherein
the fusing of the kinematics derived position information and the image derived position information of the first robotic tool in the state-space model is performed by the tool tracking system using a sequential Bayesian approach; and
the fusing of the kinematics derived position information and the image derived position information of the second robotic tool in the state-space model is performed by the tool tracking system using the sequential Bayesian approach.
6. The method of claim 1 , further comprising:
capturing a sequence of images of the first robotic tool and the second robotic tool at a surgical site;
processing the sequence of images of the first robotic tool and the second robotic tool at the surgical site by using the tool tracking system to generate the image derived position information of the first and second robotic tools.
7. The method of claim 6 , wherein
the processing of the sequence of images of the first robotic tool and the second robotic tool at the surgical site comprises an image-by-synthesis approach wherein synthesized images of computer models of the first and second robotic tools are compared against images of the first and second robotic tools in the sequence of images.
8. The method of claim 6 , wherein
the processing of the sequence of images of the first robotic tool and the second robotic tool at the surgical site comprises a feature matching approach wherein features of the first and second robotic tools are identified in the sequence of images.
9. The method of claim 6 , wherein
the processing of the sequence of images of the first robotic tool and the second robotic tool at the surgical site comprises a sequence matching approach wherein objects or features in a sequence of images captured from a view of the image capturing device are matched against objects or features in a sequence of images captured from a different view of the image capturing device.
10. The method of claim 6 , wherein
the processing of the sequence of images of the first robotic tool and the second robotic tool at the surgical site comprises a sequence matching approach wherein objects or features in a sequence of images captured from a view of the image capturing device are matched against objects or features in a sequence of synthesized images.