Systems and methods for robotic medical system integration with external imaging
A medical robotic system and method of operating such comprises taking intraoperative external image data of a patient anatomy, and using that image data to generate a modeling adjustment for a control system of the medical robotic system (e.g., updating anatomic model and/or refining instrument registration), and/or adjust a procedure control aspect (e.g., regulating substance or therapy delivery, improving targeting, and/or tracking performance).
1. A method comprising:
performing an intraoperative registration of a flexible tubular instrument to a preoperative model of a patient's anatomy, wherein the instrument includes a sensor that produces sensor data depending on a location of the sensor within the patient's anatomy, and wherein the registration is based at least in part on the sensor data;
presenting a virtual navigational image for the instrument on a display system based at least in part on the sensor data as the instrument traverses the patient's anatomy, wherein the virtual navigational image indicates a location of an anatomical target relative to a distal end of the instrument;
receiving intraoperative external image data for a portion of the patient's anatomy selected to include a region around the distal end of the instrument;
performing a tomographic reconstruction based at least in part on the intraoperative external image data; and
presenting an updated virtual navigational image for the instrument on the display system based at least in part on the tomographic reconstruction and the sensor data while the instrument is within the patient's anatomy, wherein the updated virtual navigational image includes an updated location of the anatomical target relative to the distal end of the instrument.
2. The method of claim 1 further comprising articulating the distal end of the instrument using a plurality of steering cables extending at least partially between an interface and the distal end of the instrument.
3. The method of claim 2 further comprising coupling the interface of the instrument to a driver assembly, wherein the driver assembly comprises a plurality of motors, and using the driver assembly to actuate the steering cables of the instrument.
4. The method of claim 3 further comprising using a hand-operated controller to control the driver assembly.
5. The method of claim 4 wherein the hand-operated controller includes a joystick.
6. The method of claim 4 wherein the hand-operated controller includes a trackball.
7. The method of claim 3 wherein the driver assembly is located on a robotic arm, and the robotic arm is attached to a cart.
8. The method of claim 1 further comprising subjecting the sensor to an externally generated electromagnetic (EM) field to produce the sensor data.
9. The method of claim 8 wherein the intraoperative external image data is provided by a fluoroscopic C-arm device.
10. The method of claim 1 wherein the updated virtual navigational image more accurately characterizes a location of the distal end of the instrument relative to the anatomical target.
11. The method of claim 1 further comprising using the intraoperative external image data to refine a registration between the preoperative model of the patient's anatomy and the patient's anatomy.
12. The method of claim 1 further comprising using the intraoperative external image data to improve a registration between the instrument and the patient's anatomy.
13. The method of claim 1 further comprising using the tomographic reconstruction to characterize a relationship between the distal end of the instrument and the anatomical target, wherein the updated virtual navigational image characterizes the relationship between the distal end of the instrument and the anatomical target more accurately than the virtual navigational image.
14. The method of claim 1 further comprising using instrument pose data extracted from the intraoperative external image data to update a registration of the instrument to the preoperative model of the patient's anatomy.
15. The method of claim 1 further comprising using instrument pose data extracted from the intraoperative external image data to update the preoperative model of the patient's anatomy.
16. The method of claim 1 further comprising using the intraoperative external image data in conjunction with the preoperative model of the patient's anatomy to provide a representation of an immediate intraoperative environment, wherein the updated virtual navigational image includes a representation of the immediate intraoperative environment that is more accurate than the virtual navigational image.
17. The method of claim 1 further comprising presenting on the display system a live camera view that is captured by a camera at the distal end of the instrument.
18. The method of claim 1 further comprising presenting on the display system a live camera view that is captured by a removable camera deployed via a working channel of the instrument.
19. The method of claim 1 wherein the sensor is part of a shape sensor system.
20. The method of claim 1 further comprising providing fiducial elements around the patient's anatomy.
21. The method of claim 20 further comprising extracting fiducial elements from the intraoperative external image data.
22. The method of claim 21 further comprising using the extracted fiducial elements to provide a common registration reference.
23. The method of claim 1 further comprising advancing a tool through a working lumen of the instrument.
24. The method of claim 23 wherein the tool is a biopsy needle.