Systems and methods for robotic medical system integration with external imaging
A medical robotic system and method of operating such comprises taking intraoperative external image data of a patient anatomy, and using that image data to generate a modeling adjustment for a control system of the medical robotic system (e.g., updating anatomic model and/or refining instrument registration), and/or adjust a procedure control aspect (e.g., regulating substance or therapy delivery, improving targeting, and/or tracking performance).
1. A robotic medical system comprising:
a robotic arm cart including a driver assembly comprising a plurality of motors;
a flexible tubular instrument including a sensor configured to produce sensor data depending on an intraoperative location of the sensor within a patient's anatomy;
an interface configured to couple the instrument to the driver assembly;
a display system; and
a control system comprising one or more computer readable media with instructions for:
registering the instrument to a preoperative model of the patient's anatomy based at least in part on the sensor data;
presenting a virtual navigational image for the instrument on the display system based at least in part on the sensor data as the instrument traverses the patient's anatomy, wherein the virtual navigational image indicates a location of an anatomical target relative to a distal end of the instrument;
receiving intraoperative external image data for a portion of the patient's anatomy selected to include a region around the distal end of the instrument;
performing a tomographic reconstruction based at least in part on the intraoperative external image data; and
presenting an updated virtual navigational image for the instrument on the display system including an updated location of the anatomical target relative to the distal end of the instrument, wherein the updated virtual navigational image is based at least in part on the tomographic reconstruction and the sensor data.
2. The system of claim 1 wherein the instrument includes a camera at the distal end of the instrument.
3. The system of claim 1 wherein the instrument includes a working lumen, and the instrument is configured to deploy a removable camera via the working lumen.
4. The system of claim 1 wherein the instrument further comprises a plurality of steering cables extending at least partially between the interface and the distal end of the instrument.
5. The system of claim 4 wherein the interface is configured to couple the steering cables to the driver assembly.
6. The system of claim 5 further comprising a hand-operated controller configured to control the driver assembly.
7. The system of claim 6 wherein the hand-operated controller includes a joystick.
8. The system of claim 6 wherein the hand-operated controller includes a trackball.
9. The system of claim 1 wherein the sensor is part of a shape sensor system.
10. The system of claim 1 wherein the sensor is part of an electromagnetic (EM) sensor system.
11. The system of claim 10 wherein the intraoperative external image data is received from a fluoroscopic C-arm device.
12. The system of claim 10 wherein the intraoperative external image data is received from a cone-beam CT scanner.
13. The system of claim 1 further comprising fiducial elements that are identifiable in the intraoperative external image data to provide a common registration reference.
14. The system of claim 1 wherein the updated virtual navigational image more accurately characterizes a location of the distal end of the instrument relative to the anatomical target more accurately than the virtual navigational image.
15. The system of claim 1 wherein the one or more computer readable media further includes instructions for using the intraoperative external image data to refine a registration between the preoperative model of the patient's anatomy and the patient's anatomy.
16. The system of claim 1 wherein the one or more computer readable media further includes instructions for using the tomographic reconstruction to characterize a relationship between the distal end of the instrument and the anatomical target, wherein the updated virtual navigational image characterizes the relationship between the distal end of the instrument and the anatomical target more accurately than the virtual navigational image.
17. The system of claim 1 wherein the one or more computer readable media further includes instructions for using instrument pose data extracted from the intraoperative external image data to update a registration of the instrument to the preoperative model of the patient's anatomy.
18. The system of claim 1 wherein the one or more computer readable media further includes instructions for using instrument pose data extracted from the intraoperative external image data to update the preoperative model of the patient's anatomy.
19. The system of claim 1 wherein the one or more computer readable media further includes instructions for using the intraoperative external image data in conjunction with the preoperative model of the patient's anatomy to provide a representation of an immediate intraoperative environment, wherein the updated virtual navigational image includes a representation of the immediate intraoperative environment that is more accurate than the virtual navigational image.