Systems and methods for robotic medical system integration with external imaging
A medical robotic system and method of operating such comprises taking intraoperative external image data of a patient anatomy, and using that image data to generate a modeling adjustment for a control system of the medical robotic system (e.g., updating anatomic model and/or refining instrument registration), and/or adjust a procedure control aspect (e.g., regulating substance or therapy delivery, improving targeting, and/or tracking performance).
1. A method, comprising:
receiving, from a sensor system coupled to a medical instrument of a medical system, intraoperative pose data for a portion of the medical instrument;
defining a scan region at least around the portion of the medical instrument, wherein the scan region is defined based on the intraoperative pose data for the portion of the medical instrument, and wherein the scan region includes a subregion of a patient anatomy;
localizing an imaging area for an intraoperative external imaging system to the scan region;
receiving, from the intraoperative external imaging system, intraoperative external image data for the subregion of the patient anatomy within the scan region;
at least semi-automatically controlling the medical system based on the intraoperative external image data to at least adjust a pose of a portion of the medical system based on a first portion of the intraoperative external image data, the first portion of the intraoperative external image data representing a portion of the medical system in the patient anatomy.
2. The method of claim 1 , wherein receiving the intraoperative external image data comprises receiving at least one of computerized tomography (CT) scan data, magnetic resonance imaging (MRI) data, positron emission tomography (PET) scan data, fluoroscopic images, thermography data, ultrasonic data, optical coherence tomography (OCT) data, thermal imaging data, impedance imaging data, laser imaging data, or nanotube X-ray imaging data.
3. The method of claim 1 , wherein the subregion of the patient anatomy is only within a predetermined region around a distal end region of the medical instrument.
4. The method of claim 1 , wherein the intraoperative external image data includes image data for a target location in the patient anatomy, and wherein at least semi-automatically controlling the medical system further comprises delivering a substance to the target location using the medical system.
5. The method of claim 4 , wherein at least semi-automatically controlling the medical system further comprises displaying the intraoperative external image data to depict the substance at the target location.
6. The method of claim 4 , wherein at least semi-automatically controlling the medical system further comprises:
identifying image data for the substance in the intraoperative external image data; and
adjusting a control parameter for delivering the substance based on the image data for the substance.
7. The method of claim 4 , wherein the substance comprises at least one of a therapeutic agent, a diagnostic agent, anesthetic agent, treatment agent, or an imaging agent.
8. The method of claim 4 , wherein the substance comprises at least one of an implant, a fiducial, or a time release capsule.
9. The method of claim 1 , wherein the intraoperative external image data includes image data for a target location in the patient anatomy, and wherein at least semi-automatically controlling the medical system further comprises applying a treatment modality using the medical system to the target location in the patient anatomy.
10. The method of claim 9 , wherein at least semi-automatically controlling the medical system further comprises displaying the intraoperative external image data to show an effect of the treatment modality at the target location.
11. The method of claim 9 , wherein at least semi-automatically controlling the medical system further comprises:
identifying an effect of the treatment modality in the intraoperative external image data; and
adjusting a parameter of the treatment modality based on the effect of the treatment modality identified in the intraoperative external image data.
12. The method of claim 9 , wherein the treatment modality comprises at least one of ablation, radiation, or ultrasound.
13. The method of claim 1 , wherein at least semi-automatically controlling the medical system further comprises:
identifying the first portion of the intraoperative external image data representing the portion of the medical system in the patient anatomy.
14. The method of claim 13 , wherein at least semi-automatically controlling the medical system further comprises identifying a second portion of the intraoperative external image data representing a target anatomical region, and wherein adjusting the pose of the portion of the medical system is further based on the second portion of the intraoperative external image data.
15. The method of claim 1 , wherein the medical system comprises a focal therapy system, and wherein at least semi-automatically controlling the medical system comprises:
identifying a target portion of the intraoperative external image data representing a procedure target in the patient anatomy; and
adjusting a parameter of the focal therapy system based on the target portion.
16. The method of claim 15 , wherein the focal therapy system comprises an external beam radiotherapy instrument for generating a radiation beam, and wherein adjusting the parameter of the focal therapy system comprises:
determining a target shape from the target portion; and
defining a beam shape for the radiation beam based on the target shape.
17. The method of claim 1 , wherein the medical system comprises the medical instrument, and wherein at least semi-automatically controlling the medical system comprises displaying the intraoperative external image data to show at least one actuation state of the medical instrument.
18. The method of claim 17 , wherein the medical instrument comprises at least one of a forceps, rongeur, scalpel, biopsy tool, suturing tool, stapler, or vessel sealer.
19. The method of claim 1 , wherein the intraoperative external image data includes shape data corresponding to a shape of the medical instrument of the medical system within the patient anatomy.
20. The method of claim 19 , wherein at least semi-automatically controlling the medical system comprises adjusting a pose of the medical instrument based on the intraoperative external image data.