Method and system for providing recommendation for optimal execution of surgical procedures
The present disclosure is related to a method and apparatus for providing recommendation for a medical surgical procedure, including acquiring, using circuitry, a plurality of multispectral images representing a portion of an anatomy of a patient, performing image processing on each of the plurality of multispectral images to form a plurality of value maps, each value map identifying aspects of the portion of the anatomy by assigned values, combining the plurality of value maps into a single recommendation map, determining optimal points for performing the medical surgical procedure based on the single recommendation map, and displaying the optimal points for the medical surgical procedure by overlaying the optimal points on an original image of the portion of the anatomy or applying the optimal points to a robotic medical surgical procedure.
1. A method for providing information for a medical surgical procedure, the method comprising:
acquiring, a processor, a plurality of multispectral images representing a portion of an anatomy of a patient;
performing image processing on each of the plurality of multispectral images to form a plurality of value maps, each value map identifying aspects of the portion of the anatomy of the patient by assigned values;
combining the plurality of value maps into a single recommendation map;
determining optimal points for performing the medical surgical procedure based on the single recommendation map;
displaying the optimal points for the medical surgical procedure by overlaying the optimal points on an original image of the portion of the anatomy of the patient or applying the optimal points to a robotic medical surgical procedure;
calculating diffuse reflectance values for the plurality of multispectral images;
selecting a reference diffuse reflectance value from the diffuse reflectance values and determining corresponding ratios between corresponding diffuse reflectance values and the reference diffuse reflectance value; and
determining a thickness map, as one of the plurality of value maps, corresponding to thickness of different portions of the anatomy of the patient based on the determined corresponding ratios,
wherein the optimal points for the medical surgical procedure are determined based on calculation of local maxima in the single recommendation map, which includes the thickness map, and
wherein the medical surgical procedure is at least one of suturing and stapling and the optimal points is at least one of optimal suture and stapling points.
2. The method for providing information according to claim 1 , further comprising:
extracting a foreground and a background from the plurality of multispectral images to extract blood vessels; and
determining a vessel map, as one of the plurality of value maps, corresponding to vessels in different portions of the anatomy of the patient based on said extracting.
3. The method for providing information according to claim 1 , further comprising:
analyzing proportions of corresponding signal intensity of the plurality of multispectral images; and
determining a perfusion map, as one of the plurality of value maps, corresponding to an amount of blood perfusion in different portions of the anatomy of the patient based on said analyzing.
4. The method for providing information according to claim 2 , wherein said extracting said foreground includes:
applying a blood vessel segmentation algorithm to the plurality of multispectral images; and
extracting a centerline or a vessel skeleton from the plurality of multispectral images based on said blood vessel segmentation algorithm.
5. The method for providing information according to claim 2 , wherein the optimal points for the medical surgical procedure are determined based on calculation of local maxima in the single recommendation map, which includes the vessel map.
6. The method for providing information according to claim 1 , wherein the plurality of multispectral images are cross-polarized images.
7. The method for providing information according to claim 1 , wherein the plurality of multispectral images are parallel polarization images.
8. The method for providing information according to claim 1 , wherein the plurality of value maps include dark portions of the anatomy of the patient and bright portions of the anatomy of the patient, and wherein the dark portions of the anatomy of the patient indicate portions of the anatomy of the patient that need to be avoided during the medical surgical procedure and the bright portions of the anatomy of the patient indicate other portions of the anatomy of the patient that are appropriate for the medical surgical procedure.
9. The method for providing information according to claim 8 , wherein the plurality of value maps include a scale indicating values from 0 to 1, wherein the values closer to 0 correspond to the dark portions of the anatomy of the patient and the values closer to 1 correspond to the bright portions of the anatomy of the patient.
10. The method for providing information according to claim 1 , wherein each of the plurality of value maps corresponds to a different portion of the anatomy of the patient.
11. The method for providing information according to claim 1 , wherein each of the plurality of value maps corresponds to a different anatomical feature of the anatomy of the patient.
12. The method for providing information according to claim 1 , further comprising segmenting the representation of the portion of the anatomy of the patient to form a plurality of segmented images based on predetermined anatomical or geometric information.
13. An apparatus for providing information for a medical surgical procedure, the apparatus comprising:
a processor configured to:
acquire a plurality of multispectral images representing a portion of an anatomy of the patient;
perform image processing on each of the plurality of segmented images to form a plurality of value maps, each value map identifying aspects of the portion of the anatomy of the patient by assigned values;
combine the plurality of value maps into a single recommendation map;
determine optimal points for performing the medical surgical procedure based on the single recommendation map;
display the optimal points for the medical surgical procedure by overlaying the optimal points on an original image of the portion of the anatomy of the patient or apply the optimal points to a robotic medical surgical procedure;
calculate diffuse reflectance values for the plurality of multispectral images;
select a reference diffuse reflectance value from the diffuse reflectance values and determining corresponding ratios between corresponding diffuse reflectance values and the reference diffuse reflectance value; and
determine a thickness map, as one of the plurality of value maps, corresponding to thickness of different portions of the anatomy of the patient based on the determined corresponding ratios,
wherein the optimal points for the medical surgical procedure are determined based on calculation of local maxima in the single recommendation map, which includes the thickness map, and
wherein the medical surgical procedure is at least one of suturing and stapling and the optimal points is at least one of optimal suture and stapling points.
14. The apparatus for providing information according to claim 13 , wherein the processor is configured to:
extract a foreground and a background from the plurality of multispectral images to extract blood vessels, and
determine a vessel map, as one of the plurality of value maps, corresponding to vessels in different portions of the anatomy of the patient based on the extracted foreground and background.
15. The apparatus for providing information according to claim 13 , wherein the processor is configured to:
analyze proportions of corresponding signal intensity of the plurality of multispectral images; and
determine a perfusion map, as one of the plurality of value maps, corresponding to an amount of blood perfusion in different portions of the anatomy of the patient based on said analyzed proportions.
16. The apparatus for providing information according to claim 14 , wherein the processor is configured to:
apply a blood vessel segmentation algorithm to the plurality of multispectral images, and
extract a centerline or a vessel skeleton from the plurality of multispectral images based on said blood vessel segmentation algorithm in order to extract the foreground.
17. The apparatus for providing information according to claim 14 , wherein the optimal points for the medical surgical procedure are determined based on calculation of local maxima in the single recommendation map, which includes the vessel map.
18. The apparatus for providing information according to claim 13 , wherein the plurality of multispectral images are at least one of cross-polarized images and parallel polarization images.
19. The apparatus for providing information according to claim 13 , wherein the plurality of value maps include dark portions of the anatomy of the patient and bright portions of the anatomy of the patient, and wherein the dark portions of the anatomy of the patient indicate portions of the anatomy of the patient that need to be avoided during the medical surgical procedure and the bright portions of the anatomy of the patient indicate other portions of the anatomy of the patient that are appropriate for the medical surgical procedure.
20. The apparatus for providing information according to claim 15 , wherein the plurality of value maps include a scale indicating values from 0 to 1, wherein the values closer to 0 correspond to the dark portions of the anatomy of the patient and the values closer to 1 correspond to the bright portions of the anatomy of the patient.
21. A non-transitory computer-readable storage medium including computer-readable instructions, that when executed by a computer, cause the computer to execute a method for providing information for a medical surgical procedure, the method comprising:
acquiring a plurality of multispectral images representing a portion of an anatomy of the patient;
performing image processing on each of the plurality of multispectral images to form a plurality of value maps, each value map identifying aspects of the portion of the anatomy of the patient by assigned values;
combining the plurality of value maps into a single recommendation map;
determining optimal points for performing the medical surgical procedure based on the single recommendation map;
displaying the optimal points for the medical surgical procedure by overlaying the optimal points on an original image of the portion of the anatomy of the patient or applying the optimal points to a robotic medical surgical procedure;
calculating diffuse reflectance values for the plurality of multispectral images;
selecting a reference diffuse reflectance value from the diffuse reflectance values and determining corresponding ratios between corresponding diffuse reflectance values and the reference diffuse reflectance value; and
determining a thickness map, as one of the plurality of value maps, corresponding to thickness of different portions of the anatomy of the patient based on the determined corresponding ratios,
wherein the optimal points for the medical surgical procedure are determined based on calculation of local maxima in the single recommendation map, which includes the thickness map, and
wherein the medical surgical procedure is at least one of suturing and stapling and the optimal points is at least one of optimal suture and stapling points.