AUTONOMOUS SEGMENTATION OF THREE-DIMENSIONAL NERVOUS SYSTEM STRUCTURES FROM MEDICAL IMAGES
A method for autonomous segmentation of three-dimensional nervous system structures from raw medical images, the method including: receiving a 3D scan volume with a set of medical scan images of a region of the anatomy; autonomously processing the set of medical scan images to perform segmentation of a bony structure of the anatomy to obtain bony structure segmentation data; autonomously processing a subsection of the 3D scan volume as a 3D region of interest by combining the raw medical scan images and the bony structure segmentation data, wherein the 3D ROI contains a subvolume of the bony structure with a portion of surrounding tissues, including the nervous system structure; autonomously processing the ROI to determine the 3D shape, location, and size of the nervous system structures by means of a pre-trained convolutional neural network (CNN).
1 . A method for autonomous segmentation of three-dimensional nervous system structures from raw medical images, the method comprising:
receiving a 3D scan volume comprising a set of medical scan images of a region of the anatomy;
autonomously processing the set of medical scan images to perform segmentation of a bony structure of the anatomy to obtain bony structure segmentation data;
autonomously processing a subsection of the 3D scan volume as a 3D region of interest (ROI) by combining the raw medical scan images and the bony structure segmentation data, wherein the 3D ROI contains a subvolume of the bony structure with a portion of surrounding tissues, including a nervous system structure;
autonomously processing the ROI to determine a 3D shape, location, and size of the nervous system structure by means of a pre-trained convolutional neural network (CNN).
2 . The method according to claim 1 , further comprising 3D resizing of the ROI.
3 . The method according to claim 1 , further comprising visualizing the output including the segmented nervous system structure.
4 . The method according to claim 1 , further comprising detecting collision between an embodiment and/or trajectory of surgical instruments or implants and the segmented nervous system structure.
5 . The method according to claim 1 , wherein the nervous-system-structure segmentation CNN is a fully convolutional neural network model with layer skip connections.
6 . The method according to claim 5 , wherein the nervous-system-structures segmentation CNN output is improved by Select-Attend-Transfer (SAT) gates.
7 . The method according to claim 5 , wherein the nervous-system-structures segmentation CNN output is improved by Generative Adversarial Networks (GAN).
8 . The method according to claim 1 , wherein the received medical scan images are collected from an intraoperative scanner.
9 . The method according to claim 1 , wherein the received medical scan images are collected from a presurgical stationary scanner.
10 . A computer-implemented system, comprising:
at least one non-transitory processor-readable storage medium that stores at least one processor-executable instruction or data; and
at least one processor communicably coupled to the at least one non-transitory processor-readable storage medium, wherein the at least one processor is configured to perform the steps of the method of claim 1 .