Method for generating a 3D physical model of a patient specific anatomic feature from 2D medical images
There is provided a method for generating a 3D physical model of a patient specific anatomic feature from 2D medical images. The 2D medical images are uploaded by an end-user via a Web Application and sent to a server. The server processes the 2D medical images and automatically generates a 3D printable model of a patient specific anatomic feature from the 2D medical images using a segmentation technique. The 3D printable model is 3D printed as a 3D physical model such that it represents a 1:1 scale of the patient specific anatomic feature. The method includes the step of automatically identifying the patient specific anatomic feature.
1. A method for defining a patient specific anatomical features from 2D medical images, the method comprising:
receiving, by a server, 2D medical images of a patient comprising one or more patient specific anatomical features and background information;
automatically processing, by the server, the 2D medical images using a segmentation algorithm to classify each pixel of the 2D medical images;
using, by the server, an anatomical feature identification algorithm to probabilistically match the classified pixels of the 2D medical images against a database of medical image anatomical features and generate a score for the classified pixels indicative of a likelihood that the classified pixel was classified correctly; and
generating, by the server, a dataset comprising the classification and the score for each pixel of the one or more patient specific anatomical features of the 2D medical images of the patient for defining the patient specific anatomical feature.
2. The method of claim 1 , wherein the background information comprises at least one of foreign objects, skin, a bed, or unwanted artifacts.
3. The method of claim 1 , wherein receiving the 2D medical images comprises receiving 2D medical images uploaded by an end-user via a Web Application.
4. The method of claim 1 , wherein the segmentation algorithm segments out the one or more patient specific anatomical features from the background information.
5. The method of claim 1 , wherein the segmentation algorithm classifies each pixel of the one or more patient specific anatomical features by tissue type selected from at least one of bone, soft tissue, blood vessel, or organs.
6. The method of claim 1 , wherein the database of medical image anatomical features comprises a graph database of labeled 2D medical images of anatomical features that are labeled using a medical imaging ontology.
7. The method of claim 1 , wherein the dataset is compressed for transmission across a network.
8. The method of claim 1 , wherein the dataset is encrypted for transmission across a network.
9. The method of claim 1 , further comprising using, by the server, the anatomical feature identification algorithm to classify each pixel of the 2D medical images based on the score, and generate segmentation data the defines the patient specific anatomical feature based on the classification of each pixel of the 2D medical images.
10. The method of claim 9 , further comprising removing non-target tissue from the segmentation data.
11. The method of claim 9 , further comprising generating, by the server, a 3D surface mesh model defining a surface of the patient specific anatomical feature using the segmentation data.
12. The method of claim 11 , further comprising:
using, by the server, a mesh cleaning algorithm to process the 3D surface mesh model; and
compressing, smoothing, and reducing, by the server, the processed 3D surface mesh model.
13. The method of claim 11 , further comprising compressing the 3D surface mesh model prior to transmission to an end-user device.
14. The method of claim 11 , further comprising 3D printing the 3D surface mesh model as a 3D physical model.
15. The method of claim 14 , wherein the 3D physical model represents a 1:1 scale of the patient specific anatomic feature.
16. The method of claim 1 , further comprising using, by the server, the anatomical feature identification algorithm to probabilistically match associated groups of the labeled pixels against the anatomical knowledge dataset to identify the patient specific anatomical feature within the 2D medical images and to generate a confidence score indicative of a likelihood that the patient specific anatomical feature was classified correctly.
17. A system for defining a patient specific anatomical features from 2D medical images, the system comprising at least one processor configured to:
receive 2D medical images of a patient comprising one or more patient specific anatomical features and background information;
automatically process the 2D medical images using a segmentation algorithm to classify each pixel of the 2D medical images;
use an anatomical feature identification algorithm to probabilistically match the classified pixels of the 2D medical images against a database of medical image anatomical features and generate a score for the classified pixels indicative of a likelihood that the classified pixel was classified correctly; and
generate a dataset comprising the classification and the score for each pixel of the one or more patient specific anatomical features of the 2D medical images of the patient for defining the patient specific anatomical feature.
18. The system of claim 17 , wherein the background information comprises at least one of foreign objects, skin, a bed, or unwanted artifacts.
19. The system of claim 17 , wherein the at least one processor is configured to receive 2D medical images uploaded by an end-user via a Web Application.
20. The system of claim 17 , wherein the segmentation algorithm segments out the one or more patient specific anatomical features from the background information.
21. The system of claim 17 , wherein the segmentation algorithm classifies each pixel of the one or more patient specific anatomical features by tissue type selected from at least one of bone, soft tissue, blood vessel, or organs.
22. The system of claim 17 , wherein the dataset is compressed for transmission across a network.
23. The system of claim 17 , wherein the at least one processor is configured to:
use the anatomical feature identification algorithm to classify each pixel of the 2D medical images based on the score; and
generate segmentation data the defines the patient specific anatomical feature based on the classification of each pixel of the 2D medical images.
24. The system of claim 23 , wherein the at least one processor is configured to remove non-target tissue from the segmentation data.
25. The system of claim 23 , wherein the at least one processor is configured to:
generate a 3D surface mesh model defining a surface of the patient specific anatomical feature using the segmentation data; and
compress the 3D surface mesh model prior to transmission to an end-user device.
26. The system of claim 17 , wherein the at least one processor is configured to use the anatomical feature identification algorithm to probabilistically match associated groups of the labeled pixels against the anatomical knowledge dataset to identify the patient specific anatomical feature within the 2D medical images and to generate a confidence score indicative of a likelihood that the patient specific anatomical feature was classified correctly.
27. A non-transitory computer readable media having instructions that, when executed by a processor, cause the processor to:
receive 2D medical images of a patient comprising one or more patient specific anatomical features and background information;
automatically process the 2D medical images using a segmentation algorithm to classify each pixel of the 2D medical images;
use an anatomical feature identification algorithm to probabilistically match the classified pixels of the 2D medical images against a database of medical image anatomical features and generate a score for the classified pixels indicative of a likelihood that the classified pixel was classified correctly; and
generate a dataset comprising the classification and the score for each pixel of the one or more patient specific anatomical features of the 2D medical images of the patient for defining the patient specific anatomical feature.
28. The non-transitory computer readable media of claim 27 , wherein the segmentation algorithm segments out the one or more patient specific anatomical features from the background information.
29. The non-transitory computer readable media of claim 27 , wherein the dataset is compressed for transmission across a network.
30. The non-transitory computer readable media of claim 27 , wherein the processor is configured to:
use the anatomical feature identification algorithm to classify each pixel of the 2D medical images based on the score;
generate segmentation data the defines the patient specific anatomical feature based on the classification of each pixel of the 2D medical images; and
remove non-target tissue from the segmentation data.