SYSTEM AND METHOD FOR MEDICAL IMAGE ALIGNMENT
An image alignment system and method which generates X-ray aligned patient specific 3D models. In particular, the image alignment system combines a CT scan and an X-ray into a single patient specific 3D model that, leveraging the benefits of both types of images and providing a surgeon with a single model for diagnosing a spinal deformity, for engaging and education a patient about the spinal deformity, and for preparing for spinal surgery. The system allows the CT scan to be done with the patient in the prone condition while the X-ray can be done with the patient in a vertical, e.g., standing, position to capture impacts on the spine from that vertical position.
1 . A method for aligning images for providing a patient specific 3D model, comprising the steps of:
an alignment computer receiving an x-ray image of biological features of a particular patient;
the alignment computer receiving CT scan images of the biological features of the particular patient;
the alignment computer converting at least a portion of the CT scan images into segmented polygons;
the alignment computer selecting one or more landmarks on the X-ray image;
the alignment computer aligning the segmented polygons with the x-ray image using the one or more landmarks;
the alignment computer generating the patient specific 3D model utilizing the CT scan images and the X-ray image according to the aligning; and
outputting the patient specific 3D model to a user interface for display to a user.
2 . The method of claim 1 , wherein the CT scan images are obtained from a CT scan of the patient that is performed with the patient in a prone or horizontal position.
3 . The method of claim 2 , wherein said x-ray scan images are obtained from a x-ray of the patient that is performed with the patient in a standing or vertical position.
4 . The method of claim 1 , wherein said x-ray scan images are obtained from a x-ray of the patient that is performed with the patient in a standing or vertical position.
5 . The method of claim 1 , wherein said biological features of the patient include at least a portion of the spine of the patient.
6 . The method of claim 1 , wherein the alignment computer converts at least a portion of the CT scan images into segmented polygons using a deep neural network.
7 . A method of treating the patient using a plurality of views provided by the patient specific 3D model generated by claim 1 .
8 . The method of claim 1 , wherein the alignment computer detects said one or more landmarks using multiple learning networks.
9 . The method of claim 1 , wherein the alignment computer is configured to generate said 3D model to have 6 degrees of freedom.
10 . A method for aligning images for providing a patient specific 3D model of the spine of a particular patient, comprising the steps of:
an alignment computer receiving an x-ray image of the spine of the particular patient;
the alignment computer receiving CT scan images of the spine of the particular patient;
the alignment computer converting a plurality of vertebrae of the CT scan images into segmented polygons;
the alignment computer selecting one or more landmarks on the X-ray image;
the alignment computer aligning the segmented polygons with the x-ray image using the one or more landmarks;
the alignment computer generating the patient specific 3D model utilizing the CT scan images and the X-ray image according to the aligning; and
outputting the patient specific 3D model to a user interface for display to a user.
11 . The method of claim 10 , wherein the CT scan images are obtained from a CT scan of the patient that is performed with the patient in a prone or horizontal position.
12 . The method of claim 11 , wherein said x-ray scan images are obtained from a x-ray of the patient that is performed with the patient in a standing or vertical position.
13 . The method of claim 10 , wherein said x-ray scan images are obtained from a x-ray of the patient that is performed with the patient in a standing or vertical position.
14 . The method of claim 10 , wherein the alignment computer converts at least a portion of the CT scan images into segmented polygons using a deep neural network.
15 . A method of treating the patient using a plurality of views provided by the patient specific 3D model generated by claim 1 .
16 . The method of claim 10 , wherein the alignment computer detects said one or more landmarks using multiple learning networks.
17 . The method of claim 10 , wherein the alignment computer is configured to generate said 3D model to have 6 degrees of freedom.
18 . A method for aligning images for providing a patient specific 3D model of the spine of a particular patient, comprising the steps of:
an alignment computer receiving an x-ray image of the spine of the particular patient, said x-ray image being taken by an x-ray with the patient provided in a first position;
the alignment computer receiving CT scan images of the spine of the particular patient, said CT Scan being taken with the patient provided in a second position different than said first position;
the alignment computer converting a plurality of vertebrae of the CT scan images into segmented polygons;
the alignment computer selecting one or more landmarks on the X-ray image;
the alignment computer aligning the segmented polygons with the x-ray image using the one or more landmarks;
the alignment computer generating the patient specific 3D model utilizing the CT scan images and the X-ray image according to the aligning; and
outputting the patient specific 3D model to a user interface for display to a user.
19 . The method of claim 18 , wherein the alignment computer is configured to generate said 3D model to have 6 degrees of freedom.
20 . A method for aiding a spine deformation treatment for a particular patient using a patient specific 3D model of the spine of the particular patient, comprising the steps of:
an alignment computer receiving an x-ray image of the spine of the particular patient, said x-ray image being taken by an x-ray with the patient provided in a first position;
the alignment computer receiving CT scan images of the spine of the particular patient, said CT Scan being taken with the patient provided in a second position different than said first position;
the alignment computer converting a plurality of vertebrae of the CT scan images into segmented polygons;
the alignment computer selecting one or more landmarks on the X-ray image;
the alignment computer aligning the segmented polygons with the x-ray image using the one or more landmarks;
the alignment computer generating the patient specific 3D model utilizing the CT scan images and the X-ray image according to the aligning;
outputting the patient specific 3D model to a user interface for displaying a plurality of different views of the spine of the particular patient to a user.