System and Method for Fusing Computer Assisted Detection in a Multi-Modality, Multi-Dimensional Breast Imaging Environment
A multi-modality cancer screening and diagnosis system fuses CAD information obtained by imaging an immobilized patient using multiple different image acquisition systems to provide a single fused CAD data set. Combining the CAD results of multiple modalities into a single, rich, data set allows the strengths of each imaging modality to be leveraged to improve the sensitivity and specificity of breast cancer diagnosis. The CAD results may be used, together with fused image data, to train a CAD algorithm which may be used to directly process a fused multi-mode image data set.
1 . A method of generating a fused Computer Assisted Detection (CAD) data set includes the steps of:
obtaining a plurality of image data sets of an object, each data set acquired using a different imaging modality;
processing each image data set to generate a personalized CAD data set for the respective image data sets;
identifying a landmark that is common to each image data set;
mapping each image data set to a common coordinate system such that the landmark is in a similar location in each mapped image data set, including identifying a transform function for each image data set that defines the mapping of the respective image data set to the common coordinate system; and
applying the transform function for each image data set to the personalized CAD data for the image data set to provide a transformed personalized CAD data set for each image data set;
combining the transformed personalized data sets to provide the fused CAD data set; and
displaying the fused CAD data set with at least one of the image data sets.
2 . The method of claim 1 further including the step of normalizing the pixel sizes of each of the image data sets.
3 . The method of claim 1 wherein the landmark is selected from a group including physical landmarks and fiducial landmarks.
4 . The method of claim 3 wherein the object is a breast and the physical landmarks are selected from a group including a nipple position, a skin line, a chest wall, major vessel junctions, parenchyml lesions, skin lesions and calcifications.
5 . The method of claim 3 wherein the object is a breast and the fiducial landmark is selected from a group including a breast biopsy marker or wire and a breast implant valve.
6 . A computer system comprising:
a display;
a computer readable medium having a data structure stored thereon, the data structure comprising a data volume including fused Computer Assisted Detection (CAD) information, the CAD information including an integration of CAD information obtained from a plurality of different image data sets, the image data sets including images of a common object but acquired using a image acquisition systems of a corresponding plurality of different modalities; and
transform software, stored on the computer readable medium and operable to transform the data volume from a first coordinate system to a coordinate system specific to the display to enable display.
6 . A computer system comprising:
a workstation comprising:
a communication link couplable to a plurality of imaging systems of different modalities;
a processing device, coupled to the communication link;
a computer readable medium coupled to the processing device and having program code stored thereon, the program code comprising:
computer assisted detection (CAD) program code, operable when executed upon by the processing device to process image data sets received from each of the imaging systems in accordance with its respective modality of each imaging system, to provide respective personalized CAD data sets for association with each image data set; and
transform program code operable when executed upon by the processing device to transform the personalized CAD data sets to a common geometry; and
merge program code operable to selectively merge the CAD data sets to provide one or more fused CAD data sets.