Reconstructor and contrastor for medical anomaly detection
Systems and methods for diagnosing a patient condition include a medical imaging device for generating an anatomical image. A reconstructor reconstructs the anatomical image by reconstructing portions of the anatomical image to be a healthy representation of the portions and merging the portions into the anatomical image to generate a reconstructed image. A contrastor contrasts the anatomical image with the reconstructed image to generate an anomaly map indicating locations of difference between the anatomical image and the reconstructed image. An anomaly tagging device tags the locations of difference as anomalies corresponding to anatomical abnormalities in the anatomical image, and a display displays the anatomical image with tags corresponding to the anatomical abnormalities.
1. A system for diagnosing a patient condition, the system including:
a medical imaging device for generating an anatomical image;
a reconstructor to reconstruct the anatomical image by reconstructing portions of the anatomical image to be a healthy representation of the portions and merging the portions into the anatomical image to generate a reconstructed image;
a contrastor to contrast the anatomical image with the reconstructed image to generate an anomaly map indicating locations of difference between the anatomical image and the reconstructed image;
an anomaly tagging device to tag the locations of difference as anomalies corresponding to anatomical abnormalities in the anatomical image; and
a display to display the anatomical image with tags corresponding to the anatomical abnormalities.
2. The system as recited in claim 1 , further including an image patch extractor to extract the portions of the anatomical image.
3. The system as recited in claim 2 , wherein the image patch extractor imposes a grid across the anatomical image, with each area defined by the grid corresponds to a portion to be extracted.
4. The system as recited in claim 1 , wherein the reconstructor blacks out an area of the portions to be reconstructed.
5. The system as recited in claim 1 , wherein the reconstructor includes an encoder-decoder arrangement trained to generate image portions of healthy depictions of anatomy.
6. The system as recited in claim 1 , wherein the contrastor determines a pixel-by-pixel difference between the reconstructed image and the original image.
7. The system as recited in claim 1 , wherein the anomaly map includes a matrix of difference values corresponding to differences between the reconstructed image and the original image at a plurality of locations on the original image.
8. The system as recited in claim 1 , wherein the anomaly map includes an image depicting a difference between the reconstructed image and the anatomical image at a plurality of locations on the original image.
9. The system as recited in claim 1 , wherein the medical imaging device includes an X-ray imaging device.
10. The system as recited in claim 9 , wherein the display displays a X-ray image with a tagged fracture for a doctor to splint.
11. A system for diagnosing a patient condition, the system including:
a medical imaging device for generating an anatomical image;
an image patch extractor to extract portions of an anatomical image and partially masking the portions to generate partially masked image patches;
a reconstructor to reconstruct the anatomical image by reconstructing the partially masked image patches of the anatomical image to be a healthy representation of the portions;
an image merging module to merge the healthy representations into the original image to generate a reconstructed image;
a contrastor to contrast the anatomical image with the reconstructed image to generate an anomaly map indicating locations of difference between the anatomical image and the reconstructed image;
an anomaly tagging device to tag the locations of difference as anomalies corresponding to anatomical abnormalities in the anatomical image; and
a diagnosis system to automatically administer a medication is response to a tag corresponding to the anatomical abnormality.
12. The system as recited in claim 11 , further including an image patch extractor to extract the portions of the anatomical image.
13. The system as recited in claim 12 , wherein the image patch extractor imposes a grid across the anatomical image, with each area defined by the grid corresponds to a portion to be extracted.
14. The system as recited in claim 11 , wherein the reconstructor partially masks the portions by blacking out an area of the portions to be reconstructed.
15. The system as recited in claim 11 , wherein the reconstructor includes an encoder-decoder arrangement trained to generate image portions of healthy depictions of anatomy.
16. The system as recited in claim 11 , wherein the contrastor determines a pixel-by-pixel difference between the reconstructed image and the original image.
17. The system as recited in claim 11 , wherein the anomaly map includes a matrix of difference values corresponding to differences between the reconstructed image and the original image at a plurality of locations on the original image.
18. The system as recited in claim 11 , wherein the anomaly map includes an image depicting a difference between the reconstructed image and the anatomical image at a plurality of locations on the original image.
19. The system as recited in claim 11 , wherein the medical imaging device includes an X-ray imaging device.
20. The system as recited in claim 19 , wherein the anatomical abnormalities correspond to bone fractures.