SYSTEMS AND METHODS FOR CONTRAST DOSE REDUCTION
A deep learning-based algorithm has been proposed for contrast dose reduction in MRI, using multi-contrast images and an anomaly-aware attention mechanism. The method comprises: obtaining a multi-contrast image of a subject, where the multi-contrast image comprises an image of a first contrast acquired with a reduced dose of contrast agent; generating an anomaly mask using a first deep learning network; and taking the multi-contrast image and the anomaly mask as input to a second deep network model to generate a predicted image with improved quality.
1 . A computer-implemented method for enhancing image quality and anomaly detection, the method comprising:
(a) obtaining a multi-contrast image of a subject, wherein the multi-contrast image comprises an image of a first contrast acquired with a reduced dose of contrast agent;
(b) generating an anomaly mask using a first deep learning network; and
(c) taking the multi-contrast image and the anomaly mask as input to a second deep network model to generate a predicted image with improved quality.
2 . The computer-implemented method of claim 1 , wherein the multi-contrast image is acquired using a magnetic resonance (MR) device.
3 . The computer-implemented method of claim 1 , wherein the first deep learning network is trained using unsupervised anomaly detection scheme.
4 . The computer-implemented method of claim 3 , wherein the first deep learning network comprises a variational autoencoder (VAE) model trained only on images without anomaly.
5 . The computer-implemented method of claim 1 , wherein the multi-contrast image comprises an image of a second contrast that is processed by the first deep learning network for generating the anomaly mask.
6 . The computer-implemented method of claim 5 , wherein the image of the first contrast is T1-weighted image and the image of the second contrast is selected from the group consisting of T2-weighted image, fluid attenuated inversion recovery (FLAIR), proton density (PD), and diffusion weighted (DWI).
7 . The computer-implemented method of claim 1 , wherein the second deep network model comprises multiple branches.
8 . The computer-implemented method of claim 7 , wherein an input to at least one of the multiple branches comprises the image of the first contrast and an image of a different contrast.
9 . The computer-implemented method of claim 7 , wherein an input to at least one of the multiple branches comprises the image of the first contrast and the anomaly mask generated in (b).
10 . The computer-implemented method of claim 7 , wherein an input to each of the multiple branches comprises at least the image of the first contrast.
11 . The computer-implemented method of claim 7 , wherein the predicted image with improved quality is generated based on multiple predictions generated by the multiple branches.
12 . The computer-implemented method of claim 1 , wherein the anomaly mask is further utilized as an attention mechanism for training the second deep learning network model.
13 . The computer-implemented method of claim 1 , further comprising displaying the predicted image overlaid with the anomaly mask.
14 . A non-transitory computer-readable storage medium including instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
(a) obtaining a multi-contrast image of a subject, wherein the multi-contrast image comprises an image of a first contrast acquired with a reduced dose of contrast agent;
(b) generating an anomaly mask using a first deep learning network; and
(c) taking the multi-contrast image and the anomaly mask as input to a second deep network model to generate a predicted image with improved quality.
15 . A computer-implemented method for enhancing image quality and anomaly detection, the method comprising:
(a) obtaining a multi-contrast image of a subject, wherein the multi-contrast image comprises an image of a first contrast acquired with a reduced dose of contrast agent;
(b) providing a deep learning network model comprising a multi-contrast branched architecture; and
(c) taking the multi-contrast image and an anomaly mask as input to the deep network model to generate a predicted image with improved quality.
16 . The computer-implemented method of claim 15 , wherein the multi-contrast branched architecture comprises a first branch configured to process the image of the first contrast and an image of a second contrast.
17 . The computer-implemented method of claim 16 , wherein the image of the first contrast is T1-weighted image and the image of the second contrast is selected from the group consisting of T2-weighted image, fluid attenuated inversion recovery (FLAIR), proton density (PD), and diffusion weighted (DWI).
18 . The computer-implemented method of claim 16 , wherein the multi-contrast branched architecture comprises a second branch to process the image of the first contrast and the anomaly mask.
19 . The computer-implemented method of claim 15 , wherein the multi-contrast branched architecture comprises at least three branches.
20 . The computer-implemented method of claim 19 , wherein the predicted image with improved quality is generated based on multiple predictions generated by the at least three branches.