Denoising medical images by learning sparse image representations with a deep unfolding approach
The present embodiments relate to denoising medical images. By way of introduction, the present embodiments described below include apparatuses and methods for machine learning sparse image representations with deep unfolding and deploying the machine learnt network to denoise medical images. Iterative thresholding is performed using a deep neural network by training each layer of the network as an iteration of an iterative shrinkage algorithm. The deep neural network is randomly initialized and trained independently with a patch-based approach to learn sparse image representations for denoising image data. The different layers of the deep neural network are unfolded into a feed-forward network trained end-to-end.
1. A method for denoising medical images in computed tomography (CT), the method comprising:
scanning a patient to generate CT image data;
denoising the CT image data by applying a deep-learnt multiscale network of filters decomposing the CT image data into sparse image representations at multiple scales, the deep-learnt multiscale network of filters comprising a cascade of trained sparse denoising autoencoders, wherein lower levels of the deep-learnt multiscale network apply learnt filters to image data recursively downsampled from the CT image data and resulting denoised image data at each scale is upsampled back to full resolution and summed to obtain a final denoised image CT data set; and
displaying an image rendered from the final denoised CT image data set.
2. The method of claim 1 wherein the filters trained by the cascade of sparse denoising autoencoders were randomly initialized and trained jointly and end-to-end to optimize a quality of the denoised image data.
3. The method of claim 1 wherein filter weights of the filters are initialized with a random zero-mean Gaussian distribution.
4. The method of claim 1 wherein the filters trained by the cascade of sparse denoising autoencoders were trained with image data patches.
5. The method of claim 4 wherein denoising is repeated for patches of the CT image data at each scale.
6. The method of claim 5 wherein denoising learnt filter maps the patch of the CT image data to sparse image representations, wherein the sparse image representations are thresholded to remove noise.
7. The method of claim 1 wherein the sparse denoising autoencoders were trained with a noise model directly related to a radiation dose of the CT system.
8. A system for denoising medical images, the system comprising:
a scanner configured to scan an image of a patient;
an image processor configured to denoise the image of the patient with machine-learnt multiscale sparse image representations, the multiscale sparse image representations comprising layers of sparse denoising autoencoders having been trained with image data at different resolutions in an unfolded, independent feed forward network for the different resolutions,
wherein lower resolution ones of the layers recursively downsample from the image data and resulting denoised image data at each scale is upsampled to full resolution and summed to obtain a final denoised image; and
a display configured to display the denoised image of the patient.
9. The system of claim 8 wherein the image processor is configured to receive noise level of the scanner as an input for denoising the image of the patient.
10. The system of claim 8 wherein the scanner is configured to generate a three-dimensional scan of the patient; and
wherein decomposition filters of the sparse denoising autoencoders are three-dimensional filters.