Methods and systems for translating magnetic resonance images to pseudo computed tomography images

1. A method, comprising:

acquiring a magnetic resonance (MR) image;

generating, with a multi-task neural network, a pseudo CT image, a bone mask, and a bone Hounsfield unit (HU) image corresponding to the MR image, wherein the pseudo CT image comprises a set of three density classes, the density classes comprising air, tissue, and bone, and wherein the bone HU image includes image values within a bone region of interest in terms of HU; and

outputting the MR image and the pseudo CT image,

wherein the multi-task neural network is trained with a whole image regression loss for the pseudo CT image, a segmentation loss for the bone mask, and a regression loss focused on bone segments for the bone HU image.

2. The method of claim 1 , wherein the multi-task neural network is trained with a focused loss for a region of interest including bone in the MR image.

3. The method of claim 1 , further comprising training the multi-task neural network with a composite loss comprising the whole image regression loss, the segmentation loss, and the regression loss focused on the bone segments, wherein each loss is weighted in the composite loss.

4. The method of claim 1 , further comprising updating the pseudo CT image with the bone HU image, and outputting the updated pseudo CT image with the MR image.

5. The method of claim 1 , wherein the multi-task neural network comprises a U-Net convolutional neural network configured with multiple output layers, and wherein one output layer of the multiple output layers outputs the pseudo CT image.

6. A magnetic resonance imaging (MRI) system, comprising:

an MRI scanner;

a display device;

a controller unit communicatively coupled to the MRI scanner and the display device; and

a memory storing executable instructions that when executed cause the controller unit to:

acquire, via the MRI scanner, a magnetic resonance (MR) image;

generate, with a multi-task neural network, a pseudo CT image, a bone mask, and a bone Hounsfield unit (HU) image corresponding to the MR image, wherein the pseudo CT image comprises a set of three density classes, the density classes comprising air, tissue, and bone, and wherein the bone HU image includes image values within a bone region of interest in terms of HU; and

output, to the display device, the MR image and the pseudo CT image,

wherein the multi-task neural network is trained with a whole image regression loss for the pseudo CT image, a segmentation loss for the bone mask, and a regression loss focused on bone segments for the bone HU image.

7. The MRI system of claim 6 , wherein the multi-task neural network is trained with a focused loss for a region of interest including bone in the MR image.

8. The MRI system of claim 6 , the memory further storing executable instructions that when executed cause the controller unit to train the multi-task neural network with a composite loss comprising the whole image regression loss, the segmentation loss, and the regression loss focused on the bone segments, wherein each loss is weighted in the composite loss.

9. The MRI system of claim 6 , the memory further storing executable instructions that when executed cause the controller unit to update the pseudo CT image with the bone HU image, and output, to the display device, the updated pseudo CT image with the MR image.

10. A non-transitory computer-readable medium comprising instructions that when executed cause a processor to:

acquire a magnetic resonance (MR) image;

generate, with a multi-task neural network, a pseudo CT image, a bone mask, and a bone Hounsfield unit (HU) image corresponding to the MR image, wherein the pseudo CT image comprises a set of three density classes, the density classes comprising air, tissue, and bone, and wherein the bone HU image includes image values within a bone region of interest in terms of HU; and

output, to a display device, the MR image and the pseudo CT image,

wherein the multi-task neural network is trained with a whole image regression loss for the pseudo CT image, a segmentation loss for the bone mask, and a regression loss focused on bone segments for the bone HU image.

11. The non-transitory computer-readable medium of claim 10 , wherein the multi-task neural network is trained with a focused loss for a region of interest including bone in the MR image.

12. The non-transitory computer-readable medium of claim 10 , wherein the instructions when executed further cause the processor to train the multi-task neural network with a composite loss comprising the whole image regression loss, the segmentation loss, and the regression loss focused on the bone segments, wherein each loss is weighted in the composite loss.

13. The non-transitory computer-readable medium of claim 10 , wherein the instructions when executed further cause the processor to update the pseudo CT image with the bone HU image, and output, to the display device, the updated pseudo CT image with the MR image.

14. The non-transitory computer-readable medium of claim 10 , wherein the multi-task neural network comprises a U-Net convolutional neural network configured with multiple output layers, and wherein one output layer of the multiple output layers outputs the pseudo CT image.

15. A method, comprising:

acquiring a magnetic resonance (MR) image;

generating, with a multi-task neural network, a pseudo CT image, a bone mask, and a bone image corresponding to the MR image, wherein the pseudo CT image comprises a set of three density classes, the density classes comprising air, tissue, and bone, wherein the bone mask is obtained via a convolution-sigmoid operation, and the bone image is obtained via a convolution-rectified linear unit (ReLU) operation; and

outputting the MR image and the pseudo CT image.