Self ensembling techniques for generating magnetic resonance images from spatial frequency data
Techniques for generating magnetic resonance (MR) images of a subject from MR data obtained by a magnetic resonance imaging (MRI) system, the techniques including: obtaining input MR data obtained by imaging the subject using the MRI system; generating a plurality of transformed input MR data instances by applying a respective first plurality of transformations to the input MR data; generating a plurality of MR images from the plurality of transformed input MR data instances and the input MR data using a non-linear MR image reconstruction technique; generating an ensembled MR image from the plurality of MR images at least in part by: applying a second plurality of transformations to the plurality of MR images to obtain a plurality of transformed MR images; and combining the plurality of transformed MR images to obtain the ensembled MR image; and outputting the ensembled MR image.
1. A method for generating magnetic resonance (MR) images of a subject from MR data obtained by a magnetic resonance imaging (MRI) system, the method comprising:
generating a first set of one or more MR images from first input MR data obtained by imaging the subject using the MRI system;
generating a second set of one or more MR images from second input MR data obtained by imaging the subject using the MRI system;
aligning the first set of one or more MR images and the second set of one or more MR images using a neural network model to obtain aligned first and second sets of one or more MR images, the neural network model comprising a first neural network and a second neural network, the aligning comprising:
estimating, using the first neural network, a first transformation between the first set of one or more MR images and the second set of one or more MR images;
generating a first updated set of one or more MR images from the second set of one or more MR images using the first transformation;
estimating, using the second neural network, a second transformation between the first set of one or more MR images and the first updated set of one or more MR images; and
aligning the first set of one or more MR images and the second set of one or more MR images at least in part by using the first transformation and the second transformation;
combining the aligned first and second sets of one or more MR images to obtain a combined set of one or more MR images; and
outputting the combined set of one or more MR images.
2. The method of claim 1 , wherein obtaining the second input MR data is performed after obtaining the first input MR data.
3. The method of claim 1 , wherein generating the first updated set of one or more MR images from the second set of one or more MR images comprises applying the first transformation to the second set of one or more MR images.
4. The method of claim 3 , wherein generating the first updated set of one or more MR images further comprises interpolating results of applying the first transformation to the second set of one or more MR images to obtain the first updated set of one or more MR images.
5. The method of claim 1 , wherein estimating the first transformation comprises estimating a rigid transformation.
6. The method of claim 1 , wherein estimating the first transformation comprises estimating a plurality of translation parameters and a plurality of rotation parameters.
7. The method of claim 6 , wherein estimating the plurality of rotation parameters comprises estimating Euler angles.
8. The method of claim 1 , wherein aligning the first set of one or more MR images and the second set of one or more MR images comprises:
calculating a composed transformation at least in part by composing the first and second transformations; and
applying the composed transformation to the second set of one or more MR images to obtain a set of one or more MR images aligned to the first set of one or more MR images.
9. The method of claim 1 , wherein aligning the first set of one or more MR images and the second set of one or more MR images comprises:
obtaining a set of one or more MR images aligned to the first set of one or more MR images from the first updated set of one or more MR images.
10. The method of claim 1 , wherein the neural network model further comprises a third neural network, and wherein the aligning further comprises:
generating a second updated set of one or more MR images from the first updated set of one or more MR images using the second transformation;
estimating, using the third neural network, a third transformation between the first updated set of one or more MR images and the second updated set of one or more MR images; and
aligning the first set of one or more MR images and the second set of one or more MR images at least in part by using the first transformation, the second transformation, and the third transformation.
11. The method of claim 1 , wherein the first neural network comprises one or more two-dimensional (2D) convolutional layers.
12. The method of claim 1 , wherein the first neural network comprises one or more three-dimensional (3D) convolutional layers configured to simultaneously process data in multiple images of the first set of one or more MR images.
13. The method of claim 1 , wherein combining the aligned first and second sets of one or more MR images comprises averaging the aligned first and second sets of one or more MR images.
14. The method of claim 1 , wherein the aligning is performed by at least one processor that is a part of the MRI system.
15. The method of claim 1 , wherein estimating the first transformation is performed at least in part by using the aligning is performed by at least one graphics processing unit (GPU) part of the MRI system.
16. The method of claim 1 , wherein the first set of one or more MR images consists of one image and the second set of one or more MR images consists of one MR image.
17. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for generating magnetic resonance (MR) images of a subject from MR data obtained by a magnetic resonance imaging (MRI) system, the method comprising:
generating a first set of one or more MR images from first input MR data obtained by imaging the subject using the MRI system;
generating a second set of one or more MR images from second input MR data obtained by imaging the subject using the MRI system;
aligning the first set of one or more MR images and the second set of one or more MR images using a neural network model to obtain aligned first and second sets of one or more MR images, the neural network model comprising a first neural network and a second neural network, the aligning comprising:
estimating, using the first neural network, a first transformation between the first set of one or more MR images and the second set of one or more MR images;
generating a first updated set of one or more MR images from the second set of one or more MR images using the first transformation;
estimating, using the second neural network, a second transformation between the first set of one or more MR images and the first updated set of one or more MR images; and
aligning the first set of one or more MR images and the second set of one or more MR images at least in part by using the first transformation and the second transformation;
combining the aligned first and second sets of one or more MR images to obtain a combined set of one or more MR images; and
outputting the combined set of one or more MR images.
18. A magnetic resonance imaging (MRI) system, comprising:
a magnetics system having a plurality of magnetics components to produce magnetic fields for performing MRI; and
at least one processor configured to perform:
generating a first set of one or more MR images from first input MR data obtained by imaging a subject using the MRI system;
generating a second set of one or more MR images from second input MR data obtained by imaging the subject using the MRI system;
aligning the first set of one or more MR images and the second set of one or more MR images using a neural network model to obtain aligned first and second sets of one or more MR images, the neural network model comprising a first neural network and a second neural network, the aligning comprising:
estimating, using the first neural network, a first transformation between the first set of one or more MR images and the second set of one or more MR images;
generating a first updated set of one or more MR images from the second set of one or more MR images using the first transformation;
estimating, using the second neural network, a second transformation between the first set of one or more MR images and the first updated set of one or more MR images; and
aligning the first set of one or more MR images and the second set of one or more MR images at least in part by using the first transformation and the second transformation;
combining the aligned first and second sets of one or more MR images to obtain a combined set of one or more MR images; and
outputting the combined set of one or more MR images.
19. The MRI system of claim 18 , wherein the magnetics system comprises a permanent B 0 magnet configured to generate a B 0 magnetic field, the permanent B 0 magnet comprising a plurality of concentric permanent magnet rings.
20. The MRI system of claim 19 , wherein the B 0 magnetic field has a strength between 20 milliTesla and 0.2 Tesla.