IP Library Granted Patent US 12,196,833
Granted Patent B2
US 12,196,833 · App. 17/324,161 · Granted Jan 14, 2025

Method and system for accelerated acquisition and artifact reduction of undersampled MRI using a deep learning based 3D generative adversarial network

Inventors: Peng Hu (Beverly Hills, CA); Xiaodong Zhong (Oak Park, CA); Chang Gao (Los Angeles, CA); Valid Ghodrati (Glendale, CA)
Assignees: Siemens Healthineers AG; The Regents of the University of California
G01R33/565G01R33/482G01R33/4824G01R33/5608G06F18/2132G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,196,833
App. No.
17/324,161
Granted
Jan 14, 2025
Kind
B2
Abstract

Systems and methods for generative adversarial networks (GANs) to remove artifacts from undersampled magnetic resonance (MR) images are described. The process of training the GAN can include providing undersampled 3D MR images to the generator model, providing the generated example and a real example to the discriminator model, applying adversarial loss, L2 loss, and structural similarity index measure loss to the generator model based on a classification output by the discriminator model, and repeating until the generator model has been trained to remove the artifacts from the undersampled 3D MR images. At runtime, the trained generator model of the GAN can be generate artifact-free images or parameter maps from undersampled MRI data of a patient.

Claims (40)

1. A computer-implemented method for training a generator model of a generative adversarial network (GAN) to remove artifacts from undersampled magnetic resonance imaging (MRI) data, the GAN comprising the generator model and a discriminator model, the method comprising:

(a) obtaining, by a computer system, the undersampled 3D MRI data from fully-sampled 3D MRI data;

(b) providing, by the computer system, the undersampled 3D MRI data to the generator model, wherein the generator model is configured to output a generated example in response thereto;

(c) providing, by the computer system, the generated example and a real example based on the fully-sampled 3D MRI data to the discriminator model;

(d) applying, by the computer system, adversarial loss, L2 loss, and structural similarity index measure loss to the generator model based on a classification output by the discriminator model;

(e) repeating, by the computer system, (a)-(d) until the generator model has been trained to remove the artifacts from the undersampled 3D MRI data;

(f) generating, by the computer system, using the trained generator model, a parameter map for a biomarker from an undersampled MRI data set associated with a patient.

2. The method of claim 1 , wherein the undersampled 3D MRI data were created via kspace data undersampling.

3. The method of claim 1 , wherein the artifacts comprise at least one of streaking, aliasing, or ghosting.

4. The method of claim 1 , wherein the undersampled 3D MRI data were obtained via a Cartesian trajectory.

5. The method of claim 1 , wherein the undersampled 3D MRI data were obtained via a non-Cartesian trajectory.

6. The method of claim 1 , further comprising:

generating, by the computer system, using the trained generator model, an image of a patient from an undersampled MR image of the patient.

7. The method of claim 1 , wherein the trained generator model is configured to reduce a mean value and a standard deviation of measured values of the biomarker to suppress artificial values for the biomarker.

8. A computer system for training a generator model of a generative adversarial network (GAN) to remove artifacts from undersampled magnetic resonance imaging (MRI) data, the GAN comprising the generator model and a discriminator model, the computer system comprising:

a processor; and

a memory coupled to the processor, the memory storing instructions that, when executed by the processor, cause the computer system to:

(a) obtain the undersampled 3D MRI data from fully-sampled 3D MRI data;

(b) provide the undersampled 3D MRI data to the generator model, wherein the generator model is configured to output a generated example in response thereto;

(c) provide the generated example and a real example based on the fully-sampled 3D MRI data to the discriminator model,

(d) apply adversarial loss, L2 loss, and structural similarity index measure loss to the generator model based on a classification output by the discriminator model;

(e) repeat (a)-(d) until the generator model has been trained to remove the artifacts from the undersampled 3D MRI data; and

(f) generate, using the trained generator model, a parameter map for a biomarker from an undersampled MRI data set associated with a patient.

9. The computer system of claim 8 , wherein the undersampled 3D MRI data were created via k-space data undersampling.

10. The computer system of claim 8 , wherein the artifacts comprise at least one of streaking, aliasing, or ghosting.

11. The computer system of claim 8 , wherein the undersampled 3D MRI data were obtained via a Cartesian trajectory.

12. The computer system of claim 8 , wherein the undersampled 3D MRI data were obtained via a non-Cartesian trajectory.

13. The computer system of claim 8 , wherein the memory stores further instructions that, when executed by the processor, cause the computer system to:

generate, using the trained generator model, an image of a patient from an undersampled MR image of the patient.

14. A non-transitory medium storing program instructions for training a generator model of a generative adversarial network (GAN) to remove artifacts from undersampled magnetic resonance imaging (MRI) data, the GAN comprising the generator model and a discriminator model, the program instructions executable by a processing apparatus to:

a) obtain the undersampled 3D MRI data from fully-sampled 3D MRI data;

b) provide the undersampled 3D MRI data to the generator model, wherein the generator model is configured to output a generated example in response thereto;

c) provide the generated example and a real example based on the fully-sampled 3D MRI data to the discriminator model,

d) apply adversarial loss, L2 loss, and structural similarity index measure loss to the generator model based on a classification output by the discriminator model;

(e) repeat (a) (d) until the generator model has been trained to remove the artifacts from the undersampled 3D MRI data; and

(f) generate, using the trained generator model, a parameter map for a biomarker from an undersampled MRI data set associated with a patient.

15. The medium of claim 14 , wherein the undersampled 3D MRI data were created via k-space data undersampling.

16. The medium of claim 14 , wherein the undersampled 3D MRI data were obtained via a non-Cartesian trajectory.

17. The medium of claim 14 , the program instructions executable by a processing apparatus to:

generate, using the trained generator model, an image of a patient from an undersampled MR image of the patient.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2022
From: HU, PENG; GAO, CHANG; GHODRATI, VAHID
To: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
Reel/Frame 061212/0639 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2021
From: SIEMENS MEDICAL SOLUTIONS USA, INC.
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 057020/0507 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2021
From: ZHONG, XIAODONG
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 056976/0613 →
Continuity (1)
Related Publication 20220381861A1 · Dec 1, 2022
References Cited (31)
US 10902651B2 · Huang · 2021 [cited by examiner]
US 11842498B2 · Laaksonen · 2023 [cited by examiner]
US 20070096732A1 · Samsonov · 2007 [cited by examiner]
US 20190108634A1 · Zaharchuk · 2019 [cited by examiner]
US 20190128989A1 · Braun · 2019 [cited by examiner]
US 20190219654A1 · Park · 2019 [cited by examiner]
US 20190369191A1 · Gong · 2019 [cited by examiner]
US 20200090382A1 · Huang · 2020 [cited by examiner]
US 20200372297A1 · Terjek · 2020 [cited by examiner]
US 20210158583A1 · Huang · 2021 [cited by examiner]
US 20210183070A1 · Laaksonen · 2021 [cited by examiner]
US 20210199743A1 · Yap · 2021 [cited by examiner]
US 20210217213A1 · Cole · 2021 [cited by examiner]
US 20210287780A1 · Korani · 2021 [cited by examiner]
US 20220026514A1 · Chen · 2022 [cited by examiner]
US 20220139003A1 · Zhu · 2022 [cited by examiner]
Lv et al., “PIC-GAN: A Parallel Imaging Coupled Generative Adversarial Network for Accelerated Multi-Channel MRI Reconstruction”, Diagnostics 2021, 11, 61, pp. 1-15 (Year: 2021). [cited by examiner]
Block KT, Chandarana H, Milla S, et al. Towards Routine Clinical Use of Radial Stack-of-Stars 3D Gradient-Echo Sequences for Reducing Motion Sensitivity. J Korean Soc Magn Reson Med. 2014; 18(2):87. doi:10.13104/iksmrm.… [cited by applicant]
Fujinaga Y, Kitou Y, Ohya A, et al. Advantages of radial volumetric breath-hold examination (VIBE) with k-space weighted image contrast reconstruction (KWIC) over Cartesian VIBE in liver imaging of volunteers simulating… [cited by applicant]
Armstrong T, Dregely I, Stemmer A, et al. Free-breathing liver fat quantification using a multiecho 3D stack-of-radial technique: Free-Breathing Radial Liver Fat Quantification. Magn Reson Med. 2018;79(1):370-382. doi: … [cited by applicant]
Zhong X, Hu HH, Armstrong T, et al. Free-Breathing Volumetric Liver R2* and Proton Density Fat Fraction Quantification in Pediatric Patients Using Stack-of-Radial MRI With Self-Gating Motion Compensation. J Magn Reson I… [cited by applicant]
Feng L, Grimm R, Block KT, et al. Golden-angle radial sparse parallel MRI: Combination of compressed sensing, parallel imaging, and golden-angle radial sampling for fast and flexible dynamic volumetric MRI: iGRASP: Iter… [cited by applicant]
Chandarana H, Feng L, Block TK, et al. Free-Breathing Contrast-Enhanced Multiphase MRI of the Liver Using a Combination of Compressed Sensing, Parallel Imaging, and Golden-Angle Radial Sampling: Investigative Radiology.… [cited by applicant]
Sun J, Li H, Xu Z. Deep ADMM-Net for compressive sensing MRI. InAdvances in neural information processing systems 2016 (pp. 10-18). [cited by applicant]
Mardani M, Gong E, Cheng JY, et al. Deep Generative Adversarial Neural Networks for Compressive Sensing MRI. IEEE Trans Med Imaging. 2019;38(1):167-179. doi:10.1109/TMI.2018.2858752. [cited by applicant]
Wu Y, Ma Y, Capaldi DP, et al. Incorporating prior knowledge via volumetric deep residual network to optimize the reconstruction of sparsely sampled MRI. Magnetic Resonance Imaging. 2020;66:93-103. doi: 10.1016/j.mri.20… [cited by applicant]
Han Y, Yoo J, Kim HH, Shin HJ, Sung K, Ye JC. Deep learning with domain adaptation for accelerated projection-reconstruction MR. Magnetic resonance in medicine. Sep. 2018;80(3):1189-205. [cited by applicant]
Hauptmann A, Arridge S, Lucka F, Muthurangu V, Steeden JA. Real-time cardiovascular MR with spatio-temporal artifact suppression using deep learning-proof of concept in congenital heart disease. Magn Reson Med. 2019;81(… [cited by applicant]
Grimm R, Block KT, Hutter J, Forman C, Hintze C, Kiefer B, Hornegger J. Self-gating reconstructions of motion and perfusion for free-breathing T1-weighted DCE-MRI of the thorax using 3D stack-of-stars GRE imaging. Proc.… [cited by applicant]
Zhong X, Armstrong T, Nickel MD, et al. Effect of respiratory motion on free-breathing 3D stack-of-radial liver R2* relaxometry and improved quantification accuracy using self-gating. Magn Reson Med 2020;83:1964-1978. [cited by applicant]
Gao, C. et al., Undersampling Artifact Reduction for Free-Breathing 3D Stack-Of-Radial MRI Based on Deep Adversarial Learning Network, ISMRM (May 15-20, 2021). [cited by applicant]