IP Library Granted Patent US 12,555,291
Granted Patent B2
US 12,555,291 · App. 17/655,013 · Granted Feb 17, 2026

Method for automated regularization of hybrid K-space combination using a noise adjustment scan

Inventors: Zahra Hosseini (Atlanta, GA); Bryan Clifford (Malden, MA); Thorsten Feiweier (Poxdorf, DE); Stephan Kannengiesser (Wuppertal, DE); Marcel Dominik Nickel (Herzogenaurach, DE); Stephen Farman Cauley (Somerville, MA)
Assignees: Siemens Healthineers AG; The General Hospital Corporation
G06T11/005A61B5/055A61B5/7264A61B2576/00G06T2207/10088G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,555,291
App. No.
17/655,013
Granted
Feb 17, 2026
Kind
B2
Abstract

The present disclosure is generally directed to systems and methods for generating de-noised MR images that are reconstructed from a hybridization of two separate image reconstruction pipelines, at least one of which includes the use of a neural network. Further, the amount of influence that the neural network reconstruction has on the hybrid reconstructed image is controlled via a regularization parameter that is selected based on an estimated noise level associated with the initial image acquisition, which can be calculated from pre-scan data.

Claims (124)

1 . A computer-implemented method for improving images captured via magnetic resonance imaging (MRI), the method comprising:

receiving, by a computer system, MRI data from an MRI machine, the MRI data comprising image data;

calculating, by the computer system, a noise level associated with the MRI data;

selecting, by the computer system, a regularization parameter corresponding to the calculated noise level;

processing, by the computer system, the image data through a first reconstruction pipeline to output a first reconstructed image;

processing, by the computer system, the image data through a second reconstruction pipeline to output a second reconstructed image, wherein the second reconstruction pipeline comprises a neural network; and

reconstructing, by the computer system, a hybrid image from the first reconstructed image and the second reconstructed image, wherein an amount that the second reconstructed image contributes to the hybrid image corresponds to the selected regularization parameter, wherein the regularization parameter is selected to cause the hybrid image to be de-noised relative to the image data,

wherein the hybrid image is reconstructed from a weighted combination of the first reconstructed image and the second reconstructed image and the reconstructing the hybrid image includes calculating, by the computer system, the hybrid image based on a measured k-space vector, a k-space sampling, a Fourier transform, a coil sensitivity corresponding to the MRI machine, a weighting matrix, the second reconstructed image, the image data, and the selected regularization parameter.

2 . The computer-implement method of claim 1 , wherein the first reconstruction pipeline comprises a sensitivity encoded (SENSE) reconstruction.

3 . The computer-implemented method of claim 1 , wherein selecting the regularization parameter comprises:

querying, by the computer system, a database comprising a plurality of regularization parameters indexed to a plurality of noise levels; and

selecting, by the computer system, the regularization parameter from the plurality of regularization parameters that corresponds to the calculated noise level.

4 . The computer-implemented method of claim 1 , wherein selecting the regularization parameter comprises:

calculating, by the computer system, the regularization parameter from a fitted parametric model relating the calculated noise level to the regularization parameter.

5 . The computer-implement method of claim 1 , wherein selecting the regularization parameter is subject to user-customized preferences.

6 . The computer-implement method of claim 1 , wherein reconstructing the hybrid image comprises

calculating, by the computer system, the hybrid image according to:

ρ

ˆ

=

argmin

ρ

d

-

Ω

FC

ρ

2

2

+

λ

WFC

(

ρ

n

e

t

-

ρ

)

2

2

wherein {circumflex over (p)} is the hybrid image, d is the measured k-space data vector, Ω is the k-space sampling, F is the Fourier transform, C is the coil sensitivity corresponding to the MRI machine, W is the weighting matrix, ρ net is the second reconstructed image, ρ is the image data, and λ is the selected regularization parameter.

7 . The computer-implement method of claim 1 , wherein the selected regularization parameter is varied spatially in the hybrid image.

8 . The computer-implement method of claim 1 , wherein the neural network comprises a deep neural network.

9 . The computer-implement method of claim 1 , wherein the neural network comprises a physics-informed network.

10 . The computer-implemented method of claim 1 , wherein:

the MRI data further comprises pre-scan data acquired without any generated MR signals; and

the noise level is calculated from the pre-scan data.

11 . The computer-implemented method of claim 1 , wherein the noise level comprises a signal-to-noise ratio.

12 . A magnetic resonance imaging (MRI) system for capturing images, the system comprising:

an MRI machine; and

a computer system coupled to the MRI machine, the computer system comprising a processor and a memory, the memory storing instructions that, when executed by the processor, cause the computer system to:

receive MRI data from the MRI machine, the MRI data comprising image data;

calculate a noise level associated with the MRI data;

select a regularization parameter corresponding to the calculated noise level;

process the image data through a first reconstruction pipeline to output a first reconstructed image;

process the image data through a second reconstruction pipeline to output a second reconstructed image, wherein the second reconstruction pipeline comprises a neural network; and

reconstruct a hybrid image from the first reconstructed image and the second reconstructed image, wherein an amount that the second reconstructed image contributes to the hybrid image corresponds to the selected regularization parameter, wherein the regularization parameter is selected to cause the hybrid image to be de-noised relative to the image data,

wherein the hybrid image is reconstructed from a weighted combination of the first reconstructed image and the second reconstructed image and the reconstructing the hybrid image includes calculating, by the computer system, the hybrid image based on a measured k-space vector, a k-space sampling, a Fourier transform, a coil sensitivity corresponding to the MRI machine, a weighting matrix, the second reconstructed image, the image data, and the selected regularization parameter.

13 . The MRI system of claim 12 , wherein the first reconstruction pipeline comprises a sensitivity encoded (SENSE) reconstruction.

14 . The MRI system of claim 12 , wherein the memory stores instructions that, when executed by the processor, cause the computer system to select the regularization parameter by:

querying a database comprising a plurality of regularization parameters indexed to a plurality of noise levels; and

selecting the regularization parameter from the plurality of regularization parameters that corresponds to the calculated noise level.

15 . The MRI system of claim 12 , wherein the memory stores instructions that, when executed by the processor, cause the computer system to select the regularization parameter by:

calculating, by the computer system, the regularization parameter from a fitted parametric model relating the calculated noise level to the regularization parameter.

16 . The MRI system of claim 12 , wherein the memory stores instructions that, when executed by the processor, cause the computer system to select the regularization parameter subject to user-customized preferences.

17 . The MRI system of claim 12 , wherein reconstructing the hybrid image comprises

calculating, by the computer system, the hybrid image according to:

ρ

ˆ

=

argmin

ρ

d

-

Ω

FC

ρ

2

2

+

λ

WFC

(

ρ

n

e

t

-

ρ

)

2

2

wherein {circumflex over (p)} is the hybrid image, d is the measured k-space data vector, Ω is the k-space sampling, F is the Fourier transform, C is the coil sensitivity corresponding to the MRI machine, W is the weighting matrix, ρ net is the second reconstructed image, ρ is the image data, and λ is the selected regularization parameter.

18 . The MRI system of claim 12 , wherein the selected regularization parameter is varied spatially in the hybrid image.

19 . The MRI system of claim 12 , wherein the neural network comprises a deep neural network.

20 . The MRI system of claim 12 , wherein the neural network comprises a physics-informed network.

21 . The MRI system of claim 12 , wherein:

the MRI data further comprises pre-scan data acquired without any generated MR signals; and

the noise level is calculated from the pre-scan data.

22 . The MRI system of claim 12 , wherein the noise level comprises a signal-to-noise ratio.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2024
From: CAULEY, STEPHEN FARMAN
To: THE GENERAL HOSPITAL CORPORATION
Reel/Frame 068393/0649 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2022
From: SIEMENS MEDICAL SOLUTIONS USA, INC.
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 059703/0945 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2022
From: FEIWEIER, THORSTEN; KANNENGIESSER, STEPHAN; NICKEL, MARCEL DOMINIK
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 059600/0839 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2022
From: HOSSEINI, ZAHRA; CLIFFORD, BRYAN
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 059419/0871 →
Continuity (2)
Provisional Application 63180128 · Apr 27, 2021
Related Publication 20220343564A1 · Oct 27, 2022
References Cited (29)
US 8135452B2 · Dougherty · 2012 [cited by examiner]
US 20110254548A1 · Setsompop · 2011 [cited by examiner]
US 20130039553A1 · Kjolby · 2013 [cited by examiner]
US 20160018498A1 · Boernert · 2016 [cited by examiner]
US 20160225169A1 · Bippus · 2016 [cited by examiner]
US 20200041592A1 · Huang · 2020 [cited by examiner]
US 20200300947A1 · Wang · 2020 [cited by examiner]
US 20200305756A1 · Wheaton · 2020 [cited by examiner]
US 20210035338A1 · Zhou · 2021 [cited by examiner]
US 20210192808A1 · Chen · 2021 [cited by examiner]
US 20230194639A1 · Feiweier · 2023 [cited by examiner]
EP 3916417A1 · 2021 [cited by examiner]
Bryan Clifford et al., “Clinical evaluation of an AI-accelerated two-minute multi-shot EPI protocol for comprehensive high-quality brain imaging,” ISMRM, 2020, pp. 1-3. (Year: 2020) (Year: 2020). [cited by examiner]
Matti Hanhela et al., “Data-Driven Regularization Parameter Selection in Dynamic MRI”, Journal of Imaging. 2021; 7(2):38. https://doi.org/10.3390/jimaging7020038 (Year: 2021) (Year: 2021). [cited by examiner]
Aggarwal, Hemant K., Merry P. Mani, and Mathews Jacob. “MoDL: Model-based deep learning architecture for inverse problems.” IEEE transactions on medical imaging 38.2 (2018): 394-405. (Year: 2019). [cited by examiner]
Lin, D. J., et al., “Artificial Intelligence for MR Image Reconstruction: An Overview for Clinicians.” Journal of Magnetic Resonance Imaging, 2020, jmri.27078. [cited by applicant]
Chaudhari, A. S., et a., “Prospective Deployment of Deep Learning in MRI□: A Framework for Important Considerations, Challenges, and Recommendations for Best Practices.” Journal of Magnetic Resonance Imaging, Aug. 24, 2… [cited by applicant]
Knoll, F., et al., “Deep Learning Methods for Parallel Magnetic Resonance Image Reconstruction.” ArXiv:1904.01112 [Cs, Eess], Apr. 1, 2019. [cited by applicant]
Blu, T., and Luisier, F., “The SURE-LET approach to image denoising.” IEEE Transactions on Image Processing 16.11, 2778-2786, (2007). [cited by applicant]
Kannengiesser, S. A. R, et al. “Universal iterative denoising of complex-valued volumetric MR image data using supplementary information.” ISMRM Abstract. vol. 2016. 1779. [cited by applicant]
Knoll, F. et al., “Assessment of the Generalization of Learned Image Reconstruction and the Potential for Transfer Learning.” Magnetic Resonance in Medicine 81, 1: 116-28, (2019). [cited by applicant]
Hammernik, K., et al. “Σ-Net: Systematic Evaluation of Iterative Deep Neural Networks for Fast Parallel MR Image Reconstruction.” ArXiv:1912.09278 [Cs, Eess], Dec. 18, 2019. [cited by applicant]
Recht, M., et al., “Using Deep Learning to Accelerate Knee MRI at 3T: Results of an Interchangeability Study”, American Journal of Radiology., doi:10.2214/AJR.20.23313 (2020). [cited by applicant]
He, J., et al.: “Modulating Image Restoration with Continual Levels via Adaptive Feature Modification Layers”, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2019). [cited by applicant]
Kellman P., McVeigh E.R., “Image reconstruction in SNR units: a general method for SNR measurement,” Magnetic Resonance in Medicine 54(6):1439-47, (2005). [cited by applicant]
Pruessmann, K.P., et al., “SENSE: Sensitivity Encoding for Fast MRI.” Magnetic Resonance in Medicine 42: 952-62, (1999). [cited by applicant]
Clifford, B., et al., “Clinical evaluation of an Al-accelerated two-minute multi-shot EPI protocol for comprehensive high-quality brain imaging,” ISMRM, 2021, pp. 1131. [cited by applicant]
Hyun, C. M., et al., “Deep learning for undersampled MRI reconstruction,” Phys. Med. Biol. 63, 135007 (2018). [cited by applicant]
U.S. Appl. No. 17/178,674, filed Feb. 18, 2021. [cited by applicant]