IP Library Granted Patent US 11,181,598
Granted Patent B2
US 11,181,598 · App. 16/857,908 · Granted Nov 23, 2021

Multi-contrast MRI image reconstruction using machine learning

Inventors: Daniel Polak (Blankenbach, DE); Kawin Setsompop (Charlestown, MA)
Assignees: Siemens Healthcare GmbH; The General Hospital Corporation
G01R33/5608A61B5/055A61B5/7207A61B5/7267G01R33/3607G01R33/4818G01R33/5611
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,181,598
App. No.
16/857,908
Granted
Nov 23, 2021
Kind
B2
Abstract

A computer-implemented method for reconstructing a MRI image, including: receiving a plurality of MRI measurement data sets ƒ 1 to ƒ N , wherein each data set is acquired from an examination object based on a different MRI protocol of an MRI system; receiving MRI images u 1 0 to u N 0 corresponding to the MRI measurement data sets ƒ 1 to ƒ N ; applying, in at least a first step GD 1 , trained functions to the MRI images u 1 0 to u N 0 , using a neural network and a forward-sampling operator, wherein at least one output MRI image u T is generated; and providing the at least one output MRI image u T , wherein the forward-sampling operator determines an agreement between at least one MRI image u 1 0 to u N 0 and the corresponding MRI measurement data set ƒ 1 to ƒ N .

Claims (81)

1. A computer-implemented method for reconstructing a MRI image, comprising:

receiving a plurality of MRI measurement data sets ƒ 1 to ƒ N , wherein each data set is acquired from an examination object based on a different MRI protocol of an MRI system;

receiving MRI images u 1 0 to u N 0 corresponding to the MRI measurement data sets ƒ 1 to ƒ N ;

applying, in at least a first step GD 1 , trained functions to the MRI images u 1 0 to u N 0 , using a neural network and a forward-sampling operator, wherein at least one output MRI image u T is generated; and

providing the at least one output MRI image u T ,

wherein the forward-sampling operator determines an agreement between at least one MRI image u 1 0 to u N 0 and the corresponding MRI measurement data set ƒ 1 to ƒ N .

2. The computer-implemented method according to claim 1 , wherein applying trained functions to the MRI images u 1 0 to u N 0 comprises:

applying a variational model to the MRI images u 1 0 to u N 0 , wherein, for each input MRI image u 1 0 to u N 0 , an output of the neural network and an output of the forward-sampling operator is subtracted from the respective input MRI image u 1 0 to u N 0 .

3. The computer-implemented method according to claim 1 , wherein the neural network is a convolutional neural network, and wherein applying trained functions to the MRI images u 1 0 to u N 0 comprises:

applying a plurality of trained filter functions to the MRI images u 1 0 to u N 0 simultaneously, using convolutions and non-linear activations, wherein each filter function is applied to each MRI image u 1 0 to u N 0 .

4. The computer-implemented method according to claim 1 , wherein, for each of the MRI images u 1 0 to u N 0 separately, the forward-sampling operator determines an agreement between of the MRI image u 1 0 to u N 0 and the corresponding MRI measurement data sets ƒ 1 to ƒ N using a MRI forward model of the corresponding MRI protocol.

5. The computer-implemented method according to claim 1 , further comprising:

receiving coil sensitivities C of the MRI system; and

receiving an under-sampling scheme for each MRI protocol;

wherein the forward-sampling operator determines an agreement between a respective MRI image u 1 0 to u N 0 and the corresponding MRI measurement data set ƒ 1 to ƒ N using a MRI forward model of the MRI protocol, based on the coil sensitivities C and the respective under-sampling scheme.

6. The computer-implemented method according to claim 1 , wherein applying, in at least one step GD 1 , trained functions to the MRI images u 1 0 to u n 0 comprises:

applying, in a plurality of steps GD 1 to GD T for a predefined number T, trained functions to the MRI images u 1 0 to u N 0 , each step GD t for t=1 . . . T comprising:

receiving input MRI images u 1 t−1 to u N t−1 ;

applying trained functions to the MRI images u 1 t−1 to u N t−1 , using the neural network, and the forward-sampling operator, wherein MRI output images u 1 t to u N t are generated; and

providing the MRI output images u i t to u N t .

7. The computer-implemented method according to claim 6 , wherein applying trained functions to the input MRI images u 1 t−1 to u N t−1 comprises:

applying the neural network and the forward-sampling operator on the input MRI images u 1 t−1 to u N t−1 ; and

subtracting, for each input MRI image u 1 t−1 to u N t−1 , an corresponding output of the neural network and output of the forward-sampling operator from the input MRI image u 1 t to u N t .

8. The computer-implemented method according to claim 1 , wherein the forward-sampling operator determines an agreement between each MRI image u i t−1 , with i=0 . . . N, and the corresponding MRI measurement dataset ƒ i , using the relation

λ

i

t

-

1

A

i

*

(

A

i

u

i

t

-

1

-

f

i

)

,

wherein λ i t−1 is a contrast specific regularization parameter, and A i is a MRI forward model for the corresponding MRI protocol.

9. The computer-implemented method according to claim 1 , wherein the MRI measurements data sets ƒ 1 to ƒ N are based on different MRI contrasts of the MRI system.

10. The computer-implemented method according to claim 1 , wherein the MRI measurement data sets ƒ 1 to ƒ N are acquired based on WAVE-CAIPI MRI protocols with different contrasts.

11. The computer-implemented method according to claim 1 , wherein the at least one output MRI image u T is an output image u i T , for i={1 . . . N}, of a plurality of output MRI images u 1 T to u N T , wherein each output MRI image u 1 T to u N T , corresponds to a respective one of the MRI images u 1 0 to u N 0 .

12. The computer-implemented method according to claim 1 , wherein each MRI measurement data set ƒ 1 to ƒ N is undersampled in k-space based on a specific under-sampling scheme.

13. The computer-implemented method according to claim 8 , wherein at least two of the MRI measurement data sets ƒ 1 to ƒ N are based on different under-sampling schemes, specifically on complementary under-sampling schemes.

14. The computer-implemented method according to claim 1 , wherein reconstructing MRI images u 1 0 to u N 0 from the MRI measurement data sets ƒ 1 to ƒ N further comprises:

removing a low-resolution background phase from the MRI images u 1 0 to u N 0 .

15. The computer-implemented method according to claim 1 , wherein applying trained functions to the MRI images u 1 0 to u N 0 further comprises:

dividing the coil sensitivities C, the MRI measurement data sets ƒ 1 to ƒ N , the MRI images u 1 0 to u N 0 , and the reference images g 1 to g N into patches of collapsing voxel groups, and

applying the trained functions to the patches of collapsing voxel groups of each MRI image u 1 0 to u N 0 individually.

16. A non-transitory computer-readable storage medium comprising a computer program having instructions which, when executed by a computer, cause the computer to carry out the method of claim 1 .

17. A computer-implemented method for providing trained functions for reconstructing an MRI image, comprising:

receiving a plurality of MRI measurement data sets ƒ 1 to ƒ N , wherein each data set is acquired from an examination object based on a different MRI protocol of an MRI system;

receiving reference MRI images g 1 to g N with reduced MRI artefacts or noise amplification compared to the MRI images u 1 0 to u N 0 , corresponding to the MRI measurement data sets ƒ 1 to ƒ N ;

receiving MRI images u 1 0 to u N 0 corresponding to the MRI measurement data sets ƒ 1 to ƒ N ;

applying, in at least a first step GD 1 , functions to the MRI images u 1 0 to u N 0 using a neural network and a forward-sampling operator, wherein at least one output MRI image u T is generated; and

determining a difference between the at least one output MRI image u T and the corresponding reference image g i , i={1 . . . N};

training the functions based on the determined difference; and

providing the trained functions;

wherein the forward-sampling operator determines an agreement between at least one MRI image u 1 0 to u N 0 and the corresponding MRI measurement data set ƒ 1 to ƒ N .

18. A computer configured for reconstructing an MRI image, the computer having a memory, an interface, and at least one processor, the memory storing instructions executable by said at least one processor, wherein execution of the instructions causes the computer to:

receive, by the interface, a plurality of MRI measurement data sets ƒ 1 to ƒ N , wherein each data set is acquired from an examination object based on a different MRI protocol of a MRI system;

receive, by the interface, MRI images u 1 0 to u N 0 corresponding to the MRI measurement data sets ƒ 1 to ƒ N ;

apply, by the processor, in at least a first step GD 1 , trained functions to the MRI images u 1 0 to u N 0 , using a neural network and a forward-sampling operator based on a MRI forward model, wherein at least one output MRI image u i T is generated; and

provide, by the interface, the at least one output MRI image u T ,

wherein the forward-sampling operator determines an agreement between at least one MRI image u 1 0 to u N 0 and the corresponding MRI measurement data set ƒ 1 to ƒ N .

19. The computer according to claim 18 , wherein execution of the instructions further causes the computer to:

receive reference MRI images g 1 to g N with reduced MRI artefacts or noise amplification compared to the MRI images u 1 0 to u N 0 , corresponding to the MRI measurement data sets ƒ 1 to ƒ N ;

determine a difference between the at least one output MRI image u T and the corresponding reference image g i , i={1 . . . N};

train the functions based on the determined difference; and

provide the trained functions.

20. An MRI system comprising at least one computer according to claim 18 .

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2021
From: SETSOMPOP, KAWIN
To: THE GENERAL HOSPITAL CORPORATION
Reel/Frame 056427/0145 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2021
From: POLAK, DANIEL
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 056427/0265 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2021
From: SETSOMPOP, KAWIN
To: THE GENERAL HOSPITAL CORPORATION
Reel/Frame 054965/0694 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2021
From: POLAK, DANIEL
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 054965/0779 →
Continuity (2)
Provisional Application 62838458 · Apr 25, 2019
Related Publication 20200341094A1 · Oct 29, 2020
Cited By (1)
US 12,189,011