IP Library › Granted Patent US 11,756,197
Granted Patent B2
US 11,756,197 · App. 17/197,854 · Granted Sep 12, 2023

Systems and methods of processing magnetic resonance images using phase-sensitive structural similarity index measure

Inventors: Sangtae Ahn (Guilderland, NY); Uri Wollner (Ramat Gan, IL); Graeme C. Mckinnon (Hartland, WI); Rafael Shmuel Brada (Hod-Hasharon, IL); Christopher Judson Hardy (Schenectady, NY)
Assignee: GE PRECISION HEALTHCARE LLC
G06T7/0014G06N3/08G06V10/60G06T2207/10081G06T2207/10088G06T2207/20081G06T2207/30016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,756,197
App. No.
17/197,854
Filed
Mar 10, 2021
Granted
Sep 12, 2023
Kind
B2
Art Unit
2662
USPC
382/131
Abstract

A computer-implemented method of processing complex magnetic resonance (MR) images is provided. The method includes receiving a pair of corrupted complex data and pristine complex images. The method also includes training a neural network model using the pair by inputting the corrupted complex data to the neural network model, setting the pristine complex images as target outputs, and processing the corrupted complex data using the neural network model to derive output complex images of the corrupted complex data. Training a neural network model also includes comparing the output complex images with the target outputs by computing a phase-sensitive structural similarity index measure (PS-SSIM) between each of the output complex images and its corresponding target complex image, wherein the PS-SSIM is real-valued and varies with phases of the output complex image and phases of the target complex image, and adjusting the neural network model based on the comparison.

Claims (38)

1. A computer-implemented method of processing complex magnetic resonance (MR) images, comprising:

receiving a pair of corrupted complex data and pristine complex images corresponding to the corrupted complex data; and

training a neural network model using the pair of corrupted complex data and pristine complex images by:

inputting the corrupted complex data to the neural network model;

setting the pristine complex images as target outputs of the neural network model;

processing the corrupted complex data using the neural network model to derive output complex images of the corrupted complex data;

comparing the output complex images with the target outputs by computing a phase-sensitive structural similarity index measure (PS-SSIM) between each of the output complex images and its corresponding target complex image, wherein the PS-SSIM is real-valued and varies with phases of the output complex image and phases of the target complex image; and

adjusting the neural network model based on the comparison.

2. The method of claim 1 , wherein the PS-SSIM includes a luminance comparison function, the luminance comparison function varying with the phases of the output complex image and the phases of the target complex image.

3. The method of claim 2 , wherein the luminance comparison function reaches a maximum when means of image patches in the output complex image are equal to means of image patches in the target complex image.

4. The method of claim 2 , wherein the luminance comparison function reaches a maximum when means of real components of image patches in the output complex image are equal to means of real components of image patches in the target complex image and means of imaginary components of image patches in the output complex image are equal to means of imaginary components of image patches in the target complex image.

5. The method of claim 1 , wherein the PS-SSIM includes a contrast comparison function, the contrast comparison function varying with the phases of the output complex image and the phases of the target complex image.

6. The method of claim 5 , wherein the contrast comparison function reaches a maximum when standard deviations of image patches in the output complex image are equal to standard deviations of image patches in the target complex image.

7. The method of claim 5 , wherein the contrast comparison function reaches a maximum when standard deviations of real components of image patches in the output complex image are equal to standard deviations of real components of image patches in the target complex image and standard deviations of imaginary components of image patches in the output complex image are equal to standard deviations of imaginary components of image patches in the target complex image.

8. The method of claim 1 , wherein the PS-SSIM includes a structure comparison function, the structure comparison function varying with phases of the output complex image and phases of the target complex image.

9. The method of claim 8 , wherein the structure comparison function reaches a maximum when real components of image patches in the output complex image are linearly dependent upon real components of image patches in the target complex image and imaginary components of image patches in the output complex image are linearly dependent upon imaginary components of image patches in the target complex image.

10. The method of claim 8 , wherein the structure comparison function reaches a maximum when image patches in the output complex image are linearly dependent upon image patches in the target complex image.

11. The method of claim 8 , wherein the structure comparison function reaches a maximum when real components of image patches in the output complex image are positively fully correlated with real components of image patches in the target complex image and imaginary components of image patches in the output complex image are positively fully correlated with imaginary components of image patches in the target complex image.

12. The method of claim 8 , wherein the structure comparison function reaches a maximum when image patches in the output complex image are positively fully correlated with image patches in the target complex image.

13. An image processing system, comprising an image processing computing device, the image processing computing device comprising at least one processor in communication with at least one memory device, and the at least one processor programmed to:

receive a pair of corrupted complex data and pristine complex images corresponding to the corrupted complex data; and

train a neural network model using the pair of corrupted complex data and pristine complex images by:

inputting the corrupted complex data to the neural network model;

setting the pristine complex images as target outputs of the neural network model;

processing the corrupted complex data using the neural network model to derive output complex images of the corrupted complex data;

comparing the output complex images with the target outputs by computing a phase-sensitive structural similarity index measure (PS-SSIM) between each of the output complex images and its corresponding target complex image, wherein the PS-SSIM is real-valued and varies with phases of the output complex image and phases of the target complex image; and

adjusting the neural network model based on the comparison.

14. The system of claim 13 , wherein the PS-SSIM includes a luminance comparison function, the luminance comparison function varying with the phases of the output complex image and the phases of the target complex image.

15. The system of claim 14 , wherein the luminance comparison function reaches a maximum when means of image patches in the output complex image are equal to means of image patches in the target complex image.

16. The system of claim 13 , wherein the PS-SSIM includes a contrast comparison function, the contrast comparison function varying with the phases of the output complex image and the phases of the target complex image.

17. The system of claim 16 , wherein the contrast comparison function reaches a maximum when standard deviations of image patches in the output complex image are equal to standard deviations of image patches in the target complex image.

18. The system of claim 13 , wherein the PS-SSIM include a structure comparison function, the structure comparison function varying with phases of the output complex image and phases of the target complex image.

19. The system of claim 18 , wherein the structure comparison function reaches a maximum when real components of image patches in the output complex image are linearly dependent upon real components of image patches in the target complex image and imaginary components of image patches in the output complex image are linearly dependent upon imaginary components of image patches in the target complex image.

20. An image processing system, comprising an image processing computing device, the image processing computing device comprising at least one processor in communication with at least one memory device, and the at least one processor programmed to:

receive crude complex data;

process the crude complex data using a neural network model, wherein the neural network model was trained with a pair of corrupted complex data and pristine complex images with the corrupted complex data as inputs and the pristine complex images as target outputs, and a loss function of the neural network model that compares outputs of the neural network model and the target outputs of the neural network model includes a phase-sensitive structural similarity index measure (PS-SSIM) between each of the output complex images and its corresponding target complex image, wherein the PS-SSIM is real-valued and varies with phases of the output complex image and phases of the target complex image;

generate a predicted image of the crude complex data based on the processing; and

output the predicted image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2021
From: AHN, SANGTAE; WOLLNER, URI; MCKINNON, GRAEME C.; BRADA, RAFAEL SHMUEL; HARDY, CHRISTOPHER JUDSON
To: GE PRECISION HEALTHCARE LLC
Reel/Frame 055552/0804 →
Continuity (1)
Related Publication 20220292679A1 · Sep 15, 2022
Cited By (1)
US 12,488,431