IP Library Granted Patent US 11,550,011
Granted Patent B2
US 11,550,011 · App. 17/097,436 · Granted Jan 10, 2023

Systems and methods for magnetic resonance imaging standardization using deep learning

Inventors: Tao Zhang (Mountain View, CA); Enhao Gong (Sunnyvale, CA); Gregory Zaharchuk (Stanford, CA)
Assignee: SUBTLE MEDICAL, INC.
G01R33/54G06N3/04G06T7/0012G06T2207/10088G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,550,011
App. No.
17/097,436
Granted
Jan 10, 2023
Kind
B2
Abstract

A computer-implemented method for transforming magnetic resonance (MR) imaging across multiple vendors is provided. The method comprises: obtaining a training dataset, wherein the training dataset comprises a paired dataset and an un-paired dataset, and wherein the training dataset comprises image data acquired using two or more MR imaging devices; training a deep network model using the training dataset; obtaining an input MR image; and transforming the input MR image to a target image style using the deep network model.

Claims (28)

1. A computer-implemented method for transforming magnetic resonance (MR) imaging across multiple vendors comprising:

(a) during a training phase, obtaining a training dataset, wherein the training dataset comprises a paired dataset and an un-paired dataset, wherein the training dataset comprises image data acquired using two or more MR imaging devices provided by two or more different vendors, and wherein the image data have different image styles of MR imaging;

(b) training a deep network model to learn a function that transforms images of different image styles to a target image style, wherein the training comprises using a combination of supervised learning and unsupervised learning, and wherein the supervised learning comprises using the paired data set of the training dataset to train the deep network model and the unsupervised learning comprises using the un-paired dataset to train the deep network model;

(c) after the deep network model is trained, using the trained deep network model to generate a synthesized MR image by processing an input MR image, wherein the synthesized MR image has the target image style and the input MR image has an image style different from the target image style; and

(d) displaying the synthesized MR image with the target image style on a display device.

2. The computer-implemented method of claim 1 , wherein the image data acquired using the two or more MR imaging devices save different image styles.

3. The computer-implemented method of claim 1 , wherein the plurality of different image styles are different in at least one of contrast, resolution and image distortion.

4. The computer-implemented method of claim 1 , wherein the target image style is pre-determined or selected based on a set of pre-determined rules.

5. The computer-implemented method of claim 4 , wherein the target image style comprises one or more characteristics including contrast, resolution or image distortion.

6. The computer-implemented method of claim 1 , wherein the target image style is consistent with an image style corresponding to a given MR imaging device, wherein the given MR imaging device is different from an MR imaging device used for acquiring the input MR image.

7. The computer-implemented method of claim 1 , wherein the paired dataset comprises reference image data acquired using a first MR imaging device and an original image data acquired using a second MR imaging device that is different from the first MR imaging device.

8. The computer-implemented method of claim 1 , wherein the combination of supervised learning and unsupervised learning comprises training the deep network model using the supervised learning and further enhancing the deep network model using the unsupervised learning.

9. The computer-implemented method of claim 1 , wherein the unsupervised learning comprises using Cycle Generative Adversarial Network.

10. The computer-implemented method of claim 1 , wherein the deep learning model comprises U-net neural network structures.

11. The computer-implemented method of claim 1 , wherein the target image style is determined by a user via a graphical user interface.

12. A non-transitory computer-readable storage medium including instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

(a) during a training phase, obtaining a training dataset, wherein the training dataset comprises a paired dataset and an un-paired dataset, wherein the training dataset comprises image data acquired using two or more MR imaging devices provided by two or more different vendors, and wherein the image data comprises different image styles of MR imaging;

(b) training a deep network model to learn a function that transforms images of different image styles to a target image style, wherein the training comprises using a combination of supervised learning and unsupervised learning, and wherein the supervised learning comprises using the paired data set of the training dataset and the unsupervised learning comprises using the un-paired dataset to train the deep network model;

(c) after the deep network model is trained, using the trained deep network model to generate a synthesized MR image by processing an input MR image, wherein the synthesized MR image has the target image style and the input MR image has an image style different from the target image style; and

(d) displaying the synthesized MR image with the target image style on a display device.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the image data acquired using the two or more MR imaging devices have different image styles.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the plurality of different image styles are different in at least one of contrast, resolution and image distortion.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the target image style is pre-determined or selected based on a set of pre-determined rules.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the target image style comprises one or more characteristics including contrast, resolution or image distortion.

17. The non-transitory computer-readable storage medium of claim 12 , wherein the target image style corresponds to an image style of a given MR imaging device, wherein the given MR imaging device is different from a MR imaging device used for acquiring the input MR image.

18. The non-transitory computer-readable storage medium of claim 12 , wherein the paired dataset comprises reference image data acquired using a first MR imaging device and an original image data acquired using a second MR imaging device that is different from the first MR imaging device.

19. The non-transitory computer-readable storage medium of claim 12 , wherein the combination of supervised learning and unsupervised learning comprises training the deep network model using the supervised learning and further enhancing the deep network model using the unsupervised learning.

20. The non-transitory computer-readable storage medium of claim 12 , wherein the unsupervised learning comprises using Cycle Generative Adversarial Network.

Assignments (2)
GRANT OF SECURITY INTEREST IN PATENTS Recorded May 29, 2026
From: SUBTLE MEDICAL, INC.
To: MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC
Reel/Frame 075648/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2020
From: GONG, ENHAO; ZHANG, TAO; ZAHARCHUK, GREGORY
To: SUBTLE MEDICAL, INC.
Reel/Frame 054363/0813 →
Continuity (3)
Continuation PCTUS2019037235 · Jun 14, 2019
Provisional Application 62685774 · Jun 15, 2018
Related Publication 20210063518A1 · Mar 4, 2021
Cited By (4)
US 12,282,856 US 12,511,921 US 12,573,028 US 12,682,455