IP Library Granted Patent US 12,282,856
Granted Patent B2
US 12,282,856 · App. 18/058,658 · Granted Apr 22, 2025

Systems and methods for magnetic resonance imaging standardization using deep learning

Inventors: Tao Zhang (Mountain View, CA); Enhao Gong (Sunnyvale, CA); Gregory Zaharchuk (Stanford, CA)
Assignee: SUBTLE MEDICAL, INC.
G06N3/088G01R33/54G06N3/04G06T7/0012G06V10/764G06V10/82G06T2207/10088G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,856
App. No.
18/058,658
Granted
Apr 22, 2025
Kind
B2
Abstract

A computer-implemented method for transforming magnetic resonance (MR) imaging across multiple vendors is provided. The method comprises: obtaining a training dataset, wherein the training dataset comprises a paired dataset and an un-paired dataset, and wherein the training dataset comprises image data acquired using two or more MR imaging devices; training a deep network model using the training dataset; obtaining an input MR image; and transforming the input MR image to a target image style using the deep network model.

Claims (28)

1. A computer-implemented method for standardizing medical imaging, the method comprising:

acquiring one or more input images using one or more imaging devices, wherein the one or more imaging devices are of a same imaging modality and the one or more imaging devices correspond to one or more different image styles;

determining a standardized image style for processing the one or more input images;

predicting a synthesized output image by processing the one or more input images using a deep network model, wherein the synthesized output image has the standardized image style; and

displaying the synthesized output image with the standardized image style on a display device.

2. The computer-implemented method of claim 1 , wherein the standardized image style is determined by a user via a graphical user interface (GUI) rendered on the display device.

3. The computer-implemented method of claim 2 , wherein the standardized image style is determined by the user selecting an image style from a list of image styles.

4. The computer-implemented method of claim 1 , wherein the standardized image style is determined automatically based at least in part on the one or more input images.

5. The computer-implemented method of claim 1 , wherein the standardized image style comprises one or more characteristics including contrast, resolution, size, color, or image distortion.

6. The computer-implemented method of claim 1 , wherein the one or more imaging devices are magnetic resonance (MR) devices and are provided by one or more different vendors.

7. The computer-implemented method of claim 1 , wherein the one or more different image styles are different in at least one of contrast, resolution and image distortion.

8. The computer-implemented method of claim 1 , wherein the deep network model is trained using a combination of unsupervised learning and supervised learning.

9. The computer-implemented method of claim 8 , wherein the combination of unsupervised learning and supervised learning comprises training the deep network model using supervised training approach and further enhancing the deep network model using an unsupervised training approach.

10. The computer-implemented method of claim 8 , wherein the combination of unsupervised learning and supervised learning comprises using a combination of supervised loss and unsupervised loss.

11. A non-transitory computer-readable storage medium including instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

acquiring one or more input images using one or more imaging devices, wherein the one or more imaging devices are of a same imaging modality and the one or more imaging devices correspond to one or more different image styles;

determining a standardized image style for processing the one or more input images;

predicting a synthesized output image by processing the one or more input images using a deep network model, wherein the synthesized output image has the standardized image style; and

displaying the synthesized output image with the standardized image style on a display device.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the standardized image style is determined by a user via a graphical user interface (GUI) rendered on the display device.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the standardized image style is determined by the user selecting an image style from a list of image styles.

14. The non-transitory computer-readable storage medium of claim 11 , wherein the standardized image style is determined automatically based at least in part on the one or more input images.

15. The non-transitory computer-readable storage medium of claim 11 , wherein the standardized image style comprises one or more characteristics including contrast, resolution, size, color, or image distortion.

16. The non-transitory computer-readable storage medium of claim 11 , wherein the one or more imaging devices are magnetic resonance (MR) devices and are provided by one or more different vendors.

17. The non-transitory computer-readable storage medium of claim 11 , wherein the one or more different image styles are different in at least one of contrast, resolution and image distortion.

18. The non-transitory computer-readable storage medium of claim 11 , wherein the deep network model is trained using a combination of unsupervised learning and supervised learning.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the combination of unsupervised learning and supervised learning comprises training the deep network model using supervised training approach and further enhancing the deep network model using an unsupervised training approach.

20. The non-transitory computer-readable storage medium of claim 18 , wherein the combination of unsupervised learning and supervised learning comprises using a combination of supervised loss and unsupervised loss.

Assignments (2)
GRANT OF SECURITY INTEREST IN PATENTS Recorded May 29, 2026
From: SUBTLE MEDICAL, INC.
To: MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC
Reel/Frame 075648/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2022
From: ZHANG, TAO; GONG, ENHAO; ZAHARCHUK, GREGORY
To: SUBTLE MEDICAL, INC.
Reel/Frame 061980/0447 →
Continuity (4)
Continuation 17097436 · Nov 13, 2020
Continuation PCTUS2019037235 · Jun 14, 2019
Provisional Application 62685774 · Jun 15, 2018
Related Publication 20230162043A1 · May 25, 2023
References Cited (42)
US 9721340B2 · Gillies et al. · 2017 [cited by applicant]
US 10127659B2 · Hsieh et al. · 2018 [cited by applicant]
US 10871536B2 · Golden · 2020 [cited by examiner]
US 11550011B2 · Zhang et al. · 2023 [cited by applicant]
US 11704799B2 · Li · 2023 [cited by examiner]
US 20150238148A1 · Georgescu et al. · 2015 [cited by applicant]
US 20150347682A1 · Chen et al. · 2015 [cited by applicant]
US 20160203599A1 · Gillies et al. · 2016 [cited by applicant]
US 20170053064A1 · Bhavani · 2017 [cited by applicant]
US 20170072222A1 · Siversson · 2017 [cited by applicant]
US 20170200067A1 · Zhou et al. · 2017 [cited by applicant]
US 20170337682A1 · Liao et al. · 2017 [cited by applicant]
US 20170372193A1 · Mailhe et al. · 2017 [cited by applicant]
US 20180061058A1 · Xu et al. · 2018 [cited by applicant]
US 20180061059A1 · Xu et al. · 2018 [cited by applicant]
US 20180144243A1 · Hsieh et al. · 2018 [cited by applicant]
US 20180144244A1 · Masoud et al. · 2018 [cited by applicant]
US 20180144465A1 · Hsieh et al. · 2018 [cited by applicant]
US 20190049540A1 · Odry et al. · 2019 [cited by applicant]
US 20190066268A1 · Song et al. · 2019 [cited by applicant]
US 20190220977A1 · Zhou et al. · 2019 [cited by applicant]
US 20190223725A1 · Lu et al. · 2019 [cited by applicant]
US 20200090382A1 · Huang et al. · 2020 [cited by applicant]
US 20200205745A1 · Khosousi et al. · 2020 [cited by applicant]
US 20200342362A1 · Soni · 2020 [cited by examiner]
US 20200394459A1 · Xu et al. · 2020 [cited by applicant]
US 20210016109A1 · Sjolund · 2021 [cited by applicant]
US 20210233239A1 · Li et al. · 2021 [cited by applicant]
US 20210386391A1 · Karanam et al. · 2021 [cited by applicant]
US 20220334208A1 · Tamir et al. · 2022 [cited by applicant]
WO WO2019241659A1 · 2019 [cited by applicant]
Bahrami, Khosro, et al. “Reconstruction of 7T-like images from 3T MRI.” IEEE transactions on medical imaging 35.9 (2016): 2085-2097. [cited by applicant]
Extended European Search Report issued in European Application No. 19820086.7 on Feb. 11, 2022. [cited by applicant]
Gatys, L. et al. “Image style transfer using convolutional neural networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016. [cited by applicant]
Gong, et al. Creating Standardized MR Images with Deep Learning to Improve Cross-Vendor Comparability. Proceedings of the International Society for Magnetic Resonance in Medicine, ISMRM, Joint Annual Meeting ISMRM-ESMRM… [cited by applicant]
Johnson, J. et al., “Perceptual losses for real-time style transfer and super-resolution.” European Conference on Computer Vision. Springer International Publishing, 2016. [cited by applicant]
Liu, Fang, et al. “Deep Learning MR Imaging-based Attenuation Correction for PET/MR Imaging.” Radiology (2017): 170700. [cited by applicant]
PCT/US19/37235 International Search Report & Written Opinion dated Aug. 29, 2019. [cited by applicant]
U.S. Appl. No. 17/097,436 Notice of Allowance dated Nov. 17, 2022. [cited by applicant]
Xiao, et al. A deep convolutional network that accurately transforms between brain MRI contrasts. Proceedings of the International Society for Magnetic Resonance in Medicine, ISMRM, Joint Annual Meeting ISMRM-ESMRMB, Pa… [cited by applicant]
Zhang, et al. Separating Style and Content for Generalized Style Transfer. arxiv.org, Cornell University Library, 201 Olin Library Cornell University Ithaca, NY 14853, Nov. 17, 2017 (Nov. 17, 2017), 9 pages. XP080838067. [cited by applicant]
Zhu, Jun-Yan, et al. “Unpaired image-to-image translation using cycle-consistent adversarial networks.” arXiv preprint arXiv:1703.10593 (2017). [cited by applicant]
Cited By (1)
US 12,640,248