IP Library › Granted Patent US 12,262,981
Granted Patent B1
US 12,262,981 · App. 17/327,450 · Granted Apr 1, 2025

Virtual microwave phantom generation

Inventors: Wenyi Shao (Laurel, MD); Todd McCollough (Barrington, IL)
A61B5/0507A61B5/055A61B5/4312A61B5/7267
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,981
App. No.
17/327,450
Granted
Apr 1, 2025
Kind
B1
Abstract

A method for generating virtual microwave (MW) phantoms at a specific MW frequency or multiple MW frequencies, comprising generating virtual MW phantoms using a generative neural network (generator) and identifying the authenticity of the virtual MW phantoms using a discriminative neural network (discriminator).

Claims (42)

1. A method for generating virtual microwave (MW) phantoms at a specific MW frequency, comprising:

generating virtual MW phantoms using a generative neural network (generator);

identifying the authenticity of the virtual MW phantoms using a discriminative neural network (discriminator);

wherein the generator is configured to generate virtual permittivity images or conductivity images at the specific MW frequency;

wherein the discriminator is configured to evaluate input permittivity images or conductivity images at the specific MW frequency;

selecting reconstructed MRI images from a searchable database of a plurality of reconstructed MRI images based on patient characteristics; and

converting the selected reconstructed MRI images to the input permittivity images or conductivity images at the specific MW frequency.

2. The method of claim 1 , further comprising training the generator and the discriminator in an alternative manner until a stopping criterion is reached wherein the virtual MW phantoms generated by the generator are realistic.

3. The method of claim 2 , wherein training the generator and the discriminator occurs using at least one of a plurality of computational processors or graphics processing units operating in parallel.

4. The method of claim 2 , further comprising generating electric fields from the virtual realistic MW phantoms using computational electromagnetic simulations.

5. The method of claim 4 , further comprising training a neural network using the generated electric fields as input and the virtual realistic MW phantoms as output.

6. The method of claim 5 , further comprising:

receiving collected electric fields; and

inputting the received collected electric fields to the neural network to reconstruct at least one permittivity image or conductivity image at the specific MW frequency.

7. A method for generating virtual microwave (MW) phantoms at a specific MW frequency, comprising:

generating virtual MW phantoms using a generative neural network (generator);

identifying the authenticity of the virtual MW phantoms using a discriminative neural network (discriminator);

wherein the generator comprises a plurality of transposed convolutional layers, batch normalization layers, and non-linear activation functions and wherein the discriminator comprises a plurality of convolutional layers, batch normalization layers, and non-linear activation functions.

8. The method of claim 7 , wherein at least a subset of the transposed convolutional layers are replaced by fully-connected layers.

9. A method for generating virtual microwave (MW) phantoms at multiple MW frequencies, comprising:

generating virtual MW phantoms using a generative neural network (generator);

identifying the authenticity of the virtual MW phantoms using a discriminative neural network (discriminator);

wherein the generator is configured to simultaneously generate a set of wideband MW images for each virtual MW phantom of the MW phantoms at the multiple MW frequencies; wherein the set of MW images comprises:

an image showing the distribution of the permittivity (ε ∞ ) at infinite high frequency;

an image showing the distribution of the permittivity (ε s ) at static frequency; and

an image showing the static conductivity (σ s ) at static frequency.

10. The method of claim 9 , wherein the set of wideband MW images further comprises: an image showing the distribution of relaxation parameter a; and an image showing the distribution of principal relaxation time (τ) of dipole rotation.

11. The method of claim 9 , wherein the discriminator is configured to evaluate input permittivity images or conductivity images at the multiple MW frequencies.

12. The method of claim 9 , wherein the virtual MW phantoms are virtual 3-D MW breast phantoms.

13. A method for generating virtual microwave (MW) phantoms, comprising:

generating virtual MRI phantoms using a generative neural network (generator);

identifying the authenticity of the virtual MRI phantoms using a discriminative neural network discriminator

converting the virtual MRI phantoms to virtual MW phantoms;

training the generator and the discriminator in an alternative manner until a stopping criterion is reached wherein the virtual MRI phantoms generated by the generator are realistic and hence conversion to virtual MW phantoms is realistic;

generating electric fields from the virtual realistic MW phantoms using computational electromagnetic simulations; and

training a neural network using the generated electric fields as input and the virtual realistic MW phantoms as output.

14. The method of claim 13 , further comprising:

receiving collected electric fields from at least one data acquisition site; and

inputting the received collected electric fields to the neural network to reconstruct at least one of (1) a permittivity image and conductivity image at a specific MW frequency or (2) a set of wideband MW images showing the distribution of permittivity and conductivity at a plurality of MW frequencies.

15. The method of claim 13 , further comprising:

selecting reconstructed MRI images from a searchable database of a plurality of reconstructed MRI images based on patient characteristics; and

wherein the discriminator is configured to evaluate the selected reconstructed MRI images.

Continuity (1)
Provisional Application 63036291 · Jun 8, 2020
References Cited (28)
US 7825667B2 · Fang et al. · 2010 [cited by applicant]
US 9111334B2 · McCollough et al. · 2015 [cited by applicant]
US 9386936B2 · McCollough et al. · 2016 [cited by applicant]
US 9504404B1 · Shao et al. · 2016 [cited by applicant]
US 9704275B2 · McCollough et al. · 2017 [cited by applicant]
US 9869641B2 · McCollough et al. · 2018 [cited by applicant]
US 10436895B2 · Shao et al. · 2019 [cited by applicant]
US 10983209B2 · Shao et al. · 2021 [cited by applicant]
US 10998101B1 · Tran · 2021 [cited by examiner]
US 20200330026A1 · Zhu · 2020 [cited by examiner]
US 20200364860A1 · Kearney · 2020 [cited by examiner]
US 20210128070A1 · Kim · 2021 [cited by examiner]
Shao (“Microwave Imaging by Deep Learning Network: Feasibility and Training Method”, IEEE Transactions on Antennas and Propagation, vol. 68, No. 7 Jul. 2020, published on Mar. 12, 2020, pp. 5626-5635) (Year: 2020). [cited by examiner]
Goodfellow (“Generative Adversarial Networks” Proceedings of the International Conference on Neural Information Processing Systems (NIPS 2014), pp. 2672-2680) (Year: 2014). [cited by examiner]
Senaras et al., (“Optimized generation of high-resolution phantom images using cGAN: Application to quantification of Ki67 breast cancer images” PLOS ONE (May 9, 2018), pp. 1-12) (Year: 2018). [cited by examiner]
Nikolova NK. Microwave imaging for breast cancer. IEEE Microw. Magzine. 2011; 12(7): 78-94. [cited by applicant]
Shao W, McCollough T. Advances in Microwave Near-Field Imaging: Prototypes, Systems, and Applications. IEEE Microwave Magazine. 2020; 21(5): 94-119. [cited by applicant]
Ashtari A, et al. Using a priori information for regularization in breast microwave image reconstruction. IEEE Trans Biomed Eng. 2010; 57(9): 2197-2208. [cited by applicant]
Shao W, Pomper GM, Du Y. A learned reconstruction network for SPECT imaging. IEEE Trans Radiation Plasma Med Sci. 2021, 5(1): 26-34. [cited by applicant]
Shao W., Du Y. Microwave imaging by deep learning network: feasibility and training method. IEEE Trans Antennas Propag. 2020; 68(7): 5626-5635. [cited by applicant]
Hahn C, Noghanian S. Heterogeneous breast phantom development for microwave imaging using regression models. Inter J Biomed Imag. 2012; 2012: 1-12. Article ID 803607. [cited by applicant]
Joachimowica N, Conessa C, Henriksson T, Duchene B. Breast phantoms for microwave imaging. IEEE Antennas Wireless Propag Lett. 2014; 13: 1333-1336. [cited by applicant]
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative Adversarial Networks (PDF). Proceedings of the International Conference on Neural Information Processing Systems (… [cited by applicant]
Radford A, Metz L, Chintala S. Unsupervised representation learning with deep convolutional generative adversarial networks. ICLR 2016 proceedings. 2016; 1-16. [cited by applicant]
Kazuhiro K, et al. Generative Adversarial Networks for the Creation of Realistic Artificial Brain Magnetic Resonance Images. Tomography. 2018; 4(4): 159-163. [cited by applicant]
Zastrow E, et al. Development of anatomically realistic numerical breast phantoms with accurate dielectric properties for modeling microwave interactions with human breast. IEEE Trans. Biomed Eng. 2008; 55(12):2792-2800. [cited by applicant]
Shao W, McCollough W. Multiple-GPU-based frequency-dependent finite-difference time domain formulation using MATLAB parallel computing toolbox. PIER. 2017; 72: 1-13. [cited by applicant]
Shao, W, Yong, D. SPECT Image Reconstruction by Deep Learning Using a Two-Step Training Method. JNM. 2019; 60 (supp. 1): 1353. [cited by applicant]
Cited By (1)
US 12,462,544