IP Library › Granted Patent US 12,175,734
Granted Patent B2
US 12,175,734 · App. 16/969,072 · Granted Dec 24, 2024

CT big data from simulation, emulation and transfer learning

Inventors: Ge Wang (Loudonville, NY); Daniel David Harrison (Delanson, NY); Xun Jia (Dallas, TX); Klaus Mueller (New York, NY)
Assignee: Rensselaer Polytechnic Institute
G06V10/82A61B5/0033G06F18/214G06N3/04G06N3/08G06N3/10G06N20/00G06T11/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,175,734
App. No.
16/969,072
Granted
Dec 24, 2024
Kind
B2
Abstract

In some embodiments, a method of machine learning includes identifying, by an auto encoder network, a simulator feature based, at least in part, on a received first simulator data set and an emulator feature based, at least in part, on a received first emulator data set. The method further includes determining, by a synthesis control circuitry, a synthesized feature based, at least in part, on the simulator feature and based, at least in part, on the emulator feature; and generating, by the auto encoder network, an intermediate data set based, at least in part, on a second simulator data set and including the synthesized feature. Some embodiments of the method further include determining, by a generative artificial neural network, a synthesized data set based, at least in part, on the intermediate data set and based, at least in part, on an objective function.

Claims (34)

1. A method of machine learning, the method comprising:

identifying, by an auto encoder network, a simulator feature based, at least in part, on a received first simulator computed tomography (CT) data set;

identifying, by the auto encoder network, an emulator feature based, at least in part, on a received first emulator CT data set;

determining, by a synthesis control circuitry, a synthesized feature based, at least in part, on the simulator feature and based, at least in part, on the emulator feature; and

generating, by the auto encoder network, an intermediate data set based, at least in part, on a second simulator CT data set and comprising the synthesized feature.

2. The method of claim 1 , further comprising:

determining, by a generative artificial neural network, a synthesized CT data set based, at least in part, on the intermediate data set and based, at least in part, on an objective function.

3. The method of claim 1 , wherein the auto encoder network comprises an input stage, an output stage and a latent space coupled between the input stage and output stage, the simulator feature and the emulator feature extracted from the latent space and the synthesized feature provided to the latent space.

4. The method of claim 1 , wherein the synthesized feature is determined based, at least in part, on at least one of a linear interpolation and/or an algebraic manipulation.

5. The method of claim 1 , wherein each data set is selected from the group comprising CT sinogram and a reconstructed CT image.

6. The method of claim 2 , wherein the objective function comprises at least one parameter related to at least one of a physical characteristic, a physiological function and/or a model of a human organ.

7. A transfer learning apparatus comprising:

an auto encoder network configured to identify a simulator feature based, at least in part, on a received first simulator CT data set and an emulator feature based, at least in part, on a received first emulator CT data set; and

a synthesis control circuitry configured to determine a synthesized feature based, at least in part, on the simulator feature and based, at least in part, on the emulator feature,

the auto encoder network further configured to generate an intermediate data set based, at least in part, on a second simulator CT data set and comprising the synthesized feature.

8. The apparatus of claim 7 , further comprising a generative artificial neural network configured to determine a synthesized CT data set based, at least in part, on the intermediate data set and based, at least in part, on an objective function.

9. The apparatus of claim 7 , wherein the auto encoder network comprises an input stage, an output stage and a latent space coupled between the input stage and output stage, the simulator feature and the emulator feature extracted from the latent space and the synthesized feature provided to the latent space.

10. The apparatus according to claim 7 , wherein the synthesized feature is determined based, at least in part, on at least one of a linear interpolation and/or an algebraic manipulation.

11. The apparatus according to claim 7 , wherein each data set is selected from the group comprising a CT sinogram and a reconstructed CT image.

12. The apparatus of claim 8 , wherein the objective function comprises at least one parameter related to at least one of a physical characteristic, a physiological function and/or a model of a human organ.

13. A machine learning system comprising:

a simulator;

an emulator; and

a transfer learning circuitry comprising:

an auto encoder network configured to identify a simulator feature based, at least in part, on a received first simulator CT data set and an emulator feature based, at least in part, on a received first emulator CT data set; and

a synthesis control circuitry configured to determine a synthesized feature based, at least in part, on the simulator feature and based, at least in part, on the emulator feature,

the auto encoder network further configured to generate an intermediate data set based, at least in part, on a second simulator data set and comprising the synthesized feature.

14. The system of claim 13 , wherein the transfer learning circuitry further comprises a generative artificial neural network configured to determine a synthesized CT data set based, at least in part, on the intermediate data set and based, at least in part, on an objective function.

15. The system of claim 13 , wherein the auto encoder network comprises an input stage, an output stage and a latent space coupled between the input stage and output stage, the simulator feature and the emulator feature extracted from the latent space and the synthesized feature provided to the latent space.

16. The system according to claim 13 , wherein the synthesized feature is determined based, at least in part, on at least one of a linear interpolation and/or an algebraic manipulation.

17. The system according to claim 13 , wherein each data set is selected from the group comprising a CT sinogram and a reconstructed CT image.

18. The system of claim 14 , wherein the objective function comprises at least one parameter related to at least one of a physical characteristic, a physiological function and/or a model of a human organ.

19. The system according to claim 13 , wherein the simulator is a Monte Carlo simulator.

20. A computer readable storage device having stored thereon instructions that when executed by one or more processors result in the following operations comprising the method according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2020
From: WANG, GE; HARRISON, DANIEL DAVID
To: RENSSELAER POLYTECHNIC INSTITUTE
Reel/Frame 054197/0535 →
Continuity (2)
Provisional Application 62629464 · Feb 12, 2018
Related Publication 20210035340A1 · Feb 4, 2021