IP Library › Granted Patent US 12,367,620
Granted Patent B2
US 12,367,620 · App. 17/909,998 · Granted Jul 22, 2025

Trained model generation program, image generation program, trained model generation device, image generation device, trained model generation method, and image generation method

Inventors: Hiroyuki Kudo (Tsukuba, JP); Kazuki Mori (Tsukuba, JP)
Assignee: UNIVERSITY OF TSUKUBA
G06T11/005G06T5/70G06V10/82G06T2207/10081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,620
App. No.
17/909,998
Granted
Jul 22, 2025
Kind
B2
Abstract

A trained model generation program causes a computer to implement a learning execution function of inputting first input image data representing a first input image generated by a first reconstruction method using compressed sensing and second input image data representing a second input image generated by a second reconstruction method different from the first reconstruction method to a machine learning device to execute machine learning, the second reconstruction method being an analytical reconstruction method, and causing the machine learning device to generate a trained model, and a trained model acquisition function of acquiring trained model data indicating the trained model. Then, input image data representing an input image is input to the trained model to generate a reconstructed image with improved image quality.

Claims (90)

1. A non-transitory computer-readable storage medium storing a trained model generation program causing a computer to implement:

a learning execution function of:

inputting first input image data representing a first input image generated by a first reconstruction method using compressed sensing and second input image data representing a second input image generated by a second reconstruction method different from the first reconstruction method to a machine learning device to execute machine learning, the second reconstruction method being an analytical reconstruction method, and

causing the machine learning device to generate a trained model; and

a trained model acquisition function of acquiring trained model data indicating the trained model,

wherein the learning execution function searches for a smoothing parameter of the first reconstruction method, a weight used in a convolutional neural network that is used as the trained model, and a bias used in the convolutional neural network which minimize a mean squared error to cause the machine learning device to generate the trained model.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein the learning execution function searches for the smoothing parameter, the weight, and the bias which minimize the mean squared error represented by the following equation (1) to cause the machine learning device to generate the trained model:

[

Math

.

1

]

MSE

⁡

(

w

,

b

,

β

)

=

1

N

⁢

∑

i

=

1

N

x

i

-

CNN

⁡

(

w

,

b

)

[

y

i

z

i

(

β

)

]

2

(

1

)

where w is a vector in which weights used in the convolutional neural network are arranged in a row,

b is a vector in which biases used in the convolutional neural network are arranged in a row,

β is a smoothing parameter of the first reconstruction method,

x i is a vector in which values indicating densities represented by pixels of an output image are arranged in a row,

y i is a vector in which values indicating densities represented by pixels of the second input image are arranged in a row, and

z i is a vector in which values indicating densities represented by pixels of the first input image are arranged in a row.

3. The non-transitory computer-readable storage medium according to claim 1 , wherein the learning execution function:

inputs to the machine learning device at least the first input image data representing the first input image generated by the first reconstruction method using the compressed sensing configured with a first smoothing parameter and the first input image data representing the first input image generated by the first reconstruction method using the compressed sensing configured with a second smoothing parameter having a different value from the first smoothing parameter, and

causes the machine learning device to perform machine learning and generate the trained model.

4. The non-transitory computer-readable storage medium according to claim 1 , wherein the learning execution function:

inputs to the machine learning device output image data representing an output image generated by a third reconstruction method different from the first reconstruction method, in addition to the first input image data, and

causes the machine learning device to perform machine learning and generate the trained model.

5. An image generation program causing a computer to implement an image generation function of inputting input image data representing an input image to the trained model generated by the trained model generation program according to claim 1 to generate a reconstructed image.

6. A trained model generation device comprising:

a processor configured to:

input to a machine learning device first input image data representing a first input image generated by a first reconstruction method using compressed sensing and second input image data representing a second input image generated by a second reconstruction method different from the first reconstruction method, the second reconstruction method being an analytical reconstruction method;

cause the machine learning device to perform machine learning and generate a trained model; and

acquire trained model data indicating the trained model,

wherein the processor is configured to search for a smoothing parameter of the first reconstruction method, a weight used in a convolutional neural network that is used as the trained model, and a bias used in the convolutional neural network which minimize a mean squared error to cause the machine learning device to generate the trained model.

7. An image generation device comprising:

a processor configured to input input image data representing an input image to the trained model generated by the trained model generation device according to claim 6 to generate a reconstructed image.

8. A trained model generation method comprising:

inputting to a machine learning device first input image data representing a first input image generated by a first reconstruction method using compressed sensing and second input image data representing a second input image generated by a second reconstruction method different from the first reconstruction method, the second reconstruction method being an analytical reconstruction method;

causing the machine learning device to perform machine learning and generate a trained model; and

acquiring trained model data indicating the trained model,

wherein the method includes searching for a smoothing parameter of the first reconstruction method, a weight used in a convolutional neural network that is used as the trained model, and a bias used in the convolutional neural network which minimize a mean squared error to cause the machine learning device to generate the trained model.

9. An image generation method comprising inputting input image data representing an input image to the trained model generated by the trained model generation method according to claim 8 to generate a reconstructed image.

10. A non-transitory computer-readable storage medium storing a trained model generation program causing a computer implement:

a learning execution function of:

inputting first input image data including more than two first input images generated by a first reconstruction method using compressed sensing and second input image data including a second input image generated by a second reconstruction method different from the first reconstruction method to a machine learning device to execute machine learning, the second reconstruction method being an analytical reconstruction method, and

causing the machine learning device to generate a trained model; and

a trained model acquisition function of acquiring trained model data indicating the trained model,

wherein the more than two first input images are configured with different smoothing parameters from each other, and

wherein the learning execution function searches for a smoothing parameter of the first reconstruction method, a weight used in a convolutional neural network that is used as the trained model, and a bias used in the convolutional neural network which minimize a mean squared error to cause the machine learning device to generate the trained model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2022
From: KUDO, HIROYUKI; MORI, KAZUKI
To: UNIVERSITY OF TSUKUBA
Reel/Frame 061023/0404 →
Priority Claims (1)
JP 2020-042154 · Mar 11, 2020 · national
Continuity (1)
Related Publication 20230106845A1 · Apr 6, 2023
References Cited (21)
US 11112480B2 · Kartäusch · 2021 [cited by examiner]
US 11315221B2 · Matsuura · 2022 [cited by examiner]
US 20190251713A1 · Chen · 2019 [cited by examiner]
US 20190325621A1 · Wang et al. · 2019 [cited by applicant]
US 20190353741A1 · Bolster, Jr. et al. · 2019 [cited by applicant]
US 20190371018A1 · Ye et al. · 2019 [cited by applicant]
US 20200294287A1 · Schlemper · 2020 [cited by examiner]
US 20200311490A1 · Lee · 2020 [cited by examiner]
US 20210012543A1 · Hein · 2021 [cited by examiner]
US 20210118204A1 · Fu et al. · 2021 [cited by applicant]
CN 107871332A · 2018 [cited by applicant]
CN 110751701A · 2020 [cited by applicant]
JP 2018134199A · 2018 [cited by applicant]
WO 2016033458A1 · 2016 [cited by applicant]
WO WO2017223560A1 · 2017 [cited by examiner]
International Search Report and Written Opinion mailed on Apr. 20, 2021, received for PCT Application PCT/JP2021/006833, filed on Feb. 24, 2021, 10 pages including English Translation. [cited by applicant]
Han et al., “Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis”, arXiv: 1611.06391v2, Nov. 25, 2016, 10 pages. [cited by applicant]
Ma et al., “Low dose CT reconstruction assisted by an image manifold prior”, Medical Physics, arXiv: 1810.12255, Oct. 29, 2018, pp. 1-15. [cited by applicant]
European Search Report issued Mar. 5, 2024 in European Patent Application No. 21767498.5. [cited by applicant]
Yinsheng Li et al.: “Learning to Reconstruct Computed Tomography Images Directly From Sinogram Data Under A Variety of Data Acquisition Conditions”, IEEE Transactions on Medical Imaging, IEEE, USA, vol. 38, No. 10, Oct.… [cited by applicant]
Yongbo Wang et al: “Iterative quality enhancement via residual-artifact learning networks for low-dose CT”, Physics in Medicine and Biology, Institute of Physics Publishing, Bristol GB, vol. 63, No. 21, Oct. 23, 2018, p… [cited by applicant]