DEEP LEARNING-BASED ALGORITHM FOR REJECTING UNWANTED TEXTURES FOR X-RAY IMAGES
A medical image processing method, an X-ray diagnostic apparatus, and a method of generating a learned model includes receiving first X-ray image data, inputting the first X-ray image data to a trained model, outputting, from the trained model, an X-ray image having an image quality higher than an image quality of the first X-ray image data. The learned model was trained using contrastive learning using second X-ray image data as input data, third X-ray image data and fourth X-ray image data as label data, the third X-ray image data being negative label data having worse image quality than the second X-ray image data, and the fourth image data being positive label data having better image quality than the second X-ray image data.
1 . An X-ray image processing method, comprising:
receiving first X-ray image data;
inputting the first X-ray image data to a trained model; and
outputting, from the trained model, an X-ray image having an image quality higher than an image quality of the first X-ray image data,
wherein the trained model was trained using contrastive learning using second X-ray image data as input data, third X-ray image data and fourth X-ray image data as label data, the third X-ray image data being negative label data having worse image quality than the fourth X-ray image data, and the fourth image data being positive label data having better image quality than the second X-ray image data.
2 . The method of claim 1 , wherein the third X-ray image data includes X-ray image data with blurriness.
3 . The method of claim 1 , wherein the positive label data used in the training is X-ray image data with less noise and blurriness than the second X-ray image data.
4 . The method of claim 1 , wherein the second X-ray image data is image data with noise and blurriness, and the fourth X-ray image data is image data with less noise and less blurriness than the second X-ray image data.
5 . The method of claim 1 , wherein the contrastive learning uses a negative loss function term to learn from unwanted negative images used for the third X-ray image data.
6 . The method of claim 1 , wherein the contrastive learning simultaneously uses a negative loss term and a positive loss term.
7 . The method of claim 5 , wherein the contrastive learning includes encoding positive images, images predicted by the trained model, and the unwanted negative images so as to increase a weight for specific features.
8 . The method of claim 7 , wherein the encoding includes passing the images through a projection layer.
9 . The method of claim 1 , wherein the contrastive learning includes training a discriminator on an inverse of the contrastive loss using, as input to the discriminator, positive images, images predicted by the trained model, and the negative label data.
10 . An X-ray medical diagnosis apparatus, comprising:
processing circuitry configured to
receive first X-ray image data;
input the first X-ray image data to a trained model; and
output, from the trained model, an X-ray image having an image quality higher than an image quality of the first X-ray image data,
wherein the trained model was trained using contrastive learning using second X-ray image data as an input, and third X-ray image data and fourth X-ray image data as label data, the third X-ray image data being negative label data having worse image quality than the fourth X-ray image data, and the fourth image data being positive label data having better image quality than the second X-ray image data.
11 . The X-ray medical diagnosis apparatus of claim 10 , wherein the processing circuitry is further configured to receive, as the first X-ray image data, X-ray fluoroscopy image data from a sequence of fluoroscopy images obtained by an image collector.
12 . The X-ray medical diagnosis apparatus of claim 10 , wherein the processing circuitry is further configured to:
remove, from the trained neural network, weighted connections that are below a predetermined value, and
reduce a precision of the weighted connections of the trained neural network.
13 . The X-ray medical diagnosis apparatus of claim 10 , wherein the processing circuitry includes multiple processors and an image preprocessor;
the image preprocessor is configured to divide the first X-ray image data into a plurality of patches of image data, and
the multiple processors are configured to, based on the trained model, receive a subset of the plurality of patches of image data and generate respective restored patches of image data.
14 . A method of generating a trained model, comprising:
receiving first X-ray image data;
receiving second X-ray image, the second X-ray image data being unwanted negative image data having worse image quality than the first X-ray image data;
receiving third X-ray image, the third X-ray image data being wanted positive image data having better image quality than the first X-ray image data; and
training the neural network model using contrastive learning using the first X-ray image data as input data and the second and third X-ray data as label data,
wherein the contrastive learning includes a negative loss term for the neural network model to learn from the unwanted negative image data and a positive loss term for the neural network model to learn from the wanted positive image data.
15 . The method of claim 14 , wherein the contrastive learning simultaneously uses the negative loss term in combination with the positive loss term.
16 . The method of claim 14 , wherein the contrastive learning includes encoding positive images, images predicted by the trained model, and the unwanted negative image data so as to increase a weight for specific features.
17 . The method of claim 16 , wherein the encoding includes passing the predicted images through a projection layer.
18 . The method of claim 14 , wherein the contrastive learning includes training a discriminator on an inverse of the contrastive loss using, as input to the discriminator, positive image data, an image predicted by the trained model, and the unwanted negative image data.