Learning apparatus, learning method, trained model, and program
The learning apparatus includes a processor ( 129 ), a memory ( 114 ), and a learning model ( 126 ). The processor ( 129 ) performs processing of inputting a pseudo simple X-ray image ( 204 ), which is generated by projecting an X-ray CT image ( 202 ), to the learning model ( 126 ), processing of generating a second interpretation report ( 208 ) with respect to the pseudo simple X-ray image ( 204 ) by converting a first interpretation report ( 206 ), processing of acquiring an error between an estimation report ( 210 ) with respect to the pseudo simple X-ray image ( 204 ) output by the learning model ( 126 ) on the basis of the input pseudo simple X-ray image ( 204 ), and the second interpretation report ( 208 ), and processing of training the learning model ( 126 ) by using the error.
1 . A learning apparatus comprising:
a processor;
a memory that stores a training data set of an X-ray CT image having three dimensional information and a first interpretation report with respect to the X-ray CT image; and
a learning model that generates an interpretation report from a simple X-ray image having two dimensional information,
wherein the processor performs:
processing of acquiring a pseudo simple X-ray image, which is generated by projecting the X-ray CT image;
processing of generating a second interpretation report with respect to the pseudo simple X-ray image by converting the first interpretation report;
processing of inputting the pseudo simple X-ray image to the learning model and acquiring an estimation report with respect to the pseudo simple X-ray image;
processing of acquiring an error between the estimation report and the second interpretation report; and
processing of training the learning model by using the error.
2 . The learning apparatus according to claim 1 ,
wherein in the processing of generating the second interpretation report, the second interpretation report is generated from the first interpretation report by converting an organ label included in the first interpretation report into an organ label of the second interpretation report.
3 . The learning apparatus according to claim 1 ,
wherein in the processing of generating the second interpretation report, the second interpretation report is generated from the first interpretation report by converting a disease label included in the first interpretation report into a disease label of the second interpretation report.
4 . The learning apparatus according to claim 1 ,
wherein in the processing of generating the second interpretation report, a first knowledge graph corresponding to the first interpretation report is converted into a second knowledge graph corresponding to the second interpretation report, and the second interpretation report is generated on the basis of the conversion.
5 . The learning apparatus according to claim 1 ,
wherein in a case in which the memory stores the X-ray CT image obtained by imaging a subject in a first posture and the learning model generates an interpretation report from the simple X-ray image obtained by imaging the subject in a second posture, in the processing of inputting the pseudo simple X-ray image, the pseudo simple X-ray image in the second posture is generated from the X-ray CT image in the first posture, and the pseudo simple X-ray image in the second posture is input to the learning model.
6 . The learning apparatus according to claim 1 ,
wherein in the processing of inputting the pseudo simple X-ray image, the pseudo simple X-ray image projected in a first direction and the pseudo simple X-ray image projected in a second direction are generated from the X-ray CT image, and the pseudo simple X-ray image projected in the first direction and the pseudo simple X-ray image projected in the second direction are input to the learning model.
7 . The learning apparatus according to claim 1 ,
wherein the memory stores an additional training data set of the simple X-ray image and a disease label of the simple X-ray image, and
in the processing of acquiring the error, an error between the estimation report with respect to the pseudo simple X-ray image output by the learning model with reference to the disease label, and the second interpretation report is acquired.
8 . The learning apparatus according to claim 1 ,
wherein the memory stores an additional training data set of the simple X-ray image and a third interpretation report with respect to the simple X-ray image, and
in the processing of acquiring the error, the error between the estimation report with respect to the pseudo simple X-ray image output by the learning model on the basis of the input pseudo simple X-ray image, and the second interpretation report and an error between an estimation report with respect to the simple X-ray image output by the learning model on the basis of the input simple X-ray image, and the third interpretation report are acquired.
9 . The learning apparatus according to claim 1 ,
wherein the processor generates the second interpretation report by converting a text stated in the first interpretation report on a basis of a predefined conversion list.
10 . A learning method in which a processor trains a learning model, which generates an interpretation report from a simple X-ray image having two dimensional information, by using a training data set of an X-ray CT image having three dimensional information and a first interpretation report with respect to the X-ray CT image stored in a memory, the learning method comprising:
acquiring a pseudo simple X-ray image, which is generated by projecting the X-ray CT image;
generating a second interpretation report with respect to the pseudo simple X-ray image by converting the first interpretation report;
inputting the pseudo simple X-ray image to the learning model and acquiring an estimation report with respect to the pseudo simple X-ray image;
acquiring an error between the estimation report and the second interpretation report; and
training the learning model by using the error.
11 . The learning method according to claim 10 ,
wherein the second interpretation report is generated from the first interpretation report by converting an organ label included in the first interpretation report into an organ label of the second interpretation report.
12 . The learning method according to claim 10 ,
wherein the second interpretation report is generated from the first interpretation report by converting a disease label included in the first interpretation report into a disease label of the second interpretation report.
13 . The learning method according to claim 10 ,
wherein a first knowledge graph corresponding to the first interpretation report is converted into a second knowledge graph corresponding to the second interpretation report, and the second interpretation report is generated on the basis of the conversion.
14 . A non-transitory, computer-readable tangible recording medium on which a program for causing, when read by a computer, a processor of the computer to execute the learning method according to claim 10 is recorded.
15 . A trained model trained by the learning method according to claim 10 .