MEDICAL INFORMATION PROCESSING DEVICE, MEDICAL INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
A medical information processing device of an embodiment includes processing circuitry. The processing circuitry acquires a plurality of verification data sets including medical data, result data obtained by inputting the medical data to a trained model, and true/false data regarding the result data. The processing circuit identifies a target verification data set suitable for evaluating a performance required for a trained model that outputs the result data in response to input of the medical data among the plurality of verification data sets on the basis of the relationship between a first trained model that outputs the result data in response to input of the medical data and the verification data sets.
1 . A medical information processing device comprising processing circuitry,
wherein the processing circuitry is configured to:
acquire a plurality of verification data sets including medical data, result data obtained by inputting the medical data to a trained model, and true/false data regarding the result data; and
identify a target verification data set suitable for evaluating a performance required for a trained model that outputs the result data in response to input of the medical data among the plurality of verification data sets on the basis of a relationship between a first trained model that outputs the result data in response to input of the medical data and the verification data sets.
2 . The medical information processing device according to claim 1 , wherein the processing circuitry evaluates a performance of a second trained model on the basis of a relationship between the first trained model and the target verification data set and a relationship between the second trained model and the verification data set,
wherein the second trained model is a trained model different from the first trained model and is a machine learning model trained to output the result data in response to input of the medical data.
3 . The medical information processing device according to claim 1 , wherein the result data is data regarding a diagnosis result, and the performance required of the trained model includes a low false positive false detection rate of the diagnostic result.
4 . The medical information processing device according to claim 3 , wherein the processing circuitry identifies the target verification data set including the verification data set in which the result data is positive and the true/false data is negative.
5 . The medical information processing device according to claim 1 , wherein the result data is data regarding a diagnosis result, and the performance required of the trained model includes a low false negative false detection rate of the diagnostic result.
6 . The medical information processing device according to claim 5 , wherein the processing circuitry identifies the target verification data set including the verification data set in which the result data is negative and the true/false data is positive.
7 . The medical information processing device according to claim 1 , wherein the true/false data includes data based on a finding report.
8 . The medical information processing device according to claim 1 , wherein the medical data is medical image data.
9 . A medical information processing method using a computer, the medical information processing method comprising:
acquiring a plurality of verification data sets including medical data, result data obtained by inputting the medical data to a trained model, and true/false data regarding the result data; and
identifying a target verification data set suitable for evaluating a performance required for a trained model that outputs the result data in response to input of the medical data among the plurality of verification data sets on the basis of a relationship between a first trained model that outputs the result data in response to input of the medical data and the verification data sets and a relationship between a second trained model that outputs the result data in response to input of the medical data and is different from the first trained model and the verification data sets.
10 . A computer-readable non-transitory storage medium storing a program for causing a computer to execute:
acquiring a plurality of verification data sets including medical data, result data obtained by inputting the medical data to a trained model, and true/false data regarding the result data; and
identifying a target verification data set suitable for evaluating a performance required for a trained model that outputs the result data in response to input of the medical data among the plurality of verification data sets on the basis of a relationship between a first trained model that outputs the result data in response to input of the medical data and the verification data sets and a relationship between a second trained model that outputs the result data in response to input of the medical data and is different from the first trained model and the verification data sets.