Medical image processing device and endoscope system
The medical image processing device acquires the plurality of types of medical images obtained by imaging a subject under imaging conditions different from each other. In a case where a first medical image that is one type of the plurality of types of medical images is input, diagnosis information regarding a diagnosis of the subject shown in the first medical image is generated. Diagnostic reference information is generated using assigned reference information that is the reference information assigned to a second medical image which is included in the medical image and which has a type different from the first medical image.
1 . A medical image processing device comprising:
one or more processors configured to:
acquire a plurality of types of medical images obtained by imaging a subject under imaging conditions different from each other, wherein a first type of medical image of the plurality of types of medical images is imaged under a first imaging condition of the imaging conditions and a second type of medical image of the plurality of types of medical images is imaged under a second imaging condition of the imaging conditions, as the first imaging condition is imaging under a specific spectrum of light and the second imaging condition is imaging under a normal light which is a broader spectrum than the specific spectrum;
generate, as a first medical image that is the first type of the plurality of types of medical images is input to the one or more processors, diagnosis information regarding a diagnosis of the subject shown in the first medical image;
generate, as a second medical image showing the same subject as the subject shown in the first medical image is input to the one or more processors, reference information regarding a reference for the diagnosis; and
output the diagnosis information and the reference information in association with each other, and
wherein the reference information is generated using assigned reference information that is the reference information assigned to the second medical image which is the second type of medical image.
2 . The medical image processing device according to claim 1 ,
wherein the one or more processors are configured to generate the reference information using the assigned reference information and the medical image showing the same subject as the subject shown in the second medical image to which the assigned reference information is assigned.
3 . The medical image processing device according to claim 1 ,
wherein the one or more processors are configured to, in a case where the medical image showing the same subject as the subject shown in the first medical image is input to the one or more processors:
acquire a feature amount of the input medical image; and
generate the reference information by converting the feature amount into the reference information.
4 . The medical image processing device according to claim 1 ,
wherein the one or more processors are configured to, in a case where the medical image showing the same subject as the subject shown in the first medical image is input to the one or more processors:
acquire a plurality of feature amounts of the input medical image; and
generate the reference information by converting the plurality of feature amounts into at least one piece of the reference information.
5 . The medical image processing device according to claim 1 ,
wherein the one or more processors are configured to include a first model that generates the diagnosis information, and
the first model has a layered structure including a first output layer that outputs the diagnosis information and at least one first intermediate layer.
6 . The medical image processing device according to claim 5 ,
wherein the one or more processors are configured to include a second model that generates the feature amount, and
the second model has a layered structure including a second output layer that outputs the feature amount and at least one second intermediate layer, and the second intermediate layer shares the first intermediate layer.
7 . The medical image processing device according to claim 1 ,
wherein the assigned reference information is the reference information assigned to the second medical image by a doctor through visual observation of the second medical image.
8 . The medical image processing device according to claim 1 ,
wherein the one or more processors are configured to, in a case where the first medical image is input to the one or more processors, acquire a first feature amount of the first medical image and generate the diagnosis information based on the first feature amount.
9 . The medical image processing device according to claim 8 ,
wherein the one or more processors are configured to generate the reference information by converting the first feature amount into the reference information using the assigned reference information and the first medical image showing the same subject as the subject shown in the second medical image to which the assigned reference information is assigned.
10 . The medical image processing device according to claim 1 ,
wherein the one or more processors are configured to, in a case where the second medical image showing the same subject as the subject shown in the first medical image is input to the one or more processors:
acquire a second feature amount of the second medical image; and
generate the reference information by converting the second feature amount into the reference information using the assigned reference information and the second medical image.
11 . The medical image processing device according to claim 10 ,
wherein the one or more processors are configured to acquire the second feature amount of the second medical image captured within a preset period before and after a time when the first medical image is captured.
12 . The medical image processing device according to claim 1 ,
wherein the one or more processors are configured to perform a control of displaying the first medical image and the second medical image on a display.
13 . The medical image processing device according to claim 12 ,
wherein the one or more processors are configured to perform a control of displaying the diagnosis information and the reference information, which are associated with each other, on the display.
14 . An endoscope system comprising:
a plurality of light sources that emit rays of light having different wavelength ranges;
a processor device that includes a light source processor which is configured to perform a control of emitting each of a plurality of types of illumination light having different combinations of light intensity ratios between the plurality of light sources;
an endoscope that images the subject illuminated with the illumination light; and
the medical image processing device according to claim 1 .