Medical image processing apparatus, medical image processing method and computer-readable medium
A medical image processing apparatus includes: an obtaining unit configured to obtain a first image that is a medical image of a predetermined site of a subject; an image quality improving unit configured to generate, from the first image, a second image in which the image quality is improved compared to the first image by using an image quality improving engine that includes a machine learning engine; and a display controlling unit configured to cause a display unit to display a composite image obtained by combining the first image and the second image according to a ratio obtained using information relating to at least a partial region of the first image.
1 . A medical image processing apparatus comprising at least one of (a) one or more processors connected to one or more memories storing a program including instructions executed by the one or more processors and (b) circuitry configured to function as:
an obtaining unit configured to obtain a first image that is an image of a predetermined site of an eye to be examined; and
a display controlling unit configured to control a display unit to display one of the first image and a second image generated by inputting the first image into an image quality improving engine including a machine learning engine as an input image of the image quality improving engine
wherein:
in a case where an imaging condition of the first image is an imaging angle with which an image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to display the second image; and
in a case where the imaging condition of the first image is not the imaging angle with which the image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to display the first image.
2 . The medical image processing apparatus according to claim 1 , wherein:
in a case where an imaging condition of the first image is the imaging angle with which the image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to change the display of the first image into the display of the second image in accordance with an instruction from an operator.
3 . The medical image processing apparatus according to claim 1 , wherein:
in a case where an imaging condition of the first image is the imaging angle with which the image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to change the display of the first image into the display of the second image in accordance with an instruction of a button on a user interface displayed on the display unit.
4 . The medical image processing apparatus according to claim 1 , wherein:
the first image is an image included in a moving image of the predetermined site of the eye to be examined; and
the second image is sequentially generated.
5 . The medical image processing apparatus according to claim 1 , wherein:
the image quality improving engine including a machine learning engine obtained using an OCTA image as training data;
the first image is an OCTA image; and
an OCTA image is a motion contrast image indicating temporal change of the predetermined site, the motion contrast image obtained from an imaging result obtained by repeatedly imaging a same location.
6 . The medical image processing apparatus according to claim 5 , wherein:
the image quality improving engine includes a machine learning engine for which an OCTA image obtained by performing averaging process is adopted as training data.
7 . The medical image processing apparatus according to claim 5 , wherein:
the display unit is controlled to display an analysis result obtained by performing an image analysis relating to blood vessel density measurement on the second image in accordance with an instruction from an operator.
8 . The medical image processing apparatus according to claim 1 , wherein:
the second image has a higher image quality than the first image.
9 . The medical image processing apparatus according to claim 1 , wherein:
the second image has at least one of lower noise and higher contrast than the first image.
10 . The medical image processing apparatus according to claim 1 , wherein:
input data of training data of the image quality improving engine includes an image based on one or more images of an eye to be examined, and output data of the training data includes an image based on images of an eye to be examined which are more than the one or more images of the eye to be examined.
11 . The medical image processing apparatus according to claim 1 , wherein:
the second image is generated using an image quality improving engine selected in accordance with an imaging condition corresponding to the first image from among a plurality of image quality improving engines, and each of the plurality of image quality engines obtained by using different training data from each other with respect to imaging condition.
12 . The medical image processing apparatus according to claim 1 , wherein:
in a case where imaging conditions of the first image are an imaging system according to OCTA and the imaging angle with which the image quality improvement is capable of being performed by the image quality improving engine as imaging conditions with which the image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to display the second image.
13 . The medical image processing apparatus according to claim 1 , wherein:
the image quality improving engine further includes a machine learning engine obtained using an OCT image as training data; and
in a case where the imaging condition of the first image is an imaging system according to OCT as an imaging condition with which the image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to display the second image.
14 . An optical coherence tomography apparatus comprising:
an imaging unit arranged to image an eye to be examined; and
the medical image processing apparatus according to claim 1 .
15 . A medical image processing method comprising:
obtaining a first image that is an image of a predetermined site of an eye to be examined; and
controlling a display unit to display one of the first image and a second image generated by inputting the first image into an image quality improving engine including a machine learning engine as an input image of the image quality improving engine, wherein:
in a case where an imaging condition of the first image is an imaging angle with which an image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to display the second image; and
in a case where the imaging condition of the first image is not the imaging angle with which the image quality improvement is capable of being performed by the image quality improving engine, the display unit is controlled to display the first image.
16 . A non-transitory computer-readable medium having stored thereon a program for causing, when executed by a processor, the processor to execute respective steps of the medical image processing method according to claim 15 .