Medical image processing apparatus, medical image processing method, and program
A medical image processing apparatus includes a processor configured to perform: a first determination process of determining, based on an acquired medical image, whether any of a plurality of imaging target sites is included in the medical image; a second determination process of determining, if it is determined in the first determination process that any of the plurality of imaging target sites is included in the medical image, whether the medical image is an image satisfying a determination criterion of a site included in the medical image; and a display control process of displaying, if it is determined in the second determination process that the medical image is the image satisfying the determination criterion of the site included in the medical image, a notification indicator on a display unit, the notification indicator indicating that the image satisfying the determination criterion of the site included in the medical image is captured.
1. A medical image processing apparatus comprising one or more processors configured to perform:
a first determination process of determining, based on an acquired medical image, whether any of a plurality of imaging target sites is included in the medical image;
a second determination process of determining, if it is determined in the first determination process that any of the plurality of imaging target sites is included in the medical image, whether the medical image is an image satisfying a determination criterion corresponding to each of the plurality of imaging target sites; and
a display control process of displaying, if it is determined in the second determination process that the medical image is the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites, a notification indicator on a display unit, the notification indicator indicating that the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites is captured, wherein
in the display control process, a schematic diagram illustrating a luminal organ and the notification indicator corresponding to each of the plurality of imaging target sites are displayed.
2. The medical image processing apparatus according to claim 1 , wherein, in the display control process, the displaying of the notification indicator is maintained until the notification indicator for all the plurality of imaging target sites is displayed.
3. The medical image processing apparatus according to claim 1 , wherein, in the second determination process, determination is performed based on the determination criterion different for each of the plurality of imaging target sites.
4. The medical image processing apparatus according to claim 1 , wherein the second determination process is performed based on a plurality of indices and is performed based on determination results using the plurality of indices.
5. The medical image processing apparatus according to claim 4 , wherein the plurality of indices include at least one of out-of-focus/blurring determination, brightness determination, boundary visibility determination, cardia visibility determination, cardia distance determination, peristalsis determination, fold determination, treatment determination, or composition determination.
6. The medical image processing apparatus according to claim 1 , wherein, in the second determination process, determination is performed by a determiner different for each of the plurality of imaging target sites.
7. The medical image processing apparatus according to claim 1 , wherein
the first determination process is performed based on a determination result of a first determiner constituted by a convolutional neural network, and
at least a part of the second determination process is performed by inputting an intermediate feature amount acquired by the first determiner to a second determiner and outputting a determination result by the second determiner.
8. The medical image processing apparatus according to claim 1 , wherein
the medical image is captured using a first light source or a second light source, and
in the first determination process, if determination is performed on the medical image captured using the first light source, the determination is performed on the plurality of imaging target sites, and if determination is performed on the medical image captured using the second light source, the determination is performed on an imaging target site selected from the plurality of imaging target sites.
9. The medical image processing apparatus according to claim 1 , wherein
the medical image is an endoscopic image captured with an endoscope.
10. The medical image processing apparatus according to claim 9 , wherein, in the display control process, a guide indicator for guiding imaging with the endoscope for capturing the medical image is displayed on the schematic diagram.
11. The medical image processing apparatus according to claim 10 , wherein the guide indicator has a stick shape, an imaging direction of the endoscope is indicated by a direction of the stick shape, and a distance of the endoscope from a subject is indicated by a length of the stick shape.
12. The medical image processing apparatus according to claim 1 , wherein, in the display control process, site indicators of the plurality of imaging target sites are displayed at corresponding positions on the schematic diagram.
13. The medical image processing apparatus according to claim 12 , wherein, if it is determined in the second determination process that the medical image is the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites, in the display control process, the notification indicator is displayed by changing a display form of the site indicator for each of the plurality of imaging target sites.
14. The medical image processing apparatus according to claim 1 , wherein
the medical image is captured using a first light source or a second light source, and
in the display control process, if the medical image captured using the first light source is acquired, the schematic diagram is displayed in a first display mode, and if the medical image captured using the second light source is acquired, the schematic diagram is displayed in a second display mode.
15. The medical image processing apparatus according to claim 1 , wherein, if it is determined in the second determination process that the medical image is an image satisfying the determination criterion corresponding to each of the plurality of imaging target sites, in the display control process, information is displayed on the display unit, the information indicating that imaging of all the imaging target sites is completed.
16. The medical image processing apparatus according to claim 1 , wherein
the processor is configured to perform a storage process of storing the medical image in a memory if it is determined in the second determination process that the medical image is the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites.
17. The medical image processing apparatus according to claim 1 , wherein the plurality of imaging target sites are selected from at least an esophagogastric junction, a lesser curvature J-turn immediately below a cardia, a greater curvature U-turn immediately below the cardia, a lesser curvature posterior wall J-turn from an angulus or a lower body part, a pyloric ring from a prepyloric region, and a greater curvature in the lower body part from above.
18. The medical image processing apparatus according to claim 1 , wherein the plurality of imaging target sites are selected from at least a rectum, an anus, a splenic flexure, a hepatic flexure, a duodenal entrance, and ileocecal region.
19. A medical image processing method for a medical image processing apparatus comprising one or more processors, the method comprising:
performing, by the one or more processors,
a first determination step of determining, based on an acquired medical image, whether any of a plurality of imaging target sites is included in the medical image;
a second determination step of determining, if it is determined in the first determination step that any of the plurality of imaging target sites is included in the medical image, whether the medical image is an image satisfying a determination criterion corresponding to each of the plurality of imaging target sites; and
a display control step of displaying, if it is determined in the second determination step that the medical image is the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites, a notification indicator on a display unit, the notification indicator indicating that the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites is captured, wherein
in the display control process, a schematic diagram illustrating a luminal organ and the notification indicator corresponding to each of the plurality of imaging target sites are displayed.
20. A non-transitory, computer-readable tangible recording medium on which a program for causing, when read by a computer, the computer to execute:
a first determination step of determining, based on an acquired medical image, whether any of a plurality of imaging target sites is included in the medical image;
a second determination step of determining, if it is determined in the first determination step that any of the plurality of imaging target sites is included in the medical image, whether the medical image is an image satisfying a determination criterion corresponding to each of the plurality of imaging target sites; and
a display control step of displaying, if it is determined in the second determination step that the medical image is the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites, a notification indicator on a display unit, the notification indicator indicating that the image satisfying the determination criterion corresponding to each of the plurality of imaging target sites is captured, wherein
in the display control process, a schematic diagram illustrating a luminal organ and the notification indicator corresponding to each of the plurality of imaging target sites are displayed.