Image processing device, endoscope system, image processing method, and information storage medium

1 . An image processing device comprising:

a processor configured to:

acquire a surgery image captured by an endoscope;

recognize blood vessel running information indicating blood vessel running in a subject of the endoscope;

recognize a first bleeding position from the surgery image;

identify a second bleeding position in the blood vessel running information corresponding to the first bleeding position in the surgery image;

identify a bleeding stopping recommended point corresponding to the second bleeding position based on a direction of blood flow and a vascular bifurcation in the blood vessel running information; and

perform processing in which the identified bleeding stopping recommended point is superimposed on the surgery image and displayed on a display.

2 . The image processing device as defined in claim 1 ,

wherein the blood vessel running information is two-dimensional or three-dimensional information about a blood vessel of an inside of an organ, an image of which is captured by a method different from a method of capturing the surgery image.

3 . The image processing device as defined in claim 1 ,

wherein a trained model is trained to identify the bleeding stopping recommended point in the surgery image using information about a past bleeding stopping result,

wherein the processor is configured to identify the bleeding stopping recommended point in the surgery image by processing using the trained model.

4 . The image processing device as defined in claim 1 ,

wherein the processor is configured to:

extract a bleeding stopping point candidate corresponding to each of one or more blood vessel areas in the blood vessel running information based on the direction of blood flow and the vascular bifurcation in the blood vessel running information;

identify the blood vessel area among the one or more blood vessel areas, to which the second bleeding position belongs; and

identify the bleeding stopping point candidate corresponding to the identified blood vessel area as the bleeding stopping recommended point.

5 . The image processing device as defined in claim 1 ,

wherein the processor is configured to:

search for a bifurcation upstream of the second bleeding position in the blood vessel running information; and

identify, in a blood vessel area between the second bleeding position and the bifurcation upstream thereof, a position in the blood vessel running information where at least one of a size of a blood vessel or a depth of the blood vessel from an organ surface is within a predetermined range as the bleeding stopping recommended point.

6 . The image processing device as defined in claim 1 ,

wherein the processor is further configured to perform processing of highlighting an area in the surgery image, the area being affected when bleeding stopping treatment is performed on the bleeding stopping recommended point.

7 . An endoscope system, comprising:

the image processing device, the endoscope, and the display as defined in claim 1 .

8 . The image processing device as defined in claim 1 ,

wherein the processor is configured to:

acquire information about a bleeding stopping recommended point corresponding to each of one or more blood vessel areas in the blood vessel running information;

identify the blood vessel area among the one or more blood vessel areas, to which the second bleeding position belongs; and

perform processing in which the bleeding stopping recommended point corresponding to the identified blood vessel area is superimposed on the surgery image and displayed on the display.

9 . The image processing device as defined in claim 8 ,

wherein the processor is configured to:

extract a bleeding stopping point candidate corresponding to each of one or more blood vessel areas in the blood vessel running information based on the direction of blood flow and the vascular bifurcation in the blood vessel running information;

identify the blood vessel area among the one or more blood vessel areas, to which the second bleeding position belongs; and

identify the bleeding stopping point candidate corresponding to the identified blood vessel area as the bleeding stopping recommended point.

10 . An image processing method, comprising:

recognizing blood vessel running information indicating blood vessel running in a subject of an endoscope;

recognizing a first bleeding position from a surgery image captured by the endoscope;

identifying a second bleeding position in the blood vessel running information corresponding to the first bleeding position in the surgery image;

identifying a bleeding stopping recommended point corresponding to the second bleeding position based on a direction of blood flow and a vascular bifurcation in the blood vessel running information; and

performing processing in which the identified bleeding stopping recommended point is superimposed on the surgery image and displayed on a display.

11 . The image processing method as defined in claim 10 ,

wherein the blood vessel running information is two-dimensional or three-dimensional information about a blood vessel of an inside of an organ, an image of which is captured by a method different from a method of capturing the surgery image.

12 . The image processing method as defined in claim 10 , comprising:

identifying the bleeding stopping recommended point in the surgery image by processing using a trained model trained to identify the bleeding stopping recommended point in the surgery image using information about a past bleeding stopping result.

13 . The image processing method as defined in claim 10 , comprising:

extracting a bleeding stopping point candidate corresponding to each of one or more blood vessel areas in the blood vessel running information based on the direction of blood flow and the vascular bifurcation in the blood vessel running information;

identifying the blood vessel area among the one or more blood vessel areas, to which the second bleeding position belongs; and

identifying the bleeding stopping point candidate corresponding to the identified blood vessel area as the bleeding stopping recommended point.

14 . The image processing method as defined in claim 10 , comprising:

searching for a bifurcation upstream of the second bleeding position in the blood vessel running information; and

identifying, in a blood vessel area between the second bleeding position and the bifurcation upstream thereof, a position in the blood vessel running information where at least one of a size of a blood vessel or a depth of the blood vessel from an organ surface is within a predetermined range as the bleeding stopping recommended point.

15 . The image processing method as defined in claim 10 , comprising:

performing processing of highlighting an area in the surgery image, the area being affected when bleeding stopping treatment is performed on the bleeding stopping recommended point.

16 . The image processing method as defined in claim 10 , comprising

acquiring information about a bleeding stopping recommended point corresponding to each of one or more blood vessel areas in the blood vessel running information;

identifying the blood vessel area among the one or more blood vessel areas, to which the second bleeding position belongs; and

performing processing in which the bleeding stopping recommended point corresponding to the identified blood vessel area is superimposed on the surgery image and displayed on the display.

17 . The image processing method as defined in claim 16 , comprising:

extracting a bleeding stopping point candidate corresponding to each of one or more blood vessel areas in the blood vessel running information based on the direction of blood flow and the vascular bifurcation in the blood vessel running information;

identifying the blood vessel area among the one or more blood vessel areas, to which the second bleeding position belongs; and

identifying the bleeding stopping point candidate corresponding to the identified blood vessel area as the bleeding stopping recommended point.

18 . A non-transitory information storage medium storing a program causing a computer to execute:

recognizing blood vessel running information indicating blood vessel running in a subject of an endoscope;

recognizing a first bleeding position from a surgery image captured by the endoscope;

identifying a second bleeding position in the blood vessel running information corresponding to the first bleeding position in the surgery image;

identifying a bleeding stopping recommended point corresponding to the second bleeding position based on a direction of blood flow and a vascular bifurcation in the blood vessel running information; and

performing processing in which the identified bleeding stopping recommended point is superimposed on the surgery image and displayed on a display.