Information processing system, medical system and cannulation method
An information processing system, including a processor comprising hardware. The processor being configured to: acquire an endoscope image from an endoscope, the endoscope image showing a papillary portion, determine route information of a lumen based on the endoscope image, the lumen being at least one of a biliary duct or a pancreatic duct, generate a display image based on a result of the determination of the route information of the lumen, the display image having a route guide image to provide guidance of a route of the lumen leading to the papillary portion superimposed on the endoscope image, and display the display image on a display.
1 . An information processing system comprising:
a processor comprising hardware, the processor being configured to:
acquire an endoscope image from an endoscope, the endoscope image showing a papillary portion;
determine route information of a lumen based on the endoscope image, the lumen being at least one of a biliary duct and a pancreatic duct;
generate a display image based on a result of the determination of the route information of the lumen, the display image having a route guide image showing a route of the lumen leading to the papillary portion superimposed on the endoscope image; and
control a display to display the display image.
2 . The information processing system of claim 1 , wherein the route guide image comprises a lumen route image indicating a route of the biliary duct and a route of the pancreatic duct.
3 . The information processing system of claim 1 , wherein the route guide image comprises at least one of:
an image indicating a distance between a distal end of a treatment tool of the endoscope and the papillary portion; and
an image indicating an insertion direction of the treatment tool.
4 . The information processing system of claim 1 , further comprising a storage for storing a trained model trained to output the route information of the lumen based on the endoscope image,
wherein the processor is configured to determine the route information from the endoscope image by a processing based on the trained model.
5 . The information processing system of claim 4 , wherein the trained model is trained using training data based on a classification pattern of the papillary portion.
6 . The information processing system of claim 5 , wherein the classification pattern of the papillary portion is set as a correct answer data among the training data.
7 . The information processing system of claim 4 , wherein the trained model is trained using training data based on a magnetic resonance cholangio pancreatgraphy (MRCP) image.
8 . The information processing system of claim 7 , wherein the processor is configured to control another display to display the MRCP image.
9 . The information processing system of claim 7 , wherein the processor is configured to:
control the display to display the endoscope image in a first display region of the display; and
control the display to display the MRCP image on a second display region of the display.
10 . The information processing system of claim 7 , wherein the processor is configured to acquire the MRCP image prior to an insertion operation of the endoscope.
11 . The information processing system of claim 7 , wherein the MRCP image is set as a correct answer data among the training data.
12 . The information processing system of claim 4 , wherein the trained model is trained using training data based on an ultrasound endoscope image.
13 . The information processing system of claim 1 , wherein the processor is configured to:
acquire an MRCP image showing a part of the lumen; and
determine a route of the lumen between the papillary portion and the part of the lumen shown in the MRCP image based on the endoscope image and the MRCP image.
14 . The information processing system of claim 13 , further comprising:
a storage configured to store a trained model trained to output the route information of the lumen based on the endoscope image and the MRCP image,
wherein the processor is configured to determine the route of the lumen between the papillary portion and the part of the lumen shown in the MRCP image by inputting the endoscope image and the MRCP image into the trained model.
15 . The information processing system of claim 1 , wherein:
the endoscope is configured to electrically drive an endoscopic operation, the endoscopic operation being at least one of forward movement and backward movement of an insertion section of the endoscope, a bending angle of a bending section of the insertion section, and rolling rotation of the insertion section; and
the processor is configured to:
control positioning of a distal end section of the insertion section of the endoscope with respect to the papillary portion by the electrically-driven endoscopic operation; and
subsequent to the positioning, acquire the endoscope image.
16 . The information processing system of claim 1 , wherein:
the endoscope is configured to electrically drive an endoscopic operation, the endoscopic operation being at least one of forward and backward movement of an insertion section, a bending angle of a bending section of the insertion section, or rolling rotation of the insertion section; and
the processor is configured to control the electrically-driven endoscopic operation based on the result of the determination of the route information of the lumen.
17 . A medical system comprising:
the information processing system of claim 1 ; and
the endoscope.