Control apparatus, recording medium recording learned model, and movement support method
A control apparatus includes a processor. The processor detects an image pickup scene based on a picked-up image acquired by an image pickup apparatus disposed in an insertion section included in an endoscope and calculates operation information corresponding to the image pickup scene using an approach of machine learning.
1 . A control apparatus comprising:
at least one processor comprising hardware, wherein the at least one processor is configured to:
detect an image pickup scene based on an endoscopic image acquired by an endoscope,
calculate operation information corresponding to the image pickup scene, the operation information including first operation information of a first operation for the endoscope and second operation information of a second operation for the endoscope and the second operation being an operation after the first operation in time series and different from the first operation, and
simultaneously output the first operation information and the second operation information as the operation information corresponding to the image pickup scene,
wherein:
the processor outputs, to a monitor, the operation information corresponding to the image pickup scene as an operation guide;
the operation guide includes a first operation guide indicating the first operation and a second operation guide indicating the second operation; and
the processor displays an arrow in which the first operation guide and the second operation guide are combined.
2 . The control apparatus according to claim 1 , wherein the image pickup scene is a folded lumen.
3 . The control apparatus according to claim 1 , wherein the arrow has a taper shape becoming smaller from the first operation guide to the second operation guide.
4 . The control apparatus according to claim 1 , wherein the arrow is displayed in gradation.
5 . The control apparatus according to claim 1 , wherein the processor detects a direction in which the endoscope is caused to slip into a folded lumen when the image pickup scene is the folded lumen and outputs the direction as the operation information corresponding to the image pickup scene.
6 . The control apparatus according to claim 1 , wherein the processor outputs the operation information corresponding to the image pickup scene when the processor detects that the image pickup scene is pressing into an intestine and insertion into a folded lumen is not being performed.
7 . The control apparatus according to claim 1 , wherein the processor outputs information indicating presence of a diverticulum when the image pickup scene is the diverticulum.
8 . The control apparatus according to claim 1 , wherein the processor stops outputting the operation information corresponding to the image pickup scene when the processor detects that the endoscope reaches an intestinal cecum.
9 . The control apparatus according to claim 1 , wherein the processor displays the arrow near a folded lumen.
10 . The control apparatus according to claim 1 , wherein the processor displays a folded lumen with emphasis.
11 . The control apparatus according to claim 1 , wherein the processor records the operation information corresponding to the image pickup scene and when the image pickup scene is a scene in which a lumen is lost sight of, detects a movement of the endoscope in the scene in which the lumen is lost sight of.
12 . The control apparatus according to claim 11 , wherein when the image pickup scene is not a folded lumen, the processor calculates a direction in which the folded lumen is present based on the movement of the endoscope in the image pickup scene in which the lumen is lost sight of.
13 . The control apparatus according to claim 12 , wherein the processor outputs information indicating an operation in which the endoscope is caused to slip into the folded lumen.
14 . The control apparatus according to claim 1 , wherein the processor outputs to the monitor the first operation guide and the second operation guide with numbers indicating order of operation.
15 . The control apparatus according to claim 1 , wherein the operation information corresponding to the image pickup scene is calculated based on a machine learning model.
16 . An endoscope system comprising:
an endoscope; and
at least one processor comprising hardware, the at least one processor being configured to:
detect an image pickup scene based on an endoscopic image acquired by the endoscope,
calculate operation information corresponding to the image pickup scene, the operation information including first operation information of a first operation for the endoscope and second operation information of a second operation for the endoscope and the second operation being an operation after the first operation in time series and different from the first operation, and
simultaneously output the first operation information and the second operation information as the operation information corresponding to the image pickup scene,
wherein:
the processor outputs, to a monitor, the operation information corresponding to the image pickup scene as an operation guide;
the operation guide includes a first operation guide indicating the first operation and a second operation guide indicating the second operation; and
the processor displays an arrow in which the first operation guide and the second operation guide are combined.
17 . The endoscope system according to claim 16 , wherein the image pickup scene is a folded lumen.