Processing system, image processing method, learning method, and processing device
A processing system includes a processor with hardware. The processor is configured to perform processing of acquiring a detection target image captured by an endoscope apparatus, controlling the endoscope apparatus based on control information, detecting a region of interest included in the detection target image based on the detection target image for calculating estimated probability information representing a probability of the detected region of interest, identifying the control information for improving the estimated probability information related to the region of interest within the detection target image based on the detection target image, and controlling the endoscope apparatus based on the identified control information.
1 . A processing system comprising:
a processor including hardware, wherein the processor is configured to:
acquire a first detection target image generated based on a first control information;
calculate a detection result of a region of interest and estimated probability of the detected result based on the first detection target image;
determine whether or not the estimated probability is equal to or higher than a first threshold;
output the detection result of the region of interest in a case where the estimated probability is equal to or higher than the first threshold; and
perform update of the first control information in a case where the estimated probability is less than the first threshold,
wherein in performing the update of the first control information, the processor is configured to:
identify a second control information and a third control information based on the first detection target image and the first control information;
acquire a second detection target image based on the second control information;
acquire a third detection target image based on the third control information;
detect the region of interest based the second detection target image and calculates a second estimated probability representing probability of a detection result;
detect the region of interest based the third detection target image and calculate a third estimated probability representing probability of a detection result; and
perform an update using control information used for outputting one of the second estimated probability and the third estimated probability that is higher as the first control information.
2 . An endoscope system comprising:
the processing system according to claim 1 ,
wherein the first control information includes at least one of light source control information for controlling a light source which irradiates an object with illumination light, imaging control information for controlling an imaging condition for capturing the detection target image, and image processing control information for controlling image processing to a signal of the captured image.
3 . The endoscope system according to claim 2 ,
wherein the light source control information includes at least one of a wavelength, light quantity ratio, light quantity, duty, and light distribution of a light source.
4 . The endoscope system according to claim 2 ,
wherein the imaging control information is an imaging frame rate.
5 . The endoscope system according to claim 2 ,
wherein the image processing control information includes at least one information of a color matrix, structure highlighting, noise reduction and automatic gain control.
6 . The processing system according to claim 1 ,
wherein the processor is configured to output the detection result of the region of interest and the estimated probability by inputting the first detection target image to a first trained model.
7 . The processing system according to claim 6 ,
wherein the processor is configured to output a parameter type that should be preferentially changed for improving the estimated probability by inputting the first detection target image and the first control information to a second trained model.
8 . The processing system according to claim 7 ,
wherein the processor is configured to identify the second control information and the third control information based on the parameter type.
9 . An endoscope system comprising:
the processing system according to claim 1 ,
wherein the processor is configured to generate a display image based on image processing control information.
10 . The endoscope system according to claim 9 ,
wherein the processor is configured to acquire the first detection target image and the display image alternately.
11 . The endoscope system according to claim 10 ,
wherein the processor is configured to superpose the detection result of the region of interest and information of the estimated probability on the display image.
12 . The processing system according to claim 1 ,
wherein the processor is configured to:
extract the region of interest from each frame of the first detection target image; and
continuously output the detection result of the region of interest.
13 . A method performed by a processor, the method comprising:
acquiring a first detection target image generated based on a first control information;
calculating a detection result of a region of interest and estimated probability of the detected result based on the first detection target image;
determining whether or not the estimated probability is equal to or higher than a first threshold;
outputting the detection result of the region of interest in a case where the estimated probability is equal to or higher than the first threshold; and
performing update of the first control information in a case where the estimated probability is less than the first threshold,
wherein performing the update of the first control information comprises:
identifying a second control information and a third control information based on the first detection target image and the first control information;
acquiring a second detection target image based on the second control information;
acquiring a third detection target image based on the third control information;
detecting the region of interest based the second detection target image and calculates a second estimated probability representing probability of a detection result;
detecting the region of interest based the third detection target image and calculate a third estimated probability representing probability of a detection result; and
performing an update using control information used for outputting one of the second estimated probability and the third estimated probability that is higher as the first control information.
14 . A non-transitory computer-readable storage medium storing instructions that cause a computer to at least perform:
acquiring a first detection target image generated based on a first control information;
calculating a detection result of a region of interest and estimated probability of the detected result based on the first detection target image;
determining whether or not the estimated probability is equal to or higher than a first threshold;
outputting the detection result of the region of interest in a case where the estimated probability is equal to or higher than the first threshold; and
performing update of the first control information in a case where the estimated probability is less than the first threshold,
wherein performing the update of the first control information comprises:
identifying a second control information and a third control information based on the first detection target image and the first control information;
acquiring a second detection target image based on the second control information;
acquiring a third detection target image based on the third control information;
detecting the region of interest based the second detection target image and calculates a second estimated probability representing probability of a detection result;
detecting the region of interest based the third detection target image and calculate a third estimated probability representing probability of a detection result; and
performing an update using control information used for outputting one of the second estimated probability and the third estimated probability that is higher as the first control information.