Medical image processing apparatus, method for operating medical image processing apparatus, and non-transitory computer readable medium for determining a medical image of interest based on degree of interest to a user
An endoscopic image viewing support server includes an endoscopic image acquiring unit configured to acquire imaging information, a section-of-interest setting unit configured to estimate a degree of interest and classify a plurality of endoscopic images in accordance with the degree of interest, and an endoscopic image selecting unit configured to select an endoscopic image from each of sections of interest at a ratio based on the degree of interest. The section-of-interest setting unit is configured to determine an endoscopic image of interest from among the plurality of endoscopic images, and in a case where the plurality of endoscopic images are arranged in a chronological order, estimate the degree of interest for an endoscopic image in an endoscopic image group including the endoscopic image of interest by using image processing.
1 . A medical image processing apparatus comprising a processor with a memory configured to:
acquire imaging information that has a plurality of medical images captured by a user using an imaging sensor and that has accessory information recorded in association with each medical image, the accessory information including at least one of capturing time information indicating a time at which each medical image is captured, and position information indicating a position of the imaging sensor when each medical image is captured;
estimate, from the imaging information, a degree of interest of the user when the medical image is captured, the estimating of the degree of interest including:
determining movement of the imaging sensor on the basis of at least one of the capturing time information and the position information, the movement of the imaging sensor being evaluated using at least one of (a) an imaging interval between adjacent medical images, (b) a staying time of the imaging sensor at a same position, and (c) a number of medical images captured at the same position; and
calculating the degree of interest based on the movement of the imaging sensor;
set sections of interestto which the plurality of medical images are classified in accordance with the degree of interest;
select a medical image from each section of interest at a ratio that is based on the degree of interest; and
determine a medical image of interest from among the plurality of medical images on the basis of the imaging information, and in a case where the plurality of medical images are arranged in a chronological order, estimate the degree of interest for at least one medical image in a medical image group including the medical image of interest by using image processing, wherein
the medical image is an endoscopic image captured by an imaging sensor of an endoscope,
the accessory information has, recorded therein, position information indicating a position in a subject where the imaging sensor is located when the medical image is captured, and a capturing time at which the medical image is captured, and
the processor is configured to acquire the position information and the capturing time, and use, as the degree of interest, a length of a stay time during which the imaging sensor stays at the same position when the medical image is captured.
2 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to, in the estimation of the degree of interest using image processing, use, as the degree of interest, a degree of similarity with preceding and subsequent medical images in an arrangement in a chronological order.
3 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to:
determine a medical image including an abnormal region to be the medical image of interest; and
in the estimation of the degree of interest using image processing, use, as the degree of interest, a degree of abnormality of the abnormal region.
4 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to:
determine a medical image including an abnormal region to be the medical image of interest; and
in the estimation of the degree of interest using image processing, use, as the degree of interest, a state of treatment for the abnormal region.
5 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to:
in addition to perform the estimation of the degree of interest using image processing, use, as the degree of interest, a value inversely proportional to a capturing interval with respect to preceding and subsequent medical images in an arrangement in a chronological order.
6 . The medical image processing apparatus according to claim 1 , wherein
the processor is configured to count, using the position information, the number of times of capturing in which the imaging sensor captures the medical image at the same position, and use the number of times of capturing as the degree of interest.
7 . The medical image processing apparatus according to claim 1 , wherein
the accessory information is wavelength rangeinformation of a light source used to capture the medical image, and
the processor is configured to estimate the degree of interest from the wavelength range information.
8 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to acquire the medical image and the accessory information, the medical image being captured by the user operating a device.
9 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to acquire the medical image and the accessory information, the medical image being automatically captured without the user operating a device.
10 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to select the medical image within a range not exceeding the number of images designated by the user.
11 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to display the selected medical image in an order that is based on the degree of interest.
12 . The medical image processing apparatus according to claim 1 , wherein the processor is configured to store the selected medical image in a storage device.
13 . A method for operating a medical image processing apparatus, the method comprising:
acquiring imaging information that has a plurality of medical images captured by a user using an imaging sensor and that has accessory information recorded in association with each medical image, the accessory information including at least one of capturing time information indicating a time at which each medical image is captured, and position information indicating a position of the imaging sensor when each medical image is captured;
estimating, from the imaging information, a degree of interest of the user when the medical image is captured, the estimating of the degree of interest including:
determining movement of the imaging sensor on the basis of at least one of the capturing time information and the position information, the movement of the imaging sensor being evaluated using at least one of (a) an imaging interval between adjacent medical images, (b) a staying time of the imaging sensor at a same position, and (c) a number of medical images captured at the same position; and
calculating the degree of interest based on the movement of the imaging sensor;
setting sections of interest to which the plurality of medical images are classified in accordance with the degree of interest;
selecting a medical image from each section of interest at a ratio that is based on the degree of interest; and
determining a medical image of interest from among the plurality of medical images on the basis of the imaging information, and in a case where the plurality of medical images are arranged in a chronological order, estimating the degree of interest for at least one medical image in a medical image group including the medical image of interest by using image processing, wherein
the medical image is an endoscopic image captured by an imaging sensor of an endoscope,
the accessory information has, recorded therein, position information indicating a position in a subject where the imaging sensor is located when the medical image is captured, and a capturing time at which the medical image is captured, and
the method further comprises a step of acquiring the position information and the capturing time, and using, as the degree of interest, a length of a stay time during which the imaging sensor stays at the same position when the medical image is captured.
14 . A non-transitory computer readable medium for storing a computer-executable program for performing image processing on a medical image,
the computer-executable program causing a computer to implement:
a function of acquiring imaginginformation that has a plurality of medical images captured by a user using an imaging sensor and that has accessory information recorded in association with each medical image, the accessory information including at least one of capturing time information indicating a time at which each medical image is captured, and position information indicating a position of the imaging sensor when each medical image is captured;
a function of estimating, from the imaging information, a degree of interest of the user when the medical image is captured, the estimating of the degree of interest including:
determining movement of the imaging sensor on the basis of at least one of the capturing time information and the position information, the movement of the imaging sensor being evaluated using at least one of (a) an imaging interval between adjacent medical images, (b) a staying time of the imaging sensor at a same position, and (c) a number of medical images captured at the same position; and
calculating the degree of interest based on the movement of the imaging sensor;
a function of setting sections of interest to which the plurality of medical images are classified in accordance with the degree of interest;
a function of selecting a medical image from each section of interest at a ratio that is based on the degree of interest; and
a function of determining a medical image of interest from among the plurality of medical images on the basis of the imaging information, and in a case where the plurality of medical images are arranged in a chronological order, estimating the degree of interest for at least one medical image in a medical image groupincluding the medical image of interest by using image processing, wherein
the medical image is an endoscopic image captured by an imaging sensor of an endoscope,
the accessory information has, recorded therein, position information indicating a position in a subject where the imaging sensor is located when the medical image is captured, and a capturing time at which the medical image is captured, and
the computer-executable program further causes the computer to implement a function of acquiring the position information and the capturing time, and using, as the degree of interest, a length of a stay time during which the imaging sensor stays at the same position when the medical image is captured.