Medical image processing device, processor device, endoscope system, medical image processing method, and program
Provided is a medical image processing device, a processor device, a medical image processing method, and a computer-readable medium capable of obtaining a recognition result related to a region of interest and storing and displaying a medical image in which the recognition result matches an intention of an operator. The medical image processing device includes an image acquisition unit ( 40 ) that acquires a medical image ( 38 ), an acquired image storage unit ( 46 A) that stores the acquired medical image, a recognition processing unit ( 42 A) that performs recognition processing on the acquired medical image, a user input signal acquisition unit ( 50 ) that acquires a user input signal transmitted according to an operation of a user, and a selection unit ( 48 ) that selects a medical image from medical images for which a result of the recognition processing related to a region of interest is obtained in a case where the user input signal is acquired.
1. A medical image processing device comprising:
a processor configured to acquire medical images; and
a storage device configured to store the medical images; wherein
the processor performs recognition processing on the acquired medical images to obtain a recognition result related to a region of interest;
compares the recognition result of each of the medical images acquired with the recognition result of the medical image previously stored in the storage device and updates the medical image to be selected on the basis of a comparison result of the recognition results;
acquires a user input signal transmitted according to an operation of a user for performing a freeze display or a still image storage;
in a case where the user input signal is acquired, selects a medical image acquired at a timing near a timing at which the user input signal is acquired from the updated medical images for which the recognition result related to the region of interest detected in the medical images has been obtained in the recognition processing;
displays, on a monitor, the selected medical image and an emphasis display to emphasize the region of interest detected in the selected medical image as the recognition result related to the region of interest detected in the selected medical image; and
stores emphasis display information in association with the region of interest, the emphasis display information including a position of the emphasis display and a size of the emphasis display.
2. The medical image processing device according to claim 1 , wherein
the processor displays, on the monitor, the selected medical image for a certain period from the timing at which the user input signal is acquired.
3. The medical image processing device according to claim 2 , wherein
the processor performs processing on the selected medical image according to the recognition result of the selected medical image, and
displays, on the monitor, the selected medical image on which the processing is performed.
4. The medical image processing device according to claim 1 , wherein
the storage device stores the selected medical image.
5. The medical image processing device according to claim 4 ,
wherein the storage device stores the selected medical image in association with the recognition result of the selected medical image.
6. The medical image processing device according to claim 4 , wherein
the processor performs processing on the selected medical image according to the recognition result of the selected medical image, and
wherein the storage device stores the selected medical image on which the processing is performed.
7. The medical image processing device according to claim 1 , wherein
the processor evaluates an image quality of the acquired medical images, and
selects the selected medical image according to an image quality evaluation result of the selected medical image.
8. The medical image processing device according to claim 7 ,
wherein the processor evaluates at least one of blurriness, shake, brightness, presence or absence of noise, or sharpness of the medical images to be evaluated.
9. The medical image processing device according to claim 1 ,
wherein the processor selects the selected medical image on the basis of a period between the timing at which the user input signal is acquired and the timing at which the selected medical image is acquired.
10. The medical image processing device according to claim 1 ,
wherein the processor classifies the acquired medical images into one or more prescribed classes, and
selects the selected medical image classified into a predetermined class.
11. The medical image processing device according to claim 1 ,
wherein the processor measures the acquired medical images, and
selects the selected medical image in which a value measured is equal to or more than a predetermined threshold value.
12. The medical image processing device according to claim 1 ,
wherein the storage device stores the medical images acquired in a prescribed period.
13. The medical image processing device according to claim 1 , wherein
the processor applies emphasis processing on the region of interest;
selects the selected medical image in which the region of interest has been applied with the emphasis processing as the selected medical image for which the recognition result related to the region of interest has been obtained; and
displays, on the monitor, the emphasis display emphasizing the region of interest as the recognition result related to the region of interest.
14. The medical image processing device according to claim 13 , wherein
the processor specifies a position of the region of interest;
defines the position of the emphasis display according to the position of the region of interest;
specifies a size of the region of interest; and
defines the size of the emphasis display according to the size of the region of interest.
15. The medical image processing device according to claim 13 , wherein the processor stores different emphasis in association with the region of interest, the different emphasis being different from the emphasis applied for displaying the selected medical image.
16. A processor device comprising:
a processor configured to control an endoscope, and acquire medical images; and
a storage device configured to store the medical images acquired; wherein
the processor performs recognition processing on the acquired medical images to obtain a recognition result related to a region of interest;
compares the recognition result of each of the medical images acquired with the recognition result of the medical image previously stored in the storage device and updates the medical image to be selected on the basis of a comparison result of the recognition results;
acquires a user input signal transmitted according to an operation of a user for performing a freeze display or a still image storage;
in a case where the user input signal is acquired, selects a medical image acquired at a timing near a timing at which the user input signal is acquired from the updated medical images for which the recognition result related to the region of interest detected in the medical images has been obtained in the recognition processing;
displays, on a monitor, the selected medical image and an emphasis display to emphasize the region of interest detected in the selected medical image as the recognition result related to the region of interest detected in the selected medical image; and
stores emphasis display information in association with the region of interest, the emphasis display information including a position of the emphasis display and a size of the emphasis display.
17. An endoscope system comprising:
an endoscope;
a medical image processing device that performs processing on an endoscopic image acquired by using the endoscope,
wherein the medical image processing device includes
a processor configured to control the endoscope, and
acquire medical images; and
a storage device configured to store the medical images acquired; wherein
the processor performs recognition processing on the acquired medical images to obtain a recognition result related to a region of interest;
compares the recognition result of each of the medical images acquired with the recognition result of the medical image previously stored in the storage device and updates the medical image to be selected on the basis of a comparison result of the recognition results;
acquires a user input signal transmitted according to an operation of a user for performing a freeze display or a still image storage;
in a case where the user input signal is acquired, selects a medical image acquired at a timing near a timing at which the user input signal is acquired from the updated medical images for which the recognition result related to the region of interest detected in the medical images has been obtained in the recognition processing;
displays, on a monitor, the selected medical image and an emphasis display to emphasize the region of interest detected in the selected medical image as the recognition result related to the region of interest detected in the selected medical image; and
stores emphasis display information in association with the region of interest, the emphasis display information including a position of the emphasis display and a size of the emphasis display.
18. A medical image processing method comprising:
acquiring medical images;
storing the acquired medical images;
performing recognition processing on the acquired medical images to obtain a recognition result related to a region of interest;
comparing the recognition result of each of the medical images acquired with the recognition result of the medical image previously stored in the storage device and updating the medical image to be selected on the basis of a comparison result of the recognition results;
acquiring a user input signal transmitted according to an operation of a user for performing a freeze display or a still image storage;
in a case where the user input signal is acquired, selecting a medical image acquired at a timing near a timing at which the user input signal is acquired from the updated medical images for which the recognition result related to the region of interest detected in the medical images has been obtained in the recognition processing;
displaying, on a monitor, the selected medical image and an emphasis display to emphasize the region of interest detected in the selected medical image as the recognition result related to the region of interest detected in the selected medical image; and
storing emphasis display information in association with the region of interest, the emphasis display information including a position of the emphasis display and a size of the emphasis display.
19. A non-transitory, tangible computer-readable medium having a program stored thereon, the program for causing a computer to implement:
an image acquisition function of acquiring medical images;
an acquired image storage function of storing the acquired medical images;
a recognition processing function of performing recognition processing on the acquired medical images to obtain a recognition result related to a region of interest;
a function of comparing the recognition result of each of the medical images acquired with the recognition result of the medical image previously stored in the storage device and updating the medical image to be selected on the basis of a comparison result of the recognition results;
a user input signal acquisition function of acquiring a user input signal transmitted according to an operation of a user for performing a freeze display or a still image storage;
a selection function of, in a case where the user input signal is acquired, selecting a medical image acquired at a timing near a timing at which the user input signal is acquired from the updated medical images for which the recognition result related to the region of interest detected in the medical images has been obtained in the recognition processing;
a display function of displaying, on a monitor, the selected medical image and an emphasis display to emphasize the region of interest detected in the selected medical image as the recognition result related to the region of interest detected in the selected medical image; and
a storage function of storing emphasis display information in association with the region of interest, the emphasis display information including a position of the emphasis display and a size of the emphasis display.