IP Library › Granted Patent US 11,918,176
Granted Patent B2
US 11,918,176 · App. 17/391,644 · Granted Mar 5, 2024

Medical image processing apparatus, processor device, endoscope system, medical image processing method, and program

Inventors: Masaaki Oosake (Kanagawa, JP); Shumpei Kamon (Kanagawa, JP)
Assignee: FUJIFILM Corporation
A61B1/00006A61B1/00009A61B1/000094G06F18/2431G06T7/0012G06V10/25G06V10/82G06T2207/10068G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,918,176
App. No.
17/391,644
Granted
Mar 5, 2024
Kind
B2
Abstract

A medical image processing apparatus includes a recognition unit that detects a region of interest from an acquired medical image and classifies the region of interest; a display control unit that causes emphasis display for emphasizing the region of interest and a classification for the region of interest to be displayed in a screen identical to a screen for displaying an observation target included in the medical image; and an observation image switching unit that switches whether to display consecutive images or to display a still image by using a display device. In a case where consecutive image display of an observation image is switched to still image display by the observation image switching unit, the display control unit makes a change for reducing visual recognizability of at least any of the emphasis display or the classification compared with a case of the consecutive image display of the observation image.

Claims (46)

1. A medical image processing apparatus comprising one or more processors configured to:

detect a region of interest from an acquired medical image and classify the detected region of interest;

cause emphasis display for emphasizing the region of interest and a classification for the region of interest to be displayed in a screen identical to a screen for displaying an observation target included in the medical image;

switch whether to display consecutive images of an observation image or to display a still image of the observation image on a display; and

in a case where switching consecutive image display of the observation image to still image display, make a change for reducing visual recognizability of at least any of the emphasis display or the classification compared with a case of the consecutive image display of the observation image.

2. The medical image processing apparatus according to claim 1 , wherein the one or more processors are configured to display the classification in a case where making the change for reducing the visual recognizability of at least any of the emphasis display or the classification compared with the case of the consecutive image display of the observation image.

3. The medical image processing apparatus according to claim 1 , wherein the one or more processors are configured to move a position of at least any of the emphasis display or the classification to a position outside a region where the observation image is displayed in the screen where the observation image is displayed.

4. The medical image processing apparatus according to claim 1 , wherein the one or more processors are further configured to:

set a period from a timing at which a display style of at least any of the emphasis display or the classification is changed to a timing at which the display style is returned to an original; and

return the display style to the original in response to an elapse of the set period since the timing at which the display style of at least any of the emphasis display or the classification is changed.

5. The medical image processing apparatus according to claim 1 , wherein the one or more processors are further configured to:

acquire a command signal transmitted in a case where an operation section is operated; and

in a case where acquiring a command signal indicating that the consecutive image display of the observation image is to be switched to the still image display, make the change for reducing the visual recognizability of at least any of the emphasis display or the classification compared with the case of the consecutive image display of the observation image.

6. The medical image processing apparatus according to claim 1 , wherein the one or more processors are configured to:

perform processing for reducing a size of an input image in stages to output reduced images; and

generate a feature map from each of the reduced images.

7. The medical image processing apparatus according to claim 6 , wherein the one or more processors are configured to perform at least any of pooling processing on the input image or convolutional processing on the input image.

8. The medical image processing apparatus according to claim 6 , wherein the one or more processors are configured to:

generate a plurality of feature maps from the reduced images; and

perform at least any of identification of the region of interest or classification of the region of interest from the generated feature maps.

9. The medical image processing apparatus according to claim 8 , wherein the one or more processors are configured to perform detection of the region of interest and classification of the region of interest on the basis of an overlapping degree of the generated feature maps.

10. The medical image processing apparatus according to claim 1 , further comprising a parameter storage configured to store parameters obtained by collectively learning detection of a region of interest and classification of the region of interest for at least one image.

11. The medical image processing apparatus according to claim 1 , wherein the one or more processors are configured to use, as the emphasis display, a closed curve that surrounds the region of interest, and in a case where changing a display style of the emphasis display, change at least any of a color, a density, or a type of a line of the closed curve.

12. The medical image processing apparatus according to claim 1 , wherein the one or more processors are configured to, in a case where changing a display style of the emphasis display, move the emphasis display to a position where visual recognizability of the emphasis display is reduced.

13. The medical image processing apparatus according to claim 1 , wherein the one or more processors are configured to use text information representing content of the classification as classification information representing the classification for the region of interest, and in a case where changing a display style of the classification for the region of interest, move the text information to a position where visual recognizability of the text information is reduced.

14. The medical image processing apparatus according to claim 13 , wherein the one or more processors are configured to, in a case where changing the display style of the classification for the region of interest, move the text information to a position outside a display region of an image representing the observation target.

15. The medical image processing apparatus according to claim 14 , wherein the one or more processors are configured to, in a case where a plurality of regions of interest are detected, move a plurality of pieces of the text information representing classifications for the plurality of regions of interest to a position outside the display region of the image representing the observation target while maintaining a positional relationship among the plurality of regions of interest.

16. The medical image processing apparatus according to claim 13 , wherein the one or more processors are configured to, in a case where changing the display style of the classification for the region of interest, cause only an initial of a character string representing a meaning of the classification to be displayed as the text information.

17. The medical image processing apparatus according to claim 1 , wherein the one or more processors are further configured to:

control an endoscope; and

detect the region of interest from the medical image, which is acquired by using the endoscope, and classify the detected region of interest.

18. An endoscope system comprising:

an endoscope;

one or more processors configured to control the endoscope; and

the medical image processing apparatus according to claim 1 ,

wherein the medical image processing apparatus performs processing on an endoscopic image acquired by using the endoscope.

19. A medical image processing method comprising:

detecting a region of interest from an acquired medical image and classifying the region of interest;

causing emphasis display for emphasizing the region of interest and a classification for the region of interest to be displayed in a screen identical to a screen for displaying an observation target included in the medical image;

switching whether to display consecutive images of an observation image or to display a still image of the observation image on a display; and

in a case where switching consecutive image display of the observation image to still image display, making a change for reducing visual recognizability of at least any of the emphasis display or the classification compared with a case of the consecutive image display of the observation image.

20. A non-transitory computer readable recording medium storing a program for causing a computer to implement:

a recognition function that detects a region of interest from an acquired medical image and classifies the region of interest;

a display function that causes emphasis display for emphasizing the region of interest and a classification for the region of interest to be displayed in a screen identical to a screen for displaying an observation target included in the medical image; and

an observation image switching function that switches whether to display consecutive images of an observation image or to display a still image of the observation image on a display device,

wherein in a case where the observation image switching function switches consecutive image display of the observation image to still image display, the display function makes a change for reducing visual recognizability of at least any of the emphasis display or the classification compared with a case of the consecutive image display of the observation image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2021
From: OOSAKE, MASAAKI; KAMON, SHUMPEI
To: FUJIFILM CORPORATION
Reel/Frame 057055/0616 →
Priority Claims (1)
JP 2019-042741 · Mar 8, 2019 · national
Continuity (2)
Continuation PCTJP2019040362 · Oct 15, 2019
Related Publication 20210366110A1 · Nov 25, 2021
Cited By (1)
US 12,705,908