IP Library Granted Patent US 12,303,097
Granted Patent B2
US 12,303,097 · App. 18/670,271 · Granted May 20, 2025

Medical image processing apparatus, endoscope system, and medical image processing method

Inventor: Shumpei Kamon (Kanagawa, JP)
Assignee: FUJIFILM Corporation
A61B1/000094A61B1/00045G06T7/0012A61B1/000096A61B1/0669A61B1/07G06T2207/10068G06T2207/20081G06T2207/20104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,303,097
App. No.
18/670,271
Filed
May 21, 2024
Granted
May 20, 2025
Kind
B2
Art Unit
2634
USPC
348/68
Abstract

A medical image processing apparatus including a processor configured to acquire a medical image from a medical apparatus that sequentially captures images of a plurality of areas in a living body of a subject, acquire area information indicating an area in the living body in the acquired medical image, perform recognition on the medical image as a recognizer; and cause a display apparatus to display a result of the recognition in a mode suitable for the area indicated by the area information.

Claims (40)

1. An endoscope system comprising:

an endoscope configured to capture an image of a subject;

a light source having a plurality of light source modes; and

one or more processors configured to:

use a plurality of recognizers corresponding respectively to a plurality of target areas in a living body;

cause the light source to irradiate the subject with light in one of the light source modes;

select one of the recognizers according to one of the target areas and the one of the light source modes; and

cause a monitor to display a result of recognition of the one of the recognizers.

2. The endoscope system according to claim 1 , wherein the processors are configured to, by analyzing the image captured through the endoscope, acquire target area information indicating the one of the target areas.

3. The endoscope system according to claim 2 , wherein the processors are configured to cause the monitor to display the result of recognition of the one of the recognizers along with the target area information.

4. The endoscope system according to claim 2 , wherein the processors are configured to cause the monitor to display the result of recognition of the one of the recognizers in a display mode according to the one of the target areas indicated with the target area information.

5. The endoscope system according to claim 1 , wherein the processors are configured to:

in a case where the endoscope captures an image of a first one of the target areas, cause the monitor to display the result of recognition with respect to the image captured with a first one of the light source modes; and

in a case where the endoscope captures an image of a second one of the target areas different from the first one of the target areas, cause the monitor not to display the result of recognition with respect to the image captured with the first one of the light source modes.

6. The endoscope system according to claim 5 , wherein:

the first one of the target areas is an esophagus; and

the second one of the target areas is a stomach.

7. The endoscope system according to claim 5 , wherein the light source irradiates the subject with special light in the first one of the light source modes.

8. The endoscope system according to claim 1 , wherein the processors are configured to:

in a case where the endoscope captures an image of a first one of the target areas, cause the monitor to display the result of recognition; and

in a case where the endoscope captures an image of a second one of the target areas different from the first one of the target areas, cause the monitor not to display the result of recognition.

9. The endoscope system according to claim 1 , wherein the light source includes light-emitting diodes respectively emitting red light, green light, blue light and violet light.

10. The endoscope system according to claim 1 , wherein the processors are configured to, for duration that the endoscope captures the image, select the one of the recognizers independently of a user's operation.

11. The endoscope system according to claim 1 , wherein the recognizers are a plurality of learned models having learned by using image sets constituted of captured images of different areas in a living body in accordance with target areas to be recognized.

12. The endoscope system according to claim 1 , wherein the processors are configured to:

activate only one of the recognizers according to the one of the target areas; and

cause the monitor to display the result of recognition of the only one of the recognizers.

13. The endoscope system according to claim 1 , wherein the processors are configured to:

activate two or more of the recognizers simultaneously; and

cause the monitor to display the result of recognition of one of the two or more of the recognizers selectively according to the one of the target areas.

14. The endoscope system according to claim 1 , wherein the one of the recognizers performs, according to the one of the target areas, at least one of:

detection of a region of interest in the image;

classification on the image; and

measurement on the image.

15. The endoscope system according to claim 1 , wherein the one of the recognizers performs, according to the one of the target areas, classification of a lesion on the image into at least two categories.

16. An operation method of an endoscope system comprising: an endoscope configured to capture an image of a subject; a light source having a plurality of light source modes; and one or more processors, the method comprising:

using a plurality of recognizers corresponding respectively to a plurality of target areas in a living body;

causing the light source to irradiate the subject with light in one of the light source modes;

selecting one of the recognizers according to one of the target areas and the one of the light source modes; and

causing a monitor to display a result of recognition of the one of the recognizers.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2024
From: KAMON, SHUMPEI
To: FUJIFILM CORPORATION
Reel/Frame 067482/0612 →
Priority Claims (1)
JP 2019-021803 · Feb 8, 2019 · national
Continuity (3)
Continuation 17373908 · Jul 13, 2021
Continuation PCTJP2020003093 · Jan 29, 2020
Related Publication 20240298873A1 · Sep 12, 2024
References Cited (39)
US 9788709B2 · Yamaguchi · 2017 [cited by examiner]
US 10945807B2 · Gibby et al. · 2021 [cited by applicant]
US 20110001811A1 · Imade · 2011 [cited by applicant]
US 20120327205A1 · Takahashi · 2012 [cited by applicant]
US 20140028821A1 · Tanaka et al. · 2014 [cited by applicant]
US 20170374292A1 · Motoki · 2017 [cited by examiner]
US 20180144453A1 · Koiso · 2018 [cited by examiner]
US 20180242817A1 · Imaizumi et al. · 2018 [cited by applicant]
US 20190082929A1 · Watanabe · 2019 [cited by examiner]
US 20200069160A1 · Oosake · 2020 [cited by applicant]
US 20200279368A1 · Tada et al. · 2020 [cited by applicant]
EP 3603483A1 · 2020 [cited by applicant]
JP H0434671A · 1992 [cited by applicant]
JP H08224209A · 1996 [cited by applicant]
JP H1069517A · 1998 [cited by applicant]
JP 2004265125A · 2004 [cited by applicant]
JP 2011135983A · 2011 [cited by applicant]
JP 2011156203A · 2011 [cited by applicant]
JP 2012249956A · 2012 [cited by applicant]
JP 2017012676A · 2017 [cited by applicant]
WO 2009104340A1 · 2009 [cited by applicant]
WO 2013140667A1 · 2013 [cited by applicant]
WO 2017073338A1 · 2017 [cited by applicant]
WO 2018179991A1 · 2018 [cited by applicant]
WO 2018221033A1 · 2018 [cited by applicant]
WO 2018225448A1 · 2018 [cited by applicant]
An Office Action mailed by China National Intellectual Property Administration on Jul. 4, 2024, which corresponds to Chinese Patent Application No. 202080012641.2 and is related to U.S. Appl. No. 18/670,271; with Englis… [cited by applicant]
International Search Report issued in PCT/JP2020/003093; mailed Apr. 7, 2020. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion issued in PCT/JP2020/003093; issued Aug. 10, 2021. [cited by applicant]
The extended European search report issued by the European Patent Office on Mar. 3, 2022, which corresponds to European Patent Application No. 20752785.4-1126 and is related to U.S. Appl. No. 17/373,908. [cited by applicant]
Office Action issued in JP 2020-571119; mailed by the Japanese Patent Office on Aug. 8, 2022. [cited by applicant]
An Office Action; “Decision of Refusal”, mailed by the Japanese Patent Office on Feb. 10, 2023, which corresponds to Japanese Patent Application No. 2020-571119 and is related to U.S. Appl. No. 17/373,908; with English … [cited by applicant]
An Office Action mailed by China National Intellectual Property Administration on Sep. 22, 2023, which corresponds to Chinese Patent Application No. 202080012641.2 and is related to U.S. Appl. No. 17/373,908; with Engli… [cited by applicant]
An Office Action mailed by China National Intellectual Property Administration on Mar. 16, 2024, which corresponds to Chinese Patent Application No. 202080012641.2 and is related to U.S. Appl. No. 17/373,908; with Engli… [cited by applicant]
Communication pursuant to Article 94(3) EPC issued by the European Patent Office on Nov. 13, 2024, which corresponds to European Patent Application No. 20 752 785.4-1122 and is related to U.S. Appl. No. 18/670,271. [cited by applicant]
Nakashima Hirotaka et al., “Artificial intelligence diagnosis of Helicobacter pylori infection using blue laser imaging-bright and linked color imaging: a single-center prospective study”, Annals of Gastroenterology, vo… [cited by applicant]
Park Young Sun et al., “Colonoscopic Polyp Detection using Convolutional Neural Networks”, Proceedings of SPIE Medical Imaging 2016: Computer-Aided Diagnosis, vol. 9785, Mar. 24, 2016, pp. 978528-1 to 978528-6. [cited by applicant]
Iwahori Yuji et al., “Classification and Size & Shape Recovery from Endoscope Image for Supporting Medical Diagnosis”, Comprehensive Engineering, vol. 30, Mar. 31, 2018, pp. 18-36. [cited by applicant]
An Office Action; “Notice of Reasons for Refusal,” mailed by the Japanese Patent Office on Jun. 6, 2024, which corresponds to Japanese Patent Application No. 2023-075660; with English language translation. [cited by applicant]