IP Library › Granted Patent US 12,232,690
Granted Patent B2
US 12,232,690 · App. 17/167,046 · Granted Feb 25, 2025

Endoscope system

Inventor: Toshihiro Usuda (Kanagawa, JP)
Assignee: FUJIFILM Corporation
A61B1/000094A61B1/018A61B1/0655G06V10/25G06V10/764
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,232,690
App. No.
17/167,046
Granted
Feb 25, 2025
Kind
B2
Abstract

An endoscope system includes an image obtaining unit that obtains an image obtained by image capturing of a photographic subject, a recognition unit that performs a recognition process of recognizing the photographic subject by using the image, an identification unit that identifies an operation performed on the photographic subject, a setting unit that enables or disables the recognition unit in accordance with the result of identification by the identification unit, and a notification unit that gives a notification of whether the recognition unit is enabled or disabled.

Claims (37)

1. An endoscope system comprising:

one or more processors configured to:

obtain an image obtained by capturing a photographic subject;

perform a recognition process of recognizing the photographic subject by using the image, wherein the recognition process recognizes presence or absence of a lesion or a potential lesion of the photographic subject or recognizes a type or a degree of progression of a lesion or a potential lesion of the photographic subject;

identify an operation performed on the photographic subject;

enable or disable the recognition process in accordance with a result of identifying the operation performed on the photographic subject;

provide a notification for indicating a state of the recognition process;

in a case where the notification indicates that the state of the recognition process is an enabled state, display information indicating the state of the recognition process, and further display either information indicating a detection position of the lesion or the potential lesion or information indicating the type or the degree of progression of the lesion or the potential lesion, on a display; and

in a case where the notification indicates that the state of the recognition process is a disabled state, display information indicating the state of the recognition process, on the display,

wherein the information indicating the state of the recognition process comprises a character string, a letter, a geometric shape, and or a symbol representing the state of the recognition process.

2. The endoscope system according to claim 1 , wherein the one or more processors determine whether or not an operation is performed on the photographic subject.

3. The endoscope system according to claim 2 , wherein the one or more processors disable the recognition unit in a case where an operation is performed on the photographic subject, and enable the recognition process in a case where no operation is performed on the photographic subject.

4. The endoscope system according to claim 1 , wherein the one or more processors identify a type of the operation performed on the photographic subject.

5. The endoscope system according to claim 4 , wherein the one or more processors disable the recognition process in a case where a specific operation is performed on the photographic subject.

6. The endoscope system according to claim 1 , wherein the operation identified by the one or more processors is use of a treatment tool.

7. The endoscope system according to claim 1 , wherein the operation identified by the one or more processors is spraying of a liquid on the photographic subject.

8. The endoscope system according to claim 1 , wherein the one or more processors enable or disable giving of a notification of a result of the recognition process.

9. The endoscope system according to claim 1 , wherein the one or more processors give a notification of the result of identification of the operation performed on the photographic subject in addition to the notification for indicating the state of the recognition process.

10. The endoscope system according to claim 1 , wherein in a case where the one or more processors perform a plurality of types of recognition processes, the one or more processors enable or disable each of the recognition processes.

11. The endoscope system according to claim 1 , wherein the operation is an operation that decreases accuracy of the recognition process.

12. The endoscope system according to claim 1 , wherein the operation includes removal of tissue from a living body, treatments related to surgical resection or resection treatment, spraying of a liquid on the photographic subject, or cleaning of the photographic subject.

13. The endoscope system according to claim 1 , wherein the notification is a notification of whether the recognition process by use of an artificial intelligence is enabled or disabled.

14. The endoscope system according to claim 1 , wherein the operation identified by the one or more processors is an operation that changes a color of the photographic subject by a user.

15. The endoscope system according to claim 1 , wherein the operation is an operation performed with respect to the photographic subject.

16. The endoscope system according to claim 1 , wherein the operation identified by the one or more processors is spraying of a coloring agent or a fluorescent drug on the photographic subject.

17. The endoscope system according to claim 1 , wherein the recognition process further obtains or calculates biological function information about the photographic subject in part or in whole, and

wherein recognition of the type of the lesion or the potential lesion is, in a case where the lesion or the potential lesion is a polyp, to determine the type as adenoma, hypertrophic polyp, or cancer.

18. The endoscope system according to claim 17 , wherein recognition of the degree of progression of the lesion or the potential lesion is, in a case where the lesion or the potential lesion is the cancer, to determine a stage of the cancer, or to determine a narrow-band imaging international colorectal endoscopic classification or a Japan narrow-band imaging expert team classification.

19. A recognition method of an endoscope system comprising-a processor, the recognition method comprising:

obtaining an image obtained by capturing a photographic subject;

performing a recognition process of recognizing the photographic subject by using the image, wherein the recognition process recognizes presence or absence of a lesion or a potential lesion of the photographic subject or recognizes a type or a degree of progression of a lesion or a potential lesion of the photographic subject;

identifying an operation performed on the photographic subject;

enabling or disabling the recognition process in accordance with a result of identifying the operation performed on the photographic subject;

providing a notification for indicating a state of the recognition process;

in a case where the notification indicates that the state of the recognition process is an enabled state, displaying information indicating the state of the recognition process, and further displaying either information indicating a detection position of the lesion or the potential lesion or information indicating the type or the degree of progression of the lesion or the potential lesion, on a display; and

in a case where the notification indicates that the state of the recognition process is a disabled state, displaying information indicating the state of the recognition process, on the display,

wherein the information indicating the state of the recognition process comprises a character string, a letter, a geometric shape, and or a symbol representing the state of the recognition process.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2021
From: USUDA, TOSHIHIRO
To: FUJIFILM CORPORATION
Reel/Frame 055138/0976 →
Priority Claims (1)
JP 2018-153733 · Aug 17, 2018 · national
Continuity (2)
Continuation PCTJP2019032166 · Aug 16, 2019
Related Publication 20210177248A1 · Jun 17, 2021
References Cited (44)
US 8497898B2 · Moriyama et al. · 2013 [cited by applicant]
US 8768024B1 · Zingman et al. · 2014 [cited by applicant]
US 10863893B2 · Imaizumi et al. · 2020 [cited by applicant]
US 11025835B2 · Kuriyama et al. · 2021 [cited by applicant]
US 11145053B2 · Hayami et al. · 2021 [cited by applicant]
US 11170498B2 · Kono et al. · 2021 [cited by applicant]
US 20050049458A1 · Honda et al. · 2005 [cited by applicant]
US 20100004505A1 · Umemoto et al. · 2010 [cited by applicant]
US 20110301443A1 · Yamaguchi et al. · 2011 [cited by applicant]
US 20130188029A1 · Takahashi · 2013 [cited by applicant]
US 20140371527A1 · Sato · 2014 [cited by examiner]
US 20180092700A1 · Itkowitz · 2018 [cited by examiner]
US 20180098690A1 · Iwaki · 2018 [cited by applicant]
US 20180114319A1 · Kono · 2018 [cited by examiner]
US 20180249900A1 · Imaizumi · 2018 [cited by examiner]
US 20190130565A1 · Lee · 2019 [cited by examiner]
US 20190311476A1 · Hayami · 2019 [cited by examiner]
US 20200090333A1 · Iwaki · 2020 [cited by applicant]
US 20220151462A1 · Usuda · 2022 [cited by examiner]
US 20230050945A1 · Nakaue · 2023 [cited by examiner]
US 20240312019A1 · Higa · 2024 [cited by examiner]
CN 102834043 · 2012 [cited by applicant]
CN 107708521 · 2018 [cited by applicant]
EP 3633987 · 2020 [cited by applicant]
JP S63259614 · 1988 [cited by applicant]
JP H03277340 · 1991 [cited by applicant]
JP 2005073799 · 2005 [cited by applicant]
JP 2007330405 · 2007 [cited by applicant]
JP 2008245840 · 2008 [cited by applicant]
JP 2011254936 · 2011 [cited by applicant]
JP 2013150658 · 2013 [cited by applicant]
JP 2015096237 · 2015 [cited by applicant]
JP 2018051364 · 2018 [cited by applicant]
WO 2016199273 · 2016 [cited by applicant]
WO 2017072853 · 2017 [cited by applicant]
WO 2017081976 · 2017 [cited by applicant]
WO 2018105063 · 2018 [cited by applicant]
WO 2018216188 · 2018 [cited by applicant]
“Search Report of Europe Counterpart Application”, issued on Sep. 6, 2021, p. 1-p. 7. [cited by applicant]
“International Search Report (Form PCT/ISA/210) of PCT/JP2019/032166,” mailed on Oct. 29, 2019, with English translation thereof, pp. 1-5. [cited by applicant]
“Written Opinion of the International Searching Authority (Form PCT/ISA/237) of PCT/JP2019/032166,” mailed on Oct. 29, 2019,, with English translation thereof, pp. 1-9. [cited by applicant]
“Office Action of Japan Counterpart Application”, issued on Aug. 29, 2023, with English translation thereof, p. 1-p. 6. [cited by applicant]
“Office Action of China Counterpart Application”, issued on Nov. 22, 2023, with English translation thereof, p. 1- p. 17. [cited by applicant]
“Office Action of Europe Counterpart Application”, issued on Mar. 13, 2024, p. 1-p. 6. [cited by applicant]