IP Library › Granted Patent US 12,569,116
Granted Patent B2
US 12,569,116 · App. 18/317,089 · Granted Mar 10, 2026

Processor device, operation method of processor device, non-transitory computer readable medium, and endoscope system for displaying movement trajectory of endoscope

Inventors: Hirona Yumbe (Kanagawa, JP); Shigetoshi Ishikawa (Kanagawa, JP); Akemi Oda (Kanagawa, JP)
Assignee: FUJIFILM Corporation
A61B1/0005A61B1/0008G06T7/00G06T2207/10068
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,569,116
App. No.
18/317,089
Filed
May 14, 2023
Granted
Mar 10, 2026
Kind
B2
Examiner
LE, VU
Art Unit
2668
USPC
382/128
Abstract

A movement trajectory calculation unit calculates a movement trajectory indicating a trajectory along which an endoscope has moved, by using a movement state of the endoscope. From an endoscopic image obtained by the endoscope, a first recognition processing unit recognizes that a tip portion of the endoscope has reached a turn-back position and recognizes which of an outward path or a return path the movement trajectory corresponds to. A display control unit displays, on a display, a movement trajectory display screen that presents the movement trajectory separately for the outward path or the return path.

Claims (53)

1 . A processor device comprising:

a processor configured to:

acquire a movement state of an endoscope that moves inside a body;

calculate a movement trajectory indicating a trajectory along which the endoscope has moved, by using the movement state of the endoscope;

in a case where a tip portion of the endoscope moves forward to and moves backward from a turn-back position inside the body, from an endoscopic image obtained by the endoscope, recognize that the tip portion has reached the turn-back position and recognize which of an outward path or a return path the movement trajectory corresponds to; and

display, on a display, a movement trajectory display screen that presents the movement trajectory separately for the outward path or the return path,

wherein an outward path display straight line that represents a movement trajectory of the outward path and a return path display straight line that represents a movement trajectory of the return path are displayed in the movement trajectory display screen,

wherein an inserted length display scale that represents an inserted length of the endoscope is displayed for the outward path display straight line or the return path display straight line in the movement trajectory display screen, and the inserted length display scale is disposed beside the outward path display straight line or the return path display straight line.

2 . The processor device according to claim 1 , wherein the outward path display straight line and the return path display straight line are linked together by a turn-back display marking that represents the turn-back position.

3 . The processor device according to claim 1 , wherein an outward path display curved line that represents a movement trajectory of the outward path and a return path display curved line that represents a movement trajectory of the return path are displayed in the movement trajectory display screen.

4 . The processor device according to claim 1 , wherein the processor is configured to:

recognize a plurality of parts between an opening where the endoscope is inserted and the turn-back position, the plurality of parts including at least a first part and a second part; and

classify the movement trajectory into a plurality of sections defined by the plurality of parts and display the plurality of sections in the movement trajectory display screen.

5 . The processor device according to claim 4 , wherein a section in which the tip portion is currently located is displayed with a message in the movement trajectory display screen.

6 . The processor device according to claim 1 , wherein the processor is configured to:

recognize a region of interest from the endoscopic image; and

display a position of the region of interest on the movement trajectory in the movement trajectory display screen.

7 . The processor device according to claim 6 , wherein the processor is configured to:

classify the region of interest into a category; and

display, in the movement trajectory display screen, the position of the region of interest on the movement trajectory in a display style that changes depending on the category that is a result of the classification.

8 . The processor device according to claim 7 , wherein category information including the category of the region of interest is displayed for the movement trajectory in the movement trajectory display screen.

9 . The processor device according to claim 1 , wherein

the processor is configured to recognize a plurality of parts between an opening where the endoscope is inserted and the turn-back position, the plurality of parts including at least a first part and a second part,

the plurality of parts define a plurality of sections,

the movement trajectory is made up of a plurality of section movement trajectories provided for the respective sections, and

section movement trajectory display screens that display the respective section movement trajectories are displayed in the movement trajectory display screen.

10 . The processor device according to claim 1 , wherein

the movement state is a movement amount of the tip portion of the endoscope, and

the movement amount of the tip portion is calculated based on at least an inserted length of the endoscope.

11 . An endoscope system comprising:

a processor; and

a display,

the processor being configured to:

acquire a movement state of an endoscope that moves inside a body;

calculate a movement trajectory indicating a trajectory along which the endoscope has moved, by using the movement state of the endoscope;

in a case where a tip portion of the endoscope moves forward to and moves backward from a turn-back position inside the body, from an endoscopic image obtained by the endoscope, recognize that the tip portion has reached the turn-back position and recognize which of an outward path or a return path the movement trajectory corresponds to; and

display, on the display, a movement trajectory display screen that presents the movement trajectory separately for the outward path or the return path,

wherein an outward path display straight line that represents a movement trajectory of the outward path and a return path display straight line that represents a movement trajectory of the return path are displayed in the movement trajectory display screen,

wherein an inserted length display scale that represents an inserted length of the endoscope is displayed for the outward path display straight line or the return path display straight line in the movement trajectory display screen, and the inserted length display scale is disposed beside the outward path display straight line or the return path display straight line.

12 . An operation method of a processor device including a processor, the operation method comprising steps, performed by the processor, of:

acquiring a movement state of an endoscope that moves inside a body;

calculating a movement trajectory indicating a trajectory along which the endoscope has moved, by using the movement state of the endoscope;

in a case where a tip portion of the endoscope moves forward to and moves backward from a turn-back position inside the body, from an endoscopic image obtained by the endoscope, recognizing that the tip portion has reached the turn-back position and recognizing which of an outward path or a return path the movement trajectory corresponds to; and

displaying, on a display, a movement trajectory display screen that presents the movement trajectory separately for the outward path or the return path,

wherein an outward path display straight line that represents a movement trajectory of the outward path and a return path display straight line that represents a movement trajectory of the return path are displayed in the movement trajectory display screen,

wherein an inserted length display scale that represents an inserted length of the endoscope is displayed for the outward path display straight line or the return path display straight line in the movement trajectory display screen, and the inserted length display scale is disposed beside the outward path display straight line or the return path display straight line.

13 . A non-transitory computer readable medium for storing a computer-executable program for causing a computer to function as a processor device, the computer-executable program causing a computer to execute:

a function of acquiring a movement state of an endoscope that moves inside a body;

a function of calculating a movement trajectory indicating a trajectory along which the endoscope has moved, by using the movement state of the endoscope;

a function of, in a case where a tip portion of the endoscope moves forward to and moves backward from a turn-back position inside the body, from an endoscopic image obtained by the endoscope, recognizing that the tip portion has reached the turn-back position and recognizing which of an outward path or a return path the movement trajectory corresponds to; and

a function of displaying, on a display, a movement trajectory display screen that presents the movement trajectory separately for the outward path or the return path,

wherein an outward path display straight line that represents a movement trajectory of the outward path and a return path display straight line that represents a movement trajectory of the return path are displayed in the movement trajectory display screen,

wherein an inserted length display scale that represents an inserted length of the endoscope is displayed for the outward path display straight line or the return path display straight line in the movement trajectory display screen, and the inserted length display scale is disposed beside the outward path display straight line or the return path display straight line.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2023
From: YUMBE, HIRONA; ISHIKAWA, SHIGETOSHI; ODA, AKEMI
To: FUJIFILM CORPORATION
Reel/Frame 063648/0409 →
Priority Claims (1)
JP 2020-190900 · Nov 17, 2020 · national
Continuity (2)
Continuation PCTJP2021037522 · Oct 11, 2021
Related Publication 20230277036A1 · Sep 7, 2023
References Cited (43)
US 10524641B2 · Prisco · 2020 [cited by examiner]
US 10898286B2 · Srinivasan · 2021 [cited by examiner]
US 11529197B2 · Kronman · 2022 [cited by examiner]
US 20080303898A1 · Nishimura · 2008 [cited by examiner]
US 20120287238A1 · Onishi et al. · 2012 [cited by applicant]
US 20120289777A1 · Chopra · 2012 [cited by examiner]
US 20140031625A1 · Donhowe · 2014 [cited by examiner]
US 20140088357A1 · Kuma et al. · 2014 [cited by applicant]
US 20170164869A1 · Lee · 2017 [cited by examiner]
US 20180110401A1 · Watanabe · 2018 [cited by applicant]
US 20180114319A1 · Kono et al. · 2018 [cited by applicant]
US 20190231444A1 · Tojo et al. · 2019 [cited by applicant]
US 20190290108A1 · Nakamitsu et al. · 2019 [cited by applicant]
US 20190298458A1 · Srinivasan et al. · 2019 [cited by applicant]
US 20200078103A1 · Duindam · 2020 [cited by examiner]
US 20200205904A1 · Chopra · 2020 [cited by applicant]
US 20200294227A1 · Usuda · 2020 [cited by applicant]
US 20210042925A1 · Usuda · 2021 [cited by applicant]
US 20210106209A1 · Usuda · 2021 [cited by applicant]
CN 103068294 · 2013 [cited by applicant]
EP 2700351 · 2014 [cited by applicant]
JP 2003093326 · 2003 [cited by applicant]
JP 2020146202 · 2020 [cited by applicant]
WO 2013132880 · 2013 [cited by applicant]
WO WO2015168066A1 · 2015 [cited by examiner]
WO WO2016135966A1 · 2016 [cited by examiner]
WO 2017002184 · 2017 [cited by applicant]
WO 2017006404 · 2017 [cited by applicant]
WO WO2018116572A1 · 2018 [cited by examiner]
WO 2019220848 · 2019 [cited by applicant]
WO 2020017212 · 2020 [cited by applicant]
WO WO2020194472A1 · 2020 [cited by examiner]
WO2013132880A1—Machine English translation (Year: 2013). [cited by examiner]
WO2017002184A1—Machine English translation (Year: 2017). [cited by examiner]
WO2020194472A1—Machine English translation (Year: 2020). [cited by examiner]
WO-2016135966-A1_original_English machine translation (Year: 2016). [cited by examiner]
WO-2020194472-A1_original_English machine translation (Year: 2020). [cited by examiner]
WO-2018116572-A1_original_English machine translation (Year: 2018). [cited by examiner]
“International Search Report (Form PCT/ISA/210) of PCT/JP2021/037522,” mailed on Dec. 28, 2021, with English translation thereof, pp. 1-7. [cited by applicant]
“Written Opinion of the International Searching Authority (Form PCT/ISA/237) of PCT/JP2021/037522,” mailed on Dec. 28, 2021, with English translation thereof, pp. 1-8. [cited by applicant]
“Office Action of Japan Counterpart Application”, issued on Apr. 1, 2025, with English translation thereof, p. 1-p. 6. [cited by applicant]
“Search Report of Europe Counterpart Application”, issued on Apr. 9, 2024, pp. 1-8. [cited by applicant]
“Office Action of China Counterpart Application”, issued on Jun. 27, 2025, with English translation thereof, p. 1-p. 16. [cited by applicant]