IP Library › Granted Patent US 11,419,481

Granted Patent B2

US 11,419,481 · App. 16/699,903 · Granted Aug 23, 2022

Medical system and operation method of medical system for controlling a driver to move an area defined by a plurality of positions of a treatment tool to a predetermined region in next image captured

Inventor: Shintaro Inoue (Tokyo, JP)

Assignee: OLYMPUS CORPORATION

A61B1/00009 A61B1/00133 A61B1/00149 A61B1/00188 A61B1/045 A61B17/0469 A61B17/29 A61B17/320016 G06T7/70 A61B2017/320004 G06T2207/10068 G06T2207/20104

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,419,481
App. No.: 16/699,903
Filed: Dec 2, 2019
Granted: Aug 23, 2022
Kind: B2
Examiner: LEUBECKER, JOHN P
Art Unit: 3795
USPC: 600/102

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A medical system, having a treatment tool; an endoscope having an image sensor configured to capture an image; a driver configured to drive the endoscope; and a processor configured to control the driver, wherein the processor is configured to determine a locus of the treatment tool and control the driver for operating the endoscope according to the determined locus.

Claims (111)

1. A medical system, comprising:

an endoscope comprising an image sensor configured to capture an image; and

a processor configured to:

determine a plurality of positions of a treatment tool captured in a plurality of images by the image sensor over a predetermined time period;

determine an area defined by the plurality of positions of the treatment tool; and

control a driver for operating the endoscope to move the area defined by the plurality of positions of the treatment tool to a predetermined region in a next image captured by the image sensor.

2. The medical system according to claim 1 ,

wherein the processor is configured to:

determine a center of the area defined by the plurality of positions of the treatment tool by calculating an average coordinate or a centroid of the plurality of positions of the treatment tool; and

in controlling the driver to move the endoscope, control the driver to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image to make the center of the area defined by the plurality of positions of the treatment tool to be at a center of the next image.

3. The medical system according to claim 2 ,

wherein the treatment tool is a first treatment tool,

wherein the predetermined region is a first predetermined region, and

wherein the processor is configured to:

determine a plurality of positions of a second treatment tool captured in the plurality of images by the image sensor over the predetermined time period;

determine an area defined by the plurality of positions of the second treatment tool;

determine a center of the area defined by the plurality of positions of the first treatment tool and a center of the area defined by the plurality of positions of the second treatment tool; and

determine a center of the next image to be acquired according to the center of the area defined by the plurality of positions of the first treatment tool and the center of the area defined by the plurality of positions of the second treatment tool.

4. The medical system according to claim 3 ,

wherein the processor is configured to:

calculate average coordinates of the center of the area defined by the plurality of positions of the first treatment tool;

calculate average coordinates of the center of the area defined by the plurality of positions of the second treatment tool; and

determine the center of the next image to be acquired according to the average coordinates of the center of the area defined by the plurality of positions of the first treatment tool and the average coordinates of the center of the area defined by the plurality of positions of the second treatment tool.

5. The medical system according to claim 1 ,

wherein the processor is configured to:

determine a range of the area defined by the plurality of positions of the treatment tool; and

in controlling the driver to move the endoscope, control the driver to move the endoscope to make the range of the area defined by the plurality of positions of the treatment tool to be in a predetermined range, as the predetermined region, of the next image.

6. The medical system according to claim 1 ,

wherein the processor is configured to:

request an operator to select a partial region in an initial image;

determine whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected; and

in controlling the driver to move the endoscope,

control the driver to move the endoscope to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image to make a visual field of the next image to be focused on the partial region in a situation in which the area defined by the plurality of positions of the treatment tool is within the predetermined distance from the partial region selected; and

control the driver to move the endoscope move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image to make the visual field of the next image to be an overhead view of the partial region in a situation in which the area defined by the plurality of positions of the treatment tool is not within the predetermined distance from the partial region selected.

7. The medical system according to claim 1 ,

wherein the processor is configured to:

request an operator to select a partial region in an initial image;

determine whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected;

determine whether the treatment tool is stationary; and

in controlling the driver to move the endoscope, control the driver to move the endoscope to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image so as to capture a distal end of the treatment tool in the next image in a situation in which the area defined by the plurality of positions of the treatment tool is within the predetermined distance from the partial region selected and the treatment tool is determined to be stationary.

8. The medical system according to claim 1 ,

wherein the processor is configured to selectively switch between operating under operable operation modes comprising:

an abrasion A mode in which the processor is configured to:

determine a center of the area defined by the plurality of positions of the treatment tool by calculating an average coordinate or a centroid of the plurality of positions of the treatment tool; and

an abrasion B mode in which the processor is configured to:

determine a range of the area defined by the plurality of positions of the treatment tool; and

a suture mode in which the processor is configured to:

request an operator to select a partial region in an initial image;

determine whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected; and

in controlling the driver to move the endoscope,

control the driver to move the endoscope to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image to make the visual field of the next image to be an overhead view of the partial region in a situation in which the area defined by the plurality of positions of the treatment tool is not within the predetermined distance from the partial region selected;

a dissection mode in which the processor is configured to:

request an operator to select a partial region in an initial image;

determine whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected;

determine whether the treatment tool is stationary; and

9. An operation method of a medical system having, an endoscope having an image sensor configured to capture an image, comprising:

determining a plurality of positions of a treatment tool captured in a plurality of images by the image sensor over a predetermined time period;

determining an area defined by the plurality of positions of the treatment tool; and

controlling a driver for operating the endoscope to move the area defined by the plurality of positions of the treatment tool to a predetermined region in a next image captured by the image sensor.

10. The operation method according to claim 9 , comprising:

determining a center of the area defined by the plurality of positions of the treatment tool by calculating an average coordinate or a centroid of the plurality of positions of the treatment tool; and

in controlling the driver to move the endoscope, controlling the driver to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image to make the center of the area defined by the plurality of positions of the treatment tool to be at a center of the next image.

11. The operation method according to claim 10 ,

wherein the treatment tool is a first treatment tool,

wherein the predetermined region is a first predetermined region, and

wherein the operation method comprises:

determining a plurality of positions of a second treatment tool captured in the plurality of images by the image sensor over the predetermined time period;

determining an area defined by the plurality of positions of the second treatment tool;

determining a center of the area defined by the plurality of positions of the first treatment tool and a center of the area defined by the plurality of positions of the second treatment tool; and

determining a center of the next image to be acquired according to the center of the area defined by the plurality of positions of the first treatment tool and the center of the area defined by the plurality of positions of the second treatment tool.

12. The operation method according to claim 11 , comprising:

calculating average coordinates of the center of the area defined by the plurality of positions of the first treatment tool;

calculating average coordinates of the center of the area defined by the plurality of positions of the second treatment tool; and

determining the center of the next image to be acquired according to the average coordinates of the center of the area defined by the plurality of positions of the first treatment tool and the average coordinates of the center of the area defined by the plurality of positions of the second treatment tool.

13. The operation method of a medical system according to claim 9 , comprising:

determining a range of the area defined by the plurality of positions of the treatment tool; and

in controlling the driver to move the endoscope, controlling the driver to move the endoscope to make the range of the area defined by the plurality of positions of the treatment tool to be in a predetermined range, as the predetermined region, of the next image.

14. The operation method of a medical system according to claim 9 , comprising:

requesting an operator to select a partial region in an initial image;

determining whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected; and

in controlling the driver to move the endoscope,

controlling the driver to move the endoscope to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image to make a visual field of the next image to be focused on the partial region in a situation in which the area defined by the plurality of positions of the treatment tool is within the predetermined distance from the partial region selected; and

controlling the driver to move the endoscope to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image to make the visual field of the next image to be an overhead view of the partial region in a situation in which the area defined by the plurality of positions of the treatment tool is not within the predetermined distance from the partial region selected.

15. The operation method of a medical system according to claim 9 , comprising:

requesting an operator to select a partial region in an initial image;

determining whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected;

determining whether the treatment tool is stationary; and

in controlling the driver to move the endoscope, controlling the driver to move the endoscope to move the area defined by the plurality of positions of the treatment tool to the predetermined region in the next image so as to capture a distal end of the treatment tool in the next image in a situation in which the area defined by the plurality of positions of the treatment tool is within the predetermined distance from the partial region selected and the treatment tool is determined to be stationary.

16. The operation method according to claim 9 , comprising:

selectively switching between operating under operable operation modes comprising:

an abrasion A mode comprising:

an abrasion B mode comprising:

determining a range of the area defined by the plurality of positions of the treatment tool; and

a suture mode comprising:

requesting an operator to select a partial region in an initial image;

determining whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected; and

in controlling the driver to move the endoscope,

a dissection mode comprising:

requesting an operator to select a partial region in an initial image;

determining whether the area defined by the plurality of positions of the treatment tool is within a predetermined distance from the partial region selected;

determining whether the treatment tool is stationary; and

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2019

From: INOUE, SHINTARO

To: OLYMPUS CORPORATION

Reel/Frame 051148/0559 →

Continuity (2)

Continuation PCTJP2017020841 · Jun 5, 2017

Related Publication 20200100649A1 · Apr 2, 2020

Cited By (2)

US 12,533,178 US 12,740,835