Granted Patent B2

US 12,593,962 · App. 18/610,966 · Granted Apr 7, 2026

Inventor: Ryota Sasai (Tokyo, JP)

Assignee: OLYMPUS CORPORATION

A61B1/00149A61B1/000095A61B1/00042A61B1/00177A61B1/00193G06T7/248G06T7/74G06T2200/24G06T2207/10012G06T2207/10068G06T2207/30004H04N23/555

Abstract

Claims (78)

1 . An endoscope system comprising:

an endoscope;

a moving device that holds and moves the endoscope; and

at least one processor,

wherein the at least one processor is configured to:

detect a movement direction of the endoscope moved by the moving device in a coordinate system of the moving device;

estimate an area of a moving body in an image captured by the endoscope;

detect a movement direction of an object in the image on the basis of another area in the image excluding the area of the moving body;

calculate a deviation between a coordinate system of the endoscope and the coordinate system of the moving device on the basis of the movement direction of the endoscope and the movement direction of the object; and

correct the coordinate system of the moving device on the basis of the calculated deviation.

2 . The endoscope system according to claim 1 , wherein

the moving device holds the endoscope so as to allow rotation about a longitudinal axis of the endoscope, and

the deviation between the coordinate system of the endoscope and the coordinate system of the moving device includes a deviation in a rotational direction about an axis corresponding to the longitudinal axis.

3 . The endoscope system according to claim 2 , wherein

the endoscope is an oblique-viewing endoscope having a long lens barrel and an operation part connected to the proximal end of the lens barrel and holding an imaging device, the operation part being rotatable about a longitudinal axis of the lens barrel with respect to the lens barrel, and

the at least one processor is configured to calculate, as the deviation, a rotation angle of the endoscope about the longitudinal axis with respect to the moving device and a rotation angle of the operation part about the longitudinal axis with respect to the lens barrel on the basis of the movement direction of the endoscope and the movement direction of the object.

4 . The endoscope system according to claim 1 , wherein the at least one processor is configured to:

detect a movement direction of the object in the other area; and

calculate the deviation on the basis of the movement direction of the endoscope and the movement direction of the object in the other area.

5 . The endoscope system according to claim 4 , wherein the at least one processor is configured to:

detect multiple movement directions at multiple positions in the other area; and

calculate the movement direction of the object from the multiple movement directions.

6 . The endoscope system according to claim 5 , wherein the at least one processor is configured to:

count the number of the movement directions for each direction;

select, from the multiple movement directions, movement directions that are present in the largest number and movement directions close to the movement directions that are present in the largest number; and

calculate the movement direction of the object from the selected movement directions.

7 . The endoscope system according to claim 1 , wherein the at least one processor is configured to:

detect a motion vector of the object in the other area; and

calculate the deviation on the basis of the movement direction of the endoscope and the motion vector of the object in the other area.

8 . The endoscope system according to claim 7 , wherein the at least one processor is configured to:

detect multiple motion vectors at multiple positions in the other area; and

calculate the motion vector of the object from the multiple motion vectors.

9 . The endoscope system according to claim 8 , wherein the at least one processor is configured to:

count the number of the motion vectors for each direction;

select, from the multiple motion vectors, motion vectors that are present in the largest number and motion vectors whose direction is close to the direction of the motion vectors that are present in the largest number; and

calculate the motion vector of the object from the selected motion vectors.

10 . The endoscope system according to claim 7 , wherein

the endoscope is an oblique-viewing endoscope having a long lens barrel and an operation part connected to the proximal end of the lens barrel and holding an imaging device, the operation part being rotatable about a longitudinal axis of the lens barrel with respect to the lens barrel, and

the at least one processor is configured to:

acquire three-dimensional position information of the object in the image; and

detect a three-dimensional motion vector from the three-dimensional position information.

11 . The endoscope system according to claim 10 , wherein

the endoscope is configured to acquire a stereo image as the image, and

the at least one processor is configured to acquire the three-dimensional position information from the stereo image.

12 . The endoscope system according to claim 1 , further comprising a user interface that receives input of a trigger from a user,

wherein the at least one processor is configured to perform processing for correcting the coordinate system of the moving device in response to reception of the trigger at the user interface.

13 . The endoscope system according to claim 12 , wherein

the at least one processor is configured to detect the movement direction of the object on the basis of at least two images captured at different times, and

one of the at least two images is an image at a time when the trigger is received.

14 . The endoscope system according to claim 12 , wherein the at least one processor is configured to:

acquire an image captured by the endoscope at a predetermined time interval; and,

each time the processor newly acquires an image, detect the movement direction of the object on the basis of the newly acquired image and a previously acquired image.

15 . The endoscope system according to claim 1 , wherein the at least one processor is configured to:

detect a motion vector of the object; and,

when a magnitude of the motion vector of the object is greater than or equal to a predetermined threshold, calculate the deviation and corrects the coordinate system of the moving device.

16 . The endoscope system according to claim 1 , wherein the at least one processor is configured to:

perform, on the image, enhancement processing for enhancing a feature of the object; and

detect the movement direction of the object from the image that has gone through the enhancement processing.

17 . The endoscope system according to claim 1 , wherein the at least one processor is configured to detect the movement direction of the object on the basis of the other area excluding an area obtained by adding a margin to the area of the moving body.

18 . The endoscope system according to claim 1 , wherein the at least one processor is configured to:

estimate motion vectors at respective positions in the image; and

estimate the area of the moving body on the basis of the motion vectors at the respective positions.

19 . An endoscope system comprising:

an endoscope;

a moving device that holds and moves the endoscope; and

at least one processor,

wherein the at least one processor is configured to:

detect a movement direction of the endoscope moved by the moving device in a coordinate system of the moving device;

estimate motion vectors at respective positions in an image captured by the endoscope;

detect a movement direction of an object in the image on the basis of another area in the image excluding an area in which magnitudes of the motion vectors are greater than or equal to a predetermined threshold;

calculate a deviation between a coordinate system of the endoscope and the coordinate system of the moving device on the basis of the movement direction of the endoscope and the movement direction of the object; and

correct the coordinate system of the moving device on the basis of the calculated deviation.

20 . A coordinate system correction method for correcting a coordinate system of a moving device that holds and moves an endoscope, the method comprising:

detecting a movement direction of the endoscope moved by the moving device in the coordinate system of the moving device;

estimating an area of a moving body in an image captured by the endoscope;

detecting a movement direction of an object in the image on the basis of another area in the image excluding the area of the moving body;

calculating a deviation between a coordinate system of the endoscope and the coordinate system of the moving device on the basis of the movement direction of the endoscope and the movement direction of the object; and

correcting the coordinate system of the moving device on the basis of the calculated deviation.

Assignments (1)

Continuity (2)

References Cited (33)