IP Library › Granted Patent US 11,039,732
Granted Patent B2
US 11,039,732 · App. 16/109,797 · Granted Jun 22, 2021

Endoscopic system and method of operating same

Inventor: Yoshiro Imai (Kanagawa, JP)
Assignee: FUJIFILM Corporation
A61B1/00009A61B1/0005A61B1/00006A61B1/00055A61B1/04A61B1/045A61B1/05A61B1/0638A61B1/0669A61B1/0684A61B1/07G06T5/003G06T5/50H04N5/23254H04N5/23267H04N7/18H04N9/04521A61B1/00186A61B1/00188A61B1/041G06T2207/10024G06T2207/10068G06T2207/10152G06T2207/30101H04N2005/2255
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,039,732
App. No.
16/109,797
Granted
Jun 22, 2021
Kind
B2
Abstract

An image selection unit selects a B 2 image signal of which an image blurring amount satisfies a first condition, from a B 2 image signal at a first timing T 1 or B 2 image signals at the second timing T 2 to an N-th timing TN. A computed image signal generation unit performs computation based on a B 1 image signal at the first timing T 1 and a second image signal selected in the image selection unit, thereby generating a computed image signal.

Claims (63)

1. An endoscope system comprising:

a light source that sequentially generates first illumination light and second illumination light;

an imaging sensor that sequentially images an observation object illuminated sequentially with the first illumination light and the second illumination light at a first timing T 1 , thereby outputting multi-frame image signals at the first timing T 1 and sequentially images the observation object illuminated sequentially with the first illumination light and the second illumination light at a specific timing before the first timing T 1 , thereby outputting multi-frame image signals at the specific timing;

a processor, configured to:

select a second image signal of which an image blurring amount satisfies a first condition from second image signals obtained in a case where the second illumination light is radiated among the multi-frame image signals at the first timing T 1 and the specific timing; and

perform computation based on a first image signal obtained in a case where the first illumination light is radiated among the multi-frame image signals at the first timing T 1 and the second image signal, thereby generating a computed image signal.

2. The endoscope system according to claim 1 ,

wherein the processor selects a second image signal, of which the image blurring amount is less than a predetermined threshold value and which is imaged at a timing closest to the first timing T 1 , as the second image signal that satisfies the first condition.

3. The endoscope system according to claim 1 ,

wherein the processor selects a second image signal with the smallest image blurring amount, as the second image signal that satisfies the first condition.

4. The endoscope system according to claim 1 ,

wherein the processor does not select the second image signal in a case where the second image signal of which the image blurring amount satisfies the first condition is not included in the multi-frame image signals at the first timing T 1 and the specific timing, and

wherein the processor generates the computed image signal only on the basis of the first image signal.

5. The endoscope system according to claim 1 ,

wherein the processor does not select the second image signal in a case where the second image signal of which the image blurring amount satisfies the first condition is not included in the multi-frame image signals at the first timing T 1 and the specific timing, and

wherein the processor does not generate the computed image signal.

6. The endoscope system according to claim 1 , wherein the processor is further configured to:

perform a control of displaying a warning in a case where the second image signal of which the image blurring amount satisfies the first condition is not included in the multi-frame image signals at the first timing T 1 and the specific timing.

7. The endoscope system according to claim 1 , wherein the processor is further configured to:

perform a control of displaying an image based on the second image signals included in the multi-frame image signals at the first timing T 1 and the specific timing, and image blurring amounts of the second image signals at the first timing T 1 and the specific timing on a display,

wherein the processor has an auto-selection mode where the second image signal that satisfies the first condition is automatically selected, and a manual selection mode where a second image signal selected and indicated by a user is selected among the second image signals displayed on the display, and performs image selection in either the auto-selection mode or the manual selection mode.

8. An endoscope system comprising:

a light source that sequentially generates first illumination light and second illumination light;

an imaging sensor that sequentially images an observation object illuminated sequentially with the first illumination light and the second illumination light at a first timing T 1 , thereby outputting multi-frame image signals at the first timing T 1 and sequentially images the observation object illuminated sequentially with the first illumination light and the second illumination light at a specific timing before the first timing T 1 , thereby outputting multi-frame image signals at the specific timing;

a blurring index value calculation unit that calculates blurring index values at the first timing T 1 and the specific timing on the basis of an image blurring amount of a first image signal obtained in a case where the first illumination light is radiated and an image blurring amount of a second image signal obtained in a case where the second illumination light is radiated, among the multi-frame image signals at the first timing T 1 and the specific timing;

an image selection unit that selects a second image signal at a timing at which the blurring index values satisfy a second condition among the second image signals included in the multi-frame image signals at the first timing T 1 and the specific timing; and

a computed image signal generation unit that performs computation based on a first image signal included in the multi-frame image signals at the first timing T 1 and a second image signal selected in the image selection unit, thereby generating a computed image signal.

9. The endoscope system according to claim 8 ,

wherein in a case where the blurring index values are a blurring difference showing a difference between an image blurring amount of the first image signal and an image blurring amount of the second image signal, the image selection unit selects a second image signal at a timing at which the blurring difference is within a first specific range as the second image signal at the timing at which the second condition is satisfied, and

wherein in a case where the blurring index values are a blurring ratio showing a ratio of the image blurring amount of the first image signal and the image blurring amount of the second image signal, the image selection unit selects a second image signal at a timing at which the blurring ratio is within a second specific range as the second image signal at the timing at which the second condition is satisfied.

10. The endoscope system according to claim 8 ,

wherein the processor does not select the second image signal in a case where the blurring index values at any of the timings do not satisfy the second condition, and

wherein the processor generates the computed image signal only on the basis of the first image signal.

11. The endoscope system according to claim 8 ,

wherein the processor does not select the second image signal in a case where the blurring index values at any of the timings do not satisfy the second condition, and

wherein the processor does not generate the computed image signal.

12. The endoscope system according to claim 8 , wherein the processor is further configured to:

perform a control of displaying a warning in a case where the blurring index values at any of the timings do not satisfy the second condition.

13. The endoscope system according to claim 8 , wherein the processor is further configured to:

perform a control of displaying an image based on the second image signals included in the multi-frame image signals at the first timing T 1 and the specific timing, and the blurring index values at the first timing T 1 and the specific timing on a display,

wherein the processor has an auto-selection mode where the multi-frame image signals that satisfy the second condition is automatically selected, and a manual selection mode where a second image signal selected and indicated by a user is selected among the second image signals displayed on the display, and performs image selection in either the auto-selection mode or the manual selection mode.

14. The endoscope system according to claim 1 ,

wherein the image blurring amount is calculated on the basis of a blood vessel structure or a mucous membrane structure within the first image signal or the second image signal.

15. The endoscope system according to claim 1 ,

wherein the image blurring amount is calculated on the basis of a central region within the first image signal or the second image signal.

16. The endoscope system according to claim 1 ,

wherein a plurality of timings of a second timing T 2 to an N-th timing TN are included in the specific timing, and

wherein N represents an integer of 3 or more.

17. The endoscope system according to claim 1 ,

wherein the first illumination light and the second illumination light have different wavelength ranges, respectively.

18. A method of operating an endoscope system, the method comprising:

sequentially generating first illumination light and second illumination light by a light source;

sequentially imaging an observation object illuminated sequentially with the first illumination light and the second illumination light at a first timing T 1 , thereby outputting multi-frame image signals at the first timing T 1 and sequentially images the observation object illuminated sequentially with the first illumination light and the second illumination light at a specific timing before the first timing T 1 , thereby outputting multi-frame image signals at the specific timing, by an imaging sensor;

selecting a second image signal of which an image blurring amount satisfies a first condition from second image signals included in the multi-frame image signals at the first timing T 1 and the specific timing, by a processor; and

performing computation based on a first image signal including in the multi-frame image signals at the first timing T 1 and the second image signal, thereby generating a computed image signal, by the processor.

19. A method of operating an endoscope system, the method comprising:

sequentially generating first illumination light and second illumination light by a light source;

sequentially imaging an observation object illuminated sequentially with the first illumination light and the second illumination light at a first timing T 1 , thereby outputting multi-frame image signals at the first timing T 1 and sequentially images the observation object illuminated sequentially with the first illumination light and the second illumination light at a specific timing before the first timing T 1 , thereby outputting multi-frame image signals at the specific timing, by an imaging sensor;

calculating blurring index values at the first timing T 1 and the specific timing on the basis of an image blurring amount of a first image signal and an image blurring amount of a second image signal in the multi-frame image signals at the first timing T 1 and the specific timing, by a processor;

selecting a second image signal at a timing at which the blurring index values satisfy a second condition among the second image signals included in the multi-frame image signals at the first timing T 1 and the specific timing, by the processor; and

performing computation based on a first image signal included in the multi-frame image signals at the first timing T 1 and a second image signal included in the multi-frame image signals, thereby generating a computed image signal, by the processor.

20. The method of operating an endoscope system according to claim 18 ,

wherein the first illumination light and the second illumination light have different wavelength ranges, respectively.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2018
From: IMAI, YOSHIRO
To: FUJIFILM CORPORATION
Reel/Frame 046731/0981 →
Priority Claims (1)
JP JP2016-054631 · Mar 18, 2016 · national
Continuity (2)
Continuation PCTJP2017002677 · Jan 26, 2017
Related Publication 20190008361A1 · Jan 10, 2019