IP Library Granted Patent US 10,244,972
Granted Patent B2
US 10,244,972 · App. 15/041,553 · Granted Apr 2, 2019

Fluorescence observation device, endoscopic system, processor device, and operation method

Inventor: Shunsuke Tominaga (Ashigara-kami-gun, JP)
Assignee: FUJIFILM Corporation
A61B5/14556A61B1/00009A61B1/043A61B1/0638A61B1/0646A61B5/14546A61B1/00188A61B5/14539A61B5/7425
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,244,972
App. No.
15/041,553
Granted
Apr 2, 2019
Kind
B2
Abstract

A fluorescence observation device includes an oxygen saturation calculation section, a reference region setting section, a region-of-interest setting section, a normalized fluorescence intensity calculation section, and a fluorescent image generation section. The oxygen saturation calculation section calculates the oxygen saturation of the subject for each pixel. The reference region setting section sets a reference region of the subject based on the oxygen saturation. The region-of-interest setting section sets a region of interest of the subject. The normalized fluorescence intensity calculation section calculates a normalized fluorescence intensity indicating the normalized emission intensity of the fluorescence by dividing the region-of-interest fluorescence intensity, which is calculated using the pixel value of the region of interest, by the reference fluorescence intensity calculated using the pixel value of the reference region of a fluorescent image signal obtained by imaging the subject with the fluorescence. The fluorescent image generation section generates a fluorescent image based on the normalized fluorescence intensity.

Claims (79)

1. A fluorescence observation device, comprising:

a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin;

an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject;

an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal; and

a processor unit that

calculates an oxygen saturation of the subject for each pixel based on the first image signal,

sets a reference region of the subject based on the oxygen saturation,

sets a region of interest of the subject,

calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and

generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity.

2. The fluorescence observation device according to claim 1 ,

wherein the processor unit sets the region of interest based on the oxygen saturation.

3. The fluorescence observation device according to claim 2 ,

wherein the processor unit sets a region where the oxygen saturation falls within a specific range as the reference region.

4. The fluorescence observation device according to claim 2 , further comprising:

a display unit that displays a fluorescent image,

wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and

displays the plurality of fluorescent images in time series on the display unit.

5. The fluorescence observation device according to claim 1 ,

wherein the processor unit sets the region of interest based on shape information of the subject.

6. The fluorescence observation device according to claim 5 ,

wherein the processor unit sets a region where the oxygen saturation falls within a specific range as the reference region.

7. The fluorescence observation device according to claim 5 , further comprising:

a display unit that displays a fluorescent image,

wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and

displays the plurality of fluorescent images in time series on the display unit.

8. The fluorescence observation device according to claim 1 ,

wherein the processor unit sets a region where the oxygen saturation falls within a specific range as the reference region.

9. The fluorescence observation device according to claim 8 , further comprising:

a display unit that displays a fluorescent image,

wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and

displays the plurality of fluorescent images in time series on the display unit.

10. The fluorescence observation device according to claim 1 , further comprising:

a display unit that displays a fluorescent image, wherein the processor unit obtains a plurality of fluorescent images by imaging the same subject at two or more different times, and

displays the plurality of fluorescent images in time series on the display unit.

11. The fluorescence observation device according to claim 1 ,

wherein the processor unit calculates the normalized fluorescence intensity using the region of interest set at a specific time of imaging and the reference region set at each time of imaging.

12. A fluorescence observation device, comprising:

an illumination light source that irradiates a subject, at least a part of which is colored with a colorant, with illumination light by which a color due to the colorant can be identified;

an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject;

an image sensor that images the subject with the illumination light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal; and

a processor unit that

sets a reference region according to a color due to the colorant,

sets a region of interest of the subject,

calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and

generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity.

13. The fluorescence observation device according to claim 12 ,

wherein the processor unit sets the region of interest according to a color due to the colorant.

14. The fluorescence observation device according to claim 12 ,

wherein the colorant is a pH indicator that changes with pH of the subject.

15. The fluorescence observation device according to claim 14 ,

wherein the processor unit sets a region where the pH is equal to or greater than a specific value as the reference region.

16. The fluorescence observation device according to claim 12 ,

wherein the colorant contains at least one of indigo carmine, toluidine blue, methylene blue, Lugol's solution, crystal violet, fluorescein, acridine orange, indocyanine green, or acetic acid.

17. The fluorescence observation device according to claim 12 ,

wherein the processor unit generates the fluorescent image of the region of interest which is pseudo-colored, by using the second image signal obtained from the subject with fluorescence before the colorant is administered to the subject and the first image signal obtained from the subject with the illumination light after the colorant is administered to the subject.

18. An endoscopic system, comprising:

a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin;

an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject;

an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal; and

processor unit that

calculates an oxygen saturation of the subject for each pixel based on the first image signal,

sets a reference region of the subject based on the oxygen saturation,

sets a region of interest of the subject,

calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and

generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity.

19. A processor device of an endoscopic system including a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin, an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject, and an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal, the processor device comprising:

a processor unit that

calculates an oxygen saturation of the subject for each pixel based on the first image signal,

sets a reference region of the subject based on the oxygen saturation,

sets a region of interest of the subject,

calculates a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal, and

generates a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity.

20. An operation method of a device including a signal light source that irradiates a subject with signal light having a wavelength band where an absorption coefficient changes with an oxygen saturation of blood hemoglobin, an excitation light source that irradiates the subject with excitation light for emitting fluorescence by exciting a fluorescent material contained in the subject, and an image sensor that images the subject with the signal light and outputs a first image signal and that images the subject with the fluorescence and outputs a second image signal, the operation method comprising:

an oxygen saturation calculation step of calculating an oxygen saturation of the subject for each pixel based on the first image signal;

a reference region setting step of setting a reference region of the subject based on the oxygen saturation;

a region-of-interest setting step of setting a region of interest of the subject;

a normalized fluorescence intensity calculation step of calculating a normalized fluorescence intensity indicating a normalized emission intensity of the fluorescence by dividing a region-of-interest fluorescence intensity, which is calculated using a pixel value of the region of interest of the subject in the second image signal, by a reference fluorescence intensity calculated using a pixel value of the reference region of the subject in the second image signal; and

a fluorescent image generation step of generating a fluorescent image of the region of interest which is pseudo colored based on the normalized fluorescence intensity.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2016
From: TOMINAGA, SHUNSUKE
To: FUJIFILM CORPORATION
Reel/Frame 037726/0652 →
Priority Claims (1)
JP 2013-202548 · Sep 27, 2013 · national
Continuity (2)
Continuation PCTJP2014066132 · Jun 18, 2014
Related Publication 20160157763A1 · Jun 9, 2016