Imaging system with a single color image sensor for simultaneous fluorescence and color video endoscopy
View Patent ↗An endoscopic video system and method using a camera with a single color image sensor, for example a CCD color image sensor, for fluorescence and color imaging and for simultaneously displaying the images acquired in these imaging modes at video rates in real time is disclosed. The tissue under investigation is illuminated continuously with fluorescence excitation light and is further illuminated periodically using visible light outside of the fluorescence excitation wavelength range. The illumination sources may be conventional lamps using filters and shutters, or may include light-emitting diodes mounted at the distal tip of the endoscope.
1. A method for real-time acquisition of fluorescence and white-light endoscopic images with a single CCD color image sensor, comprising the steps of:
continuously illuminating tissue with fluorescence excitation light,
during the continuous illuminating with fluorescence excitation light, periodically illuminating the tissue with illumination light covering the entire visible spectral range,
detecting with the single CCD color image sensor tissue fluorescence from the tissue induced by the fluorescence excitation light when the tissue is not illuminated with the illumination light,
detecting with the single CCD color imager a combined, simultaneous tissue fluorescence and white-light image from the tissue when the tissue is additionally illuminated with the illumination light,
reading image fields from the single CCD color image sensor in an interlaced fashion,
processing the image fields to produce corresponding full-frame fluorescence and white-light images,
subtracting from each full-frame combined fluorescence and white-light image the corresponding fluorescence image on a pixel-by pixel basis, and
displaying or storing the real-time fluorescence and white-light images of the tissue.
2. The method of claim 1 , wherein the illumination light is switched on for one cycle and switched off for two cycles.
3. The method of claim 2 , wherein a different image field of the combined tissue fluorescence and white-light image is read out during each of the two cycles when the illumination light is switched off.
4. The method of claim 2 , wherein a different image field of the tissue fluorescence image are read out during each of the cycles when the illumination light is switched on.
5. The method of claim 1 , further comprising summing pixel values of adjacent rows of the CCD color image sensor pixel-by-pixel to form summed row pixel values and reading the summed values in an interlaced fashion.
6. The method of claim 1 , further comprising computing a luma image of the combined full-frame fluorescence and white-light image signals and colorize the luma image based on a ratio of red reflectance to fluorescence signals to produce a superimposed fluorescence/color image for display.
7. The method of claim 2 , wherein a cycle has a duration of 1/60 second.
8. The method of claim 2 , wherein four full frame white-light images are produced every six cycles.
9. The method of claim 8 , wherein during a cycle where no full frame white-light image is produced, an interpolated full frame white-light image is computed from two adjacent full frame white-light images.
10. The method of claim 2 , wherein two full frame fluorescence images are produced every six cycles.
11. The method of claim 1 , wherein in the subtracting step, the fluorescence signals are interpolated between sequential fluorescence frames before being subtracted from the white-light image signals.
12. An endoscope system used for observing living tissue inside a body cavity, comprising:
a single CCD color image sensor configured to receive an optical image and to output image signals;
an illuminating device having a white light source that emits white light covering the entire visible spectral range, and an excitation light source that emits excitation light having a predetermined wavelength for exciting autofluorescence in the living tissue;
a display device;
a control system configured to control the illuminating device to illuminate the living tissue continuously with excitation light and additionally illuminate the living tissue periodically with the white light during the continuous illumination with the excitation light, and to control an image processing system to obtain from the image signals interlaced image fields of alternating fluorescence image signals and combined, simultaneous fluorescence and white-light image signals,
the control system further configured to process the interlaced image fields to produce corresponding full-frame fluorescence and white-light light images, and to subtract from each full-frame of the combined fluorescence and normal light image the corresponding fluorescence image on a pixel-by pixel basis to generate a white-light image frame for display on the display device.
13. The endoscope system of claim 12 , wherein the image processing system is configured to convert the combined fluorescence and white-light image signals into luma signals, and to process the luma signals into a full-frame colorable intensity image.
14. The endoscope system of claim 12 , wherein the illuminating device comprises a solid state light source having separately controllable white-light and excitation light sources.
15. The endoscope system of claim 14 , wherein the solid state light source comprises plurality of light-emitting diodes.
16. The endoscope system of claim 15 , wherein the light-emitting diodes are disposed on a distal end of the endoscope system.
17. The endoscope system of claim 16 , wherein the light-emitting diodes are externally cooled.
18. The endoscope system of claim 16 , wherein the light-emitting diodes are externally cooled by way of thermoelectric coolers, liquid-cooled heat exchangers, expansion coolers, microchannel coolers, or thermo-siphon heat pipes, or a combination thereof.