Imaging device including three image sensors enabling multiple imaging modes and associated imaging systems
Methods and systems are provided to enable multiple imaging modalities with a single camera head. The camera head may include a two chip or a three chip system capable of measuring different wavelengths of light to generate different images. The light source in the system can adjust the output spectra, by using a plurality of illuminants and filters, and measurements from different light channels on one or more images sensors can be used to generate white light images, fluorescence image, perfusion images, fluorescein images, and the like.
1 . An endoscopic or exoscopic imaging device, comprising:
a user input configured to receive a selection of one imaging mode of a plurality of imaging modes, the selection of the imaging mode triggering activation of ones of a plurality of illuminants for a scene;
an optical component including at least two spectral filters configured to separate input light from the scene into three different, spectrally distinct portions of output light;
a first image sensor with a first color filter array (CFA), the first image sensor configured to detect a first set of at least three spectrally distinct spectral channels;
a second image sensor with a second CFA, the second image sensor configured to detect a second set of at least three spectrally distinct spectral channels; and
a third image sensor,
wherein a first spectral filter of the at least two spectral filters provides a first transmission cutoff between spectral bands, reflecting all light of a shorter wavelength than the first transmission cutoff and transmitting all light of a wavelength longer than the first transmission cutoff;
wherein a second spectral filter of the least two spectral filters provides a second transmission cutoff between spectral bands, reflecting all light of a shorter wavelength than the second transmission cutoff and transmitting all light of a wavelength longer than the second transmission cutoff; and
wherein the first set and the second set of at least three spectrally distinct spectral channels are different from the three different, spectrally distinct portions of the output light.
2 . The imaging device of claim 1 , wherein the first set of at least three spectrally distinct spectral channels and the second set of at least three spectrally distinct spectral channels each includes red light channel, a green light channel, and a blue light channel.
3 . The imaging device of claim 1 , wherein the first transmission cutoff comprises reflecting light with a wavelength shorter than about 500 nanometers (nm) and transmitting light with a wavelength longer than about 500 nm.
4 . The imaging device of claim 1 , wherein the second transmission cutoff comprises reflecting light with a wavelength longer than about 650 nanometers (nm) and transmitting light with a wavelength shorter than about 650 nm.
5 . The imaging device of claim 1 , wherein a third filter is configured to block a wavelength band that corresponds to a fluorescence excitation signal.
6 . The imaging device of claim 5 , wherein the third filter blocks spectral bands from about 700 nanometers (nm) to about 800 nm.
7 . The imaging device of claim 1 , further comprising:
an illumination device that illuminates a scene to be imaged with a first spectral content.
8 . The imaging device of claim 7 , wherein the illumination device provides white light with wavelengths between about 450 nm and about 650 nm, and wherein a white light image is created from a blue channel and a green light channel of the first image sensor and a blue light channel, a green light channel, and a red light channel of the second image sensor.
9 . The imaging device of claim 7 , wherein ICG or OTL excitation illumination is generated by the illumination device at wavelengths between about 725 nm and 800 nm, and wherein an ICG or OTL fluorescence image is imaged onto the third image sensor.
10 . The imaging device of claim 7 , wherein the illumination device generates an illumination that includes a red spectral band centered at about 630 nm and an infrared spectral band centered at about 940 nm, and wherein an oxygenation or prefusion image is created based on a calculation from a red light channel of the second image sensor and an IR channel on the third image sensor.
11 . The imaging device of claim 7 , wherein the illumination device generates an illumination that includes a red spectral band centered at about 630 nm, and wherein a Cy5 or a Cy5.5 fluorescence image is imaged onto the third image sensor.
12 . The imaging device of claim 7 , wherein the illumination device generates an illumination that includes a blue spectral band of wavelengths between 450 nm and 500 nm that provide fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a greyscale image is created from the fluorescein excitation illumination and is imaged onto the first image sensor.
13 . The imaging device of claim 7 , wherein the illumination device is not strobed.
14 . An endoscopic or exoscopic imaging system, comprising:
a user input configured to receive a selection of one imaging mode of a plurality of imaging modes, the selection of the imaging mode triggering activation of ones of a plurality of illuminants for a scene;
an optical component including at least two spectral filters configured to separate input light from the scene into three, spectrally distinct portions of output light;
a processor; and
a memory storing instructions thereon that, when processed by the processor, cause the processor to:
detect, from a first image sensor with a first color filter array (CFA), a first set of at least three spectrally distinct spectral channels;
detect, from a second image sensor with a second CFA, a second set of at least three spectrally distinct spectral channels,
wherein a first spectral filter of the at least two spectral filters provides a first transmission cutoff between spectral bands, reflecting all light of a shorter wavelength than the first transmission cutoff and transmitting all light of a wavelength longer than the first transmission cutoff;
wherein a second spectral filter of the least two spectral filters provides a second transmission cutoff between spectral bands, reflecting all light of a shorter wavelength than the second transmission cutoff and transmitting all light of a wavelength longer than the second transmission cutoff; and
wherein the first set and the second set of at least three spectrally distinct spectral channels are different from the three different, spectrally distinct portions of the output light; and
a third image sensor.
15 . The imaging system of claim 14 , wherein a third filter is configured to block a wavelength band that corresponds to a fluorescence excitation signal.
16 . The imaging system of claim 15 , wherein the third filter blocks spectral bands from about 700 nanometers (nm) to about 800 nm.
17 . The imaging system of claim 14 , further comprising:
an illumination device that illuminates a scene to be imaged with a first spectral content.
18 . The imaging system of claim 17 , wherein the illumination device provides white light with wavelengths between about 450 nm and about 650 nm, and wherein a white light image is created from a blue light channel and a green light channel of the first image sensor and a blue light channel, a green light channel, and a red light channel of the second image sensor.
19 . The imaging system of claim 17 , wherein ICG or OTL excitation illumination is generated by the illumination device at wavelengths between about 725 nm and 800 nm, and wherein an ICG or OTL fluorescence image is imaged onto the third image sensor.
20 . The imaging system of claim 17 , wherein the illumination device generates an illumination that includes a red spectral band centered at about 630 nm and an infrared spectral band centered at about 940 nm, and wherein an oxygenation or prefusion image is created based on a calculation from a red light channel of the second image sensor and an image on the third image sensor.
21 . The imaging system of claim 17 , wherein the illumination device generates an illumination that includes a red spectral band centered at about 630 nm, and wherein a Cy5 or a Cy5.5 fluorescence image is imaged onto the third image sensor.
22 . The imaging device of claim 17 , wherein the illumination device generates an illumination that includes a blue spectral band of wavelengths between 450 nm and 500 nm that provide fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a greyscale image is created from the fluorescein excitation illumination and is imaged onto the first image sensor.