Systems and methods for combining hyperspectral images with color images
The invention is directed to methods and systems of hyperspectral and multispectral imaging of medical tissues. In particular, the invention is directed to new devices, tools and processes for the detection and evaluation of diseases and disorders such as, but not limited to diabetes and peripheral vascular disease and cancer, that incorporate hyperspectral or multispectral imaging.
1. An apparatus comprising:
a) a spectral imager that is configured to resolve light obtained from a region of interest of a subject into a plurality of component spectral bands, wherein the spectral imager comprises a lens in optical connection with an image sensor; and
b) a computer system electrically coupled to the spectral imager and comprising a memory and a processor, wherein the memory stores instructions for
(i) constructing a color photo image by concatenating three planes from a hyperspectral cube constructed from the plurality of component spectral bands;
(ii) constructing a pseudo color image based on the plurality of component spectral bands; and
(iii) combining the pseudo color image with the color photo image to form a composite image,
wherein the constructing of the pseudo color image comprises:
defining a color hue plane that represents a first characteristic in the group consisting of (a) an oxyhemoglobin concentration, (b) a deoxyhemoglobin concentration and (c) a mathematical combination of the oxyhemoglobin concentration and the deoxyhemoglobin concentration;
defining a color saturation plane that represents a second characteristic in the group consisting of (a) the oxyhemoglobin concentration, (b) the deoxyhemoglobin concentration and (c) a mathematical combination of the oxyhemoglobin concentration and the deoxyhemoglobin concentration, wherein the second characteristic is different than the first characteristic; and
defining a color intensity plane that represents reflectance in a region that is about 450 nm to about 580 nm.
2. The apparatus of claim 1 , wherein a wavelength range of each respective component spectral band in the plurality of component spectral bands is adjacent to the wavelength range of another component spectral band in the plurality of component spectral bands.
3. The apparatus of claim 1 , wherein each respective component spectral band in the plurality of spectral bands has a bandwidth of less than 50 nm.
4. The apparatus of claim 1 , wherein the memory further stores instructions for displaying the composite image on a computer screen.
5. The apparatus of claim 1 , wherein the region of interest of the subject is a portion of the skin of the subject.
6. The apparatus of claim 1 , wherein the light obtained from the region of interest is in the visible range.
7. The apparatus of claim 1 , wherein the color photo image is constructed by concatenating a first resolved component spectral band, a second resolved component spectral band, and a third resolved component spectral band, wherein:
the first resolved component spectral band comprises a wavelength corresponding to red light;
the second resolved component spectral band comprises a wavelength corresponding to green light; and
the third resolved component spectral band comprises a wavelength corresponding to blue light.
8. The apparatus of claim 1 , wherein the three planes concatenated from the hyperspectral cube consist of a first plane at a wavelength of 580 nm to 800 nm, a second plane at a wavelength of 480-580 nm, and a third plane at a wavelength of 350 nm to 490 nm.
9. The apparatus of claim 1 , wherein the spectral imager further comprises one or more polarizers, wherein the one or more polarizers compile light entering the spectral imager into a plane of polarization before entering the image sensor.
10. The apparatus of claim 1 , wherein the lens comprises a lens assembly.
11. The apparatus of claim 10 , wherein the lens assembly comprises a first stage imaging optic and a second stage imaging optic.
12. The apparatus of claim 1 , further comprising a display for displaying the composite image.
13. The apparatus of claim 1 , wherein the computing system further comprises a storage device for storing the composite image.
14. The apparatus of claim 1 , further comprising a printer for printing the composite image.
15. The apparatus of claim 1 , further comprising a communication link for transferring the composite image to a remote device or computer.
16. The apparatus of claim 1 , wherein each respective component spectral band in the plurality of component spectral bands has a bandwidth that is between 10 nm and 40 nm.
17. The apparatus of claim 1 , wherein each respective component spectral band in the plurality of component spectral bands has a bandwidth that is between 10 nm and 15 nm.
18. The apparatus of claim 1 , wherein each respective component spectral band in the plurality of component spectral bands has a bandwidth that is between 5 nm and 12 nm.
19. The apparatus of claim 1 , wherein the apparatus is a portable apparatus.
20. The apparatus of claim 1 , wherein the region of interest is a tissue of the subject.
21. The apparatus of claim 20 , wherein the tissue comprises an ulcer, callus, intact skin, hematoma, or superficial blood vessel.