Multi-function imaging
An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.
1. A method comprising:
receiving a single frame comprising:
a first set of pixel data that includes a fluorescence scene component, and
a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component;
determining a display fluorescence scene component from the first set of pixel data;
determining a display visible scene component from the second set of pixel data; and
generating, based on the display fluorescence scene component and the display visible scene component, a display scene.
2. The method of claim 1 , further comprising:
providing first and second illumination components to illuminate, at a same time, a scene represented by the single frame, wherein:
the first illumination component includes a fluorescence excitation illumination component, and
the second illumination component includes visible light that includes less than all visible color components of white light.
3. The method of claim 1 , further comprising capturing the single frame using a single-chip image capture sensor having a color filter array.
4. The method of claim 3 , wherein the capturing the single frame comprises:
capturing the first set of pixel data with a first set of pixels of the single-chip image capture sensor, the first set of pixels associated with a first color filter included in the color filter array; and
capturing the second set of pixel data with a second set of pixels of the single-chip image capture sensor, the second set of pixels associated with a second color filter included in the color filter array.
5. The method of claim 4 , wherein:
the first color filter is configured to allow light having a first color and fluorescence that results from fluorescence excitation illumination to pass through the first color filter to the first set of pixels; and
the second color filter is configured to allow light having a second color and the fluorescence to pass through the second color filter to the second set of pixels.
6. The method of claim 4 , wherein the second set of pixels are covered by a green color filter included in the color filter array.
7. The method of claim 4 , wherein the second set of pixels are covered by a blue color filter included in the color filter array.
8. The method of claim 1 , further comprising:
receiving, in a first color channel, the first set of pixel data; and
demosaicing the first set of pixel data to obtain a first set of image pixel data.
9. The method of claim 8 , further comprising:
receiving, in a second color channel, the second set of pixel data; and
demosaicing the second set of pixel data to obtain a second set of image pixel data.
10. The method of claim 9 , wherein the determining the display fluorescence scene component and the determining the display visible scene component are based on the first and second sets of image pixel data.
11. The method of claim 10 , wherein the display fluorescence scene component comprises a first linear weighted combination of the first set of image pixel data and the second set of image pixel data.
12. The method of claim 11 , wherein the display visible scene component comprises a second linear weighted combination of the first set of image pixel data and the second set of image pixel data.
13. The method of claim 1 , further comprising:
receiving, in a first color channel, the first set of pixel data;
receiving, in a third color channel, a third set of pixel data including the fluorescence scene component; and
demosaicing the first and third sets of pixel data as a single color channel to obtain a first set of image pixel data including the fluorescence scene component.
14. The method of claim 13 , further comprising:
receiving, in a second color channel, the second set of pixel data; and
demosaicing the second set of pixel data to obtain a second set of image pixel data.
15. The method of claim 14 , wherein the determining the display fluorescence scene component and the determining the display visible scene component are based on the first and second sets of image pixel data.
16. The method of claim 1 , further comprising generating a plurality of weighted combinations of the display fluorescence scene component and the display visible scene component.
17. The method of claim 16 , further comprising generating the display scene from the plurality of weighted combinations.
18. The method of claim 1 , wherein the display scene includes:
a highlighted scene component corresponding to the fluorescence scene component; and
a reduced color scene component.
19. The method of claim 1 , wherein the determining the display fluorescence scene component is further from the second set of pixel data.
20. The method of claim 1 , wherein the determining the display visible scene component is further from the first set of pixel data.