Multi-function imaging
An example method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.
1. A method comprising:
receiving a single frame comprising:
a first set of pixel data that includes a fluorescence scene component, and
a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and
generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.
2. The method of claim 1 , further comprising:
providing first and second illumination components to illuminate, at a same time, a scene represented by the single frame, wherein:
the first illumination component includes a fluorescence excitation illumination component, and
the second illumination component includes visible light that includes less than all visible color components of white light.
3. The method of claim 1 , further comprising capturing the single frame using a single-chip image capture sensor having a color filter array.
4. The method of claim 3 , wherein the capturing the single frame comprises:
capturing the first set of pixel data with a first set of pixels of the single-chip image capture sensor, the first set of pixels associated with a first color filter included in the color filter array; and
capturing the second set of pixel data with a second set of pixels of the single-chip image capture sensor, the second set of pixels associated with a second color filter included in the color filter array.
5. The method of claim 4 , wherein:
the first color filter is configured to allow light having a first color and fluorescence that results from fluorescence excitation illumination to pass through the first color filter to the first set of pixels; and
the second color filter is configured to allow light having a second color and the fluorescence to pass through the second color filter to the second set of pixels.
6. The method of claim 4 , wherein the second set of pixels are covered by a green color filter included in the color filter array.
7. The method of claim 4 , wherein the second set of pixels are covered by a blue color filter included in the color filter array.
8. The method of claim 1 , further comprising:
receiving, in a first color channel, the first set of pixel data; and
demosaicing the first set of pixel data to obtain a first set of image pixel data.
9. The method of claim 8 , further comprising:
receiving, in a second color channel, the second set of pixel data; and
demosaicing the second set of pixel data to obtain a second set of image pixel data.
10. The method of claim 9 , further comprising:
determining, based on the first and second sets of image pixel data, a display fluorescence scene component and a display visible scene component;
wherein the generating the display scene is based on the display fluorescence scene component and the display visible scene component.
11. The method of claim 10 , wherein the display fluorescence scene component comprises a first linear weighted combination of the first set of image pixel data and the second set of image pixel data.
12. The method of claim 11 , wherein the display visible scene component comprises a second linear weighted combination of the first set of image pixel data and the second set of image pixel data.
13. The method of claim 1 , wherein the display scene includes:
a highlighted scene component corresponding to the fluorescence scene component; and
a reduced color scene component.
14. A system comprising:
a memory storing instructions; and
one or more processors communicatively coupled to the memory and configured to execute the instructions to perform a process comprising:
receiving a single frame comprising:
a first set of pixel data that includes a fluorescence scene component, and
a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and
generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.
15. The system of claim 14 , wherein the process further comprises:
providing first and second illumination components to illuminate, at a same time, a scene represented by the single frame, wherein:
the first illumination component includes a fluorescence excitation illumination component, and
the second illumination component includes visible light that includes less than all visible color components of white light.
16. The system of claim 14 , wherein the single frame is captured using a single-chip image capture sensor having a color filter array.
17. The system of claim 14 , wherein the process further comprises:
receiving, in a first color channel, the first set of pixel data; and
demosaicing the first set of pixel data to obtain a first set of image pixel data.
18. The system of claim 17 , wherein the process further comprises:
receiving, in a second color channel, the second set of pixel data; and
demosaicing the second set of pixel data to obtain a second set of image pixel data.
19. The system of claim 18 , wherein the process further comprises:
determining, based on the first and second sets of image pixel data, a display fluorescence scene component and a display visible scene component;
wherein the generating the display scene is based on the display fluorescence scene component and the display visible scene component.
20. A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a computing device to perform a process comprising:
receiving a single frame comprising:
a first set of pixel data that includes a fluorescence scene component, and
a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and
generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.