COMPRESSED ACQUISITION OF MICROSCOPIC IMAGES
A microscope for computational imaging may include an illumination source configured to illuminate a sample with a plurality of wavelengths, an image sensor, an objective lens to image the sample onto the image sensor, and a processor operatively coupled to the illumination assembly and the image sensor. The processor may be configured to acquire a first image dataset from the sample illuminated using a first set of illumination conditions at a first wavelength. The processor may also be configured to acquire a second image dataset from the sample illuminated using a second set of illumination conditions having a second number of illumination conditions at a second wavelength. The second set of illumination conditions comprises fewer illumination conditions than the first set in order to decrease acquisition time. The processor may be configured to combine the first and second image datasets into a computationally reconstructed image of the sample.
1 . A microscope for image reconstruction, comprising:
an illumination assembly configured to illuminate a sample with a plurality of wavelengths at a plurality of angles;
an image sensor;
an objective lens to image the sample illuminated with the illumination assembly onto the image sensor; and
a processor operatively coupled to the illumination assembly and the image sensor, the processor configured to:
acquire, with the image sensor, a first image dataset from a sample illuminated using a first set of illumination conditions comprising a first number of illumination conditions each comprising a first wavelength, the first image dataset comprising a first spatial frequency bandwidth;
acquire, with the image sensor, a second image dataset from the sample illuminated using a second set of illumination conditions comprising a second number of illumination conditions, each comprising a second wavelength, the second image dataset comprising a second spatial frequency bandwidth, wherein the first number of illumination conditions is larger than the second number of illumination conditions; and
combine the first image dataset and the second image dataset into a computationally reconstructed image of the sample, wherein the computationally reconstructed image comprises a spatial frequency bandwidth greater than the first spatial frequency bandwidth of the first image dataset and the second spatial frequency bandwidth of the second image dataset.
2 . The microscope of claim 1 , wherein the first spatial frequency bandwidth corresponds to the first wavelength and the second spatial frequency bandwidth corresponds to the second wavelength, and wherein the first spatial frequency bandwidth is greater than the second spatial frequency bandwidth.
3 . The microscope of claim 2 , wherein the computationally reconstructed image comprises one or more of an increased contrast or an aberration correction for the second wavelength based at least in part on the first image dataset from the first wavelength.
4 . The microscope of claim 1 , wherein the processor is configured to provide the reconstructed image on a display with the first spatial frequency bandwidth and a first user perceivable color corresponding to the first wavelength and the second spatial frequency bandwidth and a second user perceivable color corresponding to the second wavelength, the first spatial frequency bandwidth greater than the second spatial frequency bandwidth and a spatial frequency bandwidth of the plurality of images acquired by the image sensor with the first set of illumination conditions at the first wavelength.
5 . The microscope of claim 1 , wherein the first number is larger than the second number by at least a factor of two and a second acquisition time associated with the second image dataset is no more than half of a first acquisition time associated with the first image dataset and wherein the spatial frequency bandwidth of the computationally reconstructed image is greater than a spatial frequency bandwidth of each of a plurality of images acquired with the first set of illumination conditions by at least a factor of 1.5.
6 . The microscope of claim 1 , wherein the computationally reconstructed image comprises one or more of a correction for optical aberrations, or an increase in image contrast.
7 . The microscope of claim 6 , wherein the image sensor comprise a spatial frequency bandwidth and the spatial frequency bandwidth of the computationally reconstructed image is greater than the spatial frequency bandwidth of the image sensor divided by a magnification of an image of the sample onto the image sensor.
8 . The microscope of claim 7 , wherein each of the first plurality of images comprises the first spatial frequency bandwidth, and the spatial frequency bandwidth of the computationally reconstructed image is greater than the first spatial frequency bandwidth of said each of the first plurality of images.
9 . The microscope of claim 7 , wherein the correction of optical aberrations is provided by separating aberration information from sample information, so as to decrease an effect of optical aberrations on the computationally reconstructed image.
10 . The microscope of claim 7 , wherein the increased image contrast of the computationally reconstructed image is provided by computationally amplifying high spatial frequencies of the reconstructed image to better represent the sample.
11 . A non-transitory computer readable medium configured with instruction, which we executed, cause the process to:
acquire, with an image sensor, a first image dataset from a sample illuminated using a first set of illumination conditions comprising a first number of illumination conditions each comprising a first wavelength, the first image dataset comprising a first spatial frequency bandwidth;
acquire, with the image sensor, a second image dataset from the sample illuminated using a second set of illumination conditions comprising a second number of illumination conditions, each comprising a second wavelength, the second image dataset comprising a second spatial frequency bandwidth, wherein the first number of illumination conditions is larger than the second number of illumination conditions; and
combine the first image dataset and the second image dataset into a computationally reconstructed image of the sample, wherein the computationally reconstructed image comprises a spatial frequency bandwidth greater than the first spatial frequency bandwidth of the first image dataset and the second spatial frequency bandwidth of the second image dataset.
12 . The non-transitory computer readable medium of claim 11 , wherein the first spatial frequency bandwidth corresponds to the first wavelength and the second spatial frequency bandwidth corresponds to the second wavelength, and wherein the first spatial frequency bandwidth is greater than the second spatial frequency bandwidth.
13 . The non-transitory computer readable medium of claim 12 , wherein the computationally reconstructed image comprises one or more of an increased contrast or an aberration correction for the second wavelength based at least in part on the first image dataset from the first wavelength.
14 . The non-transitory computer readable medium of claim 11 , wherein the instructions are configured to provide the reconstructed image on a display with the first spatial frequency bandwidth and a first user perceivable color corresponding to the first wavelength and the second spatial frequency bandwidth and a second user perceivable color corresponding to the second wavelength, the first spatial frequency bandwidth greater than the second spatial frequency bandwidth and a spatial frequency bandwidth of the plurality of images acquired by the image sensor with the first set of illumination conditions at the first wavelength.
15 . The non-transitory computer readable medium of claim 11 , wherein the first number is larger than the second number by at least a factor of two and a second acquisition time associated with the second image dataset is no more than half of a first acquisition time associated with the first image dataset and wherein the spatial frequency bandwidth of the computationally reconstructed image is greater than a spatial frequency bandwidth of each of a plurality of images acquired with the first set of illumination conditions by at least a factor of 1.5.
16 . The non-transitory computer readable medium of claim 11 , wherein the computationally reconstructed image comprises one or more of a correction for optical aberrations, or an increase in image contrast.
17 . The non-transitory computer readable medium of claim 16 , wherein the image sensor comprise a spatial frequency bandwidth and the spatial frequency bandwidth of the computationally reconstructed image is greater than the spatial frequency bandwidth of the image sensor divided by a magnification of an image of the sample onto the image sensor.
18 . The non-transitory computer readable medium of claim 17 , wherein each of the first plurality of images comprises the first spatial frequency bandwidth, and the spatial frequency bandwidth of the computationally reconstructed image is greater than the first spatial frequency bandwidth of said each of the first plurality of images.
19 . The non-transitory computer readable medium of claim 17 , wherein the correction of optical aberrations is provided by separating aberration information from sample information, so as to decrease an effect of optical aberrations on the computationally reconstructed image.
20 . The non-transitory computer readable medium of claim 17 , wherein the increased image contrast of the computationally reconstructed image is provided by computationally amplifying high spatial frequencies of the reconstructed image to better represent the sample.