IP Library Granted Patent US 11,131,631
Granted Patent B2
US 11,131,631 · App. 16/757,634 · Granted Sep 28, 2021

Super-resolution fluorescence microscopy by stepwise optical saturation

Inventors: Scott S. Howard (Notre Dame, IN); Yide Zhang (Notre Dame, IN); Cody J. Smith (Notre Dame, IN)
Assignee: UNIVERSITY OF NOTRE DAME DU LAC
G01N21/6458G02B21/0072G02B21/0076G02B21/367
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,131,631
App. No.
16/757,634
Granted
Sep 28, 2021
Kind
B2
Abstract

A microscopy method and system includes obtaining a plurality of raw fluorescence images, respective ones of the plurality of raw fluorescence images obtained by exciting a sample using a light source at a respective irradiance value in a weak saturation region of the sample, and capturing the respective raw fluorescence image; applying a plurality of weights to the plurality of raw fluorescence images in a one-to-one correspondence so as to generate a plurality of weighted fluorescence images, wherein a respective weight is based on the respective irradiance value at which the corresponding raw fluorescence image was obtained; and linearly combining the plurality of weighted fluorescence images, thereby generating the output image having a resolution greater than a diffraction limit. Respective raw fluorescence images correspond to irradiance values different from one another.

Claims (59)

1. A method of generating an output microscopy image, comprising:

obtaining a plurality of raw fluorescence images, respective ones of the plurality of raw fluorescence images obtained by exciting a sample using a light source at a respective irradiance value in a weak saturation region of the sample, and capturing the respective raw fluorescence image;

applying a plurality of weights to the plurality of raw fluorescence images in a one-to-one correspondence so as to generate a plurality of weighted fluorescence images, wherein a respective weight is based on the respective irradiance value at which the corresponding raw fluorescence image was obtained; and

linearly combining the plurality of weighted fluorescence images, thereby generating the output image having a resolution greater than a diffraction limit,

wherein respective raw fluorescence images correspond to irradiance values different from one another, and

wherein applying the plurality of weights includes:

extracting an image characteristic value from a respective raw fluorescence image,

determining a weight value based on the respective irradiance value, and

multiplying the image characteristic value by the weight value.

2. The method according to claim 1 , wherein the image characteristic value is representative of a fluorescence intensity of the respective raw fluorescence image.

3. The method according to claim 2 , wherein the image characteristic value is representative of a harmonic of the respective raw fluorescence image in the frequency domain.

4. The method according to claim 1 , wherein obtaining the plurality of raw fluorescence images further includes modulating a light from the light source with a periodic signal.

5. The method according to claim 1 , wherein obtaining the plurality of raw fluorescence images further includes performing a blind deconvolution on the respective raw fluorescence image.

6. A method of generating an output microscopy image, comprising:

obtaining a plurality of raw fluorescence images, respective ones of the plurality of raw fluorescence images obtained by exciting a sample using a light source at a respective irradiance value in a weak saturation region of the sample, and capturing the respective raw fluorescence image;

applying a plurality of weights to the plurality of raw fluorescence images in a one-to-one correspondence so as to generate a plurality of weighted fluorescence images, wherein a respective weight is based on the respective irradiance value at which the corresponding raw fluorescence image was obtained; and

linearly combining the plurality of weighted fluorescence images, thereby generating the output image having a resolution greater than a diffraction limit,

wherein respective raw fluorescence images correspond to irradiance values different from one another, wherein

the plurality of raw fluorescence images is two raw fluorescence images including a first raw fluorescence image and a second raw fluorescence image,

obtaining the first raw fluorescence image includes exciting the sample using the light source at a first irradiance value in the weak saturation region of the sample, and capturing the first raw fluorescence image, and

obtaining the second raw fluorescence image includes exciting the sample using the light source at a second irradiance value in the weak saturation region of the sample, and capturing the second raw fluorescence image,

wherein the second irradiance value is about 1.2 times the first irradiance value.

7. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

obtaining a plurality of raw fluorescence images, respective ones of the plurality of raw fluorescence images obtained by exciting a sample using a light source at a respective irradiance value in a weak saturation region of the sample, and capturing the respective raw fluorescence image;

applying a plurality of weights to the plurality of raw fluorescence images in a one-to-one correspondence so as to generate a plurality of weighted fluorescence images, wherein a respective weight is based on the respective irradiance value at which the corresponding raw fluorescence image was obtained; and

linearly combining the plurality of weighted fluorescence images, thereby generating the output image having a resolution greater than a diffraction limit,

wherein respective raw fluorescence images correspond to irradiance values different from one another, and

wherein applying the plurality of weights includes:

extracting an image characteristic value from a respective raw fluorescence image,

determining a weight value based on the respective irradiance value, and

multiplying the image characteristic value by the weight value.

8. The non-transitory computer-readable medium according to claim 7 , wherein the image characteristic value is representative of a fluorescence intensity of the respective raw fluorescence image.

9. The non-transitory computer-readable medium according to claim 7 , wherein the image characteristic value is representative of a harmonic of the respective raw fluorescence image in the frequency domain.

10. The non-transitory computer-readable medium according to claim 7 , wherein obtaining the plurality of raw fluorescence images further includes modulating a light from the light source with a periodic signal.

11. The non-transitory computer-readable medium according to claim 7 , wherein obtaining the plurality of raw fluorescence images further includes performing a blind deconvolution on the respective raw fluorescence image.

12. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

obtaining a plurality of raw fluorescence images, respective ones of the plurality of raw fluorescence images obtained by exciting a sample using a light source at a respective irradiance value in a weak saturation region of the sample, and capturing the respective raw fluorescence image;

applying a plurality of weights to the plurality of raw fluorescence images in a one-to-one correspondence so as to generate a plurality of weighted fluorescence images, wherein a respective weight is based on the respective irradiance value at which the corresponding raw fluorescence image was obtained; and

linearly combining the plurality of weighted fluorescence images, thereby generating the output image having a resolution greater than a diffraction limit,

wherein respective raw fluorescence images correspond to irradiance values different from one another, wherein

the plurality of raw fluorescence images is two raw fluorescence images including a first raw fluorescence image and a second raw fluorescence image,

obtaining the first raw fluorescence image includes exciting the sample using the light source at a first irradiance value in the weak saturation region of the sample, and capturing the first raw fluorescence image, and

obtaining the second raw fluorescence image includes exciting the sample using the light source at a second irradiance value in the weak saturation region of the sample, and capturing the second raw fluorescence image,

wherein the second irradiance value is about 1.2 times the first irradiance value.

13. A microscopy system, comprising:

a light source configured to excite a sample;

an imaging device configured to obtain a plurality of raw fluorescence images, respective ones of the plurality of raw fluorescence images obtained by exciting the sample using the light source at a respective irradiance value in a weak saturation region of the sample, and capturing the respective raw fluorescence image; and

a controller configured to:

apply a plurality of weights to the plurality of raw fluorescence images in a one-to-one correspondence so as to generate a plurality of weighted fluorescence images, wherein a respective weight is based on the respective irradiance value at which the corresponding raw fluorescence image was obtained, and

linearly combine the plurality of weighted fluorescence images, thereby generating the output image having a resolution greater than a diffraction limit,

wherein respective raw fluorescence images correspond to irradiance values different from one another, and

wherein applying the plurality of weights includes:

extracting an image characteristic value from a respective raw fluorescence image,

determining a weight value based on the respective irradiance value, and

multiplying the image characteristic value by the weight value.

14. The microscopy system according to claim 13 , wherein the image characteristic value is representative of a fluorescence intensity of the respective raw fluorescence image.

15. The microscopy system according to claim 13 , wherein the image characteristic value is representative of a harmonic of the respective raw fluorescence image in the frequency domain.

16. The microscopy system according to claim 13 , wherein the controller is further configured to modulate a light from the light source with a periodic signal.

17. The microscopy system according to claim 13 , wherein the controller is further configured to perform a blind deconvolution on the respective raw fluorescence image.

Assignments (2)
CONFIRMATORY LICENSE Recorded Sep 27, 2024
From: UNIVERSITY OF NOTRE DAME
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 069086/0895 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2020
From: HOWARD, SCOTT S.; ZHANG, YIDE; SMITH, CODY J.
To: UNIVERSITY OF NOTRE DAME DU LAC
Reel/Frame 053821/0742 →
Continuity (3)
Provisional Application 62722606 · Aug 24, 2018
Provisional Application 62611447 · Dec 28, 2017
Related Publication 20200333251A1 · Oct 22, 2020