IP Library › Granted Patent US 12,265,033
Granted Patent B2
US 12,265,033 · App. 17/991,447 · Granted Apr 1, 2025

Method, computer program and apparatus for determining positions of molecules in a sample

Inventors: Joachim Fischer (Karlsruhe, DE); Matthias Henrich (Heidelberg, DE); Winfried Willemer (Bovenden, DE)
Assignee: ABBERIOR INSTRUMENTS GMBH
G01N21/6458G01N21/6428G02B21/361G02B21/365
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,265,033
App. No.
17/991,447
Granted
Apr 1, 2025
Kind
B2
Abstract

The present disclosure relates to method, computer programs with instructions, and apparatus for determining positions of two or more spaced-apart molecules in one or more spatial directions in a sample by means of a localization microscope. The present disclosure also relates to localization microscopes using such an apparatus. Light distributions arising due to interference of coherent light are used for determining the positions of the molecules. In the method, a plurality of light distributions are generated (S 1 ) using a first light modulator having a plurality of switchable pixels. The first light modulator is arranged in an image plane of the localization microscope. Each light distribution has a local intensity minimum and regions with an intensity increase adjacent thereto. Each of the two or more molecules is illuminated (S 2 ) with one light distribution. For each of the light distributions, photons emitted by the molecules are detected (S 4 ) for different positionings of the light distribution. The light distributions are positioned (S 3 ) independently of each other. Based on the photons detected for the different positionings of the light distributions, the positions of the molecules are finally derived (S 5 ).

Claims (47)

1. A method for determining positions of two or more spaced-apart molecules in one or more spatial directions in a sample using a localization microscope, wherein light distributions arising due to interference of coherent light are used for determining the positions of the molecules, comprising:

generating a plurality of light distributions using a first light modulator having a plurality of switchable pixels disposed in an image plane of the localization microscope, each light distribution having at least one local intensity minimum and regions with an intensity increase adjacent thereto;

illuminating each of the two or more molecules with one light distribution each;

for each of the light distributions, detecting photons emitted by the molecules for different positionings of the light distribution, the light distributions being positioned independently of each other; and

deriving the positions of the molecules based on the photons detected for the different positionings of the light distributions.

2. The method according to claim 1 , wherein grating structures or ring structures are formed by means of the switchable pixels of the first light modulator for generating the light distributions.

3. The method according to claim 2 , wherein the structures formed by means of the switchable pixels of the first light modulator are shifted for positioning the light distributions.

4. A method for determining positions of two or more spaced-apart molecules in one or more spatial directions in a sample using a localization microscope, wherein light distributions arising due to interference of coherent light are used for determining the positions of the molecules, comprising:

generating a sequence of light distributions using a first light modulator having a plurality of switchable pixels disposed in an image plane of the localization microscope, each light distribution having local intensity minima and regions with an intensity increase adjacent thereto, wherein subsequent light distributions are locally modified in accordance with estimated positions of the molecules;

illuminating the two or more molecules with the sequence of light distributions;

for each of the light distributions, detecting photons emitted by the molecules; and

deriving the positions of the molecules based on the photons detected for the different light distributions.

5. The method according to claim 4 , wherein for generating the light distributions a grating structure is formed by means of the switchable pixels of the first light modulator, and wherein subsequent light distributions are locally modified by switching off individual grating lines of the grating structure.

6. The method according to claim 5 , wherein those grating lines or groups of grating lines are switched off that cause an intensity at an estimated position of a molecule that exceeds a threshold.

7. The method according to claim 5 , wherein the grating structure formed by means of the switchable pixels of the first light modulator is shifted for subsequent light distributions.

8. The method according to claim 1 , wherein a second light modulator for influencing the light distributions is arranged in a Fourier plane of the localization microscope, which is arranged to block individual diffraction orders.

9. The method according to claim 1 , wherein the first light modulator is an amplitude modulator or a phase modulator.

10. The method according to claim 2 , wherein for successive position determinations with a light distribution, an intensity profile of the light distribution is changed by changing a structural property of the associated grating structure or ring structure.

11. The method according to claim 1 , wherein the light distributions result from a temporal superposition of different partial light distributions.

12. The method according to claim 11 , wherein the partial light distributions result from the interference of different diffraction orders generated by the first light modulator.

13. The method according to claim 1 , wherein a marker in the sample is detected using at least one light distribution for determining a drift.

14. The method according to claim 1 , wherein a drift is determined from changes in the same direction in the measured positions of molecules in successive measurements.

15. The method according to claim 1 , wherein the photons emitted by the molecules are detected using a camera or an array of photon counters.

16. An apparatus for determining positions of two or more spaced-apart molecules in one or more spatial directions in a sample using a localization microscope, wherein light distributions arising due to interference of coherent light are used for determining the positions of the molecules, comprising:

an operating unit adapted to drive a first light modulator having a plurality of switchable pixels, which is disposed in an image plane of the localization microscope, to generate a plurality of independently positionable light distributions, each light distribution having at least one local intensity minimum and regions with an intensity increase adjacent thereto; and

an evaluation unit adapted to derive the positions of the molecules on the basis of photons emitted by the molecules for each of the light distributions for different positionings of the respective light distributions.

17. An apparatus for determining positions of two or more spaced-apart molecules in one or more spatial directions in a sample using a localization microscope, wherein light distributions arising due to interference of coherent light are used for determining the positions of the molecules, comprising:

an operating unit adapted to drive a first light modulator having a plurality of switchable pixels, which is disposed in an image plane of the localization microscope, to generate a sequence of light distributions, each light distribution having local intensity minima and regions with an intensity increase adjacent thereto, wherein subsequent light distributions are locally modified in accordance with estimated positions of the molecules; and

an evaluation unit adapted to derive the positions of the molecules on the basis of photons emitted by the molecules for the different light distributions.

18. A microscope, with:

a light source for generating coherent light;

a first light modulator having a plurality of switchable pixels, which is disposed in an image plane of the microscope for generating a plurality of light distributions arising due to interference of coherent light, each light distribution having at least one local intensity minimum and regions with an intensity increase adjacent thereto;

optical means for illuminating two or more spaced-apart molecules in a sample with one light distribution each;

a detector unit for detecting photons emitted by the molecules for each of the light distributions for different positionings of the light distributions, the light distributions being positionable independently of each other; and

an apparatus according to claim 17 for determining positions of the two or more molecules in one or more spatial directions.

19. A microscope, with:

a light source for generating coherent light;

a first light modulator having a plurality of switchable pixels, which is disposed in an image plane of the microscope for generating a sequence of light distributions arising due to interference of coherent light, each light distribution having local intensity minima and regions with an intensity increase adjacent thereto, wherein subsequent light distributions are locally modified in accordance with estimated positions of the molecules;

optical means for illuminating two or more spaced-apart molecules in a sample with the light distributions;

a detector unit for detecting photons emitted by the molecules for the different light distributions; and

an apparatus according to claim 18 for determining positions of the two or more molecules in one or more spatial directions.

20. The method according to claim 4 , wherein a second light modulator for influencing the light distributions is arranged in a Fourier plane of the localization microscope, which is arranged to block individual diffraction orders.

21. The method according to claim 4 , wherein the first light modulator is an amplitude modulator or a phase modulator.

22. The method according to claim 5 , wherein for successive position determinations with a light distribution, an intensity profile of the light distribution is changed by changing a structural property of the associated grating structure or ring structure.

23. The method according to claim 4 , wherein the light distributions result from a temporal superposition of different partial light distributions.

24. The method according to claim 4 , wherein a drift is determined from changes in the same direction in the measured positions of molecules in successive measurements.

25. The method according to claim 4 , wherein the photons emitted by the molecules are detected using a camera or an array of photon counters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2023
From: FISCHER, JOACHIM; HENRICH, MATTHIAS; WILLEMER, WINFRIED
To: ABBERIOR INSTRUMENTS GMBH
Reel/Frame 062461/0851 →
Priority Claims (1)
DE 10 2020 113 998.5 · May 26, 2020 · national
Continuity (2)
Continuation In Part PCTEP2021063788 · May 25, 2021
Related Publication 20230101017A1 · Mar 30, 2023
References Cited (42)
US 11754847B2 · Engelhardt · 2023 [cited by examiner]
US 11885948B2 · Heintzmann · 2024 [cited by examiner]
US 20060176542A1 · Muro et al. · 2006 [cited by applicant]
US 20140042340A1 · Hell · 2014 [cited by examiner]
US 20150226950A1 · Booth et al. · 2015 [cited by applicant]
US 20170123197A1 · Reuss et al. · 2017 [cited by applicant]
US 20180056603A1 · Hensleigh et al. · 2018 [cited by applicant]
US 20190234879A1 · Balzarotti et al. · 2019 [cited by applicant]
US 20190234882A1 · Balzarotti et al. · 2019 [cited by applicant]
US 20190235220A1 · Balzarotti et al. · 2019 [cited by applicant]
US 20200150446A1 · Thibon et al. · 2020 [cited by applicant]
US 20210190691A1 · Sirat · 2021 [cited by applicant]
US 20230168199A1 · Sirat · 2023 [cited by applicant]
CN 108181235A · 2018 [cited by applicant]
CN 110632045A · 2019 [cited by applicant]
DE 10063276C2 · 2002 [cited by applicant]
DE 102007025688A1 · 2007 [cited by applicant]
DE 112011103187T5 · 2013 [cited by applicant]
DE 102013114860B3 · 2015 [cited by applicant]
DE 112014001147T5 · 2015 [cited by applicant]
DE 102015002205A1 · 2016 [cited by applicant]
DE 102011055367B4 · 2017 [cited by applicant]
DE 102020113998A1 · 2021 [cited by applicant]
DE 102018127281A1 · 2022 [cited by applicant]
EP 1662296A1 · 2006 [cited by applicant]
EP 2801854B1 · 2017 [cited by applicant]
EP 2389606B1 · 2019 [cited by applicant]
SU 1374922A1 · 1991 [cited by applicant]
WO WO2021053245A1 · 2021 [cited by applicant]
WO WO2021111187A1 · 2021 [cited by applicant]
International Search Report for PCT/EP2021/063788 dated Sep. 14, 2021. [cited by applicant]
Francisco Balzarotti et al., Nanometer resolution imaging and tracking of fluorescent molecules with minimal photon fluxes, SCIENCE, Dec. 22, 2016, 85 pages, vol. 355, Issue 6325. [cited by applicant]
M. G. L. Gustafsson, Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy, Journal of Microscopy, May 2000, pp. 82-87., vol. 198, Pt 2. [cited by applicant]
Mats G. L. Gustafsson, Nonlinear structured-illumination microscopy: Wide-field fluorescence imaging with theoretically unlimited resolution, PNAS, Sep. 13, 2005, 13081-13086, vol. 102 No. 37. [cited by applicant]
Lusheng Gu et al., Molecular resolution imaging by repetitive optical selective exposure, Nature Methods, 40 pages, www.nature.com/naturemethods, https://doi.org/10.1038/s41592-019-0544-2. [cited by applicant]
Loïc Reymond et al., SIMPLE: Structured illumination based point localization estimator with enhanced precision, Optics Express, Aug. 19, 2019, 13 pages, vol. 27, No. 17. [cited by applicant]
Jelmer Cnossen et al., Localization microscopy at doubled precision with patterned illumination, bioRxiv, Feb. 20, 2019, 45 pages, http://dx.doi.org/10.1101/554337. [cited by applicant]
Andrew G. York et al., Resolution Doubling in Live, Multicellular Organisms Multifocal Structured Illumination Microscopy, NIH Public Access, Author Manuscript, Nat Methods, Jan. 1, 2013, pp. 749-754, doi:10.1038/nmeth.… [cited by applicant]
Siwei Li et al., Rapid 3D image scanning microscopy with multi-spot excitation and double-helix point spread function detection, Optics Express, Sep. 3, 2018, vol. 26, No. 18, 9 pages, https://doi.org/10.1364/OE.26.0235… [cited by applicant]
Meiqi Li et al., Structured illumination microscopy using digital micro-mirror device and coherent light source, Applied Physics Letters, Jun. 9, 2020, 8 pages, scitation.org/journal/apl, https://doi.org/10.1063/5.00082… [cited by applicant]
Egidijus Auksorius et al., Stimulated emission depletion microscopy with a supercontinuum source and fluorescence lifetime imaging, Optics Letters, Jan. 15, 2008, 4 pages, vol. 33, No. 2, https://www.researchgate.net/pu… [cited by applicant]
Mateusz Szatkowski et al., Generation of composite vortex beams by independent Spatial Light Modulator pixel addressing, Optics Communications, Sep. 26, 2019, 8 pages, https://doi.org/10.1016/j.optcom.2020.125341. [cited by applicant]