IP Library › Granted Patent US 12,251,219
Granted Patent B2
US 12,251,219 · App. 18/319,163 · Granted Mar 18, 2025

Systems, methods, and apparatus for differential phase contrast microscopy by transobjective differential epi-detection of forward scattered light

Inventors: Charles P. Lin (Arlington, MA); Hari Prasad Paudel (Boston, MA)
Assignee: The General Hospital Corporation
A61B5/14535A61B5/0068A61B5/1455G01N15/1436G01N15/1468G02B21/002G02B21/0048G02B21/0056G02B21/0068G02B21/008G02B21/086G02B21/14G02B21/365G02B26/12A61B2562/0233G01N15/01G01N2015/1006G01N2015/144
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,251,219
App. No.
18/319,163
Granted
Mar 18, 2025
Kind
B2
Abstract

Systems, methods, and apparatus for differential phase contrast microscopy by transobjective differential epi-detection of forward scattered light are provided. In some embodiments, a microscope objective comprises: a housing with mounting threads at a second end; optical components defining an optical axis, comprising: an objective lens mounted at a first end, configured to collect light from a sample placed in a field of view, the plurality of optical components create a pupil plane at a first distance along the optical axis at which rays having the same angle of incidence on the objective lens converge at the same radial distance from the optical axis; a photodetector within the housing offset from the optical axis at a second distance along the optical axis; and another photodetector within the housing at second distance along the optical axis and offset from the optical axis in the opposite direction from the first photodetector.

Claims (116)

1. A system for differential phase contrast microscopy by transobjective differential epi-detection of forward scattered light, comprising:

a scanning microscope comprising:

a light source;

an optical train defining an optical path of the scanning microscope having an optical axis comprising:

a scanner optically coupled to the light source and configured to scan a beam from the light source across a surface of a sample, and

a microscope objective optically coupled to the scanner; and

a detector mechanically coupled to the scanning microscope along the optical path within a first distance of a pupil plane of the optical train, the detector comprising:

a substrate defining a central aperture having a center configured to coincide with the optical axis of the optical path;

a first photodiode mechanically coupled to the substrate at a first radial distance from the center; and

a second photodiode mechanically coupled to the substrate at the first radial distance from the center and on an opposite side of the central aperture from the first photodiode,

wherein the first distance is less than or equal to twice the first radial distance, and

wherein the detector is integrated within the microscope objective; and at least one hardware processor that is programmed to:

cause the light source to emit a beam of light toward the sample via the optical train;

cause the scanner to scan the beam of light across the sample;

receive, from the detector, a plurality of output signals, each of the plurality of output signals indicative of a structure of the sample at a location at which the beam was focused;

generate an image based on the plurality of output signals; and

cause the image to be presented using a display.

2. The system of claim 1 , wherein the substrate comprises a printed circuit board, and

wherein the detector is mounted between the microscope objective and a plurality of lenses, the detector further comprising:

a housing supporting the printed circuit board;

first threads configured to receive the microscope objective; and

second threads configured to mechanically couple the housing to the scanning microscope.

3. The system of claim 1 , wherein the central aperture has a diameter of about 5 millimeters.

4. The system of claim 1 , further comprising a confocal imaging system comprising:

a half wave plate having a first side optically coupled to the light source, and a second side;

a polarizing beam splitter having a first port optically coupled to the second side of the half wave plate, a second port optically coupled to a confocal imaging arm, and a third port optically coupled to the scanner, and an interface that passes light having a first polarization and redirects light having a second polarization; and

a quarter wave plate having a first side optically coupled to the scanner, and a second side optically coupled to the microscope objective;

wherein the hardware processor is further programmed to:

receive, from the confocal imaging arm, confocal reflectance imaging data indicative of a structure of the sample at locations at which the beam was focused; and

generate a second image based on the confocal reflectance imaging data in parallel with the image based on the plurality of output signals.

5. The system of claim 1 , further comprising a plurality of lenses configured to optically generate a conjugate pupil plane within the optical path, wherein the detector is mounted within the first distance of the conjugate pupil plane.

6. The system of claim 1 , wherein the scanner comprises:

a first galvanometer optically coupled to the microscope objective; and

a polygon scanner or a second galvanometer, the polygon scanner or the second galvanometer optically coupling the light source to the first galvanometer.

7. The system of claim 1 , further comprising:

an amplifier electrically coupled to the detector, comprising:

a first transimpedance amplifier configured to receive a first current signal from the first photodiode and provide a first voltage signal;

a second transimpedance amplifier configured to receive a second current signal from the second photodiode and provide a second voltage signal;

a differential detection amplifier configured to receive the first voltage signal and the second voltage signal, and provide a third voltage signal indicative of a difference between the first voltage signal and the second voltage signal as an output,

wherein the at least one hardware processor is further programmed to:

receive the plurality of output signals from the differential detection amplifier,

wherein the plurality of output signals comprises the third voltage signal.

8. A microscope objective, comprising:

a housing having a first end and a second end, the second end comprising mounting threads;

a plurality of optical components comprising an objective lens and defining an optical axis,

the objective lens mounted at the first end, the objective lens configured to collect light from a sample placed in a field of view of the objective lens,

wherein the plurality of optical components create a pupil plane at a first axial distance along the optical axis at which rays having the same angle of incidence on the objective lens from within the field of view converge at the same radial distance from the optical axis;

a first photodetector mounted within the housing at a second axial distance along the optical axis and offset from the optical axis by a first radial distance;

a second photodetector mounted within the housing at the second axial distance along the optical axis and offset from the optical axis by the first radial distance in a direction opposite from the first photodetector,

the first and second photodetectors being sensitive to a first range of wavelengths;

a third photodetector mounted within the housing at the second axial distance along the optical axis and offset from the optical axis by the first radial distance; and

a fourth photodetector mounted within the housing at the second axial distance along the optical axis and offset from the optical axis by the first radial distance in a direction opposite from the first photodetector,

the third and fourth photodetectors being sensitive to a second range of wavelengths different from the first range of wavelengths.

9. The microscope objective of claim 8 , wherein the second axial distance is equal to the first axial distance.

10. The microscope objective of claim 8 , further comprising a physical aperture collocated with the pupil plane, wherein the first photodetector and the second photodetector are mechanically coupled to the physical aperture.

11. The microscope objective of claim 8 , further comprising a printed circuit board defining a central aperture having a center,

wherein the printed circuit board is mounted within the housing such that the center coincides with the optical axis, and

wherein the first photodetector and the second photodetector are mechanically coupled to the printed circuit board, and electrically coupled to the printed circuit board.

12. The microscope objective of claim 11 , further comprising an amplifier electrically coupled to the printed circuit board, comprising:

a first transimpedance amplifier configured to receive a first current signal from the first photodetector and provide a first voltage signal;

a second transimpedance amplifier configured to receive a second current signal from the second photodetector and provide a second voltage signal;

a differential detection amplifier configured to receive the first voltage signal and the second voltage signal, and provide a third voltage signal indicative of a difference between the first voltage signal and the second voltage signal as an output.

13. The microscope objective of claim 11 , wherein the printed circuit board acts as a physical aperture of the microscope objective and is collocated with the pupil plane.

14. The microscope objective of claim 11 , wherein the first radial distance is in a range of 2 millimeters (mm) to 10 mm.

15. A detection apparatus for differential phase contrast microscopy by transobjective differential epi-detection of forward scattered light, comprising:

a substrate having a first surface and a second surface and an aperture defined by a through-hole from the first surface to the second surface, the substrate mounted within a housing such that, when the housing is mechanically coupled to a scanning microscope, the substrate is disposed along an optical path of the scanning microscope between an objective lens and an image plane associated with the objective lens;

a first photodetector mechanically coupled to the first surface of the substrate and disposed at a first distance from a side of the aperture;

a second photodetector mechanically coupled to the first surface of the substrate and disposed at the first distance from an opposite side of the aperture from the first photodetector, such that second photodetector is separated from the first photodetector by a diameter of the aperture and twice the first distance,

the first and second photodetectors being sensitive to a first range of wavelengths;

a third photodetector mechanically coupled to the first surface of the substrate and disposed at the first distance from a side of the aperture;

a fourth photodetector mechanically coupled to the first surface of the substrate and disposed at the first distance from an opposite side of the aperture from the third photodetector, such that the fourth photodetector is separated from the third photodetector by the diameter of the aperture and twice the first distance,

the third and fourth photodetectors being sensitive to a second range of wavelengths different from the first range of wavelengths.

16. The detection apparatus of claim 15 , wherein the housing is a microscope objective barrel.

17. The detection apparatus of claim 15 , wherein the substrate comprises a printed circuit board, and

wherein the first photodetector and the second photodetector are mechanically coupled to printed circuit board, and electrically coupled to the first printed circuit board.

18. The detection apparatus of claim 17 , further comprising an amplifier electrically coupled to the printed circuit board, the amplifier comprising:

a first transimpedance amplifier configured to receive a first current signal from the first photodetector and provide a first voltage signal;

a second transimpedance amplifier configured to receive a second current signal from the second photodetector and provide a second voltage signal;

a differential detection amplifier configured to receive the first voltage signal and the second voltage signal, and provide a third voltage signal indicative of a difference between the first voltage signal and the second voltage signal as an output.

19. The detection apparatus of claim 17 , wherein the first distance is in a range of 0.5 millimeters (mm) to 1 mm.

20. The detection apparatus of claim 15 , further comprising:

the third photodetector mechanically coupled to the first surface of the substrate and disposed at the first distance from a perpendicular side of the aperture to the side along which the first photodetector is disposed.

21. A system for differential epi-detection of forward scattered light suitable for label free in vivo flow cytometry, comprising:

a scanning microscope comprising:

a first light source configured to emit light at a first wavelength;

a second light source configured to emit light at a second wavelength;

an optical train defining an optical path of the scanning microscope having an optical axis comprising:

a scanner optically coupled to the light source and configured to scan a beam from the light source across a surface of a sample; and

a microscope objective optically coupled to the scanner; and

a detector arranged to receive light emitted by the first light source and the second light source that has been directed into a sample via the microscope objective, forward scattered through the sample, and re-emitted from the sample on the same side as the microscope objective, the detector comprising:

at least one pair of photodiodes optically coupled to detect forward scattered light emitted from the sample toward a first side of the microscope objective and a second side of the microscope objective that is opposite the first side,

wherein the detector is integrated within the microscope objective;

at least one hardware processor that is programmed to:

cause the first light source to emit a first beam of light toward a sample via the optical train;

cause the second light source to emit a second beam of light toward a sample via the optical train;

cause the scanner to scan the first beam of light and the second beam of light across the sample;

receive, from the detector, a first plurality of output signals, each of the first plurality of output signals indicative of a structure of the sample at a location at which the first beam was focused;

receive, from the detector, a second plurality of output signals, each of the second plurality of output signals indicative of an absorption by the sample at a location at which the second beam was focused; and

generate image data indicative of a presence of blood cells and leukocytes in the sample based on the first plurality of output signals and the second plurality of output signals.

22. The system of claim 21 , wherein the detector is mechanically coupled to the scanning microscope along the optical path within a first distance of a pupil plane of the optical train, and the detector comprises:

a printed circuit board defining a central aperture having a center configured to coincide with the optical axis of the optical path; and

the at least one pair of photodiodes comprises:

a first pair of photodiodes configured to inhibit detection of light of the second wavelength, the first pair of photodiodes comprising:

a first photodiode mechanically coupled to the printed circuit board at a first radial distance from the center;

a second photodiode mechanically coupled to the printed circuit board at the first radial distance from the center and on an opposite side of the central aperture from the first photodiode, wherein the first distance is less than or equal to twice the first radial distance; and

a second pair of photodiodes configured to inhibit detection of light of the first wavelength, the second pair of photodiodes comprising:

a third photodiode mechanically coupled to the printed circuit board at the first radial distance from the center;

a fourth photodiode mechanically coupled to the printed circuit board at the first radial distance from the center and on an opposite side of the central aperture from the third photodiode.

23. The system of claim 21 , wherein the first wavelength is in a range including near infrared light and excluding visible light, and the second wavelength is in a range including visible light and excluding near infrared light.

24. The system of claim 21 , further comprising:

an amplifier electrically coupled to the detector, comprising:

a differential amplifier configured to receive a first signal and a second signal from the at least one pair of photodiodes indicative of an intensity of light received at the first side of the microscope objective and the second side of the microscope objective at the first wavelength, respectively, and provide a signal indicative of a difference between the first signal and the second signal; and

a sum amplifier configured to receive a third signal and a fourth signal from the at least one pair of photodiodes indicative of an intensity of light received at the first side of the microscope objective and the second side of the microscope objective at the second wavelength, respectively, and provide a signal indicative of a sum of the first signal and the second signal,

wherein the at least one hardware processor is further programmed to:

receive the first plurality of output signals from the differential amplifier, and

receive the second plurality of output signals from the sum amplifier.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2023
From: LIN, CHARLES P.; PAUDEL, HARI PRASAD
To: THE GENERAL HOSPITAL CORPORATION
Reel/Frame 063688/0937 →
Continuity (4)
Continuation 16773438 · Jan 27, 2020
Provisional Application 62892621 · Aug 28, 2019
Provisional Application 62796703 · Jan 25, 2019
Related Publication 20230284939A1 · Sep 14, 2023
References Cited (45)
US 5598842A · Ishihara · 1997 [cited by applicant]
US 6538730B2 · Vaez-Iravani · 2003 [cited by applicant]
US 7264794B2 · Georgakoudi · 2007 [cited by applicant]
US 7602501B2 · Ralston · 2009 [cited by applicant]
US 7745155B2 · Lin · 2010 [cited by applicant]
US 8108031B2 · Georgakoudi · 2012 [cited by applicant]
US 8184298B2 · Popescu · 2012 [cited by applicant]
US 9564291B1 · Own · 2017 [cited by examiner]
US 9772282B2 · Tucker-Schwartz · 2017 [cited by applicant]
US 10156479B2 · Liu · 2018 [cited by examiner]
US 10429629B1 · Brundage · 2019 [cited by applicant]
US 11690540B2 · Lin · 2023 [cited by examiner]
US 20060134003A1 · Georgakoudi · 2006 [cited by applicant]
US 20150087902A1 · Mertz · 2015 [cited by applicant]
US 20150285685A1 · Wax · 2015 [cited by applicant]
US 20170363582A1 · Mertz · 2017 [cited by applicant]
WO 1996037767A1 · 1996 [cited by applicant]
Ari P. Paudel, Clemens Alt, Judith Runnels, and Charles P. Lin, “Pupil plane differential detection microscopy,” Opt. Lett. 43, 4410-4412 (2018), (Year: 2018). [cited by examiner]
Paudel, Hari P., et al. “In vivo flow cytometry for blood cell analysis using differential epi-detection of forward scattered light.” Imaging, Manipulation, and Analysis of Biomolecules, Cells, and Tissues XVI. vol. 104… [cited by examiner]
Alt, C. et al, “Retinal flow cytometer,” Optics letters, vol. 32, No. 23, pp. 3450-3452, 2007. [cited by applicant]
Ba, C., et al. “Dual-modality endomicroscopy with co-registered fluorescence and phase contrast.” Biomedical optics express 7.9 (2016): 3403-3411. [cited by applicant]
Bourquard, A. et al, “Analysis of White Blood Cell Dynamics in Nailfold Capillaries,” in Conj Proc IEEE Eng Med Biol Soc, 2015. [cited by applicant]
Chen, C.L. et al, “Deep Learning in Label-free Cell Classification,” Scientific Reports, vol. 6, p. 21471, 2016. [cited by applicant]
Chen, N. et al, “Recent Advances in Optical Microscopy Methods for Subcellular Imaging of Thick Biological Tissues,” Critical Reviews in Biomedical Engineering, vol. 41, No. 4-5, pp. 393-403, 2015. [cited by applicant]
Chui, Typ, et al. “The use of forward scatter to improve retinal vascular imaging with an adaptive optics scanning aser ophthalmoscope.” Biomedical optics express 3.10 (2012): 2537-2549. [cited by applicant]
Ford, T.N. et al, “Phase-gradient microscopy in thick tissue with oblique back-illumination,” Nature Methods, vol. 9, No. 12, pp. 1195-1197, 2012. [cited by applicant]
Golan, L., et al. “High-speed interferometric spectrally encoded flow cytometry.” Optics letters 37.24 (2012): 5154-5156. [cited by applicant]
Golan, L., et al. “Noninvasive imaging of flowing blood cells using label-free spectrally encoded flow cytometry,” Biomedical Optics Express, vol. 3, No. 6, p. 1455, 2012. [cited by applicant]
Huang, D., et al. “Optical coherence tomography.” science 254.5035 (1991): 1178-1181. [cited by applicant]
Lee, H. et al, “In vivo imaging flow cytometer,” Optics express, vol. 14,No. 17,pp. 7789-7800,2006. [cited by applicant]
Mertz, J., et al. “Phase-gradient contrast in thick tissue with a scanning microscope.” Biomedical optics express 5.2 (2014): 407-416. [cited by applicant]
Morgan S., “Can new optical techniques for in vivo imaging and flow cytometry of the microcirculation benefit sickle cell disease research?,” Cytometry, vol. 79, No. 10, p. 766-774, 2011. [cited by applicant]
Nomarski G., “Micro Interfermotere defferentiel a ondes polarisees,” J. Phys Radium 16, S9-S13 (1955). [cited by applicant]
Novak, J. et al, “In vivo flow cytometer for real-time detection and quantification of circulating cells,” Optics letters, vol. 4, pp. 77-79, 2004. [cited by applicant]
Ntziachristos V., “Going deeper than microscopy: the optical imaging frontier in biology,” Nature Methods, vol. 7, No. 8, 2010. [cited by applicant]
Paudel, H. P., et al. “In vivo flow cytometry for blood cell analysis using differential epi-detection of forward scattered ight.” In SPIE Proc of Imaging, Manipulation and Analysis of Biomolecules, San Francisco 2018. [cited by applicant]
Scoles, D., et al. “In vivo imaging of human cone photoreceptor inner segments.” Investigative ophthalmology & visual science 55.7 (2014): 4244-4251. [cited by applicant]
Tsang, Tyf. “Optical third-harmonic generation at interfaces.” Physical Review A 52.5 (1995): 4116. [cited by applicant]
Watt, F.M. et al. “Cell-extracellular matrix interactions in normal and diseased skin.” Cold Spring Harbor Perspectives in Biology 3.4 (2011): a005124. [cited by applicant]
Webb R.H., “Theoretical basis of confocal microscopy,” Methods Enzymol, vol. 307, p. 3-20, 1999. [cited by applicant]
Winer, M.M. et al, “In vivo noninvasive microscopy of human leucocytes,” Scientific Reports, vol. 7, No. 1, p. 130 31, 2017. [cited by applicant]
Wu, C.-H. et al, “Imaging Cytometry of Human Leukocytes with Third Harmonic Generation Microscopy,” Scientific Reports, vol. 6, No. 1, p. 37210, 2016. [cited by applicant]
Xu C. et al, “Recent advances in fiber lasers for nonlinear microscopy,” Nature Photonics, vol. 7, pp. 875-882, 2013. [cited by applicant]
Yun S.H., “Light in diagnosis, therapy and surgery,” Nat. Bio. Eng., vol. 1, No. 8, 2017. [cited by applicant]
Zhang, C. et al, “Stimulated Raman scattering flow cytometry for label-free single-particle analysis,” Optica, vol. 4, No. 1, pp. 103-109, 2017. [cited by applicant]