IP Library Granted Patent US 10,944,896
Granted Patent B2
US 10,944,896 · App. 16/586,177 · Granted Mar 9, 2021

Single-frame autofocusing using multi-LED illumination

Inventor: Guoan Zheng (Vernon, CT)
Assignee: University of Connecticut
H04N5/232121G02B7/365G02B21/06G02B21/244G02B21/245G02B21/362G02B21/365G06N3/04G06T3/20G06T7/70H04N5/23212H04N5/33G02B21/02G02B21/361G06N3/0454G06N3/08G06T2207/10048G06T2207/10056G06T2207/20081H04N5/2253H04N5/2256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,944,896
App. No.
16/586,177
Granted
Mar 9, 2021
Kind
B2
Abstract

An imaging method is provided that includes: (i) providing a microscope having a lens and an autofocusing camera positioned adjacent to the microscope; (ii) positioning an illumination source adjacent to the microscope; (iii) moving a sample to a predefined offset position and illuminating the sample; (iv) acquiring an image of the illuminated sample via the autofocusing camera; and (v) utilizing a convolution neural network to identify an in-focus position of the sample. The convolution neural network may further include an input layer, output layer, and at least one hidden layer situated between the input and output layers. The hidden layer(s) may be selected from a group consisting of a convolution layer, pooling layer, normalization layer, fully connected layer, and a combination thereof. The convolution neural network may be trained to accurately define the weight to be applied to the layer(s). The illumination source may be a single-LED, dual-LED, LED array, Köhler illumination, and a combination thereof. The convolution neural network may advantageously predict the in-focus position of the acquired image without axial scanning and may be a multi-domain convolution neural network, which may receive input(s) selected from spatial features, Fourier transform of the acquired image, autocorrelation of the acquired image.

Claims (24)

1. An imaging method, comprising:

providing a microscope having a lens and an autofocusing camera positioned adjacent to the microscope;

positioning a first and second LEDs adjacent to the microscope;

moving a sample to a predefined offset position and illuminating the sample from two different incident angles via the first and second LEDs;

acquiring an image of the illuminated sample via the autofocusing camera, the image including two image copies of the sample; and

utilizing a convolution neural network to identify an in-focus position of the sample.

2. The imaging method of claim 1 , wherein the convolution neural network further comprises an input layer and output layer.

3. The imaging method of claim 2 , wherein the convolution neural network further comprises at least one hidden layer situated between the input and output layers; and wherein the hidden layers are selected from a group consisting of a convolution layer, pooling layer, normalization layer, fully connected layer, and a combination thereof.

4. The imaging method of claim 3 , wherein the convolution neural network is trained to accurately define the weight applied to the layers.

5. An imaging method, comprising:

providing a microscope having a lens and an autofocusing camera positioned adjacent to the microscope;

positioning an illumination source adjacent to the microscope;

moving a sample to a predefined offset position and illuminating the sample;

acquiring an image of the illuminated sample via the autofocusing camera; and

utilizing a convolution neural network to identify an in-focus position of the sample.

6. An imaging method of claim 5 , wherein the convolution neural network further comprises an input layer and output layer.

7. The imaging method of claim 5 , wherein the convolution neural network further comprises at least one hidden layer situated between the input and output layers; and wherein the hidden layers are selected from a group consisting of a convolution layer, pooling layer, normalization layer, fully connected layer, and a combination thereof.

8. The imaging method of claim 5 , wherein the convolution neural network is trained to accurately define the weight applied to the layers.

9. The imaging method of claim 5 , wherein the illumination source is selected from a group consisting of a single-LED, dual-LED, LED array, Köhler illumination, and a combination thereof.

10. The imaging method of claim 5 , wherein the illumination occurs beneath the sample.

11. The imaging method of claim 5 , wherein the illumination is relayed to a back focal plane of a condenser lens.

12. The imaging method of claim 5 , wherein the illumination is created by the microscope.

13. The imaging method of claim 5 , wherein the convolution neural network predicts the in-focus position of the acquired image without axial scanning.

14. The imaging method of claim 5 , wherein the convolution neural network is a multi-domain convolution neural network, wherein at least one input for the multi-domain convolution neural network is selected from a group consisting of spatial features, Fourier transform of the acquired image, autocorrelation of the acquired image, discrete cosine transform of the acquired image, discrete wavelet transform of the acquired image, and a combination thereof.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2019
From: ZHENG, GUOAN
To: UNIVERSITY OF CONNECTICUT
Reel/Frame 051337/0241 →
CONFIRMATORY LICENSE Recorded Oct 22, 2019
From: UNIVERSITY OF CONNECTICUT
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 050785/0772 →
Continuity (6)
Continuation In Part PCTUS2018021157 · Mar 6, 2018
Continuation 15860229 · Jan 2, 2018
Continuation 16586177
Continuation In Part 15860229 · Jan 2, 2018
Provisional Application 62441727 · Jan 3, 2017
Related Publication 20200029012A1 · Jan 23, 2020