IP Library Granted Patent US 11,520,133
Granted Patent B2
US 11,520,133 · App. 16/887,947 · Granted Dec 6, 2022

Systems, devices and methods for automatic microscope focus

Inventors: John B. Putman (Celebration, FL); Matthew C. Putman (Brooklyn, NY); Vadim Pinskiy (Wayne, NJ); Denis Y. Sharoukhov (Brooklyn, NY)
Assignee: Nanotronics Imaging, Inc.
G02B21/244G01N15/147G02B7/38G02B21/002G02B21/242G02B21/247G02B21/365H04N5/23212H04N5/2258
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,520,133
App. No.
16/887,947
Granted
Dec 6, 2022
Kind
B2
Abstract

An automatic focus system for an optical microscope that facilitates faster focusing by using at least two offset focusing cameras. Each offset focusing camera can be positioned on a different side of an image forming conjugate plane so that their sharpness curves intersect at the image forming conjugate plane. Focus of a specimen can be adjusted by using sharpness values determined from images taken by the offset focusing cameras.

Claims (69)

1. A method for automatically focusing a microscope, comprising:

receiving, by a computing system from a first camera of the microscope, a first image of a specimen positioned on a stage of the microscope at a first position, wherein the first camera comprises a first image sensor, the first camera positioned at a first offset distance to an image forming conjugate plane;

receiving, by the computing system from a second camera of the microscope, a second image of the specimen positioned on the stage of the microscope at the first position, wherein the second camera comprises a second image sensor, the second camera positioned at a second offset distance to the image forming conjugate plane;

measuring, by the computing system, a first sharpness value of the specimen based on the first image and a second sharpness value of the specimen based on the second image;

causing, by the computing system, adjustment of the stage of the microscope to a second position distinct from the first position;

receiving, by the computing system from the first camera, a third image of the specimen positioned on the stage of the microscope at the second position;

receiving, by the computing system from the second camera of the microscope, a fourth image of the specimen positioned on the stage of the microscope at the second position;

measuring, by the computing system, a third sharpness value of the specimen based on the third image and a fourth sharpness value of the specimen based on the fourth image; and

focusing, by the computing system, the first camera and the second camera by adjusting a relative distance between the first position and the second position, until images generated by the first camera and the second camera are within a threshold sharpness level.

2. The method of claim 1 , further comprising:

generating, by the computing system, a first line between the first image and the third image, wherein the first position and the first sharpness value are a first set of coordinates and the second position and the third sharpness value are a second set of coordinates; and

calculating, by the computing system, a first slope of the first line.

3. The method of claim 2 , further comprising:

generating, by the computing system, a second line between the second image and the fourth image, wherein the first position and the second sharpness value are a third set of coordinates and the second position and the fourth sharpness value are a fourth set of coordinates; and

calculating, by the computing system, a second slope of the second line.

4. The method of claim 3 , wherein focusing, by the computing system, the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

increasing the relative distance between the first position and the second position based on the first slope and the second slope being non-negative.

5. The method of claim 3 , wherein focusing, by the computing system, the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

decreasing the relative distance between the first position and the second position based on the second slope being negative.

6. The method of claim 3 , wherein focusing, by the computing system, the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

increasing the relative distance between the first position and the second position based on the first slope being non-positive, the second slope being non-negative, and the third sharpness value is greater than the fourth sharpness value.

7. The method of claim 3 , wherein focusing, by the computing system, the first camera and the second camera by adjusting the relative distance between the first position and the second position, until images generated by the first camera and the second camera are within the threshold sharpness level comprises:

decreasing the relative distance between the first position and the second position based on the first slope being non-positive, the second slope being non-negative, and the third sharpness level is less than the fourth sharpness level.

8. A system, comprising:

a processor in communication with a microscope; and

a memory having programming instructions stored thereon, which, when executed by the processor, performs one or more operations, comprising:

receiving, from a first camera of the microscope, a first image of a specimen positioned on a stage of the microscope at a first position, wherein the first camera comprises a first image sensor, the first camera positioned at a first offset distance to an image forming conjugate plane;

receiving, from a second camera of the microscope, a second image of the specimen positioned on the stage of the microscope at the first position, wherein the second camera comprises a second image sensor, the second camera positioned at a second offset distance to the image forming conjugate plane;

measuring a first sharpness value of the specimen based on the first image and a second sharpness value of the specimen based on the second image;

causing adjustment of the stage of the microscope to a second position distinct from the first position;

receiving, from the first camera, a third image of the specimen positioned on the stage of the microscope at the second position;

receiving, from the second camera of the microscope, a fourth image of the specimen positioned on the stage of the microscope at the second position;

measuring, by a computing system, a third sharpness value of the specimen based on the third image and a fourth sharpness value of the specimen based on the fourth image; and

focusing the first camera and the second camera by adjusting a relative distance between the first position and the second position, until images generated by the first camera and the second camera are within a threshold sharpness level.

9. The system of claim 8 , wherein the one or more operations further comprise:

generating a first line between the first image and the third image, wherein the first position and the first sharpness value are a first set of coordinates and the second position and the third sharpness value are a second set of coordinates; and

calculating a first slope of the first line.

10. The system of claim 9 , wherein the one or more operations further comprise:

generating a second line between the second image and the fourth image, wherein the first position and the second sharpness value are a third set of coordinates and the second position and the fourth sharpness value are a fourth set of coordinates; and

calculating a second slope of the second line.

11. The system of claim 10 , wherein focusing the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

increasing the relative distance between the first position and the second position based on the first slope and the second slope being non-negative.

12. The system of claim 10 , wherein focusing the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

decreasing the relative distance between the first position and the second position based on the second slope being negative.

13. The system of claim 10 , wherein focusing the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

increasing the relative distance between the first position and the second position based on the first slope being non-positive, the second slope being non-negative, and the third sharpness value is greater than the fourth sharpness value.

14. The system of claim 10 , wherein focusing the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

decreasing the relative distance between the first position and the second position based on the first slope being non-positive, the second slope being non-negative, and the third sharpness value is less than the fourth sharpness value.

15. A non-transitory computer readable medium including one or more sequences of instructions, which, when executed by one or more processors, causes the one or more processors to perform operations, comprising:

receiving, by a computing system from a first camera of a microscope, a first image of a specimen positioned on a stage of the microscope at a first position, wherein the first camera comprises a first image sensor, the first camera positioned at a first offset distance to an image forming conjugate plane;

receiving, by the computing system from a second camera of the microscope, a second image of the specimen positioned on the stage of the microscope at the first position, wherein the second camera comprises a second image sensor, the second camera positioned at a second offset distance to the image forming conjugate plane;

measuring, by the computing system, a first sharpness value of the specimen based on the first image and a second sharpness value of the specimen based on the second image;

causing, by the computing system, adjustment of the stage of the microscope to a second position distinct from the first position;

receiving, by the computing system from the first camera, a third image of the specimen positioned on the stage of the microscope at the second position;

receiving, by the computing system from the second camera of the microscope, a fourth image of the specimen positioned on the stage of the microscope at the second position;

measuring, by the computing system, a third sharpness value of the specimen based on the third image and a fourth sharpness value of the specimen based on the fourth image; and

focusing, by the computing system, the first camera and the second camera by adjusting a relative distance between the first position and the second position, until images generated by the first camera and the second camera are within a threshold sharpness level.

16. The non-transitory computer readable medium of claim 15 , further comprising:

generating, by the computing system, a first line between the first image and the third image, wherein the first position and the first sharpness value are a first set of coordinates and the second position and the third sharpness value are a second set of coordinates; and

calculating, by the computing system, a first slope of the first line.

17. The non-transitory computer readable medium of claim 16 , further comprising:

generating, by the computing system, a second line between the second image and the fourth image, wherein the first position and the second sharpness value are a third set of coordinates and the second position and the fourth sharpness value are a fourth set of coordinates; and

calculating, by the computing system, a second slope of the second line.

18. The non-transitory computer readable medium of claim 17 , wherein focusing, by the computing system, the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

increasing the relative distance between the first position and the second position based on the first slope and the second slope being non-negative.

19. The non-transitory computer readable medium of claim 17 , wherein focusing, by the computing system, the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

decreasing the relative distance between the first position and the second position based on the second slope being negative.

20. The non-transitory computer readable medium of claim 17 , wherein focusing, by the computing system, the first camera and the second camera by adjusting the relative distance between the first position and the second position, until the images generated by the first camera and the second camera are within the threshold sharpness level comprises:

increasing the relative distance between the first position and the second position based on the first slope being non-positive, the second slope being non-negative, and the third sharpness value is greater than the fourth sharpness value.

Assignments (2)
SECURITY INTEREST Recorded Nov 30, 2023
From: NANOTRONICS IMAGING, INC.; NANOTRONICS HEALTH LLC; CUBEFABS INC.
To: ORBIMED ROYALTY & CREDIT OPPORTUNITIES IV, LP
Reel/Frame 065726/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2021
From: PUTMAN, JOHN B.; PUTMAN, MATTHEW C.; PINSKIY, VADIM; SHAROUKHOV, DENIS Y.
To: NANOTRONICS IMAGING, INC.
Reel/Frame 058448/0906 →
Continuity (3)
Continuation 16207727 · Dec 3, 2018
Continuation 15967802 · May 1, 2018
Related Publication 20210011271A1 · Jan 14, 2021