IP Library Granted Patent US 11,593,919
Granted Patent B2
US 11,593,919 · App. 17/375,229 · Granted Feb 28, 2023

System, method and apparatus for macroscopic inspection of reflective specimens

Inventors: Jonathan Lee (Brooklyn, NY); Damas Limoge (Brooklyn, NY); Matthew C. Putman (Brooklyn, NY); John B. Putman (Celebration, FL); Michael Moskie (San Jose, CA)
Assignee: Nanotronics Imaging, Inc.
G06T5/002G06T5/50G06T7/0002H04N5/2256H04N5/23299H04N5/247G06T2207/10056G06T2207/20221G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,593,919
App. No.
17/375,229
Granted
Feb 28, 2023
Kind
B2
Abstract

An inspection apparatus includes a specimen stage configured to retain a specimen, at least three imaging devices arranged in a triangular array positioned above the specimen stage, each of the at least three imaging devices configured to capture an image of the specimen, one or more sets of lights positioned between the specimen stage and the at least three imaging devices, and a control system in communication with the at least three imaging devices.

Claims (77)

1. An inspection apparatus, comprising:

a specimen stage configured to retain a specimen;

at least three imaging devices arranged in a triangular array positioned above the specimen stage, each of the at least three imaging devices configured to capture an image of the specimen;

one or more sets of lights positioned between the specimen stage and the at least three imaging devices; and

a control system in communication with the at least three imaging devices, the control system comprising:

a processor; and

a memory having programming instructions stored thereon, which, when executed by the processor, performs operations comprising:

initializing a first imaging device of the at least three imaging devices to capture a first image of the specimen;

initializing a second imaging device of the at least three imaging devices to capture a second image of the specimen;

initializing a third imaging device of the at least three imaging devices to capture a third image of the specimen;

receiving the first image from the first imaging device, the second image from the second imaging device, and the third image from the third imaging device;

for each of the first image, the second image, and the third image, identifying an artifact contained therein;

removing, from each of the first image, the second image, and the third image, the artifact; and

generating an artifact-free image of the specimen using remaining portions of the first image, the second image, and the third image.

2. The inspection apparatus of claim 1 , where removing, from each of the first image, the second image, and the third image, the artifact comprises:

identifying a first area within the first image that includes a first set of artifacts;

removing the first area from the first image;

identifying a second area within the second image that includes a second set of artifacts;

removing the second area from the second image;

identifying a third area within the third image that includes a third set of artifacts; and

removing the third area from the third image.

3. The inspection apparatus of claim 2 , wherein generating the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:

stitching together the first image with the first area removed, the second image with the second area removed, and the third image with the third area removed.

4. The inspection apparatus of claim 1 , wherein for each of the first image, the second image, and the third image, identifying the artifact contained therein comprises:

using a computer vision technique to identify pixels in each of the first image, the second image, and the third image that correspond to the artifact.

5. The inspection apparatus of claim 4 , where removing, from each of the first image, the second image, and the third image, the artifact comprises:

removing the identified pixels from each of the first image, the second image, and the third image.

6. The inspection apparatus of claim 5 , wherein generating the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:

blending pixels surrounding the removed pixels to generate the artifact-free image.

7. The inspection apparatus of claim 1 , wherein each artifact corresponds to a reflection of one of the at least three imaging devices.

8. A method of generating an artifact-free image of a specimen with a macro inspection system, comprising:

receiving, by a computing system from a first imaging device of the macro inspection system, a first image of the specimen;

receiving, by the computing system from a second imaging device of the macro inspection system, a second image of the specimen;

receiving, by the computing system from a third imaging device of the macro inspection system, a third image of the specimen,

wherein the first imaging device, the second imaging device, and the third imaging device are arranged in a triangular array above the specimen;

for each of the first image, the second image, and the third image, identifying, by the computing system, an artifact contained therein;

removing, by the computing system, from each of the first image, the second image, and the third image, the artifact; and

generating, by the computing system, an artifact-free image of the specimen using remaining portions of the first image, the second image, and the third image.

9. The method of claim 8 , where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:

identifying a first area within the first image that includes a first set of artifacts;

removing the first area from the first image;

identifying a second area within the second image that includes a second set of artifacts;

removing the second area from the second image;

identifying a third area within the third image that includes a third set of artifacts; and

removing the third area from the third image.

10. The method of claim 9 , wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:

stitching together the first image with the first area removed, the second image with the second area removed, and the third image with the third area removed.

11. The method of claim 8 , wherein for each of the first image, the second image, and the third image, identifying, by the computing system, the artifact contained therein comprises:

using a computer vision technique to identify pixels in each of the first image, the second image, and the third image that correspond to the artifact.

12. The method of claim 11 , where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:

removing the identified pixels from each of the first image, the second image, and the third image.

13. The method of claim 12 , wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:

blending pixels surrounding the removed pixels to generate the artifact-free image.

14. The method of claim 8 , wherein each artifact corresponds to a reflection of one of the first imaging device, the second imaging device, or the third imaging device.

15. A non-transitory computer readable medium having sequences of instructions, which, when executed by a processor, causes a computing system to perform operations comprising:

receiving, by the computing system from a first imaging device of a macro inspection system, a first image of a specimen;

receiving, by the computing system from a second imaging device of the macro inspection system, a second image of the specimen;

receiving, by the computing system from a third imaging device of the macro inspection system, a third image of the specimen,

wherein the first imaging device, the second imaging device, and the third imaging device are arranged in a triangular array above the specimen;

for each of the first image, the second image, and the third image, identifying, by the computing system, an artifact contained therein;

removing, by the computing system, from each of the first image, the second image, and the third image, the artifact; and

generating, by the computing system, an artifact-free image of the specimen using remaining portions of the first image, the second image, and the third image.

16. The non-transitory computer readable medium of claim 15 , where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:

identifying a first area within the first image that includes a first set of artifacts;

removing the first area from the first image;

identifying a second area within the second image that includes a second set of artifacts;

removing the second area from the second image;

identifying a third area within the third image that includes a third set of artifacts; and

removing the third area from the third image.

17. The non-transitory computer readable medium of claim 16 , wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:

stitching together the first image with the first area removed, the second image with the second area removed, and the third image with the third area removed.

18. The non-transitory computer readable medium of claim 15 , wherein for each of the first image, the second image, and the third image, identifying, by the computing system, the artifact contained therein comprises:

using a computer vision technique to identify pixels in each of the first image, the second image, and the third image that correspond to the artifact.

19. The non-transitory computer readable medium of claim 18 , where removing, by the computing system, from each of the first image, the second image, and the third image, the artifact comprises:

removing the identified pixels from each of the first image, the second image, and the third image.

20. The non-transitory computer readable medium of claim 19 , wherein generating, by the computing system, the artifact-free image of the specimen using the remaining portions of the first image, the second image, and the third image comprises:

blending pixels surrounding the removed pixels to generate the artifact-free image.

Assignments (2)
SECURITY INTEREST Recorded Nov 30, 2023
From: NANOTRONICS IMAGING, INC.; NANOTRONICS HEALTH LLC; CUBEFABS INC.
To: ORBIMED ROYALTY & CREDIT OPPORTUNITIES IV, LP
Reel/Frame 065726/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2021
From: LEE, JONATHAN; LIMOGE, DAMAS; PUTMAN, MATTHEW C.; PUTMAN, JOHN B.; MOSKIE, MICHAEL
To: NANOTRONICS IMAGING, INC.
Reel/Frame 056904/0395 →
Continuity (4)
Continuation In Part 17170260 · Feb 8, 2021
Continuation 16705674 · Dec 6, 2019
Provisional Application 62883931 · Aug 7, 2019
Related Publication 20210342979A1 · Nov 4, 2021