IP Library Granted Patent US 11,656,184
Granted Patent B2
US 11,656,184 · App. 17/817,826 · Granted May 23, 2023

Macro inspection systems, apparatus and methods

Inventors: Matthew C. Putman (Brooklyn, NY); John B. Putman (Celebration, FL); John Moffitt (Los Banos, CA); Michael Moskie (San Jose, CA); Jeffrey Andresen (Gilroy, CA); Scott Pozzi-Loyola (Watsonville, CA); Julie Orlando (Akron, OH)
Assignee: Nanotronics Imaging, Inc.
G01N21/8806G02B21/06G02B21/26G02B21/365G06T7/0002G06V10/774G06V20/693G06V20/698H04N5/2354G01N2021/8835G06T2207/10056G06T2207/20081G06T2207/30024G06T2207/30148
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,656,184
App. No.
17/817,826
Granted
May 23, 2023
Kind
B2
Abstract

The disclosed technology relates to an inspection apparatus that includes a stage configured to retain a specimen for inspection, an imaging device having a field of view encompassing at least a portion of the stage to view a specimen retained on the stage, and a plurality of lights disposed on a moveable platform. The inspection apparatus can further include a control module coupled to the imaging device, each of the lights and the moveable platform. The control module is configured to perform operations including: receiving image data from the imaging device, where the image data indicates an illumination landscape of light incident on the specimen; and automatically modifying, based on the image data, an elevation of the moveable platform or an intensity of one or more of the lights to adjust the illumination landscape. Methods and machine-readable media are also contemplated.

Claims (48)

1. A method, comprising:

generating, by a computing system, a training data set for training a prediction model to generate an illumination profile for a specimen positioned on a stage of an inspection apparatus, the training data comprising image data and non-image data of a plurality of training specimens;

training, by the computing system, the prediction model to generate illumination profiles for the plurality of training specimens, each illumination profile comprising one or more of an indication of lighting positions for a plurality of lights illuminating a corresponding specimen, an intensity level of each of the plurality of lights, a color of each of the plurality of lights, or distance information between each of the plurality of lights and the stage; and

applying, by the computing system, the prediction model to an image of the specimen to create the illumination profile for the specimen.

2. The method of claim 1 , wherein applying, by the computing system, the prediction model to the image of the specimen to create the illumination profile for the specimen comprises:

inputting context data, the image of the specimen, and non-image specimen data into the prediction model generate the illumination profile to be applied to illuminate the specimen.

3. The method of claim 1 , wherein the training data set further comprises:

for each image in the image data, information describing an activation, an intensity, a color, and a position of lights used to illuminate a respective specimen.

4. The method of claim 1 , wherein the training data set further comprises:

for each image in the image data, a distance between a specimen stage holding a respective specimen and a lens capturing the image of the respective specimen.

5. The method of claim 1 , wherein creating the illumination profile for the specimen comprises:

determining which lights of an inspection system to activate for illuminating the specimen.

6. The method of claim 5 , wherein creating the illumination profile for the specimen further comprises:

determining at which intensity to set each light of the inspection system for illuminating the specimen.

7. The method of claim 5 , wherein creating the illumination profile for the specimen further comprises:

determining a color at which to set each light of the inspection system for illuminating the specimen.

8. The method of claim 5 , wherein creating the illumination profile for the specimen further comprises:

determining a positioning to set each light of the inspection system for illuminating the specimen.

9. A system comprising:

a processor; and

a memory having programming instructions stored thereon, which, when executed by the processor, causes the system to perform operations comprising:

generating a training data set for training a prediction model to generate an illumination profile for a specimen positioned on a stage of an inspection apparatus, the training data comprising image data and non-image data of a plurality of training specimens;

training the prediction model to generate illumination profiles for the plurality of training specimens, each illumination profile comprising one or more of an indication of lighting positions for a plurality of lights illuminating a corresponding specimen, an intensity level of each of the plurality of lights, a color of each of the plurality of lights, or distance information between each of the plurality of lights and the stage; and

applying the prediction model to an image of the specimen to create the illumination profile for the specimen.

10. The system of claim 9 , wherein applying the prediction model to the image of the specimen to create the illumination profile for the specimen comprises:

inputting context data, the image of the specimen, and non-image specimen data into the prediction model generate the illumination profile to be applied to illuminate the specimen.

11. The system of claim 9 , wherein the training data set further comprises:

for each image in the image data, information describing an activation, an intensity, a color, and a position of lights used to illuminate a respective specimen.

12. The system of claim 9 , wherein the training data set further comprises:

for each image in the image data, a distance between a specimen stage holding a respective specimen and a lens capturing the image of the respective specimen.

13. The system of claim 9 , wherein creating the illumination profile for the specimen comprises:

determining which lights of an inspection system to activate for illuminating the specimen.

14. The system of claim 13 , wherein creating the illumination profile for the specimen further comprises:

determining at which intensity to set each light of the inspection system for illuminating the specimen.

15. The system of claim 13 , wherein creating the illumination profile for the specimen further comprises:

determining a color at which to set each light of the inspection system for illuminating the specimen.

16. The system of claim 13 , wherein creating the illumination profile for the specimen further comprises:

determining a positioning to set each light of the inspection system for illuminating the specimen.

17. A non-transitory computer readable medium having one or more sequences of instructions, which, when executed by a processor, causes a computing system to perform operations comprising:

generating, by the computing system, a training data set for training a prediction model to generate an illumination profile for a specimen positioned on a stage of an inspection apparatus, the training data comprising image data and non-image data of a plurality of training specimens;

training, by the computing system, the prediction model to generate illumination profiles for the plurality of training specimens, each illumination profile comprising one or more of an indication of lighting positions for a plurality of lights illuminating a corresponding specimen, an intensity level of each of the plurality of lights, a color of each of the plurality of lights, or distance information between each of the plurality of lights and the stage; and

applying, by the computing system, the prediction model to an image of the specimen to create the illumination profile for the specimen.

18. The non-transitory computer readable medium of claim 17 , wherein applying, by the computing system, the prediction model to the image of the specimen to create the illumination profile for the specimen comprises:

inputting context data, the image of the specimen, and non-image specimen data into the prediction model generate the illumination profile to be applied to illuminate the specimen.

19. The non-transitory computer readable medium of claim 17 , wherein the training data set further comprises:

for each image in the image data, information describing an activation, an intensity, a color, and a position of lights used to illuminate a respective specimen.

20. The non-transitory computer readable medium of claim 17 , wherein the training data set further comprises:

for each image in the image data, a distance between a specimen stage holding a respective specimen and a lens capturing the image of the respective specimen.

Assignments (3)
SECURITY INTEREST Recorded Nov 30, 2023
From: NANOTRONICS IMAGING, INC.; NANOTRONICS HEALTH LLC; CUBEFABS INC.
To: ORBIMED ROYALTY & CREDIT OPPORTUNITIES IV, LP
Reel/Frame 065726/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2022
From: MOSKIE, MICHAEL
To: NANOTRONICS IMAGING, INC.
Reel/Frame 060735/0550 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2022
From: PUTMAN, MATTHEW C.; PUTMAN, JOHN B.; MOFFITT, JOHN; ANDRESEN, JEFFREY; POZZI-LOYOLA, SCOTT; ORLANDO, JULIE
To: NANOTRONICS IMAGING, INC.
Reel/Frame 060735/0591 →
Continuity (4)
Continuation 17170467 · Feb 8, 2021
Continuation 16738022 · Jan 9, 2020
Continuation 16262017 · Jan 30, 2019
Related Publication 20220383480A1 · Dec 1, 2022