Fully automated SEM sampling system for e-beam image enhancement
Disclosed herein is a method of automatically obtaining training images to train a machine learning model that improves image quality. The method may comprise analyzing a plurality of patterns of data relating to a layout of a product to identify a plurality of training locations on a sample of the product to use in relation to training the machine learning model. The method may comprise obtaining a first image having a first quality for each of the plurality of training locations, and obtaining a second image having a second quality for each of the plurality of training locations, the second quality being higher than the first quality. The method may comprise using the first image and the second image to train the machine learning model.
1. An electron beam inspection apparatus, comprising:
a memory; and
at least one processor coupled to the memory and configured to execute instructions to cause the electron beam inspection apparatus to perform operations comprising:
obtain an image acquired by a charged particle device; and
modify the obtained image using a machine learning model to generate a modified image, wherein the machine learning model was trained by:
analyzing a plurality of patterns of data relating to a layout of a product to identify a plurality of training locations to use to train the machine learning model;
obtaining a first image having a first quality for each of the plurality of training locations;
obtaining a second image having a second quality for each of the plurality of training locations, the second quality being higher than the first quality; and
using the first image and the second image to train the machine learning model.
2. The electron beam inspection apparatus of claim 1 , wherein the data is in a database.
3. The electron beam inspection apparatus of claim 2 , wherein the database comprises one of a graphic database system (GDS), an Open Artwork System Interchange Standard, or a Caltech Intermediate Form.
4. The electron beam inspection apparatus of claim 3 , where the GDS comprises at least one of GDS or GDSII formatted data.
5. The electron beam inspection apparatus of claim 1 , wherein the machine learning model was further trained by obtaining a plurality of first images having the first quality for each of the plurality of training locations and using the plurality of first images to train the machine learning model.
6. The electron beam inspection apparatus of claim 1 , wherein the machine learning model was further trained by obtaining a plurality of second images having the second quality for each of the plurality of training locations and using the plurality of second images to train the machine learning model.
7. The electron beam inspection apparatus of claim 1 , wherein analyzing the plurality of patterns of data relating to the layout of the product further comprises classifying the plurality of patterns into a plurality of subsets of patterns.
8. The electron beam inspection apparatus of claim 7 , wherein each subset of the plurality of subsets of patterns is associated with information relating to a location, a type, a shape, a size, a density, or a neighborhood layout.
9. The electron beam inspection apparatus of claim 1 , wherein analyzing the plurality of patterns of data relating to layout of a product further comprises extracting a feature from the plurality of patterns.
10. The electron beam inspection apparatus of claim 9 , wherein the extracted feature comprises one of a shape, a size, a density, or a neighborhood layout.
11. The electron beam inspection apparatus of claim 10 , wherein analyzing the plurality of patterns of data relating to the layout of the product further comprises classifying the plurality of patterns into a plurality of subsets of patterns based on the extracted feature.
12. The electron beam inspection apparatus of claim 1 , wherein identifying the plurality of training locations comprises identifying one or more training locations for each subset of patterns.
13. The electron beam inspection apparatus of claim 1 , wherein obtaining the first image comprises determining a first scanning path including a first scan for obtaining the first image, the first scanning path based on an overall scan area for the plurality of training locations.
14. The electron beam inspection apparatus of claim 13 , wherein obtaining the second image comprises determining a second scanning path including a second scan for obtaining the second image, the second scanning path based on an overall scan area for the plurality of training locations.
15. The electron beam inspection apparatus of claim 14 , wherein the first scan includes a first number of scans, the second scan includes a second number of scans, and wherein the second number of scans is larger than the first number of scans.
16. The electron beam inspection apparatus of claim 1 , wherein the modified image comprises an enhanced quality compared to the obtained image.
17. The electron beam inspection apparatus of claim 1 , wherein the quality comprises one of a resolution, a contrast, a brightness, or a noise level.
18. The electron beam inspection apparatus of claim 1 , wherein the machine learning model is configured to generate the modified image to approximate an image produced by performing a higher number of scans than a number of scans used to obtain the obtained image.
19. A non-transitory computer readable medium storing a set of instructions that is executable by a controller of a device to cause the device to perform operations comprising:
obtaining an image acquired by a charged particle device; and
modifying the obtained image using a machine learning model to generate a modified image, wherein the machine learning model was trained by:
analyzing a plurality of patterns of data relating to a layout of a product to identify a plurality of training locations to use to train the machine learning model;
a first image having a first quality for each of the plurality of training locations;
a second image having a second quality for each of the plurality of training locations, the second quality being higher than the first quality; and
use of the first image and the second image to train the machine learning model.
20. A method, comprising:
obtaining an image of a wafer acquired by a charged particle device; and
modifying the obtained image using a machine learning model to generate a modified image, wherein the machine learning model was trained by:
analyzing a plurality of patterns of data relating to a layout of a product to identify a plurality of training locations to use to train the machine learning model;
acquiring a first image having a first quality for each of the plurality of training locations;
acquiring a second image having a second quality for each of the plurality of training locations, the second quality being higher than the first quality; and
using the first image and the second image to train the machine learning model; and
performing an inspection of the wafer based on the modified obtained image.