Multi-Scale Autoencoders for Semiconductor Workpiece Understanding
An example method includes obtaining a workpiece image of a semiconductor workpiece. The example method includes providing the workpiece image as input to a machine-learned encoding model. The example method includes obtaining an output from the machine-learned encoding model, the output includes an encoding corresponding to the semiconductor workpiece. The example method includes determining one or more characteristics of the semiconductor workpiece based at least in part on the encoding or modifying a semiconductor manufacturing process based at least in part on the encoding.
1 . A method for training a machine-learned model for inspecting semiconductor workpieces, the method comprising:
obtaining a plurality of workpiece images, each workpiece image depicting at least one semiconductor workpiece;
providing input to an autoencoder having an encoder portion and a decoder portion, the input comprising the plurality of workpiece images, wherein the encoder portion is configured to produce an encoding based on the input and the decoder portion is configured to produce a recreated input based on the encoding; and
training the autoencoder based on a loss between the input and the recreated input.
2 . The method of claim 1 , wherein the method further comprises, for each workpiece image of the plurality of workpiece images:
downsampling a workpiece image portion from a first resolution to a second resolution to produce a downsampled image;
upsampling the downsampled image to the first resolution to produce a first smoothed image; and
subtracting the first smoothed image from the workpiece image portion to produce a first residual image.
3 . The method of claim 2 , wherein the input comprises the first residual image for each workpiece image of the plurality of workpiece images.
4 . The method of claim 2 , wherein:
the workpiece image portion comprises a crop of the workpiece image according to one or more crop coordinates; and
the input further comprises the crop coordinates of the crop of the workpiece image for each workpiece image of the plurality of workpiece images.
5 . The method of claim 2 , wherein the first smoothed image comprises lower-resolution features and the first residual image comprises higher-resolution features.
6 . The method of claim 2 , further comprising:
downsampling a residual portion of the first residual image to produce a downsampled residual portion;
upsampling the downsampled residual portion to produce a second smoothed image; and
subtracting the second smoothed image from the residual portion of the first residual image to produce a second residual image.
7 . The method of claim 6 , wherein the input comprises the second residual image for each workpiece image of the plurality of workpiece images.
8 . The method of claim 6 , wherein the second residual image corresponds to a smaller portion of the semiconductor workpiece than the first residual image.
9 . The method of claim 1 , further comprising:
downsampling at least one workpiece image of the plurality of workpiece images to produce a downsampled workpiece image having a lower resolution than the at least one workpiece image; and
wherein the input comprises the downsampled workpiece image.
10 . The method of claim 1 , wherein the autoencoder comprises one or more batch normalization layers configured to provide at least one of a zero mean or unity variance for the input.
11 . The method of claim 1 , wherein the input comprises workpiece characterization data of the at least one semiconductor workpiece of some or all of the plurality of workpiece images.
12 . The method of claim 1 , wherein the loss comprises at least one of an L1 loss, an L2 loss, or a conditional generative adversarial network loss.
13 . A method for inspecting semiconductor workpieces, the method comprising:
obtaining a workpiece image of a semiconductor workpiece;
downsampling a workpiece image portion from a first resolution to a second resolution to produce a downsampled image;
upsampling the downsampled image to produce a first smoothed image; and
subtracting the first smoothed image from the workpiece image portion to produce a first residual image.
14 . The method of claim 13 , wherein the downsampled image is upsampled to the first resolution.
15 . The method of claim 13 , wherein the first smoothed image comprises lower-resolution features and the first residual image comprises higher-resolution features.
16 . The method of claim 13 , further comprising:
downsampling a residual portion of the first residual image to produce a downsampled residual portion;
upsampling the downsampled residual portion to generate a second smoothed image; and
subtracting the second smoothed image from the residual portion of the first residual image to produce a second residual image.
17 . The method of claim 16 , wherein the residual portion of the first residual image is downsampled to the second resolution.
18 . The method of claim 16 , wherein the residual portion of the first residual image is downsampled to a third resolution less than the second resolution and less than the first resolution.
19 . The method of claim 16 , wherein the second residual image corresponds to a smaller portion of the semiconductor workpiece than the first residual image.
20 . A system for inspection of a semiconductor workpiece, the system comprising:
an imaging device configured to capture a workpiece image of the semiconductor workpiece;
one or more processors; and
one or more non-transitory, computer-readable media storing:
a machine-learned encoding model; and
instructions that, when implemented, cause the one or more processors to perform operations, the operations comprising:
obtaining the workpiece image of the semiconductor workpiece from the imaging device;
providing the workpiece image as input to the machine-learned encoding model;
obtaining an output from the machine-learned encoding model, the output comprising an encoding corresponding to the semiconductor workpiece; and
determining one or more characteristics of the semiconductor workpiece based at least in part on the encoding.