IP Library Granted Patent US 11,151,707
Granted Patent B2
US 11,151,707 · App. 16/277,769 · Granted Oct 19, 2021

System and method for difference filter and aperture selection using shallow deep learning

Inventors: Santosh Bhattacharyya (Milpitas, CA); Jacob George (Milpitas, CA); Saravanan Paramasivam (Chennai, IN); Martin Plihal (Pleasanton, CA)
Assignee: KLA Corporation
G06T7/0004G01N23/2251G06K9/6253G06K9/6256G06K9/6262G06K9/6267G06N3/04G06N3/08G01N2223/646G06T2207/10061G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,151,707
App. No.
16/277,769
Granted
Oct 19, 2021
Kind
B2
Abstract

A system for defect review and classification is disclosed. The system may include a controller, wherein the controller may be configured to receive one or more training images of a specimen. The one or more training images including a plurality of training defects. The controller may be further configured to apply a plurality of difference filters to the one or more training images, and receive a signal indicative of a classification of a difference filter effectiveness metric for at least a portion of the plurality of difference filters. The controller may be further configured to generate a deep learning network classifier based on the received classification and the attributes of the plurality of training defects. The controller may be further configured to extract convolution layer filters of the deep learning network classifier, and generate one or more difference filter recipes based on the extracted convolution layer filters.

Claims (87)

1. A system, comprising:

a controller including one or more processors configured to execute program instructions stored in memory, wherein the program instructions are configured to cause the one or more processors to:

receive one or more training images of a specimen, the one or more training images including a plurality of training areas of interest;

apply a plurality of difference filters to the one or more training images;

receive a signal indicative of a classification of a difference filter effectiveness metric for at least a portion of the plurality of difference filters;

generate a shallow deep learning network classifier based on the received classification and attributes of the plurality of training areas of interest;

extract a single convolution layer filter from the shallow deep learning network classifier; and

generate one or more difference filter recipes based on the extracted single convolution layer filter, wherein the one or more difference filter recipes include a series of difference filters, wherein two or more of the difference filters are of different size to enhance detection of multiple defect-of-interest types when exposed to broadband illumination.

2. The system of claim 1 , further comprising an inspection sub-system, wherein the controller is configured to receive at least one of the one or more training images or one or more product images from the inspection sub-system.

3. The system of claim 1 , further comprising an inspection sub-system, wherein the inspection sub-system is configured to acquire one or more product images of at least a portion of a specimen using the one or more difference filter recipes.

4. The system of claim 3 , wherein the inspection sub-system comprises a scanning electron microscope (SEM) inspection system.

5. The system of claim 3 , wherein the inspection sub-system is configured to acquire one or more product images of at least a portion of a specimen using a first difference filter recipe for a first region of the portion of the specimen and an additional difference filter recipe for an additional region of the portion of the specimen.

6. The method of claim 1 , wherein the receiving a signal indicative of a classification of a difference filter effectiveness metric for at least a portion of the plurality of difference filters comprises:

receiving a signal from a user interface device indicative of a manual classification of a difference filter effectiveness metric for at least a portion of the plurality of difference filters.

7. The system of claim 1 , wherein the classification of the difference filter effectiveness metric for at least a portion of the plurality of difference filters comprises:

a first difference filter effectiveness metric for a first difference filter applied to a first group of areas of interest; and

a second difference filter effectiveness metric for a second difference filter applied to the first group of areas of interest.

8. The system of claim 1 , wherein the classification of the difference filter effectiveness metric for at least a portion of the plurality of difference filters comprises:

a first difference filter effectiveness metric for a first difference filter applied to a group of areas of interest; and

a second difference filter effectiveness metric for the first difference filter applied to the group of areas of interest.

9. The system of claim 1 , wherein the controller is further configured to record the one or more training images to a virtual inspector-virtual analyzer (VIVA) network.

10. The system of claim 1 , wherein the plurality of training areas of interest include at least one of one or more defects or one or more nuisance regions.

11. A system, comprising:

a controller including one or more processors configured to execute program instructions stored in memory, wherein the program instructions are configured to cause the one or more processors to:

receive one or more training images of a specimen using a plurality of aperture settings, the one or more training images including a plurality of training areas of interest;

receive a signal indicative of a classification of an aperture setting effectiveness metric for at least a portion of the plurality of aperture settings;

generate a shallow deep learning network classifier based on the received classification and attributes of the plurality of training areas of interest;

extract a single convolution layer filter from the deep learning network classifier;

perform one or more mathematical analyses on the single convolution layer filter to generate one or more aperture setting recipes based on the extracted single convolution layer; and

generate one or more aperture setting recipes based on the extracted single convolution layer filter, wherein the one or more aperture setting recipes include a series of aperture settings to enhance detection of multiple defect-of-interest types when exposed to broadband illumination.

12. The system of claim 11 , further comprising an inspection sub-system, wherein the controller is configured to receive at least one of the one or more training images or one or more product images from the inspection sub-system.

13. The system of claim 11 , further comprising an inspection sub-system, wherein the inspection sub-system is configured to acquire one or more product images of at least a portion of a specimen using the one or more aperture setting recipes.

14. The system of claim 13 , wherein the inspection sub-system comprises a scanning electron microscope (SEM) inspection system.

15. The system of claim 13 , wherein the inspection sub-system is configured to acquire one or more product images of at least a portion of a specimen using a first aperture setting recipe for a first region of the portion of the specimen and an additional aperture setting recipe for an additional region of the portion of the specimen.

16. The system of claim 11 , wherein the receiving a signal indicative of a classification of an aperture setting effectiveness metric for at least a portion of the plurality of aperture settings comprises:

receiving a signal from a user interface device indicative of a manual classification of an aperture setting effectiveness metric for at least a portion of the plurality of aperture settings.

17. The system of claim 11 , wherein the classification of the aperture setting effectiveness metric for at least a portion of the plurality of aperture settings comprises:

a first aperture setting effectiveness metric for a first aperture setting applied to a first group of areas of interest; and

a second aperture setting effectiveness metric for a second aperture setting applied to the first group of areas of interest.

18. The system of claim 11 , wherein the classification of the aperture setting effectiveness metric for at least a portion of the plurality of aperture settings comprises:

a first aperture setting effectiveness metric for a first aperture setting applied to a group of areas of interest; and

a second aperture setting effectiveness metric for the aperture setting filter applied to the group of areas of interest.

19. The system of claim 11 , wherein the controller is further configured to record the one or more training images to a virtual inspector-virtual analyzer (VIVA) network.

20. The system of claim 11 , wherein the one or more mathematical analyses comprises a Fourier analysis.

21. The system of claim 11 , wherein the plurality of training areas of interest include at least one of one or more defects or one or more nuisance regions.

22. A method, comprising:

acquiring one or more training images of a specimen, the one or more training images including a plurality of training areas of interest;

applying a plurality of difference filters to the one or more training images to generate one or more filtered training images;

receiving a signal indicative of a classification of a difference filter effectiveness metric for at least a portion of the plurality of difference filters;

generating a shallow deep learning network classifier based on the received classification and attributes of the plurality of training areas of interest;

extracting a single convolution layer filter from the shallow deep learning network classifier;

generating one or more difference filter recipes based on the extracted single convolution layer filter, wherein the one or more difference filter recipes include a series of difference filters, wherein two or more of the difference filters are of different size to enhance detection of multiple defect-of-interest types when exposed to broadband illumination; and

acquiring one or more product images of a specimen using at least one of the one or more difference filter recipes.

23. The method of claim 22 , wherein the receiving a signal indicative of a classification of a difference filter effectiveness metric for at least a portion of the plurality of difference filters comprises:

receiving a signal from a user interface device indicative of a manual classification of a difference filter effectiveness metric for at least a portion of the plurality of difference filters.

24. The method of claim 22 , wherein the classification of the difference filter effectiveness metric for at least a portion of the plurality of difference filters comprises:

a first difference filter effectiveness metric for a first difference filter applied to a first group of areas of interest; and

a second difference filter effectiveness metric for a second difference filter applied to the first group of areas of interest.

25. The method of claim 22 , wherein the classification of the difference filter effectiveness metric for at least a portion of the plurality of difference filters comprises:

a first difference filter effectiveness metric for a first difference filter applied to a group of areas of interest; and

a second difference filter effectiveness metric for the first difference filter applied to the group of areas of interest.

26. The method of claim 22 , wherein the one or more training images comprise one or more scanning electron microscope (SEM) images.

27. The method of claim 22 , wherein the method further comprises recording the one or more training images to a virtual inspector-virtual analyzer (VIVA) network.

28. The method of claim 22 , wherein acquiring one or more product images of a specimen using at least one of the one or more difference filter recipes comprises:

acquiring one or more product images of a specimen using a first difference filter recipe for a first region of the specimen, and an additional difference filter recipe for an additional region of the specimen.

29. The method of claim 22 , wherein the plurality of training areas of interest include at least one of one or more defects or one or more nuisance regions.

30. A method, comprising:

acquiring one or more training images of a first specimen using a plurality of aperture settings, the one or more training images including a plurality of training areas of interest;

receiving a signal indicative of a classification of an aperture setting effectiveness metric for at least a portion of the plurality of aperture settings;

generating a deep learning network classifier based on the received manual classification and attributes of the plurality of training areas of interest;

extracting a single convolution layer filter from the deep learning network classifier;

performing one or more frequency domain analyses on the extracted single convolution layer filter to generate one or more aperture setting recipes based on the extracted single convolution layer filter, wherein the one or more aperture setting recipes include a series of aperture settings to enhance detection of multiple defect-of-interest types when exposed to broadband illumination; and

acquiring one or more product images of a second specimen using at least one of the one or more aperture setting recipes.

31. The method of claim 30 , wherein the receiving a signal indicative of a classification of an aperture setting effectiveness metric for at least a portion of the plurality of aperture settings comprises:

receiving a signal from a user interface device indicative of a manual classification of an aperture setting effectiveness metric for at least a portion of the plurality of aperture settings.

32. The method of claim 30 , wherein the classification of the aperture setting effectiveness metric for at least a portion of the plurality of aperture settings comprises:

a first aperture setting effectiveness metric for a first aperture setting applied to a first group of areas of interest; and

a second aperture setting effectiveness metric for a second aperture setting applied to the first group of areas of interest.

33. The method of claim 30 , wherein the classification of the aperture setting effectiveness metric for at least a portion of the plurality of aperture settings comprises:

a first aperture setting effectiveness metric for a first aperture setting applied to a group of areas of interest; and

a second aperture setting effectiveness metric for the first aperture setting applied to the group of areas of interest.

34. The method of claim 30 , wherein the one or more training images comprise one or more scanning electron microscope (SEM) images.

35. The method of claim 30 , wherein the method further comprises recording the one or more training images to a virtual inspector-virtual analyzer (VIVA) network.

36. The method of claim 30 , wherein the acquiring one or more product images of a specimen using at least one of the one or more aperture setting recipes comprises:

acquiring one or more product images of a specimen using a first aperture setting recipe for a first region of the specimen, and an additional aperture setting recipe for an additional region of the specimen.

37. The method of claim 30 , wherein the plurality of training areas of interest include at least one of one or more defects or one or more nuisance regions.

38. The method of claim 30 , wherein the one or more frequency domain analyses include a Fourier analysis.

Assignments (2)
CHANGE OF NAME Recorded Sep 14, 2021
From: KLA-TENCOR CORPORATION
To: KLA CORPORATION
Reel/Frame 057510/0766 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2019
From: BHATTACHARYYA, SANTOSH; GEORGE, JACOB; PARAMASIVAM, SARAVANAN; PLIHAL, MARTIN
To: KLA-TENCOR CORPORATION
Reel/Frame 048590/0032 →
Priority Claims (1)
IN 201841046361 · Dec 7, 2018 · national
Continuity (1)
Related Publication 20200184628A1 · Jun 11, 2020