IP Library › Granted Patent US 12,651,322
Granted Patent B2
US 12,651,322 · App. 17/799,576 · Granted Jun 9, 2026

Contour extraction method from inspection image in multiple charged-particle beam inspection

Inventors: Lingling Pu (San Jose, CA); Wei Fang (Milpitas, CA)
Assignee: ASML Netherlands B.V.
G06T5/77G06T5/50G06T7/001G06V10/26G06V10/44G06T2207/10061G06T2207/30148
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,651,322
App. No.
17/799,576
Granted
Jun 9, 2026
Kind
B2
Abstract

An improved apparatus and method for extracting pattern contour information from an inspection image in a multiple charged-particle beam inspection system are disclosed. An improved method for extracting pattern contour information from an inspection image comprises identifying, from an inspection image obtained from a charged-particle beam inspection system, a first pattern and a second pattern that partially overlap in the inspection image. The method also comprises generating a first separation image by removing an image area corresponding to the second pattern from the inspection image. The first separation image includes the first pattern of which a first part is removed when removing the image area corresponding to the second pattern. The method also comprises updating the first separation image to include image data representing the removed first part of the first pattern based on a first reference image corresponding to the first pattern.

Claims (42)

1 . A method for extracting pattern contour information from an inspection image, the method comprising:

identifying, from an inspection image obtained from a charged-particle beam inspection system, a first pattern and a second pattern that partially overlap in the inspection image, wherein the first pattern and the second pattern are structures on a sample;

generating a first separation image by:

superimposing, on the inspection image, a second reference image on the second pattern, wherein the second reference image corresponds to the second pattern; and

removing an image area corresponding to the second pattern from the inspection image, wherein the first separation image includes the first pattern of which a first part is removed when removing the image area corresponding to the second pattern; and

updating the first separation image to include image data representing the removed first part of the first pattern based on a first reference image corresponding to the first pattern.

2 . A contour extraction apparatus comprising:

a memory storing a set of instructions; and

at least one processor configured to execute the set of instructions to cause the apparatus to perform:

identifying, from an inspection image obtained from a charged-particle beam inspection system, a first pattern and a second pattern that partially overlap in the inspection image, wherein the first pattern and the second pattern are structures on a sample;

generating a first separation image by:

superimposing, on the inspection image, a second reference image on the second pattern, wherein the second reference image corresponds to the second pattern; and

removing an image area corresponding to the second pattern from the inspection image, wherein the first separation image includes the first pattern of which a first part is removed when removing the image area corresponding to the second pattern; and

updating the first separation image to include image data representing the removed first part of the first pattern based on a first reference image corresponding to the first pattern.

3 . The apparatus of claim 2 , the at least one processor is configured to execute the set of instructions to cause the apparatus to further perform:

extracting contour information of the first pattern from the updated first separation image.

4 . The apparatus of claim 2 , wherein updating the first separation image is performed by filling the first part in the first separation image using an inpainting algorithm.

5 . The apparatus of claim 2 , wherein identifying the first pattern and the second pattern comprises:

extracting, from the inspection image, a first image patch covering a portion of the first pattern, wherein the portion of the first pattern is nonoverlapping with the second pattern;

extracting, from the inspection image, a second image patch covering a portion of the second pattern, wherein the portion of the second pattern is nonoverlapping with the first pattern; and

associating the first image patch with the first reference image and the second image patch with a second reference image corresponding to the second pattern.

6 . The apparatus of claim 5 , wherein associating the first image patch with the first reference image and the second image patch with the second reference image is performed by using the first image patch and the second image patch as inputs to a machine learning model.

7 . The apparatus of claim 2 , wherein identifying the first pattern and the second pattern is performed in real time.

8 . The apparatus of claim 2 , wherein generating the first separation image comprises:

superimposing, on the inspection image, the first reference image on the first pattern; and

removing the image area corresponding to the second pattern based on the second reference image superimposed on the second pattern.

9 . The apparatus of claim 2 , wherein the first reference image is in Graphic Database System (GDS) format, Graphic Database System II (GDS II) format, Open Artwork System Interchange Standard (OASIS) format, or Caltech Intermediate Format (CIF).

10 . A non-transitory computer readable medium that stores a set of instructions that is executable by at least one processor of a computing device to cause the computing device to perform a method for extracting pattern contour information from an inspection image, the method comprising:

identifying, from an inspection image obtained from a charged-particle beam inspection system, a first pattern and a second pattern that partially overlap in the inspection image, wherein the first pattern and the second pattern are structures on a sample;

generating a first separation image by:

superimposing, on the inspection image, a second reference image on the second pattern, wherein the second reference image corresponds to the second pattern; and

removing an image area corresponding to the second pattern from the inspection image, wherein the first separation image includes the first pattern of which a first part is removed when removing the image area corresponding to the second pattern;

updating the first separation image to include image data representing the removed first part of the first pattern based on a first reference image corresponding to the first pattern.

11 . The non-transitory computer readable medium of claim 10 , the set of instructions that is executable by at least one processor of the computing device to cause the computing device to further perform:

extracting contour information of the first pattern from the updated first separation image.

12 . The non-transitory computer readable medium of claim 10 , wherein updating the first pattern in the first separation image is performed by filling the first part in the first separation image using an inpainting algorithm.

13 . The non-transitory computer readable medium of claim 10 , wherein identifying the first pattern and the second pattern comprises:

extracting, from the inspection image, a first image patch covering a portion of the first pattern, wherein the portion of the first pattern is nonoverlapping with the second pattern;

extracting, from the inspection image, a second image patch covering a portion of the second pattern, wherein the portion of the second pattern is nonoverlapping with the first pattern; and

associating the first image patch with the first reference image and the second image patch with a second reference image corresponding to the second pattern.

14 . The non-transitory computer readable medium of claim 13 , wherein associating the first image patch with the first reference image and the second image patch with the second reference image is performed by using the first image patch and the second image patch as inputs to a machine learning model.

15 . The non-transitory computer readable medium of claim 10 , wherein identifying the first pattern and the second pattern is performed in real time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2026
From: PU, LINGLING; FANG, WEI
To: ASML NETHERLANDS B.V.
Reel/Frame 074388/0928 →
Continuity (2)
Provisional Application 62976216 · Feb 13, 2020
Related Publication 20230117237A1 · Apr 20, 2023
References Cited (16)
US 7626691B2 · Do · 2009 [cited by examiner]
US 10354376B2 · Weinberg · 2019 [cited by examiner]
US 10535129B2 · Kitazawa et al. · 2020 [cited by applicant]
US 10825650B2 · Chou · 2020 [cited by examiner]
US 20190164265A1 · Liao · 2019 [cited by examiner]
US 20190378012A1 · Tripodi · 2019 [cited by examiner]
US 20200020092A1 · Fang et al. · 2020 [cited by applicant]
CN 107924119A · 2018 [cited by applicant]
CN 106574832B · 2018 [cited by applicant]
CN 110494894A · 2019 [cited by applicant]
TW 201920901A · 2019 [cited by applicant]
TW 201939564A · 2019 [cited by applicant]
TW 201940983A · 2019 [cited by applicant]
International Search Report and Written Opinion received from the International Search Authority issued in related International Application No. PCT/EP2021/051897 mailed Mar. 22, 2021 (2 pgs.). [cited by applicant]
Jian Sun, Lu Yuan, Jiaya Jia, and Heung-Yeung Shum; “Image Completion with Structure Propagation,” ACM Transactions on Graphics vol. 24, Issue 3 (https: //dl.acm.org/doi/10.1145/1073204.1073274) Jul. 2005 (8 pgs.). [cited by applicant]
Office Action issued by the Intellectual Property Office (IPO), ROC (Taiwan) Patent Application No. 110104637, issued on Mar. 9, 2022 (19 pgs.). [cited by applicant]