IP Library › Granted Patent US 12,449,379
Granted Patent B2
US 12,449,379 · App. 18/201,927 · Granted Oct 21, 2025

Machine learning model training

Inventors: Jeong Jin Hong (Yongin-si, KR); Sejune Cheon (Seoul, KR); Sang Hong Kim (Seoul, KR); Thomas Ho Fai Li (Santa Clara, CA); Anders Andelman Nottrott (Alameda, CA); Zhaozhao Zhu (Milpitas, CA); MiHyun Jang (Seoul, KR)
Assignee: Applied Materials, Inc.
G01N21/9503G06T7/001G06T2207/20081G06T2207/30148
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,449,379
App. No.
18/201,927
Filed
May 25, 2023
Granted
Oct 21, 2025
Kind
B2
Art Unit
2665
USPC
382/145
Abstract

A method includes receiving spectral data of a substrate and metrology data corresponding to the spectral data of the substrate. The method further includes determining a plurality of feature model configurations for each of a plurality of feature models, each of the plurality of feature model configurations including one or more feature model conditions. The method further includes determining a plurality of feature model combinations, where each feature model combination of the plurality of feature model combinations includes a subset of the plurality of feature model configurations. The method further includes generating a plurality of input datasets, where each input dataset of the plurality of input datasets is generated based on application of the spectral data to a respective feature model combination of the plurality of feature model combinations. The method further includes training a plurality of machine learning models, where each machine learning model is trained to generate an output using an input dataset of the plurality of input datasets and the metrology data. The method further includes selecting a trained machine learning model from the plurality of trained machine learning models satisfying one or more selection criteria.

Claims (46)

1. A method comprising:

receiving spectral data of a substrate and metrology data corresponding to the spectral data of the substrate;

determining a plurality of feature model configurations for each of a plurality of feature models, each of the plurality of feature model configurations comprising one or more feature model conditions;

determining a plurality of feature model combinations, wherein each feature model combination of the plurality of feature model combinations comprises a subset of the plurality of feature model configurations;

generating a plurality of input datasets, wherein each input dataset of the plurality of input datasets is generated based on application of the spectral data to a respective feature model combination of the plurality of feature model combinations;

training a plurality of machine learning models, wherein each machine learning model is trained to generate an output using an input dataset of the plurality of input datasets and the metrology data; and

selecting a trained machine learning model from the plurality of trained machine learning models satisfying one or more selection criteria.

2. The method of claim 1 , wherein the output comprises a critical dimension (CD) profile prediction.

3. The method of claim 1 , wherein the plurality of feature models comprises at least one of a principal component analysis (PCA) model, an independent component analysis (ICA) model, or a fast Fourier transform (FFT) model.

4. The method of claim 1 , wherein the plurality of machine learning models comprises at least one of a multi-layer perception (MLP), a gradient boosted tree (GBT), a random forest, a support vector regression (SVR), a neural network, or a recursion algorithm.

5. The method of claim 1 , further comprising processing the metrology data prior to performing the training, wherein the processing comprises at least one of filtering, smoothing, clustering, or quantizing the metrology data.

6. The method of claim 1 , wherein the one or more selection criteria comprise at least one of an accuracy criterion, a processor utilization criterion, a processing speed criterion, or a memory utilization criterion.

7. The method of claim 1 , further comprising:

determining a selection value for each trained machine learning model of the plurality of trained machine learning models, wherein the selection value comprises at least one of a root mean square error (RMSE) value, R-squared (R2) value, or error variance value; and

wherein the one or more selection criteria comprise a selection value criterion.

8. A non-transitory computer-readable storage medium storing instructions which, when executed, cause a processing device to perform operations comprising:

receiving spectral data of a substrate and metrology data corresponding to the spectral data of the substrate;

determining a plurality of feature model configurations for each of a plurality of feature models, each of the plurality of feature model configurations comprising one or more feature model conditions;

determining a plurality of feature model combinations, wherein each feature model combination of the plurality of feature model combinations comprises a subset of the plurality of feature model configurations;

generating a plurality of input datasets, wherein each input dataset of the plurality of input datasets is generated based on application of the spectral data to a respective feature model combination of the plurality of feature model combinations;

training a plurality of machine learning models, wherein each machine learning model is trained to generate an output using an input dataset of the plurality of input datasets and the metrology data; and

selecting a trained machine learning model from the plurality of trained machine learning models satisfying one or more selection criteria.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the output comprises a critical dimension (CD) profile prediction.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the plurality of feature models comprise at least one of a principal component analysis (PCA) model, an independent component analysis (ICA) model, or a fast Fourier transform (FFT) model.

11. The non-transitory computer-readable storage medium of claim 8 , wherein the plurality of machine learning models comprise at least one of a multi-layer perception (MLP), a gradient boosted tree (GBT), a random forest, a support vector regression (SVR), a neural network, or a recursion algorithm.

12. The non-transitory computer-readable storage medium of claim 8 , the operations further comprising processing the metrology data prior to performing the training, wherein the processing comprises at least one of filtering, smoothing, clustering, or quantizing the metrology data.

13. The non-transitory computer-readable storage medium of claim 8 , wherein the one or more selection criteria comprise at least one of an accuracy criterion, a processor utilization criterion, a processing speed criterion, or a memory utilization criterion.

14. The non-transitory computer-readable storage medium of claim 8 , the operations further comprising:

determining a value for each trained machine learning model of the plurality of trained machine learning models, wherein the value comprises at least one of a root mean square error (RMSE) value, R-squared (R2) value, or error variance value; and

wherein the one or more selection criteria comprise a selection value criterion.

15. A system comprising:

a memory; and

a processing device coupled to the memory, the processing device to:

receive spectral data of a substrate and metrology data corresponding to the spectral data of the substrate;

determine a plurality of feature model configurations for each of a plurality of feature models, each of the plurality of feature model configurations comprising one or more feature model conditions;

determine a feature model combination, wherein the feature model combination comprises a subset of the plurality of feature model configurations;

generate an input dataset, wherein the input dataset is generated based on application of the spectral data to the feature model combination; and

train a plurality of machine learning models, wherein each machine learning model is trained to generate an output using the input dataset and the metrology data; and

select a trained machine learning model from the plurality of trained machine learning models satisfying one or more selection criteria.

16. The system of claim 15 , wherein the output comprises a critical dimension (CD) profile prediction.

17. The system of claim 15 , wherein the plurality of feature models comprise at least one of a principal component analysis (PCA) model, an independent component analysis (ICA) model, or a fast Fourier transform (FFT) model.

18. The system of claim 15 , wherein the plurality of machine learning models comprise at least one of a multi-layer perception (MLP), a gradient boosted tree (GBT), a random forest, a support vector regression (SVR), a neural network, or a recursion algorithm.

19. The system of claim 15 , wherein the one or more selection criteria comprise at least one of an accuracy criterion, a processor utilization criterion, a processing speed criterion, or a memory utilization criterion.

20. The system of claim 15 , the processing device further to:

determine a value for each trained machine learning model of the plurality of trained machine learning models, wherein the value comprises at least one of a root mean square error (RMSE) value, R-squared (R2) value, or error variance value; and

wherein the one or more selection criteria comprise a selection value criterion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2023
From: HONG, JEONG JIN; CHEON, SEJUNE; KIM, SANG HONG; LI, THOMAS HO FAI; NOTTROTT, ANDERS ANDELMAN; ZHU, ZHAOZHAO; JANG, MIHYUN
To: APPLIED MATERIALS, INC.
Reel/Frame 064380/0129 →
Continuity (1)
Related Publication 20240393262A1 · Nov 28, 2024
References Cited (16)
US 20150323316A1 · Shchegrov et al. · 2015 [cited by applicant]
US 20180330511A1 · Ha · 2018 [cited by examiner]
US 20200111206A1 · Yati · 2020 [cited by applicant]
US 20200133117A1 · Chu · 2020 [cited by examiner]
US 20210018902A1 · Yennie et al. · 2021 [cited by applicant]
US 20210174200A1 · Huang et al. · 2021 [cited by applicant]
US 20210334608A1 · Honda et al. · 2021 [cited by applicant]
US 20220180503A1 · Oh · 2022 [cited by examiner]
US 20220187713A1 · Middlebrooks et al. · 2022 [cited by applicant]
US 20230037918A1 · Pang et al. · 2023 [cited by applicant]
US 20230132893A1 · Kwon et al. · 2023 [cited by applicant]
US 20230316593A1 · Kumar · 2023 [cited by examiner]
WO WO2017171890A1 · 2017 [cited by examiner]
WO WO2019190566A1 · 2019 [cited by examiner]
International Search Report and Written Opinion for International Application No. PCT/US2024/031090, mailed Sep. 9, 2024, 09 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2024/031100, mailed Sep. 4, 2024, 09 pages. [cited by applicant]