IP Library Granted Patent US 12,197,133
Granted Patent B2
US 12,197,133 · App. 16/596,732 · Granted Jan 14, 2025

Tool control using multistage LSTM for predicting on-wafer measurements

Inventors: Dung Tien Phan (Ossining, NY); Robert J. Baseman (Brewster, NY); Ramachandran Muralidhar (Mahopac, NY); Fateh A. Tipu (Wappingers Falls, NY); Nam H. Nguyen (Pleasantville, NY)
Assignee: International Business Machines Corporation
G03F7/705G03F7/70783G05B13/0265G06N7/01G05B2219/45031G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,197,133
App. No.
16/596,732
Granted
Jan 14, 2025
Kind
B2
Abstract

A method for process control using predictive long short term memory includes obtaining historical post-process measurements taken on prior products of the manufacturing process; obtaining historical in-process measurements taken on prior workpieces during the manufacturing process; training a neural network to predict each of the historical post-process measurements, in response to the corresponding historical in-process measurements and preceding historical post-process measurements; obtaining present in-process measurements on a present workpiece during the manufacturing process; predicting a future post-process measurement for the present workpiece, by providing the present in-process measurements and the historical post-process measurements as inputs to the neural network; and adjusting at least one controllable variable of the manufacturing process in response to the prediction of the future post-process measurement.

Claims (51)

1. A method for controlling a manufacturing process in real-time during a current process step of the manufacturing process, the method comprising:

obtaining historical post-process measurements taken on prior products of the manufacturing process;

obtaining historical in-process measurements taken on prior workpieces during prior iterations of the current process step;

training a neural network to predict at least one of the historical post-process measurements in response to the corresponding historical in-process measurements and in response to a subset of the historical post-process measurements that preceded the at least one of the historical post-process measurements to be predicted;

obtaining present in-process measurements on a present workpiece during the current process step;

predicting a future post-process measurement for the present workpiece, by providing the present in-process measurements and the historical post-process measurements as inputs to the neural network, wherein predicting the future post-process measurement comprises a first long short term memory layer taking as inputs the present in-process measurements, and producing as an output a naïve prediction of the future post-process measurement, wherein predicting the future post-process measurement also comprises a second long short term memory layer taking as inputs historical post-process measurements and the naïve prediction of the post-process measurement, and passing an output to a fully connected layer which produces an informed prediction of the future post-process measurement; and

adjusting at least one controllable variable of the manufacturing process in response to the prediction of the future post-process measurement.

2. The method of claim 1 wherein adjusting the at least one controllable variable includes repeatedly obtaining at least one in-process measurement and predicting the future post-process measurement.

3. The method of claim 1 wherein adjusting the at least one controllable variable includes changing the at least one controllable variable consistent with an empirical error function for the future post-process measurement relative to the at least one controllable variable.

4. A method for controlling a manufacturing process in real-time during a current process step of the manufacturing process, the method comprising:

obtaining historical post-process measurements taken on prior products of the manufacturing process;

obtaining historical in-process measurements taken on prior workpieces during prior iterations of the current process step;

training a neural network to predict at least one of the historical post-process measurements in response to the corresponding historical in-process measurements and in response to a subset of the historical post-process measurements that preceded the at least one of the historical post-process measurements to be predicted;

obtaining present in-process measurements on a present workpiece during the current process step;

predicting a future post-process measurement for the present workpiece, by providing the present in-process measurements and the historical post-process measurements as inputs to the neural network; and

adjusting at least one controllable variable of the manufacturing process in response to the prediction of the future post-process measurement, wherein predicting the future post-process measurement comprises a first long short term memory layer taking as inputs the present in-process measurements, and producing as an output a first naïve prediction of the future post-process measurement, and wherein the neural network incorporates a second long short term memory layer that takes as inputs in-process measurements from a previous process step that preceded the current process step on the present workpiece, and that produces as an output a second naïve prediction of the future post-process measurement, and wherein the neural network further incorporates a third long short term memory layer that takes as inputs the first naïve prediction, the second naïve prediction, and historical post-process measurements and that passes an output to a fully connected layer which produces as an output an informed prediction of the future post-process measurement.

5. A non-transitory computer readable medium embodying computer executable instructions which when executed by a computer cause the computer to facilitate a method for controlling a manufacturing process in real-time during a current process step of the manufacturing process, the method comprising:

obtaining historical post-process measurements taken on prior products of the manufacturing process;

obtaining historical in-process measurements taken on prior workpieces during prior iterations of the current process step;

training a neural network to predict at least one of the historical post-process measurements in response to the corresponding historical in-process measurements and in response to a subset of the historical post-process measurements that preceded the at least one of the historical post-process measurements to be predicted;

obtaining present in-process measurements on a present workpiece during the current process step;

predicting a future post-process measurement for the present workpiece, by providing the present in-process measurements and the historical post-process measurements as inputs to the neural network, wherein predicting the future post-process measurement comprises a first long short term memory layer taking as inputs the present in-process measurements, and producing as an output a naïve prediction of the future post-process measurement, wherein predicting the future post-process measurement also comprises a second long short term memory layer taking as inputs historical post-process measurements and the naïve prediction of the post-process measurement, and passing an output to a fully connected layer which produces an informed prediction of the future post-process measurement; and

adjusting at least one controllable variable of the manufacturing process in response to the prediction of the future post-process measurement.

6. The method of claim 5 wherein adjusting the at least one controllable variable includes repeatedly obtaining at least one in-process measurement and predicting the future post-process measurement.

7. A non-transitory computer readable medium embodying computer executable instructions which when executed by a computer cause the computer to facilitate a method for controlling a manufacturing process in real-time during a current process step of the manufacturing process, the method comprising:

obtaining historical post-process measurements taken on prior products of the manufacturing process;

obtaining historical in-process measurements taken on prior workpieces during prior iterations of the current process step;

training a neural network to predict at least one of the historical post-process measurements in response to the corresponding historical in-process measurements and in response to a subset of the historical post-process measurements that preceded the at least one of the historical post-process measurements to be predicted;

obtaining present in-process measurements on a present workpiece during the current process step;

predicting a future post-process measurement for the present workpiece, by providing the present in-process measurements and the historical post-process measurements as inputs to the neural network; and

adjusting at least one controllable variable of the manufacturing process in response to the prediction of the future post-process measurement, wherein predicting the future post-process measurement comprises a first long short term memory layer taking as inputs the present in-process measurements, and producing as an output a first naïve prediction of the future post-process measurement, and wherein the neural network incorporates a second long short term memory layer that takes as inputs in-process measurements from a previous process step that preceded the current process step on the present workpiece, and that produces as an output a second naïve prediction of the future post-process measurement, and wherein the neural network further incorporates a third long short term memory layer that takes as inputs the first naïve prediction, the second naïve prediction, and historical post-process measurements and that passes an output to a fully connected layer which produces as an output an informed prediction of the future post-process measurement.

8. A process control system comprising:

a memory embodying computer executable instructions; and

at least one processor, coupled to the memory, and operative by the computer executable instructions to facilitate a method for controlling a manufacturing process in real-time during a current process step of the manufacturing process, the method comprising:

obtaining historical post-process measurements taken on prior products of the manufacturing process;

obtaining historical in-process measurements taken on prior workpieces during prior iterations of the current process step;

training a neural network to predict each of the historical post-process measurements in response to the corresponding historical in-process measurements and in response to a subset of the historical post-process measurements that preceded the at least one of the historical post-process measurements to be predicted;

obtaining present in-process measurements on a present workpiece during the current process step;

predicting a future post-process measurement for the present workpiece, by providing the present in-process measurements and the historical post-process measurements as inputs to the neural network, wherein predicting the future post-process measurement comprises a first long short term memory layer taking as inputs the present in-process measurements, and producing as an output a naïve prediction of the future post-process measurement, wherein predicting the future post-process measurement also comprises a second long short term memory layer taking as inputs historical post-process measurements and the naïve prediction of the post-process measurement, and passing an output to a fully connected layer which produces an informed prediction of the future post-process measurement; and

adjusting at least one controllable variable of the manufacturing process in response to the prediction of the future post-process measurement.

9. The system of claim 8 wherein adjusting the at least one controllable variable includes repeatedly obtaining at least one in-process measurement and predicting the future post-process measurement.

10. The system of claim 9 wherein adjusting the at least one controllable variable includes changing the at least one controllable variable consistent with an empirical error function for the post-process measurement relative to the at least one controllable variable.

11. A process control system comprising:

a memory embodying computer executable instructions; and

at least one processor, coupled to the memory, and operative by the computer executable instructions to facilitate a method for controlling a manufacturing process in real-time during a current process step of the manufacturing process, the method comprising:

obtaining historical post-process measurements taken on prior products of the manufacturing process;

obtaining historical in-process measurements taken on prior workpieces during prior iterations of the current process step;

training a neural network to predict each of the historical post-process measurements in response to the corresponding historical in-process measurements and in response to a subset of the historical post-process measurements that preceded the at least one of the historical post-process measurements to be predicted;

obtaining present in-process measurements on a present workpiece during the current process step;

predicting a future post-process measurement for the present workpiece, by providing the present in-process measurements and the historical post-process measurements as inputs to the neural network; and

adjusting at least one controllable variable of the manufacturing process in response to the prediction of the future post-process measurement, wherein predicting the future post-process measurement comprises a first long short term memory layer taking as inputs the present in-process measurements, and producing as an output a first naïve prediction of the future post-process measurement, and wherein the neural network incorporates a second long short term memory layer that takes as inputs in-process measurements from a previous process step that preceded the current process step on the present workpiece, and that produces as an output a second naïve prediction of the future post-process measurement, and wherein the neural network further incorporates a third long short term memory layer that takes as inputs the first naïve prediction, the second naïve prediction, and historical post-process measurements and that passes an output to a fully connected layer which produces as an output an informed prediction of the future post-process measurement.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2019
From: PHAN, DUNG TIEN; BASEMAN, ROBERT J.; MURALIDHAR, RAMACHANDRAN; TIPU, FATEH A.; NGUYEN, NAM H.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 050659/0055 →
Continuity (1)
Related Publication 20210103221A1 · Apr 8, 2021
References Cited (64)
US 5467883A · Frye · 1995 [cited by applicant]
US 7243441B2 · Watanabe · 2007 [cited by applicant]
US 7444616B2 · Sandstrom et al. · 2008 [cited by applicant]
US 7493185B2 · Cheng · 2009 [cited by applicant]
US 7656182B2 · Bickford · 2010 [cited by examiner]
US 8175831B2 · Izikson · 2012 [cited by examiner]
US 8437870B2 · Tsai · 2013 [cited by examiner]
US 9606453B2 · Izikson et al. · 2017 [cited by applicant]
US 9792393B2 · Tetiker · 2017 [cited by examiner]
US 10192146B2 · Sen et al. · 2019 [cited by applicant]
US 11120182B2 · Lin · 2021 [cited by applicant]
US 20040040001A1 · Miller · 2004 [cited by applicant]
US 20100138026A1 · Kaushal · 2010 [cited by examiner]
US 20110131162A1 · Kaushal · 2011 [cited by examiner]
US 20120218533A1 · Lyulina et al. · 2012 [cited by applicant]
US 20140236515A1 · Ho · 2014 [cited by applicant]
US 20150369857A1 · Nakamura · 2015 [cited by examiner]
US 20160292342A1 · Han · 2016 [cited by applicant]
US 20170363950A1 · Sriraman · 2017 [cited by examiner]
US 20180157161A1 · Mailfert · 2018 [cited by examiner]
US 20180284621A1 · Hulsebos · 2018 [cited by examiner]
US 20180314148A1 · Tetiker · 2018 [cited by examiner]
US 20180349535A1 · Bhosale · 2018 [cited by examiner]
US 20180349538A1 · Bhosale · 2018 [cited by examiner]
US 20180356807A1 · Honda et al. · 2018 [cited by applicant]
US 20190049937A1 · Tetiker · 2019 [cited by examiner]
US 20190095797A1 · Dhandapani · 2019 [cited by examiner]
US 20190172312A1 · Shigeta · 2019 [cited by examiner]
US 20190295890A1 · Clark · 2019 [cited by applicant]
US 20200083080A1 · Clark · 2020 [cited by examiner]
US 20210103221A1 · Phan · 2021 [cited by examiner]
US 20210241137A1 · Jain · 2021 [cited by examiner]
US 20210335638A1 · Manassen · 2021 [cited by examiner]
US 20220066411A1 · Ummethala · 2022 [cited by examiner]
CN 101908495 · 2010 [cited by applicant]
CN 101939833 · 2011 [cited by applicant]
CN 103310285 · 2013 [cited by applicant]
CN 104658962A · 2015 [cited by applicant]
CN 106158679 · 2016 [cited by applicant]
CN 106158679A · 2016 [cited by applicant]
EP 0602855A1 · 1994 [cited by applicant]
EP 3650939A1 · 2020 [cited by examiner]
JP H06348679A · 1994 [cited by applicant]
JP 2004157029A · 2004 [cited by applicant]
JP 2005150340A · 2005 [cited by applicant]
JP 2005536887A · 2005 [cited by applicant]
JP 2006024195A · 2006 [cited by applicant]
JP 2006506800A · 2006 [cited by applicant]
JP 2006157029A · 2006 [cited by applicant]
JP 2019047100A · 2019 [cited by applicant]
TW 202036357A · 2020 [cited by examiner]
WO 2003081663A2 · 2003 [cited by applicant]
WO 2004019401A1 · 2004 [cited by applicant]
WO WO2009029851A2 · 2009 [cited by applicant]
WO WO2018101722A2 · 2018 [cited by examiner]
Song et al. ; “Novel Application of Deep Learning for Adaptive Testing Based on Long Short-Term Memory”; 2019 IEEE 37th VLSI Test Symposium (VTS); Conference Paper | Publisher: IEEE (Year: 2019). [cited by examiner]
Wang,Xueting, International Search Report and Written Opinion, PCT/IB2020/058381, Dec. 16, 2020, pp. 8. [cited by applicant]
Zhang et al., “Long short-term memory for machine remaining life prediction”, Journal of Manufacturing Systems, vol. 48, part C, Jul. 2018, pp. 78-86, https://www.sciencedirect.com/science/article/pii/S0278612518300803. [cited by applicant]
Salinas et al., “DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks”, Feb. 2019, 12 pages, https://arxiv.org/pdf/1704.04110v3.pdf. [cited by applicant]
Bayer et al., “Learning Stochastic Recurrent Networks”, Mar. 2015, 9 pages, https://arxiv.org/pdf/1411.7610v3.pdf. [cited by applicant]
Kingma et al., “Auto-Encoding Variational Bayes”, May 2014, 14 pages, https://arxiv.org/pdf/1312.6114v10.pdf. [cited by applicant]
J D Williams, European Patent Attorney, counterpart Application No. GB2205127.0. In response to the Examination Report, Jun. 13, 2023, pp. 5. [cited by applicant]
Office Action in Counterpart Chinese Application, in Chinese language, dated May 9, 2023, 5 pages, total, page 4 shows “A” category of cited references. [cited by applicant]
Patent examiner: Shoji. Decision to Grant a Patent. Counterpart Japanese Patent Application number: Japanese Patent Application No. 2022-521521. Apr. 6, 2024. pp. 2. [cited by applicant]