IP Library › Granted Patent US 12,417,334
Granted Patent B2
US 12,417,334 · App. 17/738,174 · Granted Sep 16, 2025

Lithography simulation using a neural network

Inventors: Haoyu Yang (Cedar Park, TX); Haoxing Ren (Austin, TX); Zongyi Li (Alhambra, CA)
Assignee: NVIDIA Corporation
G06F30/398G06F17/142G06F30/27G06F2119/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,417,334
App. No.
17/738,174
Granted
Sep 16, 2025
Kind
B2
Abstract

As integrated circuit geometries have shrunk, lithography simulation has developed to ensure that the masks used to fabricate the circuits satisfy the chip yield and fabrication turnaround time targets. To manufacture an integrated circuit (chip), an initial layout for the integrated circuit design is processed to compute a wafer image (e.g., resist material “printed” on the wafer using photomasks). Lithography simulation processes the initial layout according to optical physics to compute an estimated wafer image without actually constructing the physical masks or consuming any wafer fabrication resources and may be used to confirm manufacturability of the design layout before it is fabricated. Performing lithography simulation using a dual-band neural network produces accurate results efficiently. Dual-band refers to a dual frequency band processing whereby the input layout (mask image) is separately processed by both a first and second branch to extract low-frequency (global) features and high-frequency (local) features, respectively.

Claims (38)

1. A computer-implemented method, comprising:

processing, according to an optical model for lithography, a mask image defining shapes for fabrication of an integrated circuit by a first branch of a neural network to extract low-frequency component features by converting the mask image into a frequency domain and performing at least a linear operation in the frequency domain;

extracting high-frequency component features from the mask image by a second branch of the neural network; and

producing an estimated fabrication image by processing the low-frequency component features and the high-frequency component features by a reconstruction portion of the neural network.

2. The computer-implemented method of claim 1 , wherein the mask image is downsampled for processing by the first branch.

3. The computer-implemented method of claim 2 , further comprising subdividing the downsampled mask image into tiles for processing by the first branch.

4. The computer-implemented method of claim 3 , wherein each one of the tiles at least partially overlaps with an adjacent tile.

5. The computer-implemented method of claim 3 , wherein the first branch extracts high-frequency component features for each processed tile and further comprising concatenating the high-frequency component features for the processed tiles for input to the reconstruction portion of the neural network.

6. The computer-implemented method of claim 1 , wherein the low-frequency component features correspond to light intensity.

7. The computer-implemented method of claim 1 , wherein the high-frequency component features correspond to contour and shape edge details.

8. The computer-implemented method of claim 1 , wherein the first branch processes the mask image by:

performing a Fourier transform on the mask image to convert the mask image into the frequency domain;

convolving the converted mask image with a channel-lifting operator;

performing the linear operation on the convolved converted mask image to extract low-frequency features in the frequency domain; and

performing an inverse Fourier transform on the extracted low-frequency features in the frequency domain to produce the low-frequency component features.

9. The computer-implemented method of claim 1 , wherein at least one of the steps of processing, extracting, and producing are performed on a server or in a data center and the estimated fabrication image is streamed to a user device.

10. The computer-implemented method of claim 1 , wherein at least one of the steps of processing, extracting, and producing are performed within a cloud computing environment.

11. The computer-implemented method of claim 1 , wherein the integrated circuit is employed in a machine, robot, or autonomous vehicle.

12. The computer-implemented method of claim 1 , wherein at least one of the steps of processing, extracting, and producing is performed on a virtual machine comprising a portion of a graphics processing unit.

13. A computer-implemented method, comprising:

processing a fabrication image defining patterns for an integrated circuit by a first branch of a neural network according to an optical model for lithography to extract low-frequency component features by converting the mask image into a frequency domain and performing at least a linear operation in the frequency domain;

extracting high-frequency component features from the fabrication image by a second branch of the neural network; and

producing an estimated mask image by processing the low-frequency component features and the high-frequency component features by a reconstruction portion of the neural network.

14. The computer-implemented method of claim 13 , wherein the low-frequency component features correspond to light intensity.

15. The computer-implemented method of claim 13 , wherein the high-frequency component features correspond to contour and shape edge details.

16. A system, comprising:

a memory that stores a mask image defining shapes for fabrication of an integrated circuit; and

a processor that is connected to the memory, wherein the processor implements a neural network comprising:

a first branch that processes the mask image to extract low-frequency component features by converting the mask image into a frequency domain and performing at least a linear operation in the frequency domain;

a second branch that extracts high-frequency component features from the mask image; and

a reconstruction portion that produces an estimated fabrication image by processing the low-frequency component features and the high-frequency component features.

17. The system of claim 16 , wherein the mask image is downsampled for processing by the first branch.

18. The system of claim 16 , wherein the low-frequency component features correspond to light intensity.

19. A non-transitory computer-readable media storing computer instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

processing, according to an optical model for lithography, a mask image defining shapes for fabrication of an integrated circuit by a first branch of a neural network to extract low-frequency component features by converting the mask image into a frequency domain and performing at least a linear operation in the frequency domain;

extracting high-frequency component features from the mask image by a second branch of the neural network; and

producing an estimated fabrication image by processing the low-frequency component features and the high-frequency component features by a reconstruction portion of the neural network.

20. The non-transitory computer-readable media of claim 19 , wherein the low-frequency component features correspond to light intensity.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2022
From: YANG, HAOYU; REN, HAOXING; LI, ZONGYI
To: NVIDIA CORPORATION
Reel/Frame 059837/0547 →
Continuity (2)
Provisional Application 63264278 · Nov 18, 2021
Related Publication 20230153510A1 · May 18, 2023
References Cited (21)
US 20170323481A1 · Tran · 2017 [cited by examiner]
US 20200380362A1 · Cao · 2020 [cited by examiner]
US 20210286270A1 · Middlebrooks · 2021 [cited by examiner]
Ma, X., et al., “Computational Lithography,” John Wiley & Sons, 2011, vol. 77 (CH 2). [cited by applicant]
Yu, P., et al., “True process variation aware optical proximity correction with variational lithography modeling and model calibration,” in Proc. DAC, 2006, pp. 785-790. [cited by applicant]
Matsunawa, T., et al., “Optical proximity correction with hierarchical bayes model,” in Proc. SPIE, vol. 9426, 2015. [cited by applicant]
Ye, W., et al., “LithoGAN: End-to-end lithography modeling with generative adversarial networks,” in Proc. DAC, 2019, pp. 107:1-107:6. [cited by applicant]
Lin, Y., et al., “Data efficient lithography modeling with transfer learning and active data selection,” IEEE TCAD, 2019. [cited by applicant]
Chen, G., et al., “DAMO: Deep agile mask optimization for full chip scale,” in Proc. ICCAD, 2020. [cited by applicant]
Ye, W., et al., “Tempo: Fast mask topography effect modeling with deep learning,” in Proc. ISPD, 2020, pp. 127-134. [cited by applicant]
Shim, S., et al., “Machine learning-based 3D resist model,” in Proc. SPIE, vol. 10147, 2017. (Abstract). [cited by applicant]
Adam, K., et al., “Using machine learning in the physical modeling of lithographic processes,” in Proc. SPIE, vol. 10962, 2019. (Abstract). [cited by applicant]
Yu, F., et al., “Multi-scale context aggregation by diluted convolutions,” 2016. [cited by applicant]
Yang, H., et al., “Layout hotspot detection with feature tensor generation and deep biased learning,” IEEE TCAD, vol. 38, No. 6, pp. 1175-1187, 2019. [cited by applicant]
Li, Z., et al., “Fourier neural operator for parametric partial differential equations,” in Proc. ICLR, 2021. [cited by applicant]
Gao, J.R., et al., “MOSAIC: Mask optimizing solution with process window aware inverse correction,” in Proc. DAC, 2014, pp. 52:1-52:6. [cited by applicant]
Wang, H., et al., “High-frequency component helps explain the generalization of convolutional neural networks,” in Proc. CVPR, 2020, pp. 8684-8694. [cited by applicant]
Simonyan, K., et al., “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014. [cited by applicant]
Yang, H., et al., “GAN-OPC: Mask optimization with lithography-guided generative adversarial nets,” IEEE TCAD, 2020. [cited by applicant]
Ronneberger, O., et al., “U-net: Convolutional networks for biomedical segmentation,” in Proc. MICCAI, 2015, pp. 234-241. [cited by applicant]
“ITRS,” http://www.itrs2.net. [cited by applicant]