IP Library › Granted Patent US 12,430,713
Granted Patent B2
US 12,430,713 · App. 17/887,619 · Granted Sep 30, 2025

Method of deconvoluting and restoring image observed in charged particle beam apparatus, image processing apparatus, and charged particle beam apparatus equipped with image processing apparatus

Inventors: Takashi Ogawa (Daejeon, KR); Junhyeok Hwang (Icheon-si, KR); In Yong Park (Daejeon, KR)
Assignee: KOREA RESEARCH INSTITUTE OF STANDARDS AND SCIENCE
G06T5/20G06T5/73G06T2207/10061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,430,713
App. No.
17/887,619
Granted
Sep 30, 2025
Kind
B2
Abstract

Provided is a method of deconvoluting and restoring an image observed in a charged particle beam apparatus. The method includes receiving, by an image processing apparatus, an observed image acquired by a detector of the charged particle beam apparatus, calculating, by the image processing apparatus, a point spread function (PSF), deconvoluting and restoring, by the image processing apparatus, the observed image using the observed image and the PSF, calculating, by the image processing apparatus, an evaluation function of the parameter applied to a process of the deconvoluting, and adjusting, by the image processing apparatus, the parameter on the basis of a result of the evaluation function, and restoring the image after deconvoluting the observed image and the PSF again using an optimal parameter. Furthermore, a charged particle beam apparatus using the above-described method of deconvoluting and restoring the image is provided.

Claims (141)

1. A method of restoring an image observed in a charged particle beam apparatus, the method comprising:

receiving, by an image processing apparatus, an observed image acquired by a detector of the charged particle beam apparatus;

calculating, by the image processing apparatus, a point spread function (PSF);

restoring, by the image processing apparatus, the observed image using the observed image and the PSF;

calculating, by the image processing apparatus, an evaluation function of a parameter applied to a process of the restoring; and

adjusting, by the image processing apparatus, the parameter on the basis of a result of the evaluation function to generate an optimal parameter, and restoring the observed image by deconvoluting the observed image and the PSF again using the optimal parameter,

wherein the evaluation function of the parameter is expressed as the following equation and the image processing apparatus determines the parameter when the result of the evaluation function of the parameter has a lowest value, as the optimal parameter:

ϕ

⁡

(

γ

)

=

❘

"\[LeftBracketingBar]"

1

N

-

1

⁢

1

M

-

1

⁢

∑

n

=

0

N

∑

m

=

0

M

ψ

m

,

n

(

r

;

γ

)

❘

"\[RightBracketingBar]"

wherein ϕ(γ) denotes the evaluation function of the parameter, γ denotes an optimization parameter, and ψ(r;γ) corresponds to a difference between an original image and an image restored by applying the parameter γ.

2. The method of claim 1 , wherein the parameter includes at least one of a Wiener filter parameter and a regularization parameter.

3. The method of claim 1 , wherein the image processing apparatus adjusts the parameter using an optimization algorithm.

4. The method of claim 1 , further comprising providing, by the image processing apparatus, sharpness and contrast-to-noise-ratio (CNR) information on the restored image.

5. The method of claim 1 , wherein the image processing apparatus restores the observed image by applying a constrained least square filter (CLSF) to the process of the deconvoluting.

6. The method of claim 5 , wherein the image processing apparatus restores the observed image by applying the CLSF to the process of the deconvoluting as shown in the following equation:

f

^

(

r

;

γ

)

=

ℱ

-

1

[

G

*

(

k

)

❘

"\[LeftBracketingBar]"

G

⁡

(

k

)

❘

"\[RightBracketingBar]"

2

+

γ

⁢

❘

"\[LeftBracketingBar]"

P

⁡

(

k

)

❘

"\[RightBracketingBar]"

2

]

⁢

H

⁡

(

k

)

,

P

⁡

(

k

)

=

ℱ

-

1

(

P

⁡

(

r

)

)

,

P

⁡

(

r

)

=

[

0

-

1

0

-

1

4

-

1

0

-

1

0

]

(G(k) denotes the Fourier transform of a PSF g(r), H(k) denotes the Fourier transform of an observed image h(r), and γ denotes an optimization parameter).

7. A charged particle beam apparatus for restoring an observed image of a sample by using the method of restoring an image observed in the charged particle beam apparatus of claim 1 .

8. The charged particle beam apparatus of claim 7 , wherein the charged particle beam apparatus uses an electron source or an ion source as a source, scans the sample with an electron beam or an ion beam, and allows a detector to detect a signal emitted from the sample.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2022
From: TAKASHI, OGAWA; HWANG, JUN HYEOK; PARK, IN YONG
To: KOREA RESEARCH INSTITUTE OF STANDARDS AND SCIENCE
Reel/Frame 060804/0921 →
Priority Claims (1)
KR 10-2021-0133534 · Oct 7, 2021 · national
Continuity (1)
Related Publication 20230109872A1 · Apr 13, 2023
References Cited (17)
US 12190478B2 · Ozcan · 2025 [cited by examiner]
US 20140348440A1 · Bergner · 2014 [cited by examiner]
US 20160180190A1 · Lifshin · 2016 [cited by examiner]
US 20170191945A1 · Zhang et al. · 2017 [cited by applicant]
US 20190333199A1 · Ozcan · 2019 [cited by examiner]
US 20200294204A1 · Kalinin · 2020 [cited by examiner]
US 20210248720A1 · Ziesche · 2021 [cited by examiner]
US 20220156892A1 · Slutsky · 2022 [cited by examiner]
US 20220277426A1 · Vyas · 2022 [cited by examiner]
US 20230085827A1 · Ozcan · 2023 [cited by examiner]
US 20230319401A1 · Feng · 2023 [cited by examiner]
JP 2004038362A · 2004 [cited by applicant]
JP 2011030911A · 2011 [cited by applicant]
JP 2013246062A · 2013 [cited by applicant]
JP 2014116207A · 2014 [cited by applicant]
S Shruthi et al., “Constrained least squares filtering followed by denoising of decomposed images using wave atom and wavelet transform”, Procedia Computer Science, 2017, vol. 115, p. 526 / 532, DOI: 10.1016/j.procs.201… [cited by applicant]
Murayama Yasuhiko, Japanese Office Action, issued Jun. 5, 2023, JP Patent Application No. 2022-130753, pp. 1-11. [cited by applicant]