IP Library › Granted Patent US 12,626,351
Granted Patent B2
US 12,626,351 · App. 18/141,690 · Granted May 12, 2026

Image processing method and system thereof

Inventors: Min Su Kang (Suwon-si, KR); Jang Hoon Kim (Suwon-si, KR); Woo Jin Jung (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T7/0006G06T7/13G06T2207/10061G06T2207/30148
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,626,351
App. No.
18/141,690
Granted
May 12, 2026
Kind
B2
Abstract

An image processing system, including an input interface configured to receive a first direction image corresponding to a view of a semiconductor device in a first direction, and a second direction image corresponding to a view of the semiconductor device in a second direction which intersects the first direction at a first height at which the first direction image is generated; a processor configured to perform an edge detection operation for detecting an edge based on the first direction image, and to perform an image binarization operation on the first direction image; and a learning device configured to compare a first line width obtained based on the image binarization operation, and a second line width obtained based on the second direction image through machine learning, and to learn a condition of the image binarization operation which maximizes a correlation between the first line width and the second line width.

Claims (48)

1 . An image processing system comprising:

at least one processor; and

a memory configured to store one or more instructions which, when executed by the at least one processor, cause the image processing system to:

receive a first direction image corresponding to a view of a semiconductor device in a first direction, and a second direction image corresponding to a view of the semiconductor device in a second direction which intersects the first direction at a first height at which the first direction image is generated,

perform an edge detection operation for detecting an edge based on the first direction image,

perform an image binarization operation on the first direction image,

compare a first line width obtained based on the image binarization operation, and a second line width obtained based on the second direction image through machine learning, and

learn a condition of the image binarization operation which maximizes a correlation between the first line width and the second line width.

2 . The image processing system of claim 1 ,

wherein the memory is further configured to store the condition of the image binarization operation.

3 . The image processing system of claim 1 , wherein the one or more instructions, when executed by the at least one processor, further cause the image processing system to:

communicate with an external device which generates the first direction image and the second direction image.

4 . The image processing system of claim 1 , wherein the first direction image and the second direction image are obtained using a scanning electron microscope (SEM) or a transmission electron microscope (TEM).

5 . The image processing system of claim 1 , wherein the edge detection operation is performed based on a gradient value obtained by applying a gradient to brightness information about pixels of the first direction image.

6 . The image processing system of claim 5 , wherein the edge detection operation determines pixels in which the gradient value is greater than a threshold gradient value, to be the edge.

7 . The image processing system of claim 1 , wherein the image binarization operation determines pixels having a brightness greater than a threshold brightness to be an inner region, based on brightness information about pixels of the first direction image.

8 . The image processing system of claim 7 , wherein the at least one processor is further configured to:

calculate an edge detection ratio value by dividing a number of edges included in the inner region by a total number of edges detected in the first direction image; and

perform the image binarization operation such that the edge detection ratio value is equal to a predetermined edge detection ratio value.

9 . An image processing system comprising:

at least one processor; and

a memory configured to store a machine learning model for performing machine learning, and one or more instructions which, when executed by the at least one processor, cause the image processing system to:

receive a first direction image corresponding to a view of a semiconductor device in a first direction, and a second direction image corresponding to a view of the semiconductor device in a second direction intersecting the first direction at a first height at which the first direction image is generated;

perform the machine learning based on the first direction image and the second direction image;

wherein to perform the machine learning, the one or more instructions which, when executed by the at least one processor, cause the image processing system to:

perform an edge detection operation for detecting an edge based on the first direction image,

perform an image binarization operation on the first direction image,

compare a first line width obtained based on the image binarization operation with a second line width obtained based on the second direction image using the machine learning, and

learn a condition of the image binarization operation at which a correlation between the first line width and the second line width is maximized by performing the machine learning.

10 . The image processing system of claim 9 , wherein the memory is further configured to store the condition of the image binarization operation.

11 . The image processing system of claim 9 , wherein the first direction image and the second direction image are obtained using a scanning electron microscope (SEM) or a transmission electron microscope (TEM).

12 . The image processing system of claim 9 , wherein the edge detection operation is performed based on a gradient value obtained by applying a gradient to brightness information about pixels of the first direction image.

13 . The image processing system of claim 12 , wherein the edge detection operation determines pixels in which the gradient value is greater than a threshold gradient value, to be the edge.

14 . The image processing system of claim 9 , wherein the image binarization operation determines pixels having brightness greater than a threshold brightness to be an inner region, based on brightness information about pixels of the first direction image.

15 . The image processing system of claim 9 , wherein the one or more instructions, when executed by the at least one processor, further cause the image processing system to:

calculate an edge detection ratio value obtained by dividing a number of edges included in an inner region by a total number of edges detected in the first direction image; and

perform the image binarization operation such that the edge detection ratio value is equal to a predetermined edge detection ratio value.

16 . An image processing method comprising:

receiving a first direction image corresponding to a view of a semiconductor device in a first direction, and a second direction image corresponding to a view of the semiconductor device in a second direction intersecting the first direction at a first height at which the first direction image is generated through an input interface;

performing an edge detection operation for detecting an edge based on the first direction image, using a processor;

performing an image binarization operation on the first direction image, using the processor; and

comparing a first line width obtained based on the image binarization operation, and a second line width obtained based on the second direction image using machine learning, and learning a condition of the image binarization operation which maximizes a correlation between the first line width and the second line width, using a learning device.

17 . The image processing method of claim 16 , wherein the edge detection operation is performed based on a gradient value obtained by applying a gradient to brightness information about pixels of the first direction image.

18 . The image processing method of claim 17 , wherein the edge detection operation determines pixels in which the gradient value is greater than a threshold gradient value, to be the edge.

19 . The image processing method of claim 16 , wherein the image binarization operation determines pixels having brightness greater than a threshold brightness to be an inner region, based on brightness information about pixels of the first direction image.

20 . The image processing method of claim 19 , wherein an edge detection ratio value is obtained by dividing a number of edges included in the inner region by a total number of edges detected in the first direction image, and

wherein the image binarization operation is performed such that the edge detection ratio value is equal to a predetermined edge detection ratio value.

21 . The image processing system of claim 1 , wherein the condition specifies a relationship between the image binarization operation and at least one edge detected using the edge detection operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2023
From: KANG, MIN SU; KIM, JANG HOON; JUNG, WOO JIN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 063495/0750 →
Priority Claims (1)
KR 10-2022-0081954 · Jul 4, 2022 · national
Continuity (1)
Related Publication 20240005476A1 · Jan 4, 2024
References Cited (20)
US 6788825B1 · Fujino · 2004 [cited by applicant]
US 7386186B2 · Ovsiannikov · 2008 [cited by applicant]
US 8260057B2 · Hasegawa et al. · 2012 [cited by applicant]
US 9547909B2 · Du et al. · 2017 [cited by applicant]
US 10127651B2 · Kulkarni et al. · 2018 [cited by applicant]
US 10423854B2 · Yamada · 2019 [cited by applicant]
US 10452905B2 · Segalovitz et al. · 2019 [cited by applicant]
US 10921262B2 · Zhang et al. · 2021 [cited by applicant]
US 20150287201A1 · Shinoda · 2015 [cited by examiner]
US 20180088060A1 · Shim · 2018 [cited by examiner]
US 20200134824A1 · Adiga · 2020 [cited by applicant]
US 20220027622A1 · Taylor et al. · 2022 [cited by applicant]
US 20220092799A1 · Yan · 2022 [cited by examiner]
US 20220138973A1 · Korb et al. · 2022 [cited by applicant]
US 20230360190A1 · Kitao · 2023 [cited by examiner]
US 20240144560A1 · Cheng · 2024 [cited by examiner]
Sh Lee et al. “Automated Diagonal Slice and View Solution for 3D Device Structure Analysis” Jan. 1, 2018, pp. 224-231, XP009521978. [cited by applicant]
Ming Zeng et al. “Image Thresholding Based on edge Information Analysis”, Image and Signal processing (CISP), 2012 5th International Congress (Oct. 16, 2012), pp. 1371-1375, XP032336585. [cited by applicant]
Extended European Search Report dated Oct. 16, 2023 issued by the European Patent Office in Counterpart European Application No. 23 173 898.0. [cited by applicant]
Communication dated Oct. 27, 2023 issued by the European Patent Office in counterpart European Application No. 23 173 898.0. [cited by applicant]