IP Library › Granted Patent US 11,972,548
Granted Patent B2
US 11,972,548 · App. 17/438,734 · Granted Apr 30, 2024

Computer-implemented method for defect analysis, apparatus for defect analysis, computer-program product, and intelligent defect analysis system

Inventors: Haijin Wang (Beijing, CN); Jianfeng Zeng (Beijing, CN)
Assignee: BOE Technology Group Co., Ltd.
G06T7/0002G06T7/50G06V10/7625G06V10/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,972,548
App. No.
17/438,734
Granted
Apr 30, 2024
Kind
B2
Abstract

A computer-implemented method for defect analysis is provided. The computer-implemented method includes obtaining a plurality of sets of defect point coordinates, a respective set of the plurality of sets of detect point coordinates including coordinates of defect points in a respective substrate of a plurality of substrates, the coordinates of defect points in the respective substrate being coordinates in an image coordinate system; combining the plurality of sets of defect point coordinates according to the image coordinate system into a composite set of coordinates to generate a composite image; and performing a clustering analysis to classify defect points in the composite set in the composite image into a plurality of clusters.

Claims (146)

1. A computer-implemented method for defect analysis, comprising:

obtaining a plurality of sets of defect point coordinates, a respective set of the plurality of sets of defect point coordinates comprising coordinates of defect points in a respective substrate of a plurality of substrates, the coordinates of defect points in the respective substrate being coordinates in an image coordinate system;

combining the plurality of sets of defect point coordinates according to the image coordinate system into a composite set of coordinates to generate a composite image;

performing a clustering analysis to classify defect points in the composite set in the composite image into a plurality of clusters

determining a plurality of contours respectively of at least a plurality of selected clusters of the plurality of clusters, a respective one of the plurality of contours comprising a plurality of edge defect points in a respective one of the plurality of selected clusters;

applying a fitting algorithm to edge defect points of the plurality of selected clusters to generate a plurality of mask areas respectively corresponding to the plurality of selected clusters; and

generating a plurality of feature vectors respectively of the plurality of mask areas.

2. The computer-implemented method of claim 1 , further comprising obtaining a plurality of selected clusters from the plurality of clusters;

wherein a number of defect points in each of the plurality of selected clusters is greater than a threshold number.

3. The computer-implemented method of claim 1 , wherein generating the plurality of feature vectors comprises:

generating Hu geometric moment m i,j and center-to-center distance M i,j of a respective one of the plurality of mask areas, wherein m i,j =Σ (x,y)∈A x i y j ;

calculating defect point density p, area a, center of mass O (O x , O y ), and direction θ of the respective one of the plurality of mask areas; and

generating a respective one of the plurality of feature vectors for the respective one of the plurality of mask areas.

4. The computer-implemented method of claim 3 , wherein a respective one of the plurality of feature vectors is expressed as:

F=[ρ,a,Ox,Oy,θ,L,W,r] T ;

wherein

ρ

=

N

a

,

 N stands tor a number of defect points in the respective one of the plurality of mask areas, a stands for an area of the respective one of the plurality of mask areas;

O

x

=

m

10

a

;

⁢

O

y

=

m

01

a

;

⁢

θ

=

-

0.5

⁢

atc

⁢

tan

⁡

(

2

⁢

M

11

M

02

-

M

20

)

;

⁢

M

ij

=

∑

(

x

,

y

)

∈

𝒜

(

x

-

O

x

)

i

⁢

(

y

-

O

y

)

j

;

⁢

r

=

L

W

;;

L stands for a length of a minimal external rectangle of the respective one of the plurality of mask areas; and

W stands for a width of a minimal external rectangle of the respective one of the plurality of mask areas.

5. The computer-implemented method of claim 1 , wherein the plurality of contours are determined using an alpha shapes-based method.

6. The computer-implemented method of claim 1 , further comprising:

assigning one or more selected mask areas of the plurality of mask areas as a plurality of defect aggregation areas;

wherein feature vectors respectively of the one or more selected mask areas satisfy a threshold condition.

7. The computer-implemented method of claim 6 , further comprising:

comparing parameters of first defect points inside the one or more selected mask areas with parameters of second defect points outside the one or more selected mask areas; and

identifying potential devices that causes first defect points based on comparing.

8. The computer-implemented method of claim 1 , further comprising:

obtaining a plurality of sets of substrate defect point coordinates, a respective one of the plurality of sets of substrate defect point coordinates comprising coordinates of substrate defect points in a respective substrate, the coordinates of substrate defect points in the respective substrate being coordinates in a substrate coordinate system; and

converting the coordinates of the substrate defect points in the substrate coordinate system into the coordinates of the defect points in the image coordinate system.

9. The computer-implemented method of claim 1 , wherein obtaining the plurality of sets of defect point coordinates comprises:

obtaining a plurality of sets of raw defect point coordinates; and

selecting, from the plurality of sets of raw defect point coordinates, sets of defect point coordinates comprising more than a threshold number of defect point coordinates as the plurality of sets of defect point coordinates.

10. The computer-implemented method of claim 1 , wherein the clustering analysis is performed using a hierarchical clustering method.

11. The computer-implemented method of claim 10 , wherein the hierarchical clustering method is a single linkage clustering method.

12. The computer-implemented method of claim 1 , wherein a Euclidean distance between adjacent defect points in a respective one of the plurality of clusters being equal to or less than a threshold value, a Euclidean distance between any two defect points respectively from two of the plurality of clusters being greater than the threshold value.

13. An apparatus for defect analysis, comprising:

a memory;

one or more processors;

wherein the memory and the one or more processors are connected with each other; and

the memory stores computer-executable instructions for controlling the one or more processors to:

obtain a plurality of sets of defect point coordinates, a respective set of the plurality of sets of defect point coordinates comprising coordinates of defect points in a respective substrate of a plurality of substrates, the coordinates of defect points in the respective substrate being coordinates in an image coordinate system;

combine the plurality of sets of defect point coordinates according to the image coordinate system into a composite set of coordinates to generate a composite image;

perform a clustering analysis to classify defect points in the composite set in the composite image into a plurality of clusters;

determine a plurality of contours respectively of at least a plurality of selected clusters of the plurality of clusters, a respective one of the plurality of contours comprising a plurality of edge defect points in a respective one of the plurality of selected clusters;

apply a fitting algorithm to edge defect points of the plurality of selected clusters to generate a plurality of mask areas respectively corresponding to the plurality of selected clusters; and

generate a plurality of feature vectors respectively of the plurality of mask areas.

14. The apparatus of claim 13 , wherein the memory further stores computer-executable instructions for controlling the one or more processors to:

generate Hu geometric moment m i,j and center-to-center distance M i,j of a respective one of the plurality of mask areas, wherein m i,j =Σ (x,y)∈A x i y j ;

calculate defect point density p, area a, center of mass O (O x , O y ) and direction θ of the respective one of the plurality of mask areas; and

generate a respective one of the plurality of feature vectors for the respective one of the plurality of mask areas.

15. A computer-program product comprising a non-transitory tangible computer-readable medium having computer-readable instructions thereon, the computer-readable instructions being executable by a processor to cause the processor to perform:

obtaining a plurality of sets of defect point coordinates, a respective set of the plurality of sets of defect point coordinates comprising coordinates of defect points in a respective substrate of a plurality of substrates, the coordinates of defect points in the respective substrate being coordinates in an image coordinate system;

combining the plurality of sets of defect point coordinates according to the image coordinate system into a composite set of coordinates to generate a composite image; and

performing a clustering analysis to classify defect points in the composite set in the composite image into a plurality of clusters;

determining a plurality of contours respectively of at least a plurality of selected clusters of the plurality of clusters, a respective one of the plurality of contours comprising a plurality of edge defect points in a respective one of the plurality of selected clusters;

applying a fitting algorithm to edge defect points of the plurality of selected clusters to generate a plurality of mask areas respectively corresponding to the plurality of selected clusters; and

generating a plurality of feature vectors respectively of the plurality of mask areas.

16. The computer-program product of claim 15 , wherein the computer-readable instructions are further executable by a processor to cause the processor to perform:

generating Hu geometric moment m i,j and center-to-center distance M i,j of a respective one of the plurality of mask areas, wherein m i,j =Σ (x,y)∈A x i y j ;

calculating defect point density p, area a, center of mass O (O x , O y ), and direction θ of the respective one of the plurality of mask areas; and

generating a respective one of the plurality of feature vectors for the respective one of the plurality of mask areas.

17. An intelligent defect analysis system, comprising:

a distributed computing system comprising one or more networked computers configured to execute in parallel to perform at least one common task;

one or more computer readable storage mediums storing instructions that, when executed by the distributed computing system, cause the distributed computing system to execute software modules;

wherein the software modules comprise:

a data manager configured to store data, and intelligently extract, transform, or load the data;

a query engine connected to the data manager and configured to query the data directly from the data manager;

an analyzer connected to the query engine and configured to perform defect analysis upon received a task request, the analyzer comprising a plurality of business servers and a plurality of algorithm servers, the plurality of algorithm servers configured to query the data directly from the data manager; and

a data visualization and interaction interface configured to generate the task requests;

wherein one or more of the plurality of algorithm servers is configured to perform the computer-implemented method of claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2022
From: WANG, HAIJIN; ZENG, JIANFENG
To: BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 058817/0720 →
Continuity (1)
Related Publication 20220405909A1 · Dec 22, 2022