IP Library › Granted Patent US 12,632,947
Granted Patent B2
US 12,632,947 · App. 18/397,542 · Granted May 19, 2026

Method for detecting surface defect and apparatus thereof

Inventors: Jin Kyu Gahm (Busan, KR); Il Hae Yu (Busan, KR); Won June Choi (Busan, KR)
Assignee: Pusan National University Industry—University Cooperation Foundation
G06T7/0004G06T2207/20081G06T2207/20084G06T2207/30136
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,632,947
App. No.
18/397,542
Granted
May 19, 2026
Kind
B2
Abstract

Provided is a method of detecting a surface defect. The method includes acquiring a target image, detecting at least one defect area from the target image, generating a first defect matrix having a size corresponding to the target image and an element that is a first defect score calculated based on the number of defect areas, calculating a plurality of second defect scores by summing first defect scores in a range corresponding to a predetermined reference window in the first defect matrix, and extracting an image corresponding to the reference window from the target image based on the second defect score and generating a defect image.

Claims (34)

1 . A method of detecting a surface defect, the method comprising:

acquiring a target image;

detecting at least one defect area from the target image;

generating a first defect matrix having a size corresponding to the target image, wherein the first defect matrix has a plurality of elements, and each of the plurality of elements is a first defect score calculated based on a number of the at least one defect area detected from the target image at a position corresponding to each element;

calculating a plurality of second defect scores while moving a predetermined reference window with respect to the first defect matrix, wherein each second defect score is a sum of the first defect scores of the first defect matrix corresponding to the predetermined reference window, and the predetermined reference window is a virtual area with a predetermined size; and

generating a defect image by extracting, from the target image, an image corresponding to a position of the predetermined reference window with a largest second defect scores.

2 . The method of claim 1 , further comprising inputting the defect image as input data into a network function and generating surface defect information,

wherein the network function is trained to output the surface defect information using an image with a size corresponding to the predetermined reference window as input data.

3 . The method of claim 1 , further comprising generating a second defect matrix by applying a standard deviation for each local area of the target image to the first defect matrix,

wherein the calculating of the plurality of second defect scores is performed on the second defect matrix with which the first defect matrix is replaced, and

wherein the applying the standard deviation includes generating a standard deviation matrix by calculating the standard deviation for each local area of the target image, and combining the first defect matrix with the standard deviation matrix.

4 . The method of claim 3 , wherein the generating of the second defect matrix includes generating a standard deviation matrix by calculating the standard deviation for each the local area from the target image and summing weights of the first defect matrix and the standard deviation matrix,

wherein the summing of the weights of the first defect matrix and the standard deviation matrix includes: multiplying the first defect matrix by a first weight to obtain a first product, multiplying the standard deviation matrix by a second weight to obtain a second product, and summing the first product and the second product.

5 . The method of claim 3 , further comprising generating a third defect matrix by removing an element corresponding to a non-defect area from the second defect matrix,

wherein the calculating of the plurality of second defect scores is performed on the third defect matrix with which the second defect matrix is replaced, and

wherein the removing the element corresponding to the non-defect area from the second defect matrix is performed by an AND operation on a non-defect matrix and the first defect matrix, the non-defect matrix having the size corresponding to the target image and representing at least one of background and padding from the target image.

6 . The method of claim 3 , wherein the detecting of the defect area includes generating boundary value information from the target image, generating boundary direction information from the target image, selecting a boundary value information which is greater than or equal to a predetermined critical value based on the boundary value information and the boundary direction information, and detecting the defect area based on the selected boundary value information and corresponding boundary direction information.

7 . The method of claim 1 , wherein the detecting of the at least one defect area, the generating of the first defect matrix, the calculating of the plurality of second defect scores, and the generating of the defect image are performed when at least one of a horizontal size and a vertical size of the target image is larger than that of the predetermined reference window.

8 . The method of claim 1 , further comprising adding padding to a periphery of the target image so that the target image corresponds to the predetermined reference window when at least one of a horizontal size and a vertical size of the target image is smaller than that of the predetermined reference window.

9 . A computer program stored in a non-transitory recording medium to execute the method of claim 1 .

10 . An apparatus for detecting a surface defect, the apparatus comprising:

a memory storing a program for detecting a surface defect; and

a processor configured to:

acquire a target image,

detect at least one defect area from the target image,

generate a first defect matrix having a size corresponding to the target image, wherein the first defect matrix has a plurality of elements, and each of the plurality of elements is a first defect score calculated based on a number of defect areas detected from the target image at a position corresponding to each element,

calculate a plurality of second defect scores while moving a predetermined reference window with respect to the first defect matrix, wherein each second defect score is a sum of the first defect scores of the first defect matrix corresponding to the predetermined reference window, and the predetermined reference window is a virtual area with a predetermined size, and

generate a defect image by extracting, from the target image, an image corresponding to a position of the predetermined reference window with a largest second defect score.

11 . The apparatus of claim 10 , wherein the processor is further configured to generate a second defect matrix by applying a standard deviation for each local area of the target image to the first defect matrix, and

calculate the plurality of second defect scores using the second defect matrix with which the first defect matrix is replaced,

wherein the applying the standard deviation includes generating a standard deviation matrix by calculating the standard deviation for each local area of the target image, and combining the first defect matrix with the standard deviation matrix.

12 . The apparatus of claim 11 , wherein the processor is further configured to generate a third defect matrix by removing an element corresponding to a non-defect area from the second defect matrix, and

calculate the plurality of second defect scores using the third defect matrix with which the second defect matrix is replaced,

wherein the third defect matrix is generated by generating a non-defect matrix having a size corresponding to the target image and representing at least one of background and padding from the target image, and performing an AND operation on the non-defect matrix and the first defect matrix to remove the element corresponding to the non-defect area from the second defect matrix.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2023
From: GAHM, JIN KYU; YU, IL HAE; CHOI, WON JUNE
To: PUSAN NATIONAL UNIVERSITY INDUSTRY-UNIVERSITY COOPERATION FOUNDATION
Reel/Frame 065963/0275 →
Priority Claims (1)
KR 10-2023-0189365 · Dec 22, 2023 · national
Continuity (1)
Related Publication 20250209595A1 · Jun 26, 2025
References Cited (22)
US 7646906B2 · Saidin · 2010 [cited by examiner]
US 7835565B2 · Cai · 2010 [cited by examiner]
US 8611639B2 · Kulkarni · 2013 [cited by examiner]
US 12320756B2 · Ono · 2025 [cited by examiner]
US 20190096057A1 · Allen et al. · 2019 [cited by applicant]
US 20200160083A1 · Zhu et al. · 2020 [cited by applicant]
US 20200364906A1 · Shimodaira · 2020 [cited by applicant]
US 20230021099A1 · Becher · 2023 [cited by examiner]
US 20230206420A1 · Wang, Sr. · 2023 [cited by examiner]
US 20250124307A1 · Yahalom · 2025 [cited by examiner]
CN 111242899A · 2020 [cited by applicant]
CN 111402236A · 2020 [cited by examiner]
CN 114170208A · 2022 [cited by applicant]
CN 116012370A · 2023 [cited by examiner]
CN 112184667B · 2025 [cited by examiner]
EP 4579225A1 · 2025 [cited by examiner]
JP H08189904A · 1996 [cited by applicant]
Li et al. “Application of Machine Learning Algorithms in Cold-Rolled Strip Steel Surface Defect Grading Systems.” 28th International Conference on Automation and Computing (ICAC) (pp. 1-6) IEEE (Year: 2023). [cited by examiner]
Qiao et al. “A Review of Metal Surface Defect Detection Technologies in Industrial Applications.” IEEE Access (Year: 2025). [cited by examiner]
The extended European search report and opinion dated Jun. 25, 2024 in EP Application No. 23220331 (Year: 2024). [cited by examiner]
JPO Reasons for Refusal in application No. JP 2023-218529 dated Apr. 15, 2025 (Year: 2025). [cited by examiner]
JPO Written Opinion in application No. JP 2023-218529 dated Jul. 14, 2025 (Year: 2025). [cited by examiner]