IP Library Granted Patent US 12,322,132
Granted Patent B2
US 12,322,132 · App. 18/524,990 · Granted Jun 3, 2025

Machine vision detection method, detection apparatus and detection system thereof

Inventors: Yinhang Tu (Ningde, CN); Yifei Gao (Ningde, CN)
Assignee: CONTEMPORARY AMPEREX TECHNOLOGY (HONG KONG) LIMITED
G06T7/73G06T3/06G06T7/0004G06T7/60G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,132
App. No.
18/524,990
Granted
Jun 3, 2025
Kind
B2
Abstract

A machine vision detection method includes receiving a three-dimensional image from a line laser, converting the three-dimensional image into a two-dimensional grayscale image, obtaining a boundary of a first component and a boundary of a second component in the two-dimensional grayscale image, determining N perpendicular lines between the boundary of the first component and the boundary of the second component, and calculating an average length of the N perpendicular lines as a gap between the first component and the second component. The three-dimensional image includes at least a portion of the boundary of the first component, at least a portion of the boundary of the second component, and a welding spot located on the boundary of the first or second component. N is a positive integer.

Claims (50)

1. A machine vision detection method, comprising:

receiving a three-dimensional image from a line laser, the three-dimensional image comprising: at least a portion of a boundary of a first component, at least a portion of a boundary of a second component, and a welding spot located on the boundary of the first component or the boundary of the second component;

converting the three-dimensional image into a two-dimensional grayscale image;

obtaining the boundary of the first component and the boundary of the second component in the two-dimensional grayscale image;

generating N perpendicular lines between the boundary of the first component and the boundary of the second component, where N is a positive integer between 20 and 50; and

calculating an average length of the N perpendicular lines as a gap between the first component and the second component;

wherein obtaining the boundary of the first component and the boundary of the second component in the two-dimensional grayscale image comprises:

arranging, in a boundary area including the boundary of the first component, N first fitting units equally dividing the boundary area;

sequentially connecting intersection points each between one of the first fitting units and the boundary of the first component to form a first straight line fitted to the boundary of the first component;

arranging, in a boundary area including the boundary of the second component, N second fitting units equally dividing the boundary area; and

sequentially connecting intersection points each between one of the second fitting units and the boundary of the second component to form a second straight line fitted to the boundary of the second component.

2. The method according to claim 1 , wherein generating the N perpendicular lines between the boundary of the first component and the boundary of the second component comprises:

determining intersection points between the N first fitting units and the boundary of the first component as first set points, and generating the N perpendicular lines perpendicular to the second straight line by taking the first set points as starting points, respectively; or

determining intersection points between the N second fitting units and the boundary of the second component as second set points, and generating the N perpendicular lines perpendicular to the first straight line by taking the second set points as starting points, respectively.

3. The method according to claim 1 , further comprising:

extracting a third straight line and a fourth straight line respectively fitted to two side boundaries of the welding spot in the two-dimensional grayscale image;

determining a first tangent point where the third straight line is tangent to the welding and the second side boundary of the welding spot as the second tangent point.

4. The method according to claim 3 , wherein extracting the third straight line and the fourth straight line respectively fitted to the two side boundaries of the welding spot in the two-dimensional grayscale image comprises:

arranging, in a boundary area including the first side boundary of the welding spot, M third fitting units equally dividing the boundary area, where M is a positive integer between 30 and 50;

sequentially connecting intersection points each between one of the third fitting units and the first side boundary of the welding spot to form the third straight line;

arranging, in a boundary area including the second side boundary of the welding spot, M fourth fitting units equally dividing the boundary area respectively;

sequentially connecting intersection points each between one of the fourth fitting units and the second side boundary of the welding spot to form the fourth straight line.

5. The method according to claim 4 , wherein determining the first tangent point where the third straight line is tangent to the welding spot and the second tangent point where the fourth straight line is tangent to the welding spot comprises:

taking the intersection point between the last third fitting unit on the third straight line and the first side boundary of the welding spot as the first tangent point; and

taking the intersection point between the last fourth fitting unit on the fourth straight line

arranging, in a boundary area including the boundary of the first component, N first fitting units equally dividing the boundary area;

sequentially connecting intersection points each between one of the first fitting units and the boundary of the first component to form a first straight line fitted to the boundary of the first component;

arranging, in a boundary area including the boundary of the second component, N second fitting units equally dividing the boundary area; and

sequentially connecting intersection points each between one of the second fitting units and the boundary of the second component to form a second straight line fitted to the boundary of the second component;

generating N perpendicular lines between the boundary of the first component and the boundary of the second component, where N is a positive integer between 20 and 50; and

calculating an average length of the N perpendicular lines as a gap between the first component and the second component.

6. The method according to claim 4 , wherein determining the first tangent point where the third straight line is tangent to the welding spot and the second tangent point where the fourth straight line is tangent to the welding spot comprises:

taking an intersection point between the third straight line and the first straight line as the first tangent point; and

taking an intersection point between the fourth straight line and the first straight line as the second tangent point.

7. A non-volatile computer storage medium, storing computer program instructions that, when executed by a processor, cause the processor to perform the method according to claim 1 .

8. An electronic device, comprising:

a processor; and

a memory communicatively connected with the processor and storing computer program instructions that, when executed by the processor, cause the processor to perform a machine vision detection method comprising:

receiving a three-dimensional image from a line laser, the three-dimensional image comprising: at least a portion of a boundary of a first component, at least a portion of a boundary of a second component, and a welding spot located on the boundary of the first component or the boundary of the second component;

converting the three-dimensional image into a two-dimensional grayscale image;

obtaining the boundary of the first component and the boundary of the second component in the two-dimensional grayscale image, comprising:

spot and a second tangent point where the fourth straight line is tangent to the welding spot; and

calculating a distance between the first tangent point and the second tangent point as a width of the welding spot.

9. A machine vision detection apparatus, comprising:

a receiving module configured to receive a three-dimensional image from a line laser, the three-dimensional image comprising: at least a portion of a boundary of a first component, at least a portion of a boundary of a second component, and a welding spot located on the boundary of the first component or the boundary of the second component;

a conversion module configured to convert the three-dimensional image into a two-dimensional grayscale image;

a fitting module configured to obtain the boundary of the first component and the boundary of the second component in the two-dimensional grayscale image, comprising:

arranging, in a boundary area including the boundary of the first component, N first fitting units equally dividing the boundary area, where N is a positive integer between 20 and 50; and

arranging, in a boundary area including the boundary of the second component, N second fitting units equally dividing the boundary area; and

a gap calculation module configured to determine N perpendicular lines between the boundary of the first component and the boundary of the second component and calculate an average length of the N perpendicular lines as a gap between the first component and the second component.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2024
From: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
To: CONTEMPORARY AMPEREX TECHNOLOGY (HONG KONG) LIMITED
Reel/Frame 068338/0402 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2023
From: TU, YINHANG; GAO, YIFEI
To: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
Reel/Frame 065720/0711 →
Continuity (2)
Continuation PCTCN2021142250 · Dec 29, 2021
Related Publication 20240095949A1 · Mar 21, 2024
References Cited (13)
CN 10948956A · 2019 [cited by applicant]
CN 110530278A · 2019 [cited by examiner]
CN 111630342A · 2020 [cited by applicant]
CN 111901499A · 2020 [cited by applicant]
CN 112053376A · 2020 [cited by applicant]
CN 116772723A · 2023 [cited by applicant]
DE 102014016087A1 · 2014 [cited by applicant]
EP 2495525A1 · 2012 [cited by examiner]
JP 2014035656A · 2014 [cited by applicant]
The European Patent Office (EPO) The Extended European Search Report for Application No. 21969381.9 11 Pages. [cited by applicant]
The European Patent Office (EPO) The Partial Supplementary European Search Report for Application No. 21969381.9 Apr. 18, 2024 14 Pages. [cited by applicant]
The Japan Patent Office (JPO) Notification of Reasons for Refusal for Application No. 2023-553313 Jun. 18, 2024 8 Pages (with translation). [cited by applicant]
The World Intellectual Property Organization (WIPO) International Search Report and Written Opinion for PCT/CN2021/142250 Jul. 27, 2022 15 pages (including English translation). [cited by applicant]