IP Library › Granted Patent US 12,251,773
Granted Patent B2
US 12,251,773 · App. 17/319,670 · Granted Mar 18, 2025

Systems and methods for identifying missing welds using machine learning techniques

Inventor: Stephen Paul Ivkovich (Hanover, MI)
Assignee: ILLINOIS TOOL WORKS INC.
B23K26/032B23K31/125G06N3/08G06T7/0008G06T2207/20081G06T2207/20084G06T2207/30164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,251,773
App. No.
17/319,670
Granted
Mar 18, 2025
Kind
B2
Abstract

Systems and methods for missing weld identification using machine learning techniques are described. In some examples, a part tracking system uses machine learning techniques to identify whether an operator has missed one or more welds when assembling a part. The part tracking system may additionally identify which specific welds were missed (e.g., the first weld, the third weld, the fifteenth weld, etc.). The part tracking system may be able to identify missing welds after a part has been completed, or in real-time, during assembly of the part. Identification of the particular weld(s) missed during the welding process can help an operator quickly assess and resolve any issues with the part being assembled, saving time and ensuring quality.

Claims (47)

1. A system, comprising:

processing circuitry; and

memory circuitry comprising computer readable instructions which, when executed, cause the processing circuitry to:

identify an initial weld of a part assembly process,

access one or more first feature characteristics of the initial weld,

access a typical part model representative of a part produced by the part assembly process with all required welds,

determine whether the part includes an initial required weld based on a comparison of at least some of the first feature characteristics of the initial weld with at least some first typical feature characteristics associated with an initial typical weld of the typical part model, and

in response to determining that the part does not include the initial required weld, disable one or more pieces of welding equipment involved in the part assembly process.

2. The system of claim 1 , wherein one or more machine learning techniques are used to determine whether the part includes the initial required weld.

3. The system of claim 1 , wherein the memory circuitry further comprises computer readable instructions which, when executed, cause the processing circuitry to:

in response to determining that the part does not include the initial required weld, output a notification.

4. The system of claim 1 , wherein accessing the typical part model comprises generating the typical part model using a collection of typical feature characteristics associated with welds that were used previously to create the part.

5. The system of claim 1 , wherein the typical part model comprises a neural net, a statistical model, or a data set collection.

6. The system of claim 1 , wherein the initial weld occurs first in time after a start of the part assembly process, and before any other weld in the part assembly process.

7. The system of claim 6 , wherein the memory circuitry further comprises computer readable instructions which, when executed, cause the processing circuitry to identify the start of the part assembly process based on data received from one or more sensors, a user interface, welding equipment, or a welding robot.

8. The system of claim 1 , wherein the memory circuitry further comprises computer readable instructions which, when executed, cause the processing circuitry to:

in response to determining that the part does include the initial required weld:

identify a subsequent weld of the welding assembly process, wherein one or more second feature characteristics are associated with the subsequent weld, and

determine whether the part includes a subsequent required weld based on a comparison of at least some of the second feature characteristics with at least some second typical feature characteristics associated with a subsequent typical weld of the typical part model.

9. The system of claim 1 , wherein the memory circuitry further comprises computer readable instructions which, when executed, cause the processing circuitry to:

in response to determining that the part does not include the initial required weld:

access one or more missing weld part models, each of the one or more missing weld part models being representative of the part with one or more missing welds,

determine an analogous missing weld part model of the one or more missing weld part models that is most similar to the part using one or more machine learning techniques, and

output a notification, wherein the notification is representative of the one or more missing welds of the analogous missing weld part model.

10. The system of claim 9 , wherein each initial model weld of each missing weld part model of the one or more missing weld part models is associated with one or more first model feature characteristics, and the analogous missing weld part model is determined via a comparison of at least some of the one or more first feature characteristics associated with the initial weld with at least some of one or more first model feature characteristics associated with each initial model weld.

11. A method, comprising:

identifying, via processing circuitry, an initial weld of a part assembly process;

accessing one or more first feature characteristics of the initial weld;

accessing a typical part model representative of a part produced by the part assembly process with all required welds;

determining, via the processing circuitry, whether the part includes an initial required weld based on a comparison of at least some of the first feature characteristics of the initial weld with at least some first typical feature characteristics associated with an initial typical weld of the typical part model; and

in response to determining that the part does not include the initial required weld, disabling one or more pieces of welding equipment involved in the part assembly process.

12. The method of claim 11 , wherein one or more machine learning techniques are used to determine whether the part includes the initial required weld.

13. The method of claim 11 , further comprising outputting a notification in response to determining that the part does not include the initial required weld.

14. The method of claim 11 , wherein accessing the typical part model comprises generating the typical part model using a collection of typical feature characteristics associated with welds that were used previously to create the part.

15. The method of claim 11 , wherein the typical part model comprises a neural net, a statistical model, or a data set collection.

16. The method of claim 11 , wherein the initial weld occurs first in time after a start of the part assembly process, and before any other weld in the part assembly process.

17. The method of claim 16 , further comprising identifying the start of the part assembly process, based on data received from one or more sensors, welding equipment, a welding robot, or a user interface.

18. The method of claim 11 , further comprising:

in response to determining that the part does include the initial required weld:

identifying a subsequent weld of the welding assembly process, wherein one or more second feature characteristics are associated with the subsequent weld; and

determining whether the part includes a subsequent required weld based on a comparison of at least some of the second feature characteristics with at least some second typical feature characteristics associated with a subsequent typical weld of the typical part model.

19. The method of claim 11 , further comprising:

in response to determining that the part does not include the initial required weld:

accessing one or more missing weld part models, each of the one or more missing weld part models being a modified version of the typical part model representative of the part with one or more missing welds; and

determining an analogous missing weld part model of the one or more missing weld part models that is most similar to the part using one or more machine learning techniques, and

outputting a notification, wherein the notification is representative of the one or more missing welds of the analogous missing weld part model.

20. The method of claim 19 , wherein each initial model weld of each missing weld part model of the one or more missing weld part models is associated with one or more first model feature characteristics, and the analogous missing weld part model is determined via a comparison of at least some of the one or more first feature characteristics associated with the initial weld with at least some of one or more first model feature characteristics associated with each initial model weld.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2021
From: IVKOVICH, STEPHEN PAUL
To: ILLINOIS TOOL WORKS INC.
Reel/Frame 056366/0017 →
Continuity (2)
Provisional Application 63057388 · Jul 28, 2020
Related Publication 20220032397A1 · Feb 3, 2022
References Cited (137)
US 4375026A · Kearney · 1983 [cited by applicant]
US 5221825A · Siewert · 1993 [cited by applicant]
US 5714734A · Peterson et al. · 1998 [cited by applicant]
US 5756967A · Quinn et al. · 1998 [cited by applicant]
US 6362456B1 · Ludewig · 2002 [cited by applicant]
US 6484584B2 · Johnson et al. · 2002 [cited by applicant]
US 6583386B1 · Ivkovich · 2003 [cited by applicant]
US 6624388B1 · Blankenship et al. · 2003 [cited by applicant]
US 6636776B1 · Barton et al. · 2003 [cited by applicant]
US 6795778B2 · Dodge et al. · 2004 [cited by applicant]
US 6815640B1 · Spear et al. · 2004 [cited by applicant]
US 7159753B2 · Subrahmanyam · 2007 [cited by applicant]
US 7375304B2 · Kainec et al. · 2008 [cited by applicant]
US 7574172B2 · Clark et al. · 2009 [cited by applicant]
US 7643890B1 · Hillen et al. · 2010 [cited by applicant]
US 7687741B2 · Kainec et al. · 2010 [cited by applicant]
US 7772524B2 · Hillen et al. · 2010 [cited by applicant]
US 7873495B2 · Lindell · 2011 [cited by applicant]
US 8224881B1 · Spear et al. · 2012 [cited by applicant]
US 8274013B2 · Wallace · 2012 [cited by applicant]
US 8354614B2 · Ma · 2013 [cited by applicant]
US 8355805B2 · Ricket · 2013 [cited by applicant]
US 8592723B2 · Davidson et al. · 2013 [cited by applicant]
US 8657605B2 · Wallace · 2014 [cited by applicant]
US 8847115B2 · Casner et al. · 2014 [cited by applicant]
US 9193004B2 · Enyedy et al. · 2015 [cited by applicant]
US 9266182B2 · Hung · 2016 [cited by applicant]
US 9321133B2 · Fischer et al. · 2016 [cited by applicant]
US 9415514B2 · Geheb et al. · 2016 [cited by applicant]
US 9449498B2 · Dina et al. · 2016 [cited by applicant]
US 9481045B2 · Spear · 2016 [cited by applicant]
US 9498839B2 · Hillen et al. · 2016 [cited by applicant]
US 9514421B2 · Mullin · 2016 [cited by applicant]
US 9665093B2 · Amers et al. · 2017 [cited by applicant]
US 9669484B2 · Holverson et al. · 2017 [cited by applicant]
US 9684303B2 · Lamers et al. · 2017 [cited by applicant]
US 9704140B2 · Lamers et al. · 2017 [cited by applicant]
US 9724787B2 · Becker et al. · 2017 [cited by applicant]
US 9773429B2 · Boulware · 2017 [cited by applicant]
US 9821400B2 · Hillen et al. · 2017 [cited by applicant]
US 9836994B2 · Kindig et al. · 2017 [cited by applicant]
US 9862048B2 · Holverson et al. · 2018 [cited by applicant]
US 9862049B2 · Becker · 2018 [cited by applicant]
US 9889517B2 · Lambert et al. · 2018 [cited by applicant]
US 9937577B2 · Daniel · 2018 [cited by applicant]
US 9937578B2 · Becker et al. · 2018 [cited by applicant]
US 9965973B2 · Peters et al. · 2018 [cited by applicant]
US 9975196B2 · Zhang et al. · 2018 [cited by applicant]
US 9993890B2 · Denis et al. · 2018 [cited by applicant]
US 10010959B2 · Daniel · 2018 [cited by applicant]
US 10012962B2 · Lamers et al. · 2018 [cited by applicant]
US 10032388B2 · Sommers et al. · 2018 [cited by applicant]
US 10065260B2 · Hutchison · 2018 [cited by applicant]
US 10099308B2 · Vogel · 2018 [cited by applicant]
US 10144080B2 · Chantry et al. · 2018 [cited by applicant]
US 10183351B2 · Peters · 2019 [cited by applicant]
US 10204406B2 · Becker et al. · 2019 [cited by applicant]
US 10213862B2 · Holverson et al. · 2019 [cited by applicant]
US 10242317B2 · Barhorst et al. · 2019 [cited by applicant]
US 10688584B2 · Starzengruber · 2020 [cited by applicant]
US 10722969B2 · Ulrich · 2020 [cited by applicant]
US 11103948B2 · Holverson · 2021 [cited by applicant]
US 11347191B2 · Hsu · 2022 [cited by applicant]
US 20060169682A1 · Kainec et al. · 2006 [cited by applicant]
US 20080124968A1 · Kirk · 2008 [cited by applicant]
US 20090173726A1 · Davidson et al. · 2009 [cited by applicant]
US 20100152554A1 · Steine et al. · 2010 [cited by applicant]
US 20120248081A1 · Hutchison · 2012 [cited by applicant]
US 20130075380A1 · Albrech et al. · 2013 [cited by applicant]
US 20130105556A1 · Abell · 2013 [cited by applicant]
US 20130178953A1 · Wersborg · 2013 [cited by applicant]
US 20130189658A1 · Peters · 2013 [cited by applicant]
US 20130212512A1 · Frenz · 2013 [cited by applicant]
US 20140047107A1 · Maturana · 2014 [cited by applicant]
US 20140131320A1 · Hearn et al. · 2014 [cited by applicant]
US 20140332514A1 · Holverson et al. · 2014 [cited by applicant]
US 20140337429A1 · Asenjo · 2014 [cited by applicant]
US 20150069112A1 · Abou-Nasr et al. · 2015 [cited by applicant]
US 20170032281A1 · Hsu · 2017 [cited by applicant]
US 20170036288A1 · Albrecht · 2017 [cited by applicant]
US 20170072496A1 · Falde et al. · 2017 [cited by applicant]
US 20170072497A1 · Ivkovich · 2017 [cited by applicant]
US 20170185058A1 · Holverson et al. · 2017 [cited by applicant]
US 20180032066A1 · Enyedy et al. · 2018 [cited by applicant]
US 20180178320A1 · Webster · 2018 [cited by applicant]
US 20190019061A1 · Trenholm et al. · 2019 [cited by applicant]
US 20190022787A1 · Daniel · 2019 [cited by applicant]
US 20190084069A1 · Daniel et al. · 2019 [cited by applicant]
US 20190160601A1 · Daniel · 2019 [cited by applicant]
US 20190163172A1 · Daniel et al. · 2019 [cited by applicant]
CA 2356304 · 2001 [cited by applicant]
CN 101193723 · 2008 [cited by applicant]
CN 101329169 · 2008 [cited by applicant]
CN 101374627 · 2009 [cited by applicant]
CN 102528227 · 2012 [cited by applicant]
CN 102596476 · 2012 [cited by applicant]
CN 102922089A · 2013 [cited by applicant]
CN 103331506 · 2013 [cited by applicant]
CN 103846915 · 2014 [cited by applicant]
CN 103862135 · 2014 [cited by applicant]
CN 103874965 · 2014 [cited by applicant]
CN 103909325 · 2014 [cited by applicant]
CN 104379291 · 2015 [cited by applicant]
CN 104520046 · 2015 [cited by applicant]
CN 104551372 · 2015 [cited by applicant]
CN 104768694 · 2015 [cited by applicant]
CN 106104587 · 2016 [cited by applicant]
CN 107154950 · 2017 [cited by applicant]
CN 107155317 · 2017 [cited by applicant]
CN 107635710 · 2018 [cited by applicant]
CN 107848083 · 2018 [cited by applicant]
CN 108027911 · 2018 [cited by applicant]
DE 102009016798A1 · 2010 [cited by applicant]
WO 0109723 · 2001 [cited by applicant]
WO 2012000650 · 2012 [cited by applicant]
WO 2013160745 · 2013 [cited by applicant]
WO 2014149786A1 · 2014 [cited by applicant]
WO 2018080994 · 2018 [cited by applicant]
The welding system of the future is self-learning (2015, Mar. 20) retrieved Apr. 7, 2015 from http://phys.org/news/2015-03-welding-future-self-learning.html. [cited by applicant]
Gundersen, O., et al., The Use of an Integrated Multiple Neural Network Structure for Simultaneous Prediction of Weld Shape, Mechanical Properties, and Distortion in 6063-T6 and 6082-T6 Aluminium Assemblies. [cited by applicant]
Huot, Pierre, The Basics of Weld and Process Monitoring, 20150409, Quality Magazine. [cited by applicant]
Porter, Nancy C., Session 5, Joining Technologies for Naval Applications, FABTECH International & AWS Welding Show, Nov. 13-16, 2015. [cited by applicant]
Zaharia, Matei, et al., Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing, Electrical Engineering and Computer Sciences, University of California at Berkeley, Technical Report … [cited by applicant]
Lu, Huang et al: “Research on Hadoop Cloud Computing Model and its Applications”, Networking and Distributed Computing (ICNDC), 2012 Third International Conference on, IEEE, Oct. 21, 2012 (Oct. 21, 2012), pp. 59-63, XP0… [cited by applicant]
PCT, Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration, in Application No. PCT/US2016/051585, dated Dec. 21, 2016 (12 pag… [cited by applicant]
International Search Report and Written Opinion, mailed Oct. 14, 2016, in International application No. PCT/US2016/044463, filed Jul. 28, 2016. [cited by applicant]
Bao, Yuan et al: “Massive sensor data management framework in Cloud manufacturing based on Hadoop”, Industrial Informatics (INDIN), 2012 10TH IEEE International Conference on, IEEE, Jul. 25, 2012 (Jul. 25, 2012), pp. 39… [cited by applicant]
PCT, Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration, in International application No. PCT/US2016/051579, dated Jan. 10… [cited by applicant]
Canadian Office Action Appln No. 2,996, 182 dated Nov. 5, 2019 (5 pgs.). [cited by applicant]
European Patent Office, Extended Search Report, European Patent Application No. 20161414.6, mailed Aug. 5, 2020, 7 pages. [cited by applicant]
European Patent Office, Extended Search Report, European Patent Application No. 20176044.4, mailed Dec. 17. 2020, 9 pages. [cited by applicant]
European Patent Office, Extended European Search Report, European Patent Application No. 20192803.3, mailed Mar. 10, 2021, 7 pages. [cited by applicant]
Yuan Bao, et al., “Massive Sensor Data Management Framework in Cloud Manufacturing Based on Hadoop”, IEEE, Jul. 25, 2012, pp. 397-401 (Y type reference). [cited by applicant]
European Patent Office, Office Action, No. 20192803.3, mailed Feb. 11, 2022. [cited by applicant]
Ting Wang, Binliang Jiao, Limeng Ji, “A Wireless Sensor Network Design in Oilfield based on STM32W108”, Computer Security, No. 05, May 15, 2011. [cited by applicant]
Le Zhang, Guangzhi Li, Xin Zeng, “Analysis of Factors Affecting Human Reliability”, China Military-Civilian Conversion, No. 03, Mar. 10, 2016. [cited by applicant]
Shuang Zheng, Mingri Zhu, Yue Wang, “Design of Welding Controlled System Power Source Based on Intensive Interference”, Electric Welding Machine, No. 12, Dec. 20, 2008. [cited by applicant]