IP Library Granted Patent US 12,379,717
Granted Patent B2
US 12,379,717 · App. 18/600,258 · Granted Aug 5, 2025

Systems and methods for monitoring and controlling industrial processes

Inventors: Slawek Frackowiak (Fairfax, VA); Leszek Frackowiak (Vienna, VA)
Assignee: Industrial Video Solutions Inc.
G05B19/41875G05B2219/32368
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,379,717
App. No.
18/600,258
Granted
Aug 5, 2025
Kind
B2
Abstract

Aspects of the present invention provide methods, systems, and/or the like for: (1) determining temperature data for at least part of an article of manufacture in a manufacturing process; (2) analyzing the temperature data to identify a first portion of the article of manufacture having a temperature that deviates from a surrounding portion of the first portion, the first portion comprising: at least one hot spot, at least one hot streak, at least one cold spot, or at least one cold streak on the article of manufacture; (3) determining, for the first portion of the article of manufacture, a set of properties related to the temperature: (4) processing the set of properties using at least one of a rules-based model, a machine-learning model, or a classification model to produce a defect classification; and (5) providing an indication of the defect classification for display on a computing device.

Claims (90)

1. A computer-implemented data processing method for identifying and classifying defects in a paper web produced by a manufacturing process, the method comprising:

receiving, by computing hardware, current thermal imaging data for a paper web;

analyzing, by the computing hardware, the thermal imaging data to identify a first portion of the paper web having a temperature that deviates from a surrounding portion of the paper web, the first portion comprising: at least one hot spot, at least one hot streak, at least one cold spot, or at least one cold streak on the paper web;

determining, by the computing hardware for the first portion of the paper web, a set of properties for the first portion of the paper web, the set of properties comprising

a cross-direction location of the first portion having the temperature deviation with respect to an edge of the paper web;

processing, by the computing hardware, the set of properties for the first portion of the paper web using at least one of a rules-based model, a machine-learning model, or a classification model to produce a defect classification for the first portion of the paper web;

generating, by the computing hardware based on the defect classification, a graphical user interface comprising defect map for the paper web, the defect map comprising at least the first portion of the paper web and a visual indication of the defect classification;

providing, by the computing hardware, the graphical user interface for display on a computing device; and

providing, by the computing hardware, the defect classification to at least one of a second machine-learning model or a second rules-based model to cause the second machine-learning model or the second rules-based model to generate a prediction as to an occurrence of a breakage event on the first portion of the paper web based on the defect classification.

2. The method of claim 1 , further comprising:

receiving, by the computing hardware via the graphical user interface, feedback data related to the defect classification; and

responsive to receiving the feedback data, providing the feedback data as training data for one or more of the rules-based model, the machine-learning model, or the classification model.

3. The method of claim 1 , further comprising:

determining, by the computing hardware based on the defect classification, a manufacturing risk for the manufacturing process;

identifying, by the computing hardware based on the manufacturing risk, a corrective action to take in response to the manufacturing risk; and

performing, by the computing hardware, at least a portion of the corrective action.

4. The method of claim 1 , further comprising:

analyzing, by the computing hardware, the thermal imaging data to identify a second portion of the paper web having a second temperature that deviates from the surrounding portion of the paper web;

determining, by the computing hardware for the second portion of the paper web, a second set of properties for the second portion of the paper web, the second set of properties comprising one or more of:

second location data for the second portion of the paper web;

a second temperature of the second portion;

a second shape of the second portion of the paper web;

a second edge uniformity of the second portion of the paper web; or

a second temperature deviation of the second portion with respect to the surrounding portion of the paper web;

processing, by the computing hardware, the second set of properties for the second portion of the paper web using at least one of the rules-based model, the machine-learning model, or the classification model to produce a second defect classification for the second portion of the paper web; and

providing, by the computing hardware, an indication of the second defect classification on a computing device.

5. A system comprising:

a non-transitory computer-readable medium storing instructions; and

a processing device communicatively coupled to the non-transitory computer-readable medium, wherein the processing device is configured to execute the instructions and thereby perform operations comprising:

determining temperature data for at least part of an article of manufacture in a manufacturing process;

analyzing the temperature data to identify a first portion of the article of manufacture having a temperature that deviates from a surrounding portion of the first portion, the first portion comprising: at least one hot spot, at least one hot streak, at least one cold spot, or at least one cold streak on the article of manufacture;

determining, for the first portion of the article of manufacture, a set of properties comprising one or more of:

a temperature of the first portion of the article of manufacture; or

a material type of the article of manufacture;

processing the set of properties for the first portion of the article of manufacture using at least one of a rules-based model, a machine-learning model, or a classification model to produce a defect classification for the first portion of the article of manufacture, the defect classification comprising an identification of a contaminant in the article of manufacture having a thermal property that differs from a thermal property of the article of manufacture; and

providing an indication of the defect classification for display on a computing device; and

providing the defect classification to at least one of a second machine-learning model or a second rules-based model to cause the second machine-learning model or the second rules-based model to generate a prediction as to an occurrence of a breakage event on the first portion of the article of manufacture based on the defect classification.

6. The system of claim 5 , wherein the article of manufacture comprises at least one of:

a paper web;

a non-paper web; or

an extruded material.

7. The system of claim 5 , wherein analyzing the temperature data to identify the first portion of the article of manufacture having a temperature that deviates from a surrounding portion of the first portion comprises:

determining an expected temperature profile for the article of manufacture based on the material type of the article of manufacture; and

identifying the first portion of the article of manufacture having the temperature that deviates from the surrounding portion of the first portion comprises identifying the first portion as an impurity that has a temperature other than the expected temperature.

8. The system of claim 5 , wherein determining the temperature data for the at least part of the article of manufacture in the manufacturing process comprises determining the temperature at at least one of:

during the manufacturing process; or

substantially immediately following the manufacturing process.

9. A computer-implemented data processing method for identifying and classifying potential defects in an article of manufacture, the method comprising:

determining temperature data from thermal imaging data for at least part of an article of manufacture in a manufacturing process;

analyzing, by computing hardware, the temperature data to identify a first portion of the article of manufacture having a temperature that deviates from an expected temperature;

determining, by the computing hardware for the first portion of the article of manufacture, a set of properties for the first portion of the article of manufacture, the set of properties comprising one or more of:

location data for the first portion of the article of manufacture with respect to the article of manufacture;

an absolute temperature of the article of manufacture;

a shape of the first portion of the article of manufacture; or

a temperature deviation of the first portion with respect to the expected temperature;

processing, by the computing hardware, the set of properties for the first portion of the article of manufacture using at least one of a rules-based model, a machine-learning model, or a classification model to produce a defect classification for the first portion of the article of manufacture;

providing, by the computing hardware, an indication of the defect classification for display on a computing device;

providing, by the computing hardware, the defect classification to at least one of a second machine-learning model or a second rules-based model to cause the second machine-learning model or the second rules-based model to generate a prediction as to an occurrence of a breakage event on the first portion of the article of manufacture based on the defect classification.

10. The method of claim 9 , wherein:

the expected temperature is determined based on one or more material properties of the article of manufacture; and

processing the set of properties for the first portion of the article of manufacture using at least one of the rules-based model, the machine-learning model, or the classification model to produce the defect classification for the first portion of the article of manufacture further comprises processing the one or more material properties of the article of manufacture with the set of properties to produce the defect classification for the first portion of the article of manufacture.

11. The method of claim 9 , wherein the article of manufacture comprises at least one of:

a paper web;

a non-paper web;

an extruded material;

a polymer; or

a metal.

12. The method of claim 9 , wherein:

the defect classification includes an indication of a defect concern level;

the method further comprises:

determining, by the computing hardware, an action based on the defect concern level; and

causing, by the computing hardware, performance of the action.

13. The method of claim 12 , wherein the action comprises

reclassifying at least a portion of the article of manufacture from a first type of classification to a second type of classification.

14. The method of claim 12 , further comprising:

identifying additional portions of the article of manufacture having respective temperatures that deviate from the expected temperature over time; and

generating a graphical user interface comprising a defect map comprising a representation of the article of manufacture and an indication of a respective location of each of the additional portions of the article of manufacture.

15. The method of claim 14 , wherein the indication of the defect classification comprises a trend in defects over time determined based on the identified additional portions of the article of manufacture having the respective temperatures that deviate from the expected temperature over time.

16. The method of claim 9 , wherein the set of properties comprise the location data for the first portion of the article of manufacture with respect to the article of manufacture, the shape of the first portion of the article of manufacture, and the temperature deviation of the first portion with respect to the expected temperature.

17. The method of claim 9 , further comprising:

determining, by the computing hardware, second temperature data from second thermal imaging data for the first portion of the article of manufacture in the manufacturing process; and

analyzing, by the computing hardware, the second temperature data and the defect classification to determine a defect origin for the first portion of the article of manufacture in the manufacturing process.

18. The method of claim 1 , further comprising:

responsive to the prediction of the occurrence of the breakage event, facilitating performance of a preventative action, wherein the preventative action comprises at least one of:

modifying an operating parameter of at least one machine component used in the manufacturing process;

activating a cleaning component for manufacturing process;

activating a siren;

generating an alert and transmitting the alert to a computing device; or

at least temporarily ceasing the manufacturing process.

19. The method of claim 18 , further comprising processing the prediction and historical preventative action success data using at least one of a third rules-based model or a third machine-learning model to select the preventative action.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2024
From: FRACKOWIAK, SLAWEK; FRACKOWIAK, LESZEK
To: INDUSTRIAL VIDEO SOLUTIONS INC.
Reel/Frame 066750/0380 →
Continuity (6)
Continuation In Part 18431571 · Feb 2, 2024
Continuation In Part 18212548 · Jun 21, 2023
Continuation In Part 18131926 · Apr 7, 2023
Provisional Application 63470057 · May 31, 2023
Provisional Application 63394805 · Aug 3, 2022
Related Publication 20240255932A1 · Aug 1, 2024
References Cited (134)
US 1338094A · Pope · 1920 [cited by examiner]
US 4988875A · Ortiz · 1991 [cited by examiner]
US 5006722A · Adelson · 1991 [cited by examiner]
US 5233415A · French et al. · 1993 [cited by applicant]
US 5389789A · Nguyen · 1995 [cited by applicant]
US 5862608A · Kotitschke · 1999 [cited by applicant]
US 5942689A · Bonissone et al. · 1999 [cited by applicant]
US 5999636A · Juang · 1999 [cited by applicant]
US 6075590A · Edgar · 2000 [cited by examiner]
US 6135000A · Caspar et al. · 2000 [cited by applicant]
US 6158287A · Satake et al. · 2000 [cited by applicant]
US 6299730B1 · Broek · 2001 [cited by examiner]
US 6362889B1 · Mustonen · 2002 [cited by applicant]
US 6388749B1 · Yamashita et al. · 2002 [cited by applicant]
US 6410916B1 · Jost et al. · 2002 [cited by applicant]
US 6463170B1 · Toivonen et al. · 2002 [cited by applicant]
US 6466877B1 · Chen et al. · 2002 [cited by applicant]
US 6498993B1 · Chen et al. · 2002 [cited by applicant]
US 6519534B2 · Chen et al. · 2003 [cited by applicant]
US 6522978B1 · Chen et al. · 2003 [cited by applicant]
US 6542852B2 · Chen et al. · 2003 [cited by applicant]
US 6615511B2 · Augscheller et al. · 2003 [cited by applicant]
US 6849851B2 · Komulainen et al. · 2005 [cited by applicant]
US 6943913B1 · Jung · 2005 [cited by applicant]
US 7138036B2 · Yamashita et al. · 2006 [cited by applicant]
US 7494567B2 · Haran · 2009 [cited by applicant]
US 7688079B2 · Shioda et al. · 2010 [cited by applicant]
US 7750330B2 · Murata · 2010 [cited by applicant]
US 7934722B2 · Namikawa · 2011 [cited by applicant]
US 8023843B2 · Degruchy et al. · 2011 [cited by applicant]
US 8265498B2 · Fan et al. · 2012 [cited by applicant]
US 8396384B2 · Hayashihara et al. · 2013 [cited by applicant]
US 8477234B2 · Tanigawa et al. · 2013 [cited by applicant]
US 8494384B2 · Furuya et al. · 2013 [cited by applicant]
US 9401015B2 · Minekawa · 2016 [cited by examiner]
US 9838635B2 · Gousev et al. · 2017 [cited by applicant]
US 10552662B2 · Chang et al. · 2020 [cited by applicant]
US 10591285B2 · Ando · 2020 [cited by applicant]
US 10875024B2 · Li et al. · 2020 [cited by applicant]
US 10884401B2 · Valkonen · 2021 [cited by applicant]
US 10946675B2 · Takeishi · 2021 [cited by applicant]
US 11142422B2 · Paanasalo · 2021 [cited by applicant]
US 11231363B2 · Shitara · 2022 [cited by applicant]
US 11297388B2 · Menendez · 2022 [cited by applicant]
US 11816893B1 · Frackowiak · 2023 [cited by examiner]
US 11846930B1 · Frackowiak · 2023 [cited by examiner]
US 11932991B2 · Frackowiak · 2024 [cited by examiner]
US 20020023369A1 · Augscheller · 2002 [cited by examiner]
US 20020052699A1 · Chen · 2002 [cited by examiner]
US 20020066545A1 · Karjanmaa · 2002 [cited by applicant]
US 20020166970A1 · Komulainen · 2002 [cited by examiner]
US 20040112560A1 · Yamashita · 2004 [cited by examiner]
US 20040218795A1 · Zhou · 2004 [cited by examiner]
US 20050079386A1 · Brown et al. · 2005 [cited by applicant]
US 20050094160A1 · Murai et al. · 2005 [cited by applicant]
US 20050167620A1 · Cho · 2005 [cited by examiner]
US 20050169509A1 · Grasslin et al. · 2005 [cited by applicant]
US 20060082763A1 · Teh · 2006 [cited by examiner]
US 20060096726A1 · Ahvenainen et al. · 2006 [cited by applicant]
US 20060102839A1 · Bhaskar · 2006 [cited by examiner]
US 20060143671A1 · Ens et al. · 2006 [cited by applicant]
US 20060196621A1 · Johansson · 2006 [cited by applicant]
US 20060258246A1 · Bomberger et al. · 2006 [cited by applicant]
US 20070058089A1 · Wang · 2007 [cited by applicant]
US 20070137823A1 · Haran · 2007 [cited by examiner]
US 20070200568A1 · Shioda · 2007 [cited by examiner]
US 20070294284A1 · Evans · 2007 [cited by examiner]
US 20080311416A1 · Kelly et al. · 2008 [cited by applicant]
US 20090028416A1 · Floeder · 2009 [cited by examiner]
US 20090028417A1 · Floeder · 2009 [cited by examiner]
US 20090030544A1 · Floeder · 2009 [cited by examiner]
US 20090060316A1 · Ruuska · 2009 [cited by examiner]
US 20130120561A1 · Heintze · 2013 [cited by examiner]
US 20130255096A1 · Kampris et al. · 2013 [cited by applicant]
US 20140098360A1 · Kwon · 2014 [cited by applicant]
US 20140286563A1 · Frackowiak · 2014 [cited by examiner]
US 20150013556A1 · Slaats · 2015 [cited by applicant]
US 20160267111A1 · Shoaib et al. · 2016 [cited by applicant]
US 20170015832A1 · Berlin et al. · 2017 [cited by applicant]
US 20180347970A1 · Sasaki · 2018 [cited by examiner]
US 20180348146A1 · Ando · 2018 [cited by examiner]
US 20190129396A1 · Valkonen · 2019 [cited by examiner]
US 20190139212A1 · Hanzawa · 2019 [cited by examiner]
US 20200130976A1 · Paanasalo · 2020 [cited by examiner]
US 20200184630A1 · Wang · 2020 [cited by examiner]
US 20210010954A1 · Adler · 2021 [cited by examiner]
US 20210011177A1 · Adler · 2021 [cited by examiner]
US 20210025687A1 · Ichikawa · 2021 [cited by applicant]
US 20210209745A1 · Jiang et al. · 2021 [cited by applicant]
US 20210287354A1 · Kumar · 2021 [cited by examiner]
US 20210380364A1 · Gumpinger et al. · 2021 [cited by applicant]
US 20220020139A1 · Weiss et al. · 2022 [cited by applicant]
US 20220076411A1 · Georgescu et al. · 2022 [cited by applicant]
US 20220236176A1 · Bolton et al. · 2022 [cited by applicant]
US 20220270229A1 · Nokelby · 2022 [cited by examiner]
US 20230074247A1 · Xia · 2023 [cited by examiner]
US 20230137432A1 · Selim · 2023 [cited by examiner]
US 20230147668A1 · Penugonda · 2023 [cited by examiner]
US 20230169642A1 · Floeder · 2023 [cited by examiner]
US 20230237640A1 · Ekawa · 2023 [cited by examiner]
US 20230260413A1 · Lee · 2023 [cited by examiner]
US 20230286261A1 · Condello et al. · 2023 [cited by applicant]
US 20230342907A1 · Katsuyama · 2023 [cited by examiner]
US 20230401589A1 · Panchamgam · 2023 [cited by examiner]
US 20240044079A1 · Frackowiak · 2024 [cited by examiner]
US 20240046443A1 · Okazaki · 2024 [cited by examiner]
US 20240046617A1 · Adolf · 2024 [cited by examiner]
US 20240071059A1 · Schreiner · 2024 [cited by examiner]
US 20240094139A1 · Smith · 2024 [cited by examiner]
US 20240102242A1 · Ramu · 2024 [cited by examiner]
US 20240175831A1 · Frackowiak · 2024 [cited by examiner]
US 20240212356A1 · Frackowiak · 2024 [cited by examiner]
US 20240255932A1 · Frackowiak · 2024 [cited by examiner]
US 20240361756A1 · Frackowiak · 2024 [cited by examiner]
JP 08022320 · 1996 [cited by applicant]
JP 2006099497 · 2006 [cited by applicant]
KR 1020210002142 · 2021 [cited by applicant]
KR 1020210150834 · 2021 [cited by applicant]
WO 2017037896 · 2017 [cited by applicant]
WO 2022043024 · 2022 [cited by applicant]
International Search Report, dated Nov. 21, 2023, from corresponding International Application No. PCT/US2023/029385. [cited by applicant]
International Search Report, dated Nov. 23, 2023, from corresponding International Application No. PCT/US2023/029389. [cited by applicant]
Notice of Allowance, dated Aug. 22, 2023, from corresponding U.S. Appl. No. 18/131,920. [cited by applicant]
Notice of Allowance, dated Nov. 24, 2023, from corresponding U.S. Appl. No. 18/212,548. [cited by applicant]
Notice of Allowance, dated Oct. 25, 2023, from corresponding U.S. Appl. No. 18/131,926. [cited by applicant]
Office Action, dated Jul. 13, 2023, from corresponding U.S. Appl. No. 18/131,926. [cited by applicant]
Office Action, dated Sep. 20, 2023, from corresponding U.S. Appl. No. 18/212,548. [cited by applicant]
Written Opinion of the International Searching Authority, dated Nov. 21, 2023, from corresponding International Application No. PCT/US2023/029385. [cited by applicant]
Written Opinion of the International Searching Authority, dated Nov. 23, 2023, from corresponding International Application No. PCT/US2023/029389. [cited by applicant]
Office Action, dated Apr. 22, 2024, from corresponding U.S. Appl. No. 18/431,571. [cited by applicant]
Office Action, dated May 30, 2024, from corresponding U.S. Appl. No. 18/600,272. [cited by applicant]
Notice of Allowance, dated Jun. 26, 2024, from corresponding U.S. Appl. No. 18/431,571. [cited by applicant]
Notice of Allowance, dated Sep. 19, 2024, from corresponding U.S. Appl. No. 18/600,272. [cited by applicant]
Notice of Allowance, dated Oct. 11, 2024, from corresponding U.S. Appl. No. 18/767,569. [cited by applicant]