IP Library › Granted Patent US 12,207,776
Granted Patent B2
US 12,207,776 · App. 17/193,314 · Granted Jan 28, 2025

Machine learning classification or scoring of cleaning outcomes in cleaning machines

Inventor: Alissa R. Ellingson (Woodbury, MN)
Assignee: Ecolab USA Inc.
A47L15/0021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,207,776
App. No.
17/193,314
Granted
Jan 28, 2025
Kind
B2
Abstract

An automated cleaning machine includes a trained cleaning outcome classifier that automatically classifies or scores cleaning outcomes for a cleaning machine using machine learning techniques. The cleaning outcome classifier may be trained on training data comprising a plurality of training inputs and a known output for each of the plurality of training inputs. Each of the plurality of training inputs may include one or more cleaning process parameters corresponding to a cleaning process executed by a cleaning machine executed during a training phase. The known output for each training input may include a cleaning outcome classification or score. The cleaning outcome of a novel cleaning process may then be classified or scored with the trained cleaning outcome classifier based on one or more cleaning process parameters corresponding to the novel cleaning process.

Claims (41)

1. A method comprising:

storing, in a storage device of an automated cleaning machine, predefined values of one or more cleaning process parameters and a trained cleaning process classifier, wherein the trained cleaning process classifier is a trained two-class classification machine learning model and is configured to classify outcomes of cleaning processes of the automated cleaning machine as either clean or soiled;

controlling, by a controller of the automated cleaning machine, execution by the automated cleaning machine of at least a first cleaning process of the automated cleaning machine using the predefined values of the one or more cleaning process parameters;

monitoring, by the controller of the automated cleaning machine, measured values of the one or more cleaning process parameters during execution of the first cleaning process;

classifying, by the controller of the automated cleaning machine, an outcome of the first cleaning process using the trained cleaning process classifier based on the measured values of the one or more cleaning process parameters;

in response to the trained cleaning process classifier classifying the outcome of the first cleaning process as soiled:

using, by the controller of the automated cleaning machine, the trained cleaning process classifier to predict cleaning outcomes for a plurality of different sets of adjusted values of the one or more cleaning process parameters; and

selecting, by the controller of the automated cleaning machine, one of the sets of adjusted values of the one or more cleaning process parameters that resulted in a clean prediction for the first cleaning process; and

controlling execution by the automated cleaning machine of the first cleaning process or a second cleaning process of the automated cleaning machine using the adjusted values of the one or more cleaning process parameters.

2. The method of claim 1 , wherein the trained cleaning process classifier is trained using training data obtained from one or more designed experiments or field tests in which one or more cleaning process verification coupons are placed in wash chambers of one or more cleaning machines and exposed to a cleaning process executed by the one or more cleaning machine during a training phase.

3. The method of claim 1 , wherein the trained cleaning process classifier is trained based on one or more cleaning process parameters corresponding to each of a plurality of cleaning processes executed during a training phase and a known output corresponding to each of the plurality of cleaning processes executed during the training phase.

4. The method of claim 1 , wherein the one or more cleaning process parameters include one or more of a wash temperature, a rinse temperature, a wash time, a rinse time, a conductivity of wash water, a detergent type, a rinse aid type, a water hardness of the wash water, an alkalinity of the wash water, and/or a measurement of food soil presence in the wash water.

5. The method of claim 4 , wherein the measurement of food soil presence is a Boolean parameter having a first possible value of food soil=true and a second possible value of food soil=false.

6. The method of claim 4 , wherein the measurement of food soil presence comprises a turbidity measurement of cleaning solution in a sump of the automated cleaning machine.

7. An automated cleaning machine comprising:

at least one processor; and

at least one storage device that stores predefined values of one or more cleaning process parameters and a trained cleaning process classifier, wherein the trained cleaning process classifier is a trained two-class classification machine learning model and is configured to classify outcomes of cleaning processes of the automated cleaning machine as either clean or soiled;

the at least one storage device further comprising instructions executable by the at least one processor to:

control execution by the automated cleaning machine of at least one of the cleaning processes using the predefined values of the one or more cleaning process parameters;

monitor measured values of the one or more cleaning process parameters during execution of the cleaning process;

classify an outcome of the cleaning process using the trained cleaning process classifier based on the measured values of the one or more cleaning process parameters;

in response to the trained cleaning process classifier classifying the outcome of the cleaning process as soiled:

use the trained cleaning process classifier to predict cleaning outcomes for a plurality of different sets of adjusted values of the one or more cleaning process parameters; and

select one of the sets of adjusted values of the one or more cleaning process parameters that resulted in a clean prediction for the cleaning process; and

control execution by the automated cleaning machine of a remainder of the cleaning process using the selected set of adjusted values of the one or more cleaning process parameters.

8. An automated cleaning machine comprising:

at least one processor; and

at least one storage device that stores predefined values of one or more cleaning process parameters and a trained cleaning process classifier, wherein the trained cleaning process classifier is a trained two-class classification machine learning model and is configured to classify outcomes of cleaning processes of the automated cleaning machine as either clean or soiled;

the at least one storage device further comprising instructions executable by the at least one processor to:

control execution by the automated cleaning machine of at least a first cleaning process using the predefined values of the one or more cleaning process parameters;

monitor measured values of the one or more cleaning process parameters during execution of the first cleaning process;

classify an outcome of the first cleaning process using the trained cleaning process classifier based on the measured values of the one or more cleaning process parameters;

in response to the trained cleaning process classifier classifying the outcome of the first cleaning process as soiled:

use the trained cleaning process classifier to predict cleaning outcomes for a plurality of different sets of adjusted values of the one or more cleaning process parameters; and

select one of the sets of adjusted values of the one or more cleaning process parameters that resulted in a clean prediction for the first cleaning process; and

control execution by the automated cleaning machine of a subsequent second cleaning process using the selected set of adjusted values of the one or more cleaning process parameters.

9. The automated cleaning machine of claim 8 , wherein the trained cleaning process classifier is trained using training data obtained from one or more designed experiments or field tests in which one or more cleaning process verification coupons are placed in wash chambers of one or more cleaning machines and exposed to a cleaning process executed by the one or more cleaning machines during a training phase.

10. The automated cleaning machine of claim 8 , wherein the trained cleaning process classifier is trained based on one or more cleaning process parameters corresponding to each of a plurality of cleaning processes executed during a training phase and a known output corresponding to each of the plurality of cleaning processes executed during the training phase.

11. The automated cleaning machine of claim 8 , wherein the one or more cleaning process parameters include one or more of a wash temperature, a rinse temperature, a wash time, a rinse time, a conductivity of wash water, a detergent type, a rinse aid type, a water hardness of the wash water, an alkalinity of the wash water, and/or a measurement of food soil presence in the wash water.

12. The automated cleaning machine of claim 11 , wherein the measurement of food soil presence is a Boolean parameter having a first possible values of food soil=true and a second possible value of food soil=false.

13. The automated cleaning machine of claim 11 , wherein the measurement of food soil presence comprises a turbidity measurement of cleaning solution in a sump of the automated cleaning machine.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2021
From: ELLINGSON, ALISSA R.
To: ECOLAB USA INC.
Reel/Frame 055508/0602 →
Continuity (2)
Provisional Application 63083355 · Sep 25, 2020
Related Publication 20220095879A1 · Mar 31, 2022
References Cited (165)
US D227117S · Breger · 1973 [cited by applicant]
US 4735219A · Seeland · 1988 [cited by applicant]
US D427315S · Saltzstein et al. · 2000 [cited by applicant]
US 6463940B1 · Thomas et al. · 2002 [cited by applicant]
US 6615850B1 · Hornung · 2003 [cited by applicant]
US 6622754B1 · Roth et al. · 2003 [cited by applicant]
US 7437213B2 · Batcher · 2008 [cited by applicant]
US D605588S · Nomi et al. · 2009 [cited by applicant]
US D677669S · Liu · 2013 [cited by applicant]
US D699246S · Ringlein · 2014 [cited by applicant]
US D715284S · Iwamoto · 2014 [cited by applicant]
US 9041985B2 · Kasahara et al. · 2015 [cited by applicant]
US D730886S · Tseng · 2015 [cited by applicant]
US 9289107B2 · Ellingson et al. · 2016 [cited by applicant]
US 9329159B2 · Walicki · 2016 [cited by applicant]
US D768138S · Malsan · 2016 [cited by applicant]
US 9473653B2 · Hayashi · 2016 [cited by applicant]
US D788778S · Magi et al. · 2017 [cited by applicant]
US D795323S · Melamed et al. · 2017 [cited by applicant]
US D808947S · Taniho et al. · 2018 [cited by applicant]
US D837180S · Silva · 2019 [cited by applicant]
US 10514339B2 · Chen et al. · 2019 [cited by applicant]
US D872072S · Anderson · 2020 [cited by applicant]
US 10529219B2 · Herdt et al. · 2020 [cited by applicant]
US 10762617B2 · Sanders et al. · 2020 [cited by applicant]
US 11627861B2 · Smith et al. · 2023 [cited by applicant]
US 11666198B2 · Han et al. · 2023 [cited by applicant]
US 20050201898A1 · Borich et al. · 2005 [cited by applicant]
US 20060222567A1 · Kloepfer et al. · 2006 [cited by applicant]
US 20070181162A1 · Classen et al. · 2007 [cited by applicant]
US 20080267445A1 · Capewell · 2008 [cited by applicant]
US 20090151751A1 · Bragg · 2009 [cited by applicant]
US 20100205819A1 · Ashrafzadeh et al. · 2010 [cited by applicant]
US 20110108073A1 · Tameishi · 2011 [cited by applicant]
US 20110209729A1 · Beaudet et al. · 2011 [cited by applicant]
US 20110291830A1 · Kaiser · 2011 [cited by applicant]
US 20110320133A1 · Mehus et al. · 2011 [cited by applicant]
US 20120138092A1 · Ashrafzadeh et al. · 2012 [cited by applicant]
US 20140041688A1 · Maennle et al. · 2014 [cited by applicant]
US 20140041695A1 · Ellingson et al. · 2014 [cited by applicant]
US 20140218385A1 · Carmi · 2014 [cited by applicant]
US 20150233898A1 · Chen et al. · 2015 [cited by applicant]
US 20160171690A1 · Adiri et al. · 2016 [cited by applicant]
US 20170023542A1 · Wang et al. · 2017 [cited by applicant]
US 20170119232A1 · Ugel et al. · 2017 [cited by applicant]
US 20180330338A1 · Holden et al. · 2018 [cited by applicant]
US 20190244375A1 · Choi et al. · 2019 [cited by applicant]
US 20190261828A1 · Gaus · 2019 [cited by examiner]
US 20190365197A1 · Maddux · 2019 [cited by applicant]
US 20200301382A1 · Fawaz et al. · 2020 [cited by applicant]
US 20200397216A1 · Fawaz et al. · 2020 [cited by applicant]
US 20210019874A1 · Sanders et al. · 2021 [cited by applicant]
US 20210076898A1 · Smith et al. · 2021 [cited by applicant]
US 20210127939A1 · Hofmann et al. · 2021 [cited by applicant]
US 20210161355A1 · Rahn et al. · 2021 [cited by applicant]
US 20210324561A1 · Kim et al. · 2021 [cited by applicant]
US 20210369076A1 · McGinness et al. · 2021 [cited by applicant]
US 20220104680A1 · Han et al. · 2022 [cited by applicant]
US 20230218137A1 · Smith et al. · 2023 [cited by applicant]
US 20230337891A1 · Han et al. · 2023 [cited by applicant]
CA 2541480A1 · 2006 [cited by applicant]
CN 101961237A · 2011 [cited by applicant]
CN 107485356A · 2017 [cited by applicant]
CN 107729816A · 2018 [cited by applicant]
CN 104668252B · 2019 [cited by applicant]
CN 110367898A · 2019 [cited by applicant]
CN 107421918B · 2019 [cited by applicant]
CN 111870205A · 2020 [cited by applicant]
DE 102005033345A1 · 2007 [cited by applicant]
DE 102008042290A1 · 2010 [cited by applicant]
DE 102010033016A1 · 2012 [cited by applicant]
DE 102018108775 · 2019 [cited by examiner]
DE 102018108775A1 · 2019 [cited by applicant]
EP 0341766A2 · 1989 [cited by applicant]
EP 1272093A2 · 2003 [cited by applicant]
EP 1690924A1 · 2006 [cited by applicant]
EP 1887443A1 · 2008 [cited by applicant]
EP 2497404A1 · 2012 [cited by applicant]
EP 3088593A1 · 2016 [cited by applicant]
JP 61280838A · 1986 [cited by applicant]
JP 02274289A · 1990 [cited by applicant]
JP 05115418A · 1993 [cited by applicant]
JP 0663279A · 1994 [cited by applicant]
JP 2000316783A · 2000 [cited by applicant]
JP 2002336335A · 2002 [cited by applicant]
JP 2003038888A · 2003 [cited by applicant]
JP 2003506153A · 2003 [cited by applicant]
JP 2004261439A · 2004 [cited by applicant]
JP 2005342143A · 2005 [cited by applicant]
JP 2009056030A · 2009 [cited by applicant]
JP 2009075084A · 2009 [cited by applicant]
JP 2010036023A · 2010 [cited by applicant]
JP 2015008914A · 2015 [cited by applicant]
JP 2015504708A · 2015 [cited by applicant]
JP 2016193169A · 2016 [cited by applicant]
JP 2018068862A · 2018 [cited by applicant]
JP 2018524107A · 2018 [cited by applicant]
KR 102019102134A · 2019 [cited by applicant]
KR 102119076 · 2020 [cited by examiner]
KR 102119076B1 · 2020 [cited by examiner]
WO 9930843A1 · 1999 [cited by applicant]
WO 0110472A1 · 2001 [cited by applicant]
WO 0178573A2 · 2001 [cited by applicant]
WO 0213136A2 · 2002 [cited by applicant]
WO 2006002123A1 · 2006 [cited by applicant]
WO 2006097294A1 · 2006 [cited by applicant]
WO 2007081004A1 · 2007 [cited by applicant]
WO 2010118124A2 · 2010 [cited by applicant]
WO 2011048575A2 · 2011 [cited by applicant]
WO 2011089094A1 · 2011 [cited by applicant]
WO 2013090443A1 · 2013 [cited by applicant]
WO 2014137540A1 · 2014 [cited by applicant]
WO 2015036311A1 · 2015 [cited by applicant]
WO 2015080965A1 · 2015 [cited by applicant]
WO 2015127547A1 · 2015 [cited by applicant]
WO 2015167574A1 · 2015 [cited by applicant]
WO 2017013615A1 · 2017 [cited by applicant]
WO 2017056002A1 · 2017 [cited by applicant]
KR102119076 English translation, accessed on Sep. 2023. (Year: 2020). [cited by examiner]
DE102018108775 English translation, accessed on Sep. 2023. (Year: 2019). [cited by examiner]
KR-102119076 English translation, accessed on Mar. 2024. (Year: 2020). [cited by examiner]
Notice of Allowance from U.S. Appl. No. 17/018,363 dated Jul. 14, 2022, 14 pp. [cited by applicant]
Advisory Action from U.S. Appl. No. 17/193,189 dated Aug. 3, 2023, 3 pp. [cited by applicant]
Notice of Allowability from U.S. Appl. No. 17/108,894 dated Jul. 26, 2023, 8 pp. [cited by applicant]
Response to Office Action mailed May 26, 2023, from U.S. Appl. No. 17/193,189, filed Jul. 26, 2023, 14 pp. [cited by applicant]
“CDWA Cleaning Indicator—Cleaning Performance Test,” Terragene, retrieved on Feb. 13, 2019, from https://fontlab2000.com/sites/default/files/cdwa-rev.15.pdf, 2 pp. [cited by applicant]
“NSF/ANSI 3—2017-Commercial Warewashing Equipment,” NSF International, ANSI Standard, Apr. 11, 2017, 42 pp. [cited by applicant]
“Two-Class Logistic Regression,” retrieved from https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/two-class-logistic-regression, May 6, 2019, 7 pp. [cited by applicant]
Brownlee, “A Tour of Machine Learning Algorithms,” machinelearningmastery.com, Aug. 14, 2020, 11 pp. [cited by applicant]
Kumar et al., “A Detailed Review of Feature Extraction in Image Processing Systems,” 2014 Fourth International Conference on Advanced Computing & Communication Technologies, Feb. 8, 2014, 8 pp. [cited by applicant]
Narkhede, “Understanding AUC—ROC Curve,” towardsdatascience.com, Jun. 26, 2018, 7 pp. [cited by applicant]
Narkhede, “Understanding Confusion Matrix,” towardsdatascience.com, May 9, 2018, 6 pp. [cited by applicant]
Patel, “Machine Learning Algorithm Overview,” medium.com, Jul. 21, 2018, 10 pp. [cited by applicant]
Powered for iPhone: Wireless Charging Stand for iPhone 8 and Above, Logitech POWERED iPhone Wireless Charging Standard, retrieved from https://www.logitech.com/en-us/productlpowered-iphone-wireless-charging?crid=1537 on… [cited by applicant]
Saslow, “Collinearity-What it Means, Why its Bad, and How Does it Affect Other Models,” medium.com, Jul. 11, 2018, 5 pp. [cited by applicant]
Shung, “Accuracy, Precision, Recall or F1?,” towardsdatascience.com, Mar. 15, 2018, 7 pp. [cited by applicant]
Singh, “Model-Based Feature Importance,” towardsdatascience.com, Jan. 3, 2019, 7 pp. [cited by applicant]
Youtube, “Regularization Part 1: Ridge (L2) Regression,” retrieved from https://www.youtube.com/watch?app=desktop&v=Q81RR3yKn30&t=3s, Sep. 24, 2018, 1 pp. [cited by applicant]
Youtube, “Regularization Part 2: Lasso (L1) Regression,” Retrieved from https://www.youtube.com/watch?app=desktop&v=NGfOvoTMIcs, Oct. 1, 2018, 1 pp. [cited by applicant]
International Search Report and Written Opinion of International Application No. PCT/US2021/021095, mailed Jun. 8, 2021, 17 pp. [cited by applicant]
Corrected Notice of Allowance from U.S. Appl. No. 17/193,507, dated Feb. 2, 2023, 5 pp. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/193,507 dated Jan. 25, 2023, 10 pp. [cited by applicant]
Response to Office Action dated Nov. 8, 2022 from U.S. Appl. No. 17/193,189, filed Feb. 8, 2023, 16 pp. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/018,363 dated Oct. 4, 2022, 8 pp. [cited by applicant]
Office Action from U.S. Appl. No. 17/193,189 dated Nov. 8, 2022, 30 pp. [cited by applicant]
Corrected Notice of Allowance from U.S. Appl. No. 17/193,507, dated Mar. 15, 2023, 5 pp. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/108,894 dated Apr. 5, 2023, 9 pp. [cited by applicant]
Final Office Action from U.S. Patent Application No. 17/193,189 dated May 26, 2023, 32 pp. [cited by applicant]
International Preliminary Report on Patentability from International Application No. PCT/US2021/021095 dated Apr. 6, 2023, 11 pp. [cited by applicant]
Notice of Allowability from U.S. Appl. No. 17/193,507 dated Apr. 28, 2023, 5 pp. [cited by applicant]
Response to Final Office Action dated Apr. 5, 2023 from U.S. Appl. No. 17/108,894, filed Jun. 5, 2023, 12 pp. [cited by applicant]
Response to Office Action dated Dec. 20, 2022 from U.S. Appl. No. 17/108,894, filed Mar. 20, 2023, 10 pp. [cited by applicant]
Advisory Action from U.S. Appl. No. 17/108,894 dated Jun. 23, 2023, 3 pp. [cited by applicant]
Office Action from U.S. Appl. No. 17/108,894 dated Dec. 20, 2022, 9 pp. [cited by applicant]
Supplemental Notice of Allowance from U.S. Appl. No. 17/018,363 dated Dec. 14, 2022, 8 pp. [cited by applicant]
Response to Office Action dated Dec. 16, 2021, from U.S. Appl. No. 17/018,363, filed Mar. 16, 2022, 15 pp. [cited by applicant]
Machine Translation of CN 107729816 by Shan et al., published Feb. 23, 2018, 17 Pages. [cited by applicant]
Office Action from U.S. Appl. No. 17/018,363, dated Dec. 16, 2021, 23 pp. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/193,189 dated Sep. 27, 2023, 14 pp. [cited by applicant]
Response to Communication Pursuant to Rules 161(1) and 162 EPC dated May 4, 2023, from counterpart European Application No. 21715369.1, filed Nov. 2, 2023, 16 pp. [cited by applicant]
Office Action from U.S. Appl. No. 17/108,894, dated Dec. 21, 2023, 8 pp. [cited by applicant]
U.S. Appl. No. 18/398,859, filed Dec. 28, 2023, by McGinness et al. [cited by applicant]
Response to Office Action dated Dec. 21, 2023 from U.S. Appl. No. 17/108,894, filed Mar. 21, 2024, 16 pp. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/108,894, dated Jun. 27, 2024, 7 pp. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/108,894 dated Aug. 16, 2024, 5 pp. [cited by applicant]