IP Library Granted Patent US 11,481,792
Granted Patent B2
US 11,481,792 · App. 17/036,050 · Granted Oct 25, 2022

Method of training machine learning models for making simulated estimations

Inventors: Alexander Krowitz (Chelmsford, MA); Martin Tapp (Montreal, CA)
Assignee: Kronos Technology Systems Limited Partnership
G06Q30/0202G06N5/003G06N7/00G06N20/00G06N20/20G06Q10/063116G06N3/02G06N5/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,481,792
App. No.
17/036,050
Granted
Oct 25, 2022
Kind
B2
Abstract

A computer-implemented method of training machine learning models for making simulated estimations is provided. The method includes collecting, from a database, a set of historical data, applying one or more transformations to the set of historical data to create a set of model features, and separating the set of model features into one or more pools, each pool comprising one or more model features of the set that are homogeneous with respect to a common value. the method further includes, for each pool, dynamically creating a training set that includes the one or more sets of model features of the pool and at least some of the historical data. The method further includes, for each training set, training a machine learning model on the training set.

Claims (115)

1. A computer-implemented method of training machine learning models for making simulated estimations, the method comprising:

collecting, from a database, a set of historical business data;

applying one or more transformations to the set of historical business data to create a set of model features;

separating the set of model features into three or more pools based at least in part on a weather forecast, each pool comprising:

one or more model features of the set that are homogeneous with respect to a common value, and

a different type of feature from the other of the three or more pools;

for each of the three or more pools, dynamically creating a corresponding training set comprising the one or more model features of the pool and at least some of the historical business data;

for each of the three or more pools, creating a corresponding machine learning model;

for each training set, training the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set based at least in part on gradient boosting to predict a retail volume;

generating, a predicted labor demand by predicting, via at least one of the machine learning models, a labor demand value for a gap between an end date of the historical business data and a start date of a prediction time period;

generating a worker schedule based at least in part on the predicted labor demand; and

updating the machine learning models via at least:

deleting and recreating the machine learning models, and

for each training set, retraining the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set to improve the prediction of the retail volume via improving the correlation of each model to the features within the corresponding pool;

wherein:

each of the set of model features corresponds to a store; and

each of the set of model features corresponds to two or more departments of a same type and each department is from a different store.

2. A system comprising:

at least one processor; and

a memory device that stores an application that adapts the at least one processor to:

collect a set of historical business data from a database;

apply one or more transformations to the set of historical business data to create a set of model features;

separate the set of model features into three or more pools based at least in part on a weather forecast, each pool comprising:

one or more model features of the set that are homogeneous with respect to a common value, and

a different type of feature from the other of the three or more pools;

for each of the three or more pools, dynamically create a corresponding training set comprising the one or more model features of the pool and at least some of the historical business data;

for each of the three or more pools, create a corresponding machine learning model;

for each training set, train the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set based at least in part on gradient boosting to predict a retail volume;

generate a predicted labor demand by predicting, via at least one of the machine learning models, at labor demand value for a gap between an end date of the historical business data and a start date of a prediction time period;

generate a worker schedule based at least in part on the predicted labor demand; and

update the machine learning models via at least:

deleting and recreating the machine learning models as part of updating the machine learning models; and

for each training set, retraining the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set to improve the prediction of the retail volume via improving the correlation of each model to the features within the corresponding pool;

wherein:

each of the set of model features corresponds to a store; and

each of the set of model features corresponds to two or more departments of a same type and each department is from a different store.

3. A non-transitory computer-readable medium storing instructions that adapt at least one processor to:

collect a set of historical business data from a database;

apply one or more transformations to the set of historical business data to create a set of model features;

separate the set of model features into three or more pools based at least in part on a weather forecast, each pool comprising:

one or more model features of the set that are homogeneous with respect to a common value, and

a different type of feature from the other of the three or more pools;

for each of the three or more pools, dynamically create a corresponding training set comprising the one or more model features of the pool and at least some of the historical business data;

for each of the three or more pools, create a corresponding machine learning model;

for each training set, train the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set based at least in part on gradient boosting to predict a retail volume;

generate a predicted labor demand by predicting, via at least one of the machine learning models, a labor demand value for a gap between an end date of the historical business data and a start date of a prediction time period;

generate a worker schedule based at least in part on the predicted labor demand; and

update the machine learning models via at least:

deleting and recreating the machine learning models, and

for each training set, retraining the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set to improve the prediction of the retail volume via improving the correlation of each model to the features within the corresponding pool;

wherein:

each of the set of model features corresponds to a store; and

each of the set of model features corresponds to two or more departments of a same type and each department is from a different store.

4. The computer-implemented method of claim 1 , wherein the model features are separated into the three or more pools further based at least in part on a seasonality.

5. The system of claim 2 , wherein the model features are separated into the three or more pools further based at least in part on a seasonality.

6. The non-transitory computer-readable medium of claim 3 , wherein the model features are separated into the three or more pools further based at least in part on a seasonality.

7. A computer-implemented method of training machine learning models for making simulated estimations, the method comprising:

collecting, from a database, a set of historical business data;

applying one or more transformations to the set of historical business data to create a set of model features;

separating the set of model features into three or more pools based at least in part on a seasonality, each pool comprising:

one or more model features of the set that are homogeneous with respect to a common value, and

a different type of feature from the other of the three or more pools;

for each of the three or more pools, dynamically creating a corresponding training set comprising the one or more model features of the pool and at least some of the historical business data;

for each of the three or more pools, creating a corresponding machine learning model;

for each training set, training the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set based at least in part on gradient boosting to predict a retail volume;

generating, a predicted labor demand by predicting, via at least one of the machine learning models, a labor demand value for a gap between an end date of the historical business data and a start date of a prediction time period;

generating a worker schedule based at least in part on the predicted labor demand; and

updating the machine learning models via at least:

deleting and recreating the machine learning models, and

for each training set, retraining the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set to improve the prediction of the retail volume via improving the correlation of each model to the features within the corresponding pool;

wherein:

each of the set of model features corresponds to a store; and

each of the set of model features corresponds to two or more departments of a same type and each department is from a different store.

8. The computer-implemented method of training machine learning models for making simulated estimations of claim 7 further comprising:

for each machine learning model, testing the machine learning model to determine an accuracy of the machine learning model.

9. A system comprising:

at least one processor; and

a memory device that stores an application that adapts the at least one processor to:

collect a set of historical business data from a database;

apply one or more transformations to the set of historical business data to create a set of model features;

separate the set of model features into three or more pools based at least in part on a seasonality, each pool comprising:

one or more model features of the set that are homogeneous with respect to a common value, and

a different type of feature from the other of the three or more pools;

for each of the three or more pools, dynamically create a corresponding training set comprising the one or more model features of the pool and at least some of the historical business data;

for each of the three or more pools, create a corresponding machine learning model;

for each training set, train the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set based at least in part on gradient boosting to predict a retail volume;

generate a predicted labor demand by predicting, via at least one of the machine learning models, at labor demand value for a gap between an end date of the historical business data and a start date of a prediction time period;

generate a worker schedule based at least in part on the predicted labor demand; and

update the machine learning models via at least:

deleting and recreating the machine learning models as part of updating the machine learning models; and

for each training set, retraining the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set to improve the prediction of the retail volume via improving the correlation of each model to the features within the corresponding pool;

wherein:

each of the set of model features corresponds to a store; and

each of the set of model features corresponds to two or more departments of a same type and each department is from a different store.

10. The system of claim 9 , wherein the application further adapts the at least one processor to:

for each machine learning model, test the machine learning model to determine an accuracy of the machine learning model.

11. A non-transitory computer-readable medium storing instructions that adapt at least one processor to:

collect a set of historical business data from a database;

apply one or more transformations to the set of historical business data to create a set of model features;

separate the set of model features into three or more pools based at least in part on a seasonality, each pool comprising:

one or more model features of the set that are homogeneous with respect to a common value, and

a different type of feature from the other of the three or more pools;

for each of the three or more pools, dynamically create a corresponding training set comprising the one or more model features of the pool and at least some of the historical business data;

for each of the three or more pools, create a corresponding machine learning model;

for each training set, train the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set based at least in part on gradient boosting to predict a retail volume;

generate a predicted labor demand by predicting, via at least one of the machine learning models, a labor demand value for a gap between an end date of the historical business data and a start date of a prediction time period;

generate a worker schedule based at least in part on the predicted labor demand; and

update the machine learning models via at least:

deleting and recreating the machine learning models, and

for each training set, retraining the machine learning model, that corresponds to the pool that corresponds to the training set, on the training set to improve the prediction of the retail volume via improving the correlation of each model to the features within the corresponding pool;

wherein:

each of the set of model features corresponds to a store; and

each of the set of model features corresponds to two or more departments of a same type and each department is from a different store.

12. The non-transitory computer-readable medium of claim 11 , wherein the instructions further adapt at least one processor to:

for each machine learning model, test the machine learning model to determine an accuracy of the machine learning model.

Assignments (6)
RELEASE (REEL 066552 / FRAME 0029) Recorded Apr 9, 2024
From: NOMURA CORPORATE FUNDING AMERICAS, LLC
To: UKG INC.; KRONOS TECHNOLOGY SYSTEMS LIMITED PARTNERSHIP
Reel/Frame 067055/0917 →
SECURITY AGREEMENT (FIRST LIEN) Recorded Feb 12, 2024
From: KRONOS TECHNOLOGY SYSTEMS LIMITED PARTNERSHIP; UKG INC.
To: NOMURA CORPORATE FUNDING AMERICAS, LLC, AS COLLATERAL AGENT
Reel/Frame 066551/0941 →
SECURITY AGREEMENT (NOTES) Recorded Feb 12, 2024
From: KRONOS TECHNOLOGY SYSTEMS LIMITED PARTNERSHIP; UKG INC.
To: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 066551/0962 →
SECURITY AGREEMENT (SECOND LIEN) Recorded Feb 12, 2024
From: KRONOS TECHNOLOGY SYSTEMS LIMITED PARTNERSHIP; UKG INC.
To: NOMURA CORPORATE FUNDING AMERICAS, LLC, AS COLLATERAL AGENT
Reel/Frame 066552/0029 →
CORRECTIVE ASSIGNMENT TO CORRECT THE OMISSION SECOND ASSIGNOR'S NAME PREVIOUSLY RECORDED AT REEL: 058734 FRAME: 0815. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Aug 30, 2022
From: KROWITZ, ALEXANDER; TAPP, MARTIN
To: KRONOS TECHNOLOGY SYSTEMS LIMITED PARTNERSHIP
Reel/Frame 061285/0545 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2022
From: KROWITZ, ALEXANDER
To: KRONOS TECHNOLOGY SYSTEMS LIMITED PARTNERSHIIP
Reel/Frame 058734/0815 →
Cited By (1)
US 12,437,310