Adaptive retraining of an artificial intelligence model by detecting a data drift, a concept drift, and a model drift
A computer-implemented method, a computer program product, and a computer system for adaptive retraining of an artificial intelligence model. A computer system computes drift magnitude scores for respective drift functions. A computer system computes an aggregated data drift score for a data drift, an aggregated concept drift score for a concept drift, and an aggregated model drift score for a model drift. A computer system computes an overall drift score, based on the aggregated data drift score, the aggregated concept drift score, the aggregated model drift score, a predetermined data drift threshold, a predetermined concept drift threshold, and a predetermined model drift threshold. A computer system determines whether retraining of the artificial intelligence model is required, based on the overall drift score. A computer system performs the retraining of the artificial intelligence model, in response to determining the retraining of the artificial intelligence model is required.
1 . A computer-implemented method for adaptive retraining of an artificial intelligence model, the method comprising:
computing drift magnitude scores for respective drift functions;
computing an aggregated data drift score for a data drift, an aggregated concept drift score for a concept drift, and an aggregated model drift score for a model drift;
computing an overall drift score, based on the aggregated data drift score, the aggregated concept drift score, the aggregated model drift score, a predetermined data drift threshold, a predetermined concept drift threshold, and a predetermined model drift threshold;
determining whether retraining of the artificial intelligence model is required, based on the overall drift score to adapt the model to a changing data distribution; and
performing the retraining of the artificial intelligence model, in response to determining the retraining of the artificial intelligence model is required, wherein the retraining of the artificial intelligence model comprises:
creating a new AI model, wherein creating the new AI model comprises:
selecting a new set of model parameters using hyperparameter search;
training the new AI model using new training dataset based on the new set of model parameters; and
retraining the new AI model to adapt to the changes in the data drift, concept drift, and model drift.
2 . The computer-implemented method of claim 1 , further comprising:
computing a data drift flag based on the aggregated data drift score and the predetermined data drift threshold, a concept drift flag based on the aggregated concept drift score and the predetermined concept drift threshold, and a model drift flag based on the aggregated model drift score and the predetermined model drift threshold.
3 . The computer-implemented method of claim 1 , further comprising:
determining whether the data drift is present, by determining whether a data drift flag is true or false;
in response to determining that the data drift is present, using new training data to retrain the artificial intelligence model; and
in response to determining that the data drift is not present, using original training data.
4 . The computer-implemented method of claim 1 , further comprising:
determining whether the concept drift is present, by determining whether a concept drift flag is true or false; and
in response to determining that the concept drift is present, incorporating drifted targets into a dataset for the retraining of the artificial intelligence model.
5 . The computer-implemented method of claim 1 , further comprising:
determining whether the model drift is present, by determining whether a model drift flag is true or false;
in response to determining that the model drift is present, determining whether either the data drift or the concept drift is present; and
in response to determining that the model drift is not present, determining whether the concept drift is present.
6 . The computer-implemented method of claim 5 , further comprising:
in response to determining that the model drift is present and determining that either the data drift or the concept drift is present, performing hyperparameter search in the retraining; and
in response to determining that the model drift is present and determining that neither the data drift nor the concept drift is present, performing model selection to select a new artificial intelligence model and performing hyperparameter search in the retraining.
7 . The computer-implemented method of claim 5 , further comprising:
in response to determining that the model drift is not present and determining that the concept drift is present, performing model selection to select a new artificial intelligence model and performing hyperparameter search in the retraining.
8 . A computer program product for adaptive retraining of an artificial intelligence model, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by one or more processors, the program instructions executable to:
compute drift magnitude scores for respective drift functions;
compute an aggregated data drift score for a data drift, an aggregated concept drift score for a concept drift, and an aggregated model drift score for a model drift;
compute an overall drift score, based on the aggregated data drift score, the aggregated concept drift score, the aggregated model drift score, a predetermined data drift threshold, a predetermined concept drift threshold, and a predetermined model drift threshold;
determine whether retraining of the artificial intelligence model is required, based on the overall drift score to adapt the model to a changing data distribution; and
perform the retraining of the artificial intelligence model, in response to determining the retraining of the artificial intelligence model is required, wherein the retraining of the artificial intelligence model comprises:
create a new AI model, wherein creating the new AI model comprises:
select a new set of model parameters using hyperparameter search;
train the new AI model using new training dataset based on the new set of model parameters; and
retrain the new AI model to adapt to the changes in the data drift, concept drift, and model drift.
9 . The computer program product of claim 8 , further comprising the program instructions executable to:
compute a data drift flag based on the aggregated data drift score and the predetermined data drift threshold, a concept drift flag based on the aggregated concept drift score and the predetermined concept drift threshold, and a model drift flag based on the aggregated model drift score and the predetermined model drift threshold.
10 . The computer program product of claim 8 , further comprising the program instructions executable to:
determine whether the data drift is present, by determining whether a data drift flag is true or false;
in response to determining that the data drift is present, use new training data to retrain the artificial intelligence model; and
in response to determining that the data drift is not present, use original training data.
11 . The computer program product of claim 8 , further comprising the program instructions executable to:
determine whether the concept drift is present, by determining whether a concept drift flag is true or false; and
in response to determining that the concept drift is present, incorporate drifted targets into a dataset for the retraining of the artificial intelligence model.
12 . The computer program product of claim 8 , further comprising the program instructions executable to:
determine whether the model drift is present, by determining whether a model drift flag is true or false;
in response to determining that the model drift is present, determine whether either the data drift or the concept drift is present; and
in response to determining that the model drift is not present, determine whether the concept drift is present.
13 . The computer program product of claim 12 , further comprising program instructions executable to:
in response to determining that the model drift is present and determining that either the data drift or the concept drift is present, perform hyperparameter search in the retraining; and
in response to determining that the model drift is present and determining that neither the data drift nor the concept drift is present, perform model selection to select a new artificial intelligence model and perform hyperparameter search in the retraining.
14 . The computer program product of claim 12 , further comprising the program instructions executable to:
in response to determining that the model drift is not present and determining that the concept drift is present, perform model selection to select a new artificial intelligence model and perform hyperparameter search in the retraining.
15 . A computer system for adaptive retraining of an artificial intelligence model, the computer system comprising one or more processors, one or more computer readable tangible storage devices, and program instructions stored on at least one of the one or more computer readable tangible storage devices for execution by at least one of the one or more processors, the program instructions executable to:
compute drift magnitude scores for respective drift functions;
compute an aggregated data drift score for a data drift, an aggregated concept drift score for a concept drift, and an aggregated model drift score for a model drift;
compute an overall drift score, based on the aggregated data drift score, the aggregated concept drift score, the aggregated model drift score, a predetermined data drift threshold, a predetermined concept drift threshold, and a predetermined model drift threshold;
determine whether retraining of the artificial intelligence model is required, based on the overall drift score to adapt the model to a changing data distribution; and
perform the retraining of the artificial intelligence model, in response to determining the retraining of the artificial intelligence model is required, wherein the retraining of the artificial intelligence model comprises:
create a new AI model, wherein creating the new AI model comprises:
select a new set of model parameters using hyperparameter search;
train the new AI model using new training dataset based on the new set of model parameters; and
retrain the new AI model to adapt to the changes in the data drift, concept drift, and model drift.
16 . The computer system of claim 15 , further comprising the program instructions executable to:
compute a data drift flag based on the aggregated data drift score and the predetermined data drift threshold, a concept drift flag based on the aggregated concept drift score and the predetermined concept drift threshold, and a model drift flag based on the aggregated model drift score and the predetermined model drift threshold.
17 . The computer system of claim 15 , further comprising the program instructions executable to:
determine whether the data drift is present, by determining whether a data drift flag is true or false;
in response to determining that the data drift is present, use new training data to retrain the artificial intelligence model; and
in response to determining that the data drift is not present, use original training data.
18 . The computer system of claim 15 , further comprising the program instructions executable to:
determine whether the concept drift is present, by determining whether a concept drift flag is true or false; and
in response to determining that the concept drift is present, incorporate drifted targets into a dataset for the retraining of the artificial intelligence model.
19 . The computer system of claim 15 , wherein further comprising the program instructions executable to:
determine whether the model drift is present, by determining whether a model drift flag is true or false;
in response to determining that the model drift is present, determine whether either the data drift or the concept drift is present; and
in response to determining that the model drift is not present, determine whether the concept drift is present.
20 . The computer system of claim 19 , further comprising program instructions executable to:
in response to determining that the model drift is present and determining that either the data drift or the concept drift is present, perform hyperparameter search in the retraining;
in response to determining that the model drift is present and determining that neither the data drift nor the concept drift is present, perform model selection to select a new artificial intelligence model and perform hyperparameter search in the retraining; and
in response to determining that the model drift is not present and determining that the concept drift is present, perform model selection to select the new artificial intelligence model and perform hyperparameter search in the retraining.