RETRAINING BASED ON CHALLENGER MODEL COMPARISON

1 . A system, comprising:

one or more processors, coupled to memory, to:

determine, based on a comparison of a first model that is deployed as a primary model with a second model that is acting as a challenger model, that the second model performs better than the first model based on at least one performance metric;

determine, based on a comparison of a characteristic of the first model with a characteristic of the second model, to skip a validation process for the second model; and

establish the second model as the primary model in the deployment to replace the first model in the deployment.

2 . The system of claim 1 , wherein the characteristic comprises a blueprint.

3 . The system of claim 1 , wherein the characteristic comprises a hyperparameter.

4 . The system of claim 1 , wherein the characteristic comprises an order of operations.

5 . The system of claim 1 , wherein the one or more processors are further configured to:

determine, based on the first model, one or more performance metrics to use for the comparison of the first model with the second model;

provide the determined one or more performance metrics for presentation via a prompt output by a graphical user interface rendered on a client device;

receive, responsive to the prompt, a selection of the at least one performance metric from the one or more performance metrics provided via the prompt.

6 . The system of claim 1 , wherein the one or more processors are further configured to:

detect, subsequent to deployment of the second model as the primary model, an error with output or performance of the second model; and

return, responsive to the detection, the first model as the primary model in the deployment.

7 . The system of claim 1 , wherein the one or more processors are further configured to:

provide, responsive to the determination that the second model performs better than the first model and to skip the validation process, a prompt to a client device to request authorization to establish the second model as the primary model in the deployment; and

establish the second model as the primary model in the deployment responsive to receiving authorization from the client device via the prompt.

8 . The system of claim 1 , wherein the at least one performance metric comprises at least one of speed of performance, accuracy, or computation resource utilization.

9 . The system of claim 1 , wherein the one or more processors are further configured to:

determine the first model performs better than the second model based on the second model generating output with a same accuracy faster than the first model.

10 . A method comprising:

determining, by one or more processors coupled to memory, based on a comparison of a first model that is deployed as a primary model with a second model that is acting as a challenger model, that the second model performs better than the first model based on at least one performance metric;

determining, by the one or more processors, based on a comparison of a characteristic of the first model with a characteristic of the second model, to skip a validation process for the second model; and

establishing, by the one or more processors, the second model as the primary model in the deployment to replace the first model in the deployment.

11 . The method of claim 10 , wherein the characteristic comprises a blueprint.

12 . The method of claim 10 , wherein the characteristic comprises a hyperparameter.

13 . The method of claim 10 , wherein the characteristic comprises an order of operations.

14 . The method of claim 10 , comprising:

determining, based on the first model, one or more performance metrics to use for the comparison of the first model with the second model;

providing the determined one or more performance metrics for presentation via a prompt output by a graphical user interface rendered on a client device;

receiving, responsive to the prompt, a selection of the at least one performance metric from the one or more performance metrics provided via the prompt.

15 . The method of claim 10 , comprising:

detecting, subsequent to deployment of the second model as the primary model, an error with output or performance of the second model; and

returning, responsive to the detection, the first model as the primary model in the deployment.

16 . The method of claim 10 , comprising:

providing, responsive to the determination that the second model performs better than the first model and to skip the validation process, a prompt to a client device to request authorization to establish the second model as the primary model in the deployment; and

establishing the second model as the primary model in the deployment responsive to receiving authorization from the client device via the prompt.

17 . The method of claim 10 , wherein the at least one performance metric comprises at least one of speed of performance, accuracy, or computation resource utilization.

18 . The method of claim 10 , comprising:

determining the first model performs better than the second model based on the second model generating output with a same accuracy faster than the first model.

19 . A non-transitory computer-readable medium storing processor-executable instructions that, when executed by one or more processors, causes the one or more processors to:

determine, based on a comparison of a first model that is deployed as a primary model with a second model that is acting as a challenger model, that the second model performs better than the first model based on at least one performance metric.

determine, based on a comparison of a characteristic of the first model with a characteristic of the second model, to skip a validation process for the second model; and

establish the second model as the primary model in the deployment to replace the first model in the deployment.

20 . The computer-readable medium of claim 19 , wherein the characteristic comprises a blueprint.