Network-accessible machine learning model training and hosting system
A network-accessible machine learning service is provided herein. For example, the network-accessible machine learning service provider can operate one or more physical computing devices accessible to user devices via a network. These physical computing device(s) can host virtual machine instances that are configured to train machine learning models using training data referenced by a user device. These physical computing device(s) can further host virtual machine instances that are configured to execute trained machine learning models in response to user-provided inputs, generating outputs that are stored and/or transmitted to user devices via the network.
1 . A system comprising:
a training model data store; and
a first computing device to host a first virtual machine instance, the first computing device comprising computer-executable instructions that, when executed, cause the first computing device to:
obtain, from a user device, a training request, wherein the training request comprises an indication of a storage location of a container image, an indicator of training data, and one or more first hyperparameter values;
initialize a first machine learning (ML) training container in the first virtual machine instance, wherein the first ML training container is formed from the container image;
initialize a second ML training container in the first virtual machine instance, wherein the second ML training container is formed from the container image;
cause the first virtual machine instance to execute code stored within the ML training container according to the one or more first hyperparameter values, wherein execution of the code causes the first virtual machine instance to train a machine learning model using the training data and to generate model data that represents characteristics of the machine learning model; and
cause the first virtual machine instance to execute second code stored within the second ML training container according to the one or more first hyperparameter values in parallel with the execution of the code stored within the first ML training container.
2 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the first computing device to:
obtain a modification request to modify the machine learning model being trained, wherein the modification request comprises one of an indicator of a second container image, a modified hyperparameter value, or a modified algorithm; and
cause modification of the machine learning model according to the modification request.
3 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the first computing device to:
obtain one or more second hyperparameter values; and
cause the first virtual machine instance to execute the code stored within the ML training container according to the one or more second hyperparameter values instead of the one or more first hyperparameter values.
4 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the first computing device to:
obtain evaluation data, wherein the evaluation data comprises input data and known results;
execute the machine learning model defined by the model data using the input data as inputs to generate model output data;
compare the model output data with the known results to determine a quality metric of the machine learning model; and
store the quality metric.
5 . A computer-implemented method comprising:
receiving, from a user device over a network, a training request, wherein the training request comprises an indication of a storage location of a container image and an indicator of training data;
initializing a first machine learning (ML) training container in a first virtual machine instance hosted by a first computing device, wherein the first ML training container is formed from the container image; and
initializing a second ML training container in the first virtual machine instance, wherein the second ML training is formed from the container image;
causing the first virtual machine instance to execute code stored within the ML training container, wherein execution of the code causes the first virtual machine instance to train a machine learning model using the training data and to generate model data that represents characteristics of the machine learning model; and
causing the first virtual machine instance to execute second code stored within the second ML training container according to one or more first hyperparameter values in parallel with the execution of the code stored within the ML training container.
6 . The computer-implemented method of claim 5 , further comprising:
receiving a modification request to modify the machine learning model being trained, wherein the modification request comprises one of an indicator of a second container image, a modified hyperparameter value, or a modified algorithm; and
causing modification of the machine learning model according to the modification request.
7 . The computer-implemented method of claim 5 , wherein the computer-implemented method further comprises:
obtaining evaluation data, wherein the evaluation data comprises input data and known results;
executing the machine learning model defined by the model data using the input data as inputs to generate model output data; and
comparing the model output data with the known results to determine a quality metric of the machine learning model.
8 . The computer-implemented method of claim 5 ,
wherein execution of the second code causes the first virtual machine instance to generate second model data, and wherein a combination of the model data and the second model data defines characteristics of a trained version of the machine learning model.
9 . The computer-implemented method of claim 5 , further comprising:
initializing a ML scoring container in a second virtual machine instance hosted by a second computing device, wherein the ML scoring container is formed from the container image;
storing the model data in the ML scoring container;
receiving, from the user device, an execution request, wherein the execution request comprises input data;
executing second code stored in the ML scoring container using the input data to generate an output; and
transmitting the output to the user device.
10 . The computer-implemented method of claim 5 , wherein the training request further comprises one or more first hyperparameter values.
11 . The computer-implemented method of claim 10 , wherein causing the first virtual machine instance to execute code stored within the ML training container further comprises causing the first virtual machine instance to execute the code stored within the ML training container according to the one or more first hyperparameter values.
12 . The computer-implemented method of claim 11 , further comprising:
obtaining one or more second hyperparameter values; and
causing the first virtual machine instance to execute the code stored within the ML training container according to the one or more second hyperparameter values and not the one or more first hyperparameter values.
13 . The computer-implemented method of claim 5 , wherein the training request further comprises at least one of a graphical processing unit (GPU) instance type of the first computing device, a central processing unit (CPU) instance type of the first computing device, an amount of memory to allocate on the first computing device, or a type of the first virtual machine instance.
14 . One or more non-transitory, computer-readable storage media storing computer-executable instructions, which if performed by one or more processors, cause the one or more processors to at least:
obtain, from a user device, an indication of a storage location of a container image and an indicator of training data;
initialize a training container in a first virtual machine instance using the container image;
initialize a second training container in the first virtual machine instance, wherein the second training container is formed from the container image;
cause the first virtual machine instance to execute code stored within the training container, wherein execution of the code causes the first virtual machine instance to train a machine learning model using the training data and to generate model data that represents characteristics of the machine learning model; and
cause the first virtual machine instance to execute second code stored within the second training container according to one or more first hyperparameter values in parallel with the execution of the code stored within the training container.
15 . The non-transitory, computer-readable storage media of claim 14 , wherein the computer-executable instructions further cause the one or more processors to at least:
obtain a modification request to modify the machine learning model being trained, wherein the modification request comprises one of an indicator of a second container image, a modified hyperparameter value, or a modified algorithm; and
cause modification of the machine learning model according to the modification request.
16 . The non-transitory, computer-readable storage media of claim 14 ,
wherein execution of the second code causes the first virtual machine instance to generate second model data, and wherein a combination of the model data and the second model data defines characteristics of a trained version of the machine learning model.
17 . The non-transitory, computer-readable storage media of claim 14 , wherein the computer-executable instructions further cause the one or more processors to at least:
initialize a scoring container in a second virtual machine instance hosted by a second computing device, wherein the scoring container is formed from the container image; and
store the model data in the scoring container.
18 . The non-transitory, computer-readable storage media of claim 17 , wherein the computer-executable instructions further cause the one or more processors to at least:
receive, from the user device, an execution request, wherein the execution request comprises input data;
execute the second code stored in the scoring container using the input data to generate an output; and
transmit the output to the user device.
19 . The non-transitory, computer-readable storage media of claim 14 , wherein the computer-executable instructions further cause the one or more processors to at least:
obtain one or more first hyperparameter values; and
cause the first virtual machine instance to execute the code stored within the training container according to the one or more first hyperparameter values.