Data transformation delegation for a graphical processing unit (‘GPU’) server
Data transformation offloading in an artificial intelligence infrastructure that includes one or more storage systems and one or more graphical processing unit (‘GPU’) servers, including: storing, within the storage system, a dataset; identifying, in dependence upon one or more machine learning models to be executed on the GPU servers, one or more transformations to apply to the dataset; and generating, by the storage system in dependence upon the one or more transformations, a transformed dataset.
1. A method of data transformation delegation for a graphical processing unit (‘GPU’) server, the method comprising:
receiving, by the GPU server, an instruction to schedule execution of one or more machine learning algorithms associated with a machine learning model;
receiving, by the GPU server, a dataset transformed by a storage system; and
performing, by the GPU server, the scheduled execution of the one or more machine learning algorithms using the transformed dataset as input.
2. The method of claim 1 wherein receiving, by the GPU server, the dataset transformed by the storage system includes receiving, by the GPU server from the storage system, the dataset transformed by the storage system.
3. The method of claim 2 wherein receiving, by the GPU server from the storage system, the dataset transformed by the storage system includes receiving the transformed dataset from the storage system directly to application memory of the GPU server.
4. The method of claim 1 further comprising:
wherein receiving, by the GPU server, the instruction to schedule execution of the one or more machine learning algorithms associated with the machine learning model includes receiving, from a unified management plane, the instruction to schedule execution of the one or more machine learning algorithms associated with the machine learning model by the GPU server.
5. The method of claim 1 further comprising transmitting to the storage system, a request for the transformed dataset.
6. The method of claim 1 further comprising:
transmitting a first request for the transformed dataset to one or more storage systems;
updating the machine learning model; and
transmitting a second request for the transformed dataset to one or more of the storage systems.
7. An artificial intelligence infrastructure that includes one or more storage systems and one or more graphical processing unit (‘GPU’) servers, the artificial intelligence infrastructure configured to carry out the steps of:
receiving, by a GPU server, an instruction to schedule execution of one or more machine learning algorithms associated with a machine learning model;
receiving, by the GPU server, a dataset transformed by a storage system; and
performing, by the GPU server, the scheduled execution of the one or more machine learning algorithms using the transformed dataset as input.
8. The artificial intelligence infrastructure of claim 7 wherein receiving, by the GPU server, the dataset transformed by the storage system further includes receiving, by the GPU server from the storage system, the dataset transformed by the storage system.
9. The artificial intelligence infrastructure of claim 8 wherein receiving, by the GPU server from the storage system, the dataset transformed by the storage system includes receiving the transformed dataset from the storage system directly to application memory of the GPU server.
10. The artificial intelligence infrastructure of claim 7 wherein
wherein receiving, by the GPU server, the instruction to schedule execution of the one or more machine learning algorithms associated with the machine learning model includes receiving, from a unified management plane, the instruction to schedule execution of the one or more machine learning algorithms associated with the machine learning model by the GPU server.
11. The artificial intelligence infrastructure of claim 7 wherein the artificial intelligence infrastructure is further configured to carry out the step of transmitting, to the storage system, a request for the transformed dataset.
12. The artificial intelligence infrastructure of claim 7 wherein the artificial intelligence infrastructure is further configured to carry out the steps of:
transmitting a first request for the transformed dataset to one or more storage systems;
updating the machine learning model; and
transmitting a second request for the transformed dataset to one or more of the storage systems.
13. An apparatus for data transformation delegation for a graphical processing unit (‘GPU’) server, the apparatus comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
receiving, by the GPU server, an instruction to schedule execution of one or more machine learning algorithms associated with a machine learning model;
receiving, by the GPU server, a dataset transformed by a storage system; and
performing, by the GPU server, the scheduled execution of the one or more machine learning algorithms using the transformed dataset as input.
14. The apparatus of claim 13 wherein receiving, by the GPU server, the dataset transformed by the storage system includes receiving, by the GPU server from the storage system, the dataset transformed by the storage system.
15. The apparatus of claim 14 wherein receiving, by the GPU server from the storage system, the dataset transformed by the storage system includes receiving the transformed dataset from the storage system directly to application memory of the GPU server.
16. The apparatus of claim 13
wherein receiving, by the GPU server, the instruction to schedule execution of the one or more machine learning algorithms associated with a machine learning model includes receiving, from a unified management plane, the instruction to schedule execution of the one or more machine learning algorithms associated with the machine learning model by the GPU server.
17. The apparatus of claim 13 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of transmitting, to the storage system, a request for the transformed dataset.
18. The apparatus of claim 13 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
transmitting a first request for the transformed dataset to one or more storage systems;
updating the machine learning model; and
transmitting a second request for the transformed dataset to one or more of the storage systems.