Method and system for implementing a cloud machine learning environment
An embodiment of the present invention is directed to leveraging GPU farms for machine learning where the selection of data is self-service. The data may be cleansed based on a classification and automatically transferred to a cloud services platform. This allows an entity to leverage the commoditization of the GPU farms in the public cloud without exposing data into that cloud. Also, an entire creation of a ML instance may be fully managed by a business analyst, data scientist and/or other users and teams.
1. A system for implementing a cloud machine learning environment, the system comprising:
a data source interface that communicates with a plurality of data sources;
a discovery portal interface that communicates with a user via a network communication; and
a processor coupled to the data source interface and the discovery portal interface, the processor configured to perform the steps of:
receiving, via the discovery portal interface, a user request that identifies a data set;
accessing the data set from one or more internal data sources;
creating a machine learning instance in a cloud services platform;
transferring the data set from the one or more internal data sources to a cloud data storage associated with the cloud services platform;
cleansing the data set based on one or more classification rules; and
applying machine learning analytics to the transferred dataset in the cloud data storage.
2. The system of claim 1 , wherein the one or more internal data sources comprise Unified Data Services (UDS) data and user provided data (UPD).
3. The system of claim 1 , wherein the cloud data storage comprises one or more sandboxes.
4. The system of claim 3 , wherein the one or more sandboxes comprise folders, user groups and encryption keys.
5. The system of claim 1 , wherein the cloud data storage comprises a distributed file system.
6. The system of claim 1 , wherein the classification rules comprise one-way has encryption.
7. The system of claim 1 , wherein the classification rules comprise two way keyed encryption.
8. The system of claim 1 , wherein the classification rules comprise highly confidential, confidential and internal.
9. The system of claim 1 , wherein the classification rules comprise protection group classifications.
10. The system of claim 1 , wherein the cloud services platform comprises identify and access management services, key management services and data and access monitoring services.
11. A method for implementing a cloud machine learning environment, the method comprising the steps of:
receiving, via a discovery portal interface, a user request that identifies a data set;
accessing the data set from one or more internal data sources;
creating, via a computer processor, a machine learning instance in a cloud services platform;
transferring, via a communication channel, the data set from the one or more internal data sources to a cloud data storage associated with the cloud services platform;
cleansing the data set based on one or more classification rules; and
applying machine learning analytics to the transferred dataset in the cloud data storage.
12. The method of claim 11 , wherein the one or more internal data sources comprise Unified Data Services (UDS) data and user provided data (UPD).
13. The method of claim 11 , wherein the cloud data storage comprises one or more sandboxes.
14. The method of claim 13 , wherein the one or more sandboxes comprise folders, user groups and encryption keys.
15. The method of claim 11 , wherein the cloud data storage comprises a distributed file system.
16. The method of claim 11 , wherein the classification rules comprise one-way has encryption.
17. The method of claim 11 , wherein the classification rules comprise two way keyed encryption.
18. The method of claim 11 , wherein the classification rules comprise highly confidential, confidential and internal.
19. The method of claim 11 , wherein the classification rules comprise protection group classifications.
20. The method of claim 11 , wherein the cloud services platform comprises identify and access management services, key management services and data and access monitoring services.