Storage and automated metadata extraction using machine teaching
Techniques configuring a machine learning model include receiving, via a user interface configured to communicate with a machine learning model hosted on a collaborative computing platform, a selection of a file for input to the machine learning model, a selection of content in the file for input to the machine learning model, and instructions for applying the selected content to the machine learning model, which are sent to the machine learning model. As new files are uploaded to the selected directories of the collaborative computing platform, the machine learning model is applied to the uploaded files to classify the files and extract metadata. The extracted metadata and associated classification data are stored in data structures associated with the new files. The data structures are existing data structures of the collaborative computing platform.
1. A method for integrating a machine learning model with a collaborative computing platform, the method comprising:
receiving, via a user interface configured to communicate with the machine learning model, a selection of one or more files for input to the machine learning model, wherein the files are stored on the collaborative computing platform;
receiving, via the user interface, a selection of content in the files for input to the machine learning model, and one or more instructions for applying the selected content to the machine learning model;
receiving a selection of one or more directories of the collaborative computing platform;
in response to receiving an instruction to apply the machine learning model to the selected directories:
as new files are uploaded to the selected directories of the collaborative computing platform, applying the machine learning model to the uploaded files to classify the files and extract metadata;
storing the extracted metadata and associated classification data in data structures associated with the new files, wherein the data structures are existing data structures of the collaborative computing platform; and
exposing the extracted metadata and associated classification data to applications executing on the collaborative computing platform;
wherein the machine learning model is trained using the selected files, selected content, and instructions; and the trained machine learning model is operable to generate outputs based on the selected directories as input data.
2. The method of claim 1 , wherein the machine learning model implements a machine teaching paradigm.
3. The method of claim 1 , wherein the files comprise documents containing text.
4. The method of claim 1 , wherein the selected directories are libraries configured to host files associated with selected users of the collaborative computing platform.
5. The method of claim 1 , further comprising compiling the extracted metadata and associated classification data to maintain running statistics for the selected directories.
6. The method of claim 4 , wherein the data structures comprise columns of the libraries.
7. The method of claim 1 , wherein the applications comprise one or more of data discovery, business process, or compliance applications.
8. The method of claim 1 , wherein the metadata comprises one or more of model, label, feature, or schema.
9. A computing device comprising:
one or more processors;
a memory in communication with the one or more processors, the memory having computer-readable instructions stored thereupon which, when executed by the one or more processors, cause the computing device to:
in response to receiving an instruction to apply a machine learning model to one or more directories of a collaborative computing platform:
as new files are uploaded to the directories of the collaborative computing platform, apply the machine learning model to the uploaded files to classify the files and extract metadata;
store the extracted metadata and associated classification data in data structures associated with the new files, wherein the data structures are existing data structures of the collaborative computing platform; and
expose the extracted metadata and associated classification data to applications executing on the collaborative computing platform;
wherein the machine learning model is trained using selected files stored on the collaborative computing platform; and the trained machine learning model is operable to generate outputs based on the selected files as input data.
10. The computing device of claim 9 , wherein the machine learning model implements a machine teaching paradigm.
11. The computing device of claim 9 , wherein the directories are libraries configured to host files associated with selected users of the collaborative computing platform.
12. The computing device of claim 9 , further comprising computer-readable instructions stored thereupon which, when executed by the one or more processors, cause the computing device to:
compile the extracted metadata and associated classification data to maintain running statistics for the directories.
13. The computing device of claim 11 , wherein the data structures comprise columns of the libraries.
14. The computing device of claim 9 , wherein the applications comprise one or more of data discovery, business process, or compliance applications.
15. The computing device of claim 9 , wherein the metadata comprises one or more of model, label, feature, or schema.
16. One or more non-transitory computer-readable media storing computer-executable instructions that, upon execution cause one or more processors of a computing device to cause the computing device to perform operations comprising:
receiving a selection of one or more files for input to a machine learning model integrated with a collaborative computing platform, wherein the files are stored on the collaborative computing platform;
receiving a selection of content in the files for input to the machine learning model, and one or more instructions for applying the selected content to the machine learning model;
receiving a selection of one or more directories of the collaborative computing platform;
in response to receiving an instruction to apply the machine learning model to the selected directories:
applying the machine learning model to files that are uploaded to the selected directories to classify the files and extract metadata;
storing the extracted metadata and associated classification data in data structures associated with the uploaded files, wherein the data structures are data structures of the collaborative computing platform; and
exposing the extracted metadata and associated classification data to applications executing on the collaborative computing platform;
wherein the machine learning model is trained using the selected files, selected content, and instructions; and the trained machine learning model is operable to generate outputs based on the selected directories as input data.
17. The non-transitory computer-readable media of claim 16 further comprising computer-executable instructions that, upon execution cause one or more processors of a computing device to cause the computing device to perform operations comprising:
compiling the extracted metadata and associated classification data to maintain running statistics for the selected directories.
18. The non-transitory computer-readable media of claim 16 , wherein the selected directories are libraries configured to host files associated with selected users of the collaborative computing platform.
19. The non-transitory computer-readable media of claim 16 , wherein the applications comprise one or more of data discovery, business process, or compliance applications.
20. The non-transitory computer-readable media of claim 16 , wherein the metadata comprises one or more of model, label, feature, or schema.