Training classifiers in machine learning
An approach is provided for training classifiers used in machine learning. A corpus of training data is received. One or more clusters of the training data is generated according to features of the training data. The one or more clusters are refined using user-specified rules. One or more classifiers are trained for use in machine learning based upon the refined one or more clusters.
1. A method for training classifiers used in machine learning, the method comprising:
receiving, by one or more processors of a computer system, a corpus of training data;
generating, by the one or more processors of the computer system, one or more clusters of the training data according to features of the training data;
comparing, by a cluster refining rule elicitation module of the computer system, neighboring clusters of the one or more clusters to automatically extract boundary rules for suggestion of a user for selection, confirmation and/or editing;
interacting with the user, by the cluster refining rule elicitation module of the elicit user-specified rules by suggesting the extracted boundary rules;
automatically refining, by the one or more processors of the computer system, the one or more clusters using the user-specified rules, wherein the refining further includes: assigning subsets of the corpus of training data in or out of clusters of the one or more clusters using the user-specified rules, and using a generative model to resolve conflicts in the assigning; and
training, by one or more processors of a computer system, multiple classifiers for use in machine learning based upon the refined one or more clusters.
2. The method of claim 1 , wherein the user-specified rules are authored by the user.
3. The method of claim 1 , wherein the user-specified rules are automatically extracted and suggested to users for selection, confirmation and editing.
4. The method of claim 1 , wherein the refining further includes: interacting with a user with a cluster refining rule elicitation module, wherein the user-specified rules are elicited case-based.
5. The method of claim 1 , wherein the refining and the training are implemented by the one or more processors of the computer system in a single process.
6. The method of claim 1 , wherein the one or more clusters represent classes of the training data.
7. A computer system, comprising:
one or more processors;
one or more memory devices coupled to the one or more processors;
and one or more computer readable storage devices coupled to the one or more processors, wherein the one or more storage devices contain program code executable by the one or more processors via the one or more memory devices to implement a method for training classifiers in machine learning, the method comprising:
receiving, by the one or more processors of the computer system, a corpus of training data;
generating, by the one or more processors of the computer system, one or more clusters of the training data according to features of the training data;
comparing, by a cluster refining rule elicitation module of the computer system, neighboring clusters of the one or more clusters to automatically extract boundary rules for suggestion of a user for selection, confirmation and/or editing;
interacting with the user, by the cluster refining rule elicitation module of the computer system, to elicit user-specified rules by suggesting the extracted boundary rules; automatically refining, by the one or more processors of the computer system, the one or more clusters using the user-specified rules, wherein the refining further includes: assigning subsets of the corpus of training data in or out of clusters of the one or more cluster using the user-specified rules; and using a generative model to resolve conflicts in the assigning; and
training, by one or more processors of a computer system, multiple classifiers for use in machine learning based upon the refined one or more clusters.
8. The computer system of claim 7 , wherein the user-specified rules are authored by the user.
9. The computer system of claim 7 , wherein the user-specified rules are automatically extracted and suggested to users for selection, confirmation and editing.
10. The computer system of claim 7 , wherein the refining further includes: interacting with a user with a cluster refining rule elicitation module, wherein the user-specified rules are elicited case-based.
11. The computer system of claim 7 , wherein the refining and the training are implemented by the one or more processors of the computer system in a single process.
12. The computer system of claim 7 , wherein the one or more clusters represent classes of the training data.
13. A computer program product, comprising one or more computer readable hardware storage devices storing a computer readable program code, the computer readable program code comprising an algorithm that when executed by one or more processors of a computing system implements a method for training classifiers in machine learning, the method comprising:
receiving, by the one or more processors of the computer system, a corpus of training data;
generating, by the one or more processors of the computer system, one or more clusters of the training data according to features of the training data;
comparing, by a cluster refining rule elicitation module of the computer system, neighboring clusters of the one or more clusters to automatically extract boundary rules for suggestion of a user for selection, confirmation and/or editing;
interacting with the user, by the cluster refining rule elicitation module of the computer system, to elicit user-specified rules by suggesting the extracted boundary rules; automatically refining, by the one or more processors of the computer system, the one or more clusters using the user-specified rules, wherein the refining further includes: assigning subsets of the corpus of training data in or out of clusters of the one or more cluster using the user-specified rules; and using a generative model to resolve conflicts in the assigning; and
training, by one or more processors of a computer system, multiple classifiers for use in machine learning based upon the refined one or more clusters.
14. The computer program product of claim 13 , wherein the user-specified rules are authored by the user.
15. The computer program product of claim 13 , wherein the user-specified rules are automatically extracted and suggested to users for selection, confirmation and editing.
16. The computer program product of claim 13 , wherein the refining further includes: interacting with a user with a cluster refining rule elicitation module, wherein the user-specified rules are elicited case-based.
17. The computer program product of claim 13 , wherein the refining and the training are implemented by the one or more processors of the computer system in a single process.