Data type recognition, model training and risk recognition methods, apparatuses and devices
Data type recognition and model training methods and apparatuses, and computer devices are provided. The model training method includes acquiring a first sample data set, and using the first sample data set to train an anomaly detection model; and detecting an abnormal sample data set from a second sample data set by means of the anomaly detection model, and using the abnormal sample data set to train a classification model. By using this method, an amount of scoring events of the classification model can be reduced, and relatively balanced sample data sets can also be provided for training, to obtain the classification model with a higher accuracy.
1. A data type recognition method for recognizing data as first-type data or second-type data, wherein the method comprises:
acquiring data to be recognized, and using a preset anomaly detection model to detect whether the data to be recognized is first-type data; and
inputting other data than the first-type data recognized by the anomaly detection model, into a classification model for recognition, wherein the classification model classifies the other data as first-type data and second-type data,
wherein the anomaly detection model is a first machine learning model and obtained by pre-training based on a first sample data set, and the classification model is a second machine learning model and obtained by pre-training based on a second sample data set different from the first sample data set; and
the pre-training of the classification model comprises:
detecting, by the anomaly detection model, an abnormal sample data set from the second sample data set;
optimizing the abnormal sample data set based on a feature optimization algorithm; and
using the optimized abnormal sample data set to train the classification model.
2. The method according to claim 1 , wherein the pre-training of the anomaly detection model comprises:
acquiring the first sample data set, wherein an amount of first-type data in the first sample data set is greater than that of second-type data; and
using the first sample data set to train the anomaly detection model.
3. A risk recognition method for recognizing data as secure data or risky data, wherein the method comprises:
acquiring data to be recognized, and using a preset anomaly detection model to detect whether the data to be recognized is abnormal;
if the data to be recognized is detected not to be abnormal, determining that the data to be recognized is secure data; and
if the data to be recognized is detected to be abnormal, using a preset classification model to recognize that the data to be recognized is secure data or risky data,
wherein the anomaly detection model is a first machine learning model and obtained by pre-training based on a first sample data set, and the classification model is a second machine learning model and obtained by pre-training based on a second sample data set different from the first sample data set; and
the pre-training of the classification model comprises:
detecting, by the anomaly detection model, an abnormal sample data set from the second sample data set;
optimizing the abnormal sample data set based on a feature optimization algorithm; and
using the optimized abnormal sample data set to train the classification model.
4. The method according to claim 3 , wherein the pre-training of the anomaly detection model comprises:
acquiring the first sample data set, wherein an amount of secure data in the first sample data set is greater than that of risky data; and
using the first sample data set to train the anomaly detection model.
5. A computer device, comprising:
a processor; and
a memory for storing instructions executable by the processor,
wherein the processor is configured to:
acquire data to be recognized, and use a preset anomaly detection model to detect whether the data to be recognized is first-type data; and
input other data than the first-type data recognized by the anomaly detection model, into a classification model for recognition, wherein the classification model classifies the other data as first-type data and second-type data,
wherein the anomaly detection model is a first machine learning model and obtained by pre-training based on a first sample data set, and the classification model is a second machine learning model and obtained by pre-training based on a second sample data set different from the first sample data set; and
the pre-training of the classification model comprises:
detecting, by the anomaly detection model, an abnormal sample data set from the second sample data set;
optimizing the abnormal sample data set based on a feature optimization algorithm; and
using the optimized abnormal sample data set to train the classification model.
6. The computer device according to claim 5 , wherein the pre-training of the anomaly detection model comprises:
acquiring the first sample data set, wherein an amount of first-type data in the first sample data set is greater than that of second-type data; and
using the first sample data set to train the anomaly detection model.
7. A computer device, comprising:
a processor; and
a memory for storing instructions executable by the processor,
wherein the processor is configured to:
acquire data to be recognized, and use a preset anomaly detection model to detect whether the data to be recognized is abnormal data;
if the data to be recognized is detected not to be abnormal, determine that the data to be recognized is secure data; and
if the data to be recognized is detected to be abnormal, use a preset classification model to recognize that the data to be recognized is secure data or risky data,
wherein the anomaly detection model is a first machine learning model and obtained by pre-training based on a first sample data set, and the classification model is a second machine learning model and obtained by pre-training based on a second sample data set different from the first sample data set; and
the pre-training of the classification model comprises:
detecting, by the anomaly detection model, an abnormal sample data set from the second sample data set;
optimizing the abnormal sample data set based on a feature optimization algorithm; and
using the optimized abnormal sample data set to train the classification model.
8. The computer device according to claim 7 , wherein the pre-training of the anomaly detection model comprises:
acquiring the first sample data set, wherein an amount of secure data in the first sample data set is greater than that of risky data; and
using the first sample data set to train the anomaly detection model.
9. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of a computer device, cause the computer device to perform a data type recognition method for recognizing data as first-type data or second-type data, wherein the method comprises:
acquiring data to be recognized, and using a preset anomaly detection model to detect whether the data to be recognized is first-type data; and
inputting other data than the first-type data recognized by the anomaly detection model, into a classification model for recognition, wherein the classification model classifies the other data as first-type data and second-type data,
wherein the anomaly detection model is a first machine learning model and obtained by pre-training based on a first sample data set, and the classification model is a second machine learning model and obtained by pre-training based on a second sample data set different from the first sample data set; and
the pre-training of the classification model comprises:
detecting, by the anomaly detection model, an abnormal sample data set from the second sample data set;
optimizing the abnormal sample data set based on a feature optimization algorithm; and
using the optimized abnormal sample data set to train the classification model.
10. The non-transitory computer-readable storage medium according to claim 9 , wherein the pre-training of the anomaly detection model comprises:
acquiring the first sample data set, wherein an amount of first-type data in the first sample data set is greater than that of second-type data; and
using the first sample data set to train the anomaly detection model.
11. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of a computer device, cause the computer device to perform a risk recognition method for recognizing data as secure data or risky data, wherein the method comprises:
acquiring data to be recognized, and using a preset anomaly detection model to detect whether the data to be recognized is abnormal;
if the data to be recognized is detected not to be abnormal, determining that the data to be recognized is secure data; and
if the data to be recognized is detected to be abnormal, using a preset classification model to recognize that the data to be recognized is secure data or risky data,
wherein the anomaly detection model is a first machine learning model and obtained by pre-training based on a first sample data set, and the classification model is a second machine learning model and obtained by pre-training based on a second sample data set different from the first sample data set; and
the pre-training of the classification model comprises:
detecting, by the anomaly detection model, an abnormal sample data set from the second sample data set;
optimizing the abnormal sample data set based on a feature optimization algorithm; and
using the optimized abnormal sample data set to train the classification model.
12. The non-transitory computer-readable storage medium according to claim 11 , wherein the pre-training of the anomaly detection model comprises:
acquiring the first sample data set, wherein an amount of secure data in the first sample data set is greater than that of risky data; and
using the first sample data set to train the anomaly detection model.