IP Library Granted Patent US 11,604,871
Granted Patent B2
US 11,604,871 · App. 16/832,778 · Granted Mar 14, 2023

Projected vector modification as mitigation for machine learning model string stuffing

Inventor: Eric Glen Petersen (Beaverton, OR)
Assignee: Cylance Inc.
G06F21/52G06F21/554G06N5/04G06N20/00G06F2221/032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,604,871
App. No.
16/832,778
Granted
Mar 14, 2023
Kind
B2
Abstract

An artifact is received from which features are extracted so as to populate a vector. The features in the vector can be reduced using a feature reduction operations to result in a modified vector having a plurality of buckets. A presence of predetermined types of features are identified within buckets of the modified vector influencing a score above a pre-determined threshold. A contribution of the identified features within the high influence buckets of the modified vector is then attenuated. The modified vector is input into a classification model to generate a score which can be provided to a consuming application or process. Related apparatus, systems, techniques and articles are also described.

Claims (51)

1. A computer-implemented method comprising:

receiving an artifact;

extracting features from the artifact and populating a vector;

reducing features in the vector using a feature reduction operation to result in a modified vector having a plurality of buckets;

identifying a presence of predetermined types of feature within buckets of the modified vector influencing a score above a pre-determined threshold;

attenuating a contribution of the identified features within the high influence buckets of the modified vector by reducing a contribution of specific string features in the high influence buckets while retaining a contribution of non-string features in the high influence buckets without modification;

inputting the modified vector into a classification model to generate a score; and

providing the score to a consuming application or process.

2. The method of claim 1 , wherein the classification model characterizes the artifact as being malicious or benign to access, execute, or continue to execute.

3. The method of claim 2 further comprising: preventing access or execution of the artifact when the classification model characterizes the artifact as being malicious.

4. The method of claim 1 , wherein the classification model is a machine learning model trained using a training data set and providing a continuous scale output.

5. The method of claim 1 , wherein the machine learning model comprises one or more of: a logistic regression model, a neural network, a convolutional neural network, a recurrent neural network, a generative adversarial network, a support vector machine, a random forest, or a Bayesian model.

6. The method of claim 1 , wherein the predetermined types of features comprises alphanumeric strings.

7. The method of claim 1 further comprising:

inputting a plurality of vectorized malware samples into the classification model;

obtaining a plurality of scores based on the inputted vectorized malware samples; and

identifying, based on the classifications, the predetermined types of features within buckets of the vectorized malware samples that influence the scores above the pre-determined threshold.

8. The method of claim 1 , wherein the feature reduction operation comprises one or more of: principal component analysis (PCA), random projection matrices (RPM), linear discriminant analysis, canonical correlation analysis, singular value decomposition (SVD), latent semantic indexing (LSI), discrete cosine transform (DCT), randomized principal component analysis (RPCA), or large sample randomized principal component analysis (LS-RPCA).

9. A system comprising:

at least one data processor; and

memory including instructions which, when executed by the at least one data processor, result in operations comprising:

receiving an artifact;

extracting features from the artifact and populating a vector;

reducing features in the vector using a feature reduction operation to result in a modified vector having a plurality of buckets;

identifying a presence of predetermined types of features within buckets of the modified vector influencing a score above a pre-determined threshold by reducing a contribution of specific string features in the high influence buckets while retaining a contribution of non-string features in the high influence buckets without modification;

attenuating a contribution of the identified features within the high influence buckets of the modified vector;

inputting the modified vector into a classification model to generate a score; and

providing the score to a consuming application or process.

10. The system of claim 9 , wherein the classification model characterizes the artifact as being malicious or benign to access, execute, or continue to execute.

11. The system of claim 10 , wherein the operations further comprise: preventing access or execution of the artifact when the classification model characterizes the artifact as being malicious.

12. The system of claim 9 , wherein the classification model is a machine learning model trained using a training data set and providing a continuous scale output.

13. The system of claim 9 , wherein the machine learning model comprises one or more of: a logistic regression model, a neural network, a convolutional neural network, a recurrent neural network, a generative adversarial network, a support vector machine, a random forest, or a Bayesian model.

14. The system of claim 9 , wherein the predetermined types of features comprises alphanumeric strings.

15. The system of claim 9 , wherein the operations further comprise:

inputting a plurality of vectorized malware samples into the classification model;

obtaining a plurality of scores based on the inputted vectorized malware samples; and

identifying, based on the classifications, the predetermined types of features within buckets of the vectorized malware samples that influence the scores above the pre-determined threshold.

16. The system of claim 9 , wherein the feature reduction operation comprises one or more of: principal component analysis (PCA), random projection matrices (RPM), linear discriminant analysis, canonical correlation analysis, singular value decomposition (SVD), latent semantic indexing (LSI), discrete cosine transform (DCT), randomized principal component analysis (RPCA), or large sample randomized principal component analysis (LS-RPCA).

17. A non-transitory computer program product including instructions which, when executed by at least one computing device, result in operations comprising: receiving an artifact;

extracting features from the artifact and populating a vector;

reducing features in the vector using a feature reduction operation to result in a modified vector having a plurality of buckets;

identifying a presence of predetermined types of features within buckets of the modified vector influencing a score above a pre-determined threshold;

attenuating a contribution of the identified features within the high influence buckets of the modified vector by reducing a contribution of specific string features in the high influence buckets while retaining a contribution of non-string features in the high influence buckets without modification;

inputting the modified vector into a classification model to generate a score; and

providing the score to a consuming application or process.

18. The computer program product of claim 17 , wherein the classification model characterizes the artifact as being malicious or benign to access, execute, or continue to execute, and wherein the operations further comprise: preventing access or execution of the artifact when the classification model characterizes the artifact as being malicious.

19. The computer program product of claim 18 , wherein the classification model is a machine learning model trained using a training data set and providing a continuous scale output, and wherein the machine learning model comprises one or more of: a logistic regression model, a neural network, a convolutional neural network, a recurrent neural network, a generative adversarial network, a support vector machine, a random forest, or a Bayesian model.

20. The computer program product of claim 19 , wherein the operations further comprise:

inputting a plurality of vectorized malware samples into the classification model;

obtaining a plurality of scores based on the inputted vectorized malware samples; and

identifying, based on the classifications, the predetermined types of features within buckets of the vectorized malware samples that influence the scores above the pre-determined threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2020
From: PETERSEN, ERIC GLEN
To: CYLANCE INC.
Reel/Frame 052249/0915 →
Continuity (1)
Related Publication 20210303675A1 · Sep 30, 2021
Cited By (1)
US 12,204,644