Systems and methods for automated threat detection
Systems and methods for dynamically training a threat detection system include monitoring security analyst workflow data from security analysts analyzing scans of security logs. The workflow data includes rules applied to security log scan results, rule results selected for further analysis, tags applied to rule results, filters applied to rule results, rankings applied to rule results, or actions associated with a pivot by security analysts. A tagging classifier is then trained based on tags assigned to scan results. A review classifier is trained based on scan results previously reviewed by security analysts. A filter and ranking method is trained based on filters and rankings applied to the scan results. An automated threat hunting playbook is generated including the tagging classifier, the review classifier, and the filter and ranking method. The automated threat hunting playbook generates one or more scripts to automatically analyze incoming security data.
1. A method for dynamically training a security threat detection system, comprising:
monitoring security analyst workflow data from one or more security analysts analyzing scans of security logs, wherein the workflow data includes one or more rules applied to security log scan results, rule results selected for further analysis, tags applied to rule results, filters applied to rule results, rankings applied to rule results, or one or more actions associated with a pivot by the one or more security analysts, and/or combinations thereof;
training a tagging classifier based on the tags assigned to rule results from the workflow data;
training a review classifier based on the rule results selected for further analysis;
training a filter and ranking method based on filters and rankings applied to rule results from one or more security analysts;
training a pivot sequence model based on actions executed by the one or more security analysts;
generating an automated threat hunting playbook including the tagging classifier, the review classifier, the pivot sequence model, and the filter and ranking method; and
generating one or more scripts for automatically analyzing incoming security data using the automated threat hunting playbook.
2. The method of claim 1 , wherein the tagging classifier, review classifier, filter and ranking method, and pivot sequence model comprise supervised machine learning models trained based on the workflow data of one or more security analysts.
3. The method of claim 2 , wherein the one or more scripts for automatically analyzing incoming security data generate a plurality of tags, wherein each tag comprises an indicator of compromise within a computer network.
4. The method of claim 3 , further comprising:
receiving a tag update from one or more security analysts; and
dynamically updating the tagging classifier based on the tag update.
5. The method of claim 2 , wherein the one or more scripts for automatically analyzing incoming security data generate a selection of results for review.
6. The method of claim 5 , further comprising:
receiving analyst feedback regarding the selection of results for review; and
dynamically updating the review classifier based on the analyst feedback regarding the selection of results for review.
7. The method of claim 2 , wherein the one or more scripts for automatically analyzing incoming security data generate a selection of prioritized results.
8. The method of claim 7 , further comprising:
receiving analyst feedback regarding the selection of prioritized results; and
dynamically updating the filter and ranking method based on the analyst feedback regarding the selection of prioritized results.
9. The method of claim 1 , wherein the one or more scripts for automatically analyzing incoming security data generate one or more pivot chains via the pivot sequence model, wherein a pivot chain comprises a series of rule results that trace a potential attack.
10. The method of claim 9 , further comprising:
receiving pivot chain feedback from one or more security analysts; and
dynamically updating the pivot sequence model based on the pivot chain feedback.
11. A dynamically trained threat detection system, comprising:
one or more computing systems configured to monitor and store security analyst workflow data from one or more security analysts analyzing scans of security logs, wherein the workflow data includes rules applied to security log scan results, rule results selected for further analysis, tags applied to rule results, filters applied to rule results, rankings applied to rule results, or one or more actions associated with a pivot by the one or more security analysts, and/or combinations thereof;
a tagging classifier trained based on the tags assigned to rule results from the workflow data;
a review classifier trained based on the rule results selected for further analysis;
a pivot sequence model trained based on actions executed by one or more security analysts;
a filter and ranking method trained based on the filters and rankings applied to rule results from one or more security analysts; and
an automated threat hunting playbook including the tagging classifier, the review classifier, the pivot sequence model, and the filter and ranking method, wherein the automated threat hunting playbook is configured to generate one or more scripts for automatically analyzing incoming security data.
12. The system of claim 11 ,
wherein the pivot sequence model generates a pivot chain, and wherein the pivot chain comprises a series of rule results that trace a potential attack.
13. The system of claim 12 , wherein the tagging classifier, review classifier, filter and ranking method, and pivot sequence model comprise supervised machine learning models trained based on the workflow data of one or more security analysts.
14. The system of claim 11 , wherein the pivot sequence model, when applied to raw scan data from a security log, is configured to generate one or more pivot chains.
15. The system of claim 11 , wherein the tagging classifier, when applied to raw scan data from a security log, is configured to generate a plurality of tags, each tag being an indicator of compromise within a computer network.
16. The system of claim 11 , wherein the review classifier, when applied to raw scan data from a security log, is configured to generate a selection of results for review.
17. The system of claim 11 , wherein the filter and ranking method, when applied to raw scan data from a security log, is configured to generate a selection of prioritized results.
18. A system for dynamically training a security threat detection system, comprising:
one or more processors and at least one memory having stored therein instructions that when executed by the one or more processors, cause the system to:
monitor and record workflow data from one or more security analysts analyzing security logs within a computer network, wherein the workflow data includes rules applied to security log scan results, rule results selected for further analysis, tags applied to rule results, filters applied to rule results, rankings applied to rule results, or one or more actions associated with a pivot by the one or more security analysts, and/or combinations thereof;
train a tagging classifier based on the tags applied to rule results from the workflow data;
train a review classifier based on the rule results selected for further analysis by one or more security analysts;
train a filter and ranking method based on the filters and rankings applied to rule results from one or more security analysts;
train a pivot sequence model based on actions executed by one or more security analysts during a threat hunt, the pivot sequence model to generate one or more pivot chains, wherein the tagging classifier, review classifier, filter and ranking method, and pivot sequence model are each supervised machine learning models trained based on the workflow data of one or more security analysts; and
generate an automated threat hunting playbook including the tagging classifier, the review classifier, pivot sequence model, and the filter and ranking method.
19. The system of claim 18 , wherein the instructions further cause the system to:
analyze incoming security data using the threat hunting playbook to generate a plurality of tags, a selection of results for review, a selection of prioritized results, and one or more pivot chains, wherein each tag is an indicator of compromise within a computer network, and a pivot chain is a series of rule results that trace a potential attack;
receive analyst feedback regarding the plurality of tags, the selection of results for review, the selection of prioritized results, and the one or more pivot chains; and
dynamically update the tagging classifier, review classifier, filter and ranking method, and pivot sequence model based on the analyst feedback.
20. The system of claim 19 , wherein analyst feedback includes an alternative pivot sequence executed by the analyst that is different from a pivot chain generated by the pivot sequence model.
21. The system of claim 18 , wherein the pivot by the one or more security analysts comprises one or more of a pivot by time, by user name, towards a different host connected to a computer at a specified time, based on a pivot sequence that was followed, or toward relatable results.
22. The system of claim 21 , wherein the pivot sequence includes include a series of actions taken in investigating a potential compromise event.
23. The system of claim 18 , wherein the threat hunt includes a process for examination of forensic information to search for evidence of malicious attacks.