Automated threat hunting
Embodiments perform automated threat hunting in computing environments. A threat hunt plan is obtained to guide collection of candidate evidence items from evidence sources. Portions of candidate evidence items are discarded based on relevance scores, and evidence items are determined from non-discarded portions. Threat indicators associated with the evidence items are identified based on criteria in the threat hunt plan. Threat profiles are obtained based on the evidence items and threat indicators such that threat profiles include threat assessment metrics and are included in a report. Collection agents may interface with system logs, network traffic captures, endpoints, databases, email services, or user activity records to gather evidence items based on time ranges, filtering criteria, or sampling rates.
1 . A method for managing security in a computing environment using one or more processors to execute instructions that are configured to cause actions, comprising:
obtaining a threat hunt plan to collect a plurality of candidate evidence items from one or more evidence sources;
discarding one or more portions of the plurality of candidate evidence items based on a relevance score associated with each candidate evidence item;
collecting one or more evidence items based on one or more non-discarded portions of the plurality of candidate evidence items;
identifying one or more threat indicators associated with the one or more evidence items based on one or more criteria in the threat hunt plan;
obtaining one or more threat profiles based on the one or more evidence items and the one or more threat indicators, wherein the one or more threat profiles include one or more threat assessment metrics associated with the one or more threat indicators, and wherein the one or more threat profiles are included in a report; and
obtaining a user interface that includes one or more display panels for content that includes the report and other information associated with the one or more threat assessments, wherein the content is dynamically transformed and arranged for display to a user based on one or more of user interaction telemetry, user feedback or telemetry metrics.
2 . The method of claim 1 , further comprises:
collecting threat intelligence data from one or more external threat sources including one or more of a security vendor advisory, a government alert, an industry threat report, or a vulnerability disclosure.
3 . The method of claim 1 , wherein collecting the one or more candidate evidence items, further comprises:
obtaining one or more collection agents to interface with one or more of a system log, a network traffic capture, an endpoint, a database, an email service, or a user activity record, wherein the one or more collection agents collect the plurality of candidate evidence items from the one or more evidence sources based on one or more of a time range, a filtering criterion, or a sampling rate.
4 . The method of claim 1 , further comprising:
obtaining the threat hunt plan from a threat hunt plan repository based on a threat hunt hypothesis, wherein the threat hunt plan includes one or more of an evidence collection strategy, an investigation methodology, an analysis framework, or a reporting requirement; and
modifying the threat hunt plan based on one or more of an organizational environment, an available evidence source, a security configuration, or a network architecture.
5 . The method of claim 1 , further comprising:
discarding one or more other portions of candidate evidence items of the plurality of candidate evidence items based on one or more filters that include one or more of a relevance filter, a quality filter, a format validator, or a duplicate detector; and
normalizing one or more of a data format, a timestamp format, an entity identifier, or a metadata structure associated with each non-discarded candidate evidence item.
6 . The method of claim 1 , further comprising:
obtaining one or more authentication actions associated with the one or more evidence items, wherein the one or more authentication actions include one or more of a login frequency, an access timing pattern, a credential usage pattern, or a session management activity; and
correlating the one or more authentication actions with one or more of a user role, a geographic location, a device characteristic, or a network context to identify one or more security concerns, wherein the one or more security concerns are included in the threat profile.
7 . The method of claim 1 , wherein obtaining the one or more threat profiles further comprises:
obtaining one or more metrics that include one or more of a threat severity rating, a confidence score, a risk indicator, or an evidence correlation that are associated with the one or more evidence items, wherein the one or more threat profiles include the one or more metrics.
8 . The method of claim 1 , further comprising:
detecting one or more threats, wherein one or more descriptions of the one or more detected threats include one or more of evidence documentation, an attack vector description, a compromise indicator summary, or a threat actor attribution analysis;
obtaining one or more response recommendations associated with the one or more threats including one or more of an immediate containment measure, a threat mitigation strategy, a system hardening procedure, or an incident response escalation protocol; and
updating the report to include the one or more descriptions and the one or more response recommendations.
9 . The method of claim 1 , further comprising:
obtaining one or more other response recommendations including one or more of a complementary threat hunting plan, an expanded evidence collection activity, a related threat vector analysis, or a continuous monitoring requirement; and
collecting one or more detection rule proposals that incorporate one or more of a discovered threat indicator, an attack pattern, a behavioral anomaly, or a compromise signature into one or more automated monitoring systems; and
updating the report to include the one or more other response recommendations and the one or more detection rule proposals.
10 . The method of claim 1 , further comprising:
obtaining a threat hunt hypothesis based on one or more of a user input, a scheduled task, or a notice associated with one or more potential security threats, wherein the threat hunt plan is based on the threat hunt hypothesis.
11 . A network computer for managing security in a computing environment, comprising:
a memory that stores at least instructions; and
one or more processors that execute instructions that are configured to cause actions, including:
obtaining a threat hunt plan to collect a plurality of candidate evidence items from one or more evidence sources;
discarding one or more portions of the plurality of candidate evidence items based on a relevance score associated with each candidate evidence item;
collecting one or more evidence items based on one or more non-discarded portions of the plurality of candidate evidence items;
identifying one or more threat indicators associated with the one or more evidence items based on one or more criteria in the threat hunt plan;
obtaining one or more threat profiles based on the one or more evidence items and the one or more threat indicators, wherein the one or more threat profiles include one or more threat assessment metrics associated with the one or more threat indicators, and wherein the one or more threat profiles are included in a report; and
obtaining a user interface that includes one or more display panels for content that includes the report and other information associated with the one or more threat assessments, wherein the content is dynamically transformed and arranged for display to a user based on one or more of user interaction telemetry, user feedback or telemetry metrics.
12 . The network computer of claim 11 , wherein collecting the one or more candidate evidence items, further comprises:
obtaining one or more collection agents to interface with one or more of a system log, a network traffic capture, an endpoint, a database, an email service, or a user activity record, wherein the one or more collection agents collect the plurality of candidate evidence items from the one or more evidence sources based on one or more of a time range, a filtering criterion, or a sampling rate.
13 . The network computer of claim 11 , further comprising:
obtaining the threat hunt plan from a threat hunt plan repository based on a threat hunt hypothesis, wherein the threat hunt plan includes one or more of an evidence collection strategy, an investigation methodology, an analysis framework, or a reporting requirement; and
modifying the threat hunt plan based on one or more of an organizational environment, an available evidence source, a security configuration, or a network architecture.
14 . The network computer of claim 11 , further comprising:
discarding one or more other portions of candidate evidence items of the plurality of candidate evidence items based on one or more filters that include one or more of a relevance filter, a quality filter, a format validator, or a duplicate detector; and
normalizing one or more of a data format, a timestamp format, an entity identifier, or a metadata structure associated with each non-discarded candidate evidence item.
15 . The network computer of claim 11 , further comprising:
obtaining one or more authentication actions associated with the one or more evidence items, wherein the one or more authentication actions include one or more of a login frequency, an access timing pattern, a credential usage pattern, or a session management activity; and
correlating the one or more authentication actions with one or more of a user role, a geographic location, a device characteristic, or a network context to identify one or more security concerns, wherein the one or more security concerns are included in the threat profile.
16 . The network computer of claim 11 , wherein obtaining the one or more threat profiles further comprises:
obtaining one or more metrics that include one or more of a threat severity rating, a confidence score, a risk indicator, or an evidence correlation that are associated with the one or more evidence items, wherein the one or more threat profiles include the one or more metrics.
17 . The network computer of claim 11 , further comprising:
detecting one or more threats, wherein one or more descriptions of the one or more detected threats include one or more of evidence documentation, an attack vector description, a compromise indicator summary, or a threat actor attribution analysis;
obtaining one or more response recommendations associated with the one or more threats including one or more of an immediate containment measure, a threat mitigation strategy, a system hardening procedure, or an incident response escalation protocol; and
updating the report to include the one or more descriptions and the one or more response recommendations.
18 . The network computer of claim 11 , further comprising:
obtaining one or more other response recommendations including one or more of a complementary threat hunting plan, an expanded evidence collection activity, a related threat vector analysis, or a continuous monitoring requirement; and
collecting one or more detection rule proposals that incorporate one or more of a discovered threat indicator, an attack pattern, a behavioral anomaly, or a compromise signature into one or more automated monitoring systems; and
updating the report to include the one or more other response recommendations and the one or more detection rule proposals.
19 . A processor readable non-transitory storage media that includes instructions configured for managing security in a computing environment, wherein execution of the instructions by one or more processors on one or more network computers performs actions, comprising:
obtaining a threat hunt plan to collect a plurality of candidate evidence items from one or more evidence sources;
discarding one or more portions of the plurality of candidate evidence items based on a relevance score associated with each candidate evidence item;
collecting one or more evidence items based on one or more non-discarded portions of the plurality of candidate evidence items;
identifying one or more threat indicators associated with the one or more evidence items based on one or more criteria in the threat hunt plan;
obtaining one or more threat profiles based on the one or more evidence items and the one or more threat indicators, wherein the one or more threat profiles include one or more threat assessment metrics associated with the one or more threat indicators, and wherein the one or more threat profiles are included in a report; and
obtaining a user interface that includes one or more display panels for content that includes the report and other information associated with the one or more threat assessments, wherein the content is dynamically transformed and arranged for display to a user based on one or more of user interaction telemetry, user feedback or telemetry metrics.
20 . The media of claim 19 , wherein collecting the one or more candidate evidence items, further comprises:
obtaining one or more collection agents to interface with one or more of a system log, a network traffic capture, an endpoint, a database, an email service, or a user activity record, wherein the one or more collection agents collect the plurality of candidate evidence items from the one or more evidence sources based on one or more of a time range, a filtering criterion, or a sampling rate.