Generation of threat intelligence based on cross-customer data
Data platforms described herein are configured to monitor a compute environment and generate threat intelligence data based on cross-customer data. Such a data platform may access a plurality of customer datasets collected from a plurality of compute environments, aggregate the plurality of customer datasets into an aggregate dataset, and generate, based on the aggregate dataset, one or more indicators indicative of one or more security threats against one or more compute assets within the plurality of compute environments. The data platform may then detect an occurrence of the one or more indicators within a particular compute environment and perform, based on the occurrence of the one or more indicators, a security response operation with respect to the particular compute environment.
1 . A method comprising:
accessing, by a data platform monitoring a plurality of compute environments associated with a plurality of customers of the data platform, a plurality of customer datasets collected from the plurality of compute environments and each associated with a different customer included in the plurality of customers;
aggregating, by the data platform, the plurality of customer datasets into an aggregate dataset;
generating, by the data platform based on the aggregate dataset, one or more indicators indicative of one or more security threats against one or more compute assets within the plurality of compute environments, wherein the one or more indicators are generated based on a logical graph comprising a plurality of nodes and a plurality of edges representative of activities within the plurality of compute environments;
detecting, by the data platform, an occurrence of the one or more indicators within a particular compute environment being monitored by the data platform and associated with a particular customer of the data platform; and
performing, by the data platform based on the occurrence of the one or more indicators, a security response operation with respect to the particular compute environment.
2 . The method of claim 1 , further comprising:
analyzing, by the data platform, a customer dataset associated with the particular compute environment to detect one or more anomalies within the particular compute environment;
wherein the performing the security response operation is further based on the one or more anomalies.
3 . The method of claim 2 , wherein the analyzing the customer dataset associated with the particular compute environment comprises generating the logical graph comprising the plurality of nodes interconnected by the plurality of edges.
4 . The method of claim 2 , wherein the performing the security response operation comprises determining a confidence level for the one or more indicators.
5 . The method of claim 2 , wherein the performing the security response operation comprises correlating the one or more anomalies with the one or more indicators.
6 . The method of claim 2 , wherein the performing the security response operation comprises generating, based on the one or more anomalies and the occurrence of the one or more indicators, a composite alert signal indicative of whether the one or more anomalies and the occurrence of the one or more indicators are together indicative of one or more intrusions that are severe enough to be alerted on by the data platform.
7 . The method of claim 1 , wherein the performing the security response operation comprises determining, by the data platform based on one or more characteristics of the occurrence of the one or more indicators, contextual information for the occurrence of the one or more indicators.
8 . The method of claim 7 , wherein the contextual information comprises one or more of a severity level associated with the occurrence of the one or more indicators, a confidence level associated with the occurrence of the one or more indicators, a recommended remedial action associated with the occurrence of the one or more indicators, or a narrative description associated with the occurrence of the one or more indicators.
9 . The method of claim 7 , wherein the one or more characteristics comprises one or more of a number of customers associated with the occurrence of the one or more indicators, an environment type associated with the occurrence of the one or more indicators, or an event type associated with the occurrence of the one or more indicators.
10 . The method of claim 1 , wherein the plurality of customer datasets comprises a logins table for each customer included in the plurality of customers, and wherein the one or more security threats are associated with attempted logins within the plurality of compute environments.
11 . The method of claim 1 , wherein one or more of the plurality of customer datasets are collected using one or more agents deployed at the plurality of compute environments.
12 . The method of claim 1 , wherein one or more of the plurality of customer datasets are collected using one or more agentless configurations.
13 . The method of claim 1 , wherein the performing the security response operation comprises presenting a security alert indicating the occurrence of the one or more indicators.
14 . The method of claim 1 , wherein the performing the security response operation comprises performing a remedial action for mitigating an effect of the occurrence of the one or more indicators on the particular compute environment.
15 . The method of claim 1 , wherein the particular compute environment is included in the plurality of compute environments.
16 . A computer program product embodied in a non-transitory computer-readable storage medium and comprising computer instructions for a data platform to perform a process comprising:
accessing a plurality of customer datasets collected from a plurality of compute environments associated with a plurality of customers of a data platform, each customer dataset associated with a different customer included in the plurality of customers;
aggregating the plurality of customer datasets into an aggregate dataset;
generating, based on the aggregate dataset, one or more indicators indicative of one or more security threats against one or more compute assets within the plurality of compute environments, wherein the one or more indicators are generated based on a logical graph comprising a plurality of nodes and a plurality of edges representative of activities within the plurality of compute environments;
detecting an occurrence of the one or more indicators within a particular compute environment being monitored by the data platform and associated with a particular customer of the data platform; and
performing, based on the occurrence of the one or more indicators, a security response operation with respect to the particular compute environment.
17 . The computer program product of claim 16 , wherein the process further comprises:
analyzing a customer dataset associated with the particular compute environment to detect one or more anomalies within the particular compute environment;
wherein the performing the security response operation is further based on the one or more anomalies.
18 . The computer program product of claim 17 , wherein the performing the security response operation comprises correlating the one or more anomalies with the one or more indicators.
19 . The computer program product of claim 16 , wherein the performing the security response operation comprises determining, by the data platform based on one or more characteristics of the one or more indicators, contextual information for the one or more indicators.
20 . A system comprising:
memory storing instructions; and
one or more processors communicatively coupled to the memory and configured to execute the instructions to perform a process comprising:
accessing a plurality of customer datasets collected from a plurality of compute environments associated with a plurality of customers of a data platform, each customer dataset associated with a different customer included in the plurality of customers;
aggregating the plurality of customer datasets into an aggregate dataset;
generating, based on the aggregate dataset, one or more indicators indicative of one or more security threats against one or more compute assets within the plurality of compute environments, wherein the one or more indicators are generated based on a logical graph comprising a plurality of nodes and a plurality of edges representative of activities within the plurality of compute environments;
detecting an occurrence of the one or more indicators within a particular compute environment being monitored by the data platform and associated with a particular customer of the data platform; and
performing, based on the occurrence of the one or more indicators, a security response operation with respect to the particular compute environment.