Using graph-based models to identify datacenter anomalies
Activities within a network environment are monitored (e.g., using agents). At least a portion of the monitored activities are used to generate a logical graph model. The generated logical graph model is used to determine an anomaly. The detected anomaly is recorded and can be used to generate an alert.
1. A system, comprising:
a processor configured to:
monitor activities within a network environment and generate a graph of physical connection information, wherein generating the graph of physical connection information includes matching information provided by a client and a server, respectively, into an established connection between the client and the server;
use at least a portion of the generated graph of physical connection information to generate a multidimensional logical graph model, wherein the multidimensional logical graph model comprises a set of nodes and a set of edges, wherein a first node included in the set of nodes corresponds to an entity of a first type and wherein a second node included in the set of nodes corresponds to an entity of a second type that is different from the first type, wherein an edge connects the first node and the second node, wherein a first edge between the first node and the second node has a first edge type and a second edge between the second node and a third node has a second edge type that is different from the first edge type, wherein the first edge type indicates a first behavioral relationship between arbitrary nodes interconnected by the first edge type, and wherein the second edge type indicates a different behavioral relationship between arbitrary nodes interconnected by the second edge type;
determine, using the generated multidimensional logical graph model, that a new edge has been added to the set of edges; and
in response to determining that the new edge has been added to the set of edges, automatically generate an alert that an anomaly in the network environment associated with the new edge has occurred; and
a memory coupled to the processor and configured to provide the processor with instructions.
2. The system of claim 1 wherein the generated multidimensional logical graph model represents a baseline of behavior of nodes included in the network environment.
3. The system of claim 2 wherein using the multidimensional logical graph model to detect the anomaly includes comparing a current graph associated with the network environment against the baseline.
4. The system of claim 1 wherein the network environment comprises a datacenter.
5. The system of claim 1 wherein the detected anomaly is associated with identifying a security threat.
6. The system of claim 1 wherein the multidimensional logical graph model is generated at least in part by performing matching neighbors clustering on a graph.
7. The system of claim 6 wherein the graph comprises process information.
8. The system of claim 1 wherein the multidimensional logical graph model is generated at least in part by performing similarity ranking on a graph.
9. The system of claim 8 wherein the graph comprises process information.
10. The system of claim 1 wherein the multidimensional logical graph model is generated at least in part by performing a split on a graph.
11. The system of claim 10 wherein the graph comprises process information.
12. The system of claim 10 wherein the split is based at least in part on an application type.
13. The system of claim 1 wherein the processor is further configured to determine whether a process matches a predetermined application type included in a set of predetermined application types.
14. The system of claim 13 wherein the processor is further configured to generate an alert in response to determining that the process does not match any members of the set of predetermined application types.
15. The system of claim 1 wherein detecting the anomaly includes detecting a new node in the multidimensional logical graph model.
16. A method, comprising:
monitoring activities within a network environment and generating a graph of physical connection information, wherein generating the graph of physical connection information includes matching information provided by a client and a server, respectively, into an established connection between the client and the server;
using at least a portion of the generated graph of physical connection information to generate a multidimensional logical graph model, wherein the multidimensional logical graph model comprises a set of nodes and a set of edges, wherein a first node included in the set of nodes corresponds to an entity of a first type and wherein a second node included in the set of nodes corresponds to an entity of a second type that is different from the first type, wherein an edge connects the first node and the second node, wherein a first edge between the first node and the second node has a first edge type and a second edge between the second node and a third node has a second edge type that is different from the first edge type, wherein the first edge type indicates a first behavioral relationship between arbitrary nodes interconnected by the first edge type, and wherein the second edge type indicates a different behavioral relationship between arbitrary nodes interconnected by the second edge type;
determining, using the generated multidimensional logical graph model, that a new edge has been added to the set of edges; and
in response to determining that the new edge has been added to the set of edges, automatically generating an alert that an anomaly in the network environment associated with the new edge has occurred.
17. The method of claim 16 wherein the generated multidimensional logical graph model represents a baseline of behavior of nodes included in the network environment.
18. The method of claim 17 wherein using the multidimensional logical graph model to detect the anomaly includes comparing a current graph associated with the network environment against the baseline.
19. The method of claim 16 wherein the network environment comprises a datacenter.
20. The method of claim 16 wherein the detected anomaly is associated with identifying a security threat.
21. The method of claim 16 wherein the multidimensional logical graph model is generated at least in part by performing matching neighbors clustering on a graph.
22. The method of claim 21 wherein the graph comprises process information.
23. The method of claim 16 wherein the multidimensional logical graph model is generated at least in part by performing similarity ranking on a graph.
24. The method of claim 23 wherein the graph comprises process information.
25. The method of claim 16 wherein the multidimensional logical graph model is generated at least in part by performing a split on a graph.
26. The method of claim 25 wherein the graph comprises process information.
27. The method of claim 25 wherein the split is based at least in part on an application type.
28. The method of claim 16 further comprising determining whether a process matches a predetermined application type included in a set of predetermined application types.
29. The method of claim 28 further comprising generating an alert in response to determining that the process does not match any members of the set of predetermined application types.
30. The method of claim 16 wherein detecting the anomaly includes detecting a new node in the multidimensional logical graph model.
31. A computer program product embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
monitoring activities within a network environment and generating a graph of physical connection information, wherein generating the graph of physical connection information includes matching information provided by a client and a server, respectively, into an established connection between the client and the server;
using at least a portion of the generated graph of physical connection information to generate a multidimensional logical graph model, wherein the multidimensional logical graph model comprises a set of nodes and a set of edges, wherein a first node included in the set of nodes corresponds to an entity of a first type and wherein a second node included in the set of nodes corresponds to an entity of a second type that is different from the first type, wherein an edge connects the first node and the second node, wherein a first edge between the first node and the second node has a first edge type and a second edge between the second node and a third node has a second edge type that is different from the first edge type, wherein the first edge type indicates a first behavioral relationship between arbitrary nodes interconnected by the first edge type, and wherein the second edge type indicates a different behavioral relationship between arbitrary nodes interconnected by the second edge type;
determining, using the generated multidimensional logical graph model, that a new edge has been added to the set of edges; and
in response to determining that the new edge has been added to the set of edges, automatically generating an alert that an anomaly in the network environment associated with the new edge has occurred.