Graph-based detection of network security issues
The disclosed techniques relate to a graph-based network security analytic framework to combine multiple sources of information and security knowledge in order to detect risky behaviors and potential threats. In some examples, the input can be anomaly events or simply regular events. The entities associated with the activities can be grouped into smaller time units, e.g., per day. The riskiest days of activity can be found by computing a risk score for each day and according to the features in the day. A graph can be built with links between the time units. The links can also receive scoring based on a number of factors. The resulting graph can be compared with known security knowledge for adjustments. Threats can be detected based on the adjusted risk score for a component (i.e., a group of linked entities) as well as a number of other factors.
1. A method comprising:
accessing a relationship graph in which entities associated with an information technology network are represented as nodes and relationships among the nodes are represented as links;
assigning the nodes in the relationship graph to groups to form a plurality of groups, each group of the plurality of groups including nodes associated with activities that occurred within a same unit of time;
constructing links between nodes across different groups of the plurality of groups, to form a chain of linked nodes, the chain of linked nodes forming a component;
computing a score for the component, wherein the score is indicative of a level of interest associated with nodes attached to a given link, and wherein each node had been assigned an anomaly score from a previous data analytic stage;
identifying the component for security scrutiny based on the computed score; and
performing a network security related action on the identified component.
2. The method of claim 1 , further comprising:
adjusting the score for the component based on comparing events underlying the component with a pattern of interest, wherein the pattern of interest identifies an expected temporal order and/or logical relationship in underlying events for the component to be of interest.
3. The method of claim 2 , wherein the compared events comprise events that have been earmarked as anomalies, and wherein each node is assigned an anomaly score from a previous data analytic stage.
4. The method of claim 1 , wherein the relationship graph is a subset of a composite relationship graph that includes edges representing a plurality of anomalous activities conducted by entities.
5. The method of claim 1 , further comprising:
determining a link score for the component.
6. The method of claim 1 , further comprising:
determining a link score for each link in the component, based on a number of common nodes between the groups with which the component is associated.
7. The method of claim 1 , further comprising:
determining a link score for the component, based on a distance in time between the groups with which the component is associated.
8. The method of claim 1 , further comprising:
determining a link score for the component, based on an anomaly score of each node in the component.
9. The method of claim 1 , further comprising:
determining a link score for each link in the component, wherein the score for the component is based on the link score of the link that connects the nodes in the component.
10. The method of claim 1 , further comprising: creating a new graph using the component.
11. The method of claim 1 , further comprising:
creating a new graph using the component, wherein the new graph includes nodes with respective links and a corresponding group, and wherein the nodes in the new graph are coupled to underlying events so that, responsive to a request, the underlying events are output as supporting evidence.
12. The method of claim 1 , further comprising:
before assigning the nodes in the relationship graph to groups, filtering the nodes and links in the relationship graph by removing nodes that include a whitelisted entity.
13. The method of claim 1 , further comprising:
before assigning the nodes in the relationship graph to groups, filtering the nodes and links in the relationship graph by removing nodes that include an entity having more than a threshold number of anomaly links to other entities.
14. A computer system comprising:
a processor; and
a communication device, operatively coupled to the processor, through which to receive event data indicative of activity of entities associated with an information technology network;
wherein the processor is configured to perform operations including:
accessing a relationship graph in which the entities associated with the information technology network are represented as nodes and relationships among the nodes are represented as links;
assigning the nodes in the relationship graph to groups to form a plurality of groups, each group of the plurality of groups including nodes associated with activities that occurred within a same unit of time;
constructing links between nodes across different groups of the plurality of groups, to form a chain of linked nodes, the chain of linked nodes forming a component;
computing a score for the component, wherein the score is indicative of a level of interest associated with nodes attached to a given link, and wherein each node had been assigned an anomaly score from a previous data analytic stage;
identifying the component for security scrutiny based on the computed score; and
performing a network security related action on the identified component.
15. The computer system of claim 14 , wherein said operations further include:
adjusting the score for the component based on comparing events underlying the component with a pattern of interest, wherein the pattern of interest identifies an expected temporal order and/or logical relationship in underlying events for the component to be of interest.
16. The computer system of claim 15 , wherein the compared events that have been earmarked as anomalies, and wherein each node is assigned an anomaly score from a previous data analytic stage.
17. A non-transitory machine-readable storage medium for use in a processing system, the non-transitory machine-readable storage medium storing instructions, execution of which in the processing system causes the processing system to perform operations comprising:
accessing a relationship graph in which entities associated with an information technology network are represented as nodes and relationships among the nodes are represented as links;
assigning the nodes in the relationship graph to groups to form a plurality of groups, each group of the plurality of groups including nodes associated with activities that occurred within a same unit of time;
constructing links between nodes across different groups of the plurality of groups, to form a chain of linked nodes, the chain of linked nodes forming a component;
computing a score for the component, wherein the score is indicative of a level of interest associated with nodes attached to a given link, and wherein each node had been assigned an anomaly score from a previous data analytic stage;
identifying the component for security scrutiny based on the computed score; and
performing a network security related action on the identified component.
18. The non-transitory machine-readable storage medium of claim 17 , said operations further including:
determining a link score for the component.
19. The non-transitory machine-readable storage medium of claim 17 , said operations further including:
determining a link score for each link in the component, based on a number of common nodes between the groups with which the component is associated.
20. The non-transitory machine-readable storage medium of claim 17 , further comprising:
determining a link score for the component, based on an anomaly score of each node in the component.