Systems and methods for analyzing cybersecurity events
Methods and systems for the detection, identification, analysis of cybersecurity events in order to support prevention of the persistence of threats, malware or other harmful events are provided. The methods and systems of the present invention enable a user to find similar anomalous network traffic within a single network or across multiple networks. The methods and systems identify and correlate activity in order to analyze potential threats within a network by providing broader contextual information about how those threats relate to other activity within the network or across a sector or country.
1. A method of analyzing cybersecurity events in at least one network environment in real time comprising the steps of:
receiving, in real time, data originating from the at least one network;
processing, in real time, the received data;
producing a plurality of events in response to the processing;
adding, in real time, contextual data to one or more of the plurality of events describing the circumstances by which the event was produced;
generating, in real time, a feature vector for each event for which contextual data was added, wherein the feature vector describes the event and the contextual data of that event;
determining a similarity metric for each pair of the plurality of events, wherein each similarity metric is a mathematical measure between the feature vectors of that pair;
determining at least one group of correlated events based on comparisons of similarity metrics; and
creating, in real time, a record of the at least one group of correlated events in a data store, wherein efficient search within the at least one data store for events with similar feature vectors is enabled.
2. The method of claim 1 , wherein the data originates from two different networks within the at least one network environment.
3. The method of claim 1 , wherein the data is one of metadata, packet capture, summary data, and log data.
4. The method of claim 1 , wherein each feature vector comprises an array including at least one of numbers, letters, and symbols.
5. The method of claim 1 , wherein the step of determining at least one group of correlated events takes place remotely from the step of receiving the data.
6. The method of claim 1 , further comprising the step of sending at least one group of correlated events to a monitoring system for analysis by a user.
7. The method of claim 6 , further comprising the step of applying at least one of a tag and a rating along with each of the correlated events of at least one group of correlated events that produces an alert sent to the monitoring system.
8. The method of claim 1 , wherein the steps are stored on a non-transitory machine-readable medium for providing instructions to a processor to perform the steps.
9. A cybersecurity system for analyzing events in a network environment, the system comprising:
at least one computing device comprising a processor and non-transitory memory;
at least one analytic engine, configured to run on at least one of the at least one computing device, for real time processing of network traffic data originating from the network environment to produce events;
at least one correlation engine, configured to run on at least one of the at least one computing device, adapted and configured to receive a plurality of events in real time from the at least one analytic engine, and determine, in real time, groups of related correlated events based on a similarity metric;
an enrichment engine, configured to run on at least one of the at least one computing device, for adding, in real time, contextual data to one or more of the plurality of events describing the circumstances by which the event was produced, wherein the at least one correlation engine is further adapted and configured to:
generate, in real time, a feature vector for each event for which contextual data was added, wherein the feature vector describes the event and the contextual data of that event,
determine the similarity metric for each pair of the plurality of events, wherein each similarity metric is a mathematical measure between the feature vectors of that pair, and
determine at least one group of correlated events based on comparisons of similarity metrics; and
a data store stored on non-transitory memory for storing the at least one group of correlated events, wherein efficient search within the at least one data store for events with similar feature vectors is enabled.
10. The system of claim 9 , wherein each feature vector describing at least one of the plurality of events and its corresponding contextual data comprises an array including at least one of numbers, letters, and symbols.
11. The system of claim 9 , wherein the at least one correlation engine is located remotely from the at least one analytic engine.
12. A cybersecurity system for monitoring a network environment, the system comprising:
at least one computing device comprising a processor and non-transitory memory;
at least one analytic engine, configured to run on at least one of the at least one computing device, adapted and configured to process data in real time to produce events;
at least one correlation engine, configured to run on at least one of the at least one computing device, adapted and configured to receive a plurality of events in real time from the at least one analytic engine, and determine, in real time, groups of related correlated events based on a similarity metric;
an enrichment engine, configured to run on at least one of the at least one computing device, for adding, in real time, contextual data to one or more of the plurality of events describing the circumstances by which the event was produced, wherein the at least one correlation engine is further adapted and configured to:
generate, in real time, a feature vector for each event for which contextual data was added, wherein the feature vector describes the event and the contextual data of that event,
determine the similarity metric for each pair of the plurality of events, wherein each similarity metric is a mathematical measure between the feature vectors of that pair, and
determine at least one group of correlated events based on comparisons of similarity metrics; and
a data store stored on non-transitory memory for storing the at least one group of correlated events,
wherein efficient search within the at least one data store for events with similar feature vectors is enabled,
wherein the data originates from two networks within the at least one network environment.
13. The system of claim 12 , wherein each feature vector describing at least one of the plurality of events and its corresponding contextual data comprises an array including at least one of numbers, letters, and symbols.
14. The system of claim 12 , wherein the at least one correlation engine is located remotely from the at least one analytic engine.