Data surveillance system with contextual information
Data surveillance techniques are presented for the detection of security issues, especially of the kind where privileged data may be stolen by steganographic, data manipulation or any form of exfiltration attempts. Such attempts may be made by rogue users or admins from the inside of a network, or from outside hackers who are able to intrude into the network and impersonate themselves as legitimate users. The system and methods use a triangulation process whereby analytical results pertaining to data protocol, user-behavior and packet content are combined to establish a baseline for the data. Subsequent incoming data is then scored and compared against the baseline to detect any security anomalies. A centroid representing the normal population of the data packets is identified. The design allows establishing the context of various events of interest in the organization, thus enabling dynamic management of security policies.
1. A computer-implemented method of surveillance of a plurality of packets of data in a computer network of an organization, said method executing computer program instructions stored in a non-transitory storage medium and comprising the steps of:
(a) analyzing a protocol of said data;
(b) analyzing a user-behavior of a user of said computer network;
(c) analyzing a content of each packet belonging to said plurality of packets of said data by utilizing deep packet inspection (DPI);
(d) establishing a baseline of said data by assigning said each packet to a cluster of said packets amongst a plurality of clusters of said packets of said data;
(e) computing an overall score of said each packet along axes comprising said protocol, said user-behavior and said content;
(f) based on said overall score, computing an absolute distance between said each packet and a center of said cluster of said packets of said data;
(g) scoring said each packet based on its distance from a centroid of said baseline; and
(h) establishing a context of an event in said organization based on said steps (a) through (h).
2. The method of claim 1 providing said context to a response team of said organization.
3. The method of claim 1 where based on said context, an action in a “kill chain” of said event is taken.
4. The method of claim 1 attaching said context to one or more entries of a server log file.
5. The method of claim 4 where said server log file belongs to a proxy server on said computer network.
6. The method of claim 1 where said event is selected from the group consisting of a man-made event and a natural disaster.
7. The method of claim 6 where said man-made event is selected from the group consisting of a data exfiltration attempt and a misconfiguration of a server.
8. The method of claim 6 where said man-made event is a download and distribution of a substantially large file.
9. The method of claim 1 applying fuzzy hashing to a payload of said content.
10. The method of claim 1 performing said assigning by minimizing an objective function given by a value computed by squaring said absolute distance and summing said value across said plurality of said packets of said data and further summing said value across said plurality of said clusters of said packets of said data.
11. A system for surveilling a plurality of packets of data in a computer network of an organization, said system including computer-readable instructions stored in a non-transitory storage medium and a microprocessor coupled to said storage medium for executing said computer-readable instructions, said microprocessor configured to:
(a) analyze a protocol of said data;
(b) analyze a user-behavior of a user of said computer network;
(c) analyze a content of each packet belonging to said plurality of packets of said data by performing deep packet inspection (DPI);
(d) establish a baseline of said data by an assignment of said each packet to a cluster of said packets amongst a plurality of clusters of said packets of said data;
(e) compute an overall score of said each packet along axes comprising said protocol, said user-behavior and said content;
(f) based on said overall score, compute an absolute distance between said each packet and a center of said cluster of said packets of said data;
(g) score said each packet based on its distance from a centroid of said baseline; and
(h) establish a context of an event in said organization based on said elements (a) through (h).
12. The system of claim 11 wherein said microprocessor is further configured to perform said assignment by a minimization of an objective function given by a value computed as a square of said absolute distance summed across said plurality of said packets of said data and further summed across said plurality of said clusters of said packets of said data.
13. The system of claim 11 wherein said context is available to a response team of said organization.
14. The system of claim 11 wherein based on said context, an action in a “kill chain” of said event is taken.
15. The system of claim 11 wherein said context is attached to one or more entries of a server log file.
16. The system of claim 15 wherein said server log file belongs to a proxy server on said computer network.
17. The system of claim 11 wherein said event is selected from the group consisting of a man-made event and a natural disaster.
18. The system of claim 17 wherein said man-made event is a data exfiltration attempt.
19. The system of claim 18 wherein said data exfiltration attempt is accompanied by a suppression of server logs.
20. The system of claim 17 wherein said man-made event is a download and distribution of an unusually large file.