Network security monitoring and correlation system and method of using
A network security monitoring and correlation system for providing a three-dimensional visualization of network traffic overlaid with security alerts and other relevant discrete data. The system may comprise an application server communicably linked to a client. The server functions to retrieve network traffic metadata and relevant discrete data associated with individual computer hosts and connections in the monitored network, process the network traffic data by building a graph data structure, and then embedding within the graph data structure one or more layers of additional information about the individual computer hosts and connections derived from the discrete data. The client functions to produce a three-dimensional visualization of the network environment by parsing the graph data structure received from the server and then spawning computer hosts and connections in the 3-D environment. The client will then add the overlay information to the appropriate hosts or connections, with the overlay information preferably being represented within the 3-D environment as a particular color, shape, size, position, or a changing dynamic value.
1. A network monitoring system, comprising:
an application server comprising a non-transitory computer readable medium having stored thereon software instructions for programming the application server to perform server operations including:
retrieving network traffic metadata pertaining to a monitored network, wherein the monitored network comprises a private network, a public network, and an external network, with the private network, the public network, and the external network each comprising a plurality of computer hosts; and
processing the network traffic metadata by normalizing the network traffic metadata and constructing a graph data structure, the graph data structure comprising: one or more vertices representing the plurality of computer hosts existing on each of the private network, the public network, and the external network; and one or more edges representing connections between two computer hosts.
2. The network monitoring system of claim 1 , wherein the process of normalizing the network traffic metadata includes extracting normalized fields metadata elements from the network traffic metadata and populating an intermediary array, wherein the normalized fields metadata elements comprise a destination host identifier, a destination host port, a source host identifier, and a source host port.
3. The network monitoring system of claim 2 , wherein the processing of the network traffic metadata further includes extracting non-normalized fields metadata elements from the network traffic metadata and populating a nested array, wherein the non-normalized fields metadata elements define network traffic additional information pertaining to the one or more vertices or the one or more edges of the graph data structure.
4. The network monitoring system of claim 3 , wherein the processing of the network traffic metadata further includes adding the additional network traffic information to the one or more vertices or the one or more edges of the graph data structure.
5. The network monitoring system of claim 4 , wherein the software instructions for programming the application server to perform server operations further include:
retrieving discrete data pertaining to the monitored network; and
processing the discrete data by adding the discrete data to the one or more edges in the graph data structure.
6. The network monitoring system of claim 5 , wherein the processing of the discrete data further includes
extracting discrete data elements from the discrete data and populating the nested array, wherein the discrete data elements define discrete data additional information pertaining to the one or more vertices or the one or more edges of the graph data structure; and
adding the discrete data additional information to the one or more vertices or the one or more edges of the graph data structure.
7. The network monitoring system of claim 6 , wherein the network visualization system further comprises a client application comprising a non-transitory computer readable medium having stored thereon software instructions for programming the application server to perform client operations including: generating a three-dimensional visualization of the monitored network by parsing the graph data structure received from the application server.
8. The network monitoring system of claim 7 , wherein the process of generating the three-dimensional visualization of the monitored network includes spawning the plurality of computer hosts as a first three-dimensional object in a 3-D environment.
9. The network monitoring system of claim 8 , wherein the process of generating the three-dimensional visualization of the monitored network further includes spawning the connections as a second three-dimensional object in the 3-D environment.
10. The network monitoring system of claim 9 , wherein the process of generating the three-dimensional visualization of the monitored network further includes representing the discrete data additional information as a particular color, a particular shape, a particular size, a particular position, or a particular changing dynamic value in the 3-D environment.
11. The network monitoring system of claim 5 , wherein the process of retrieving network traffic metadata and discrete data pertaining to the monitored network includes querying a system database for network traffic metadata and discrete data collected by one or more data collectors during a snapshot timeframe and pertaining to the plurality of computer hosts existing on each of the private network, the public network, and the external network.
12. A method of monitoring a computer network, the method comprising:
retrieving network traffic metadata pertaining to a monitored network, wherein the monitored network comprises a private network, a public network, and an external network, with the private network, the public network, and the external network each comprising a plurality of computer hosts; and
processing the network traffic metadata by embedding the network traffic metadata into a graph data structure, the graph data structure comprising: a plurality of vertices, with each of the plurality of vertices representing one of the plurality of computer hosts existing on either the private network, the public network, or the external network; and one or more edges representing connections between two computer hosts.
13. The method of claim 12 , wherein processing the network traffic metadata further includes normalizing the network traffic metadata by extracting normalized fields metadata elements from the network traffic metadata and populating an intermediary array, wherein the normalized fields metadata elements comprise a destination host identifier, a destination host port, a source host identifier, and a source host port.
14. The method of claim 13 , wherein the processing of the network traffic metadata further includes extracting non-normalized fields metadata elements from the network traffic metadata and populating a nested array, wherein the non-normalized fields metadata elements define network traffic additional information pertaining to the one or more vertices or the one or more edges of the graph data structure.
15. The method of claim 14 , wherein the processing of the network traffic metadata further includes adding the additional network traffic information to the one or more vertices or the one or more edges of the graph data structure.
16. The method of claim 15 , further comprising:
retrieving discrete data pertaining to the monitored network; and
processing the discrete data by adding the discrete data to the one or more edges in the graph data structure.
17. The method of claim 16 , wherein the process of retrieving network traffic metadata and discrete data pertaining to the monitored network includes querying a system database for network traffic metadata and discrete data collected by one or more data collectors during a snapshot timeframe and pertaining to the plurality of computer hosts existing on each of the private network, the public network, and the external network.
18. The method of claim 16 , wherein the processing of the discrete data further includes:
extracting discrete data elements from the discrete data and populating the nested array, wherein the discrete data elements define discrete data additional information pertaining to the one or more vertices or the one or more edges of the graph data structure; and
adding the discrete data additional information to the one or more vertices or the one or more edges of the graph data structure.
19. The method of claim 12 , further comprising:
generating a three-dimensional visualization of the monitored network by parsing the graph data structure; and
displaying the three-dimensional visualization of the monitored network overlaid with the discrete data.
20. The method of claim 19 , wherein the process of generating the three-dimensional visualization of the monitored network includes: spawning the plurality of computer hosts as a first three-dimensional object in a 3-D environment; spawning the connections as a second three-dimensional object in the 3-D environment; and representing the discrete data additional information as a particular color, a particular shape, a particular size, a particular position, or a particular changing dynamic value in the 3-D environment.