Apparatus, system, and method for enhanced monitoring, searching, and visualization of network data
A system for monitoring and visualization of network data includes a plurality of first devices and a second device coupled to the plurality of first devices over a network. Each first device is associated with corresponding ones of a plurality of ports. Each first device is configured to determine network traffic analysis information associated with a characteristic of network data traversing each of the ports, and to push the network traffic analysis information across a network independent of a solicitation from the network. The second device is configured to generate a map of the network including a visual indicator based on the network traffic analysis information, to receive an update of the network traffic analysis information from at least one of the first devices, and to refresh the visual indicator in real time to reflect the update of the network traffic analysis information.
1. A system for monitoring and visualization of network data, comprising:
a plurality of first devices, each of the plurality of first devices comprising a processor being associated with corresponding ones of a plurality of ports, each of the plurality of first devices being configured to determine network traffic analysis information associated with a characteristic of network data traversing each of the plurality of ports, and to push the network traffic analysis information across a network independent of a solicitation from the network; and
a second device coupled to the plurality of first devices over the network, the second device comprising a processor being configured to generate a map of the network including a visual indicator based on the network traffic analysis information, to receive an update of the network traffic analysis information from at least one of the plurality of first devices, and to refresh the visual indicator in real time to reflect the update of the network traffic analysis information; wherein
each of the plurality of first devices is configured to determine statistical data over each of a plurality of time intervals of a first time granularity based on the network data; and
the statistical data reduces the volume of the network traffic analysis information; and
each of the plurality of first devices is configured to determine the network traffic analysis information based on performance of a mathematical operation on the statistical data, wherein the network traffic analysis information is associated with each of a plurality of time intervals of a second time granularity, the first time granularity being finer than the second time granularity.
2. The system of claim 1 , wherein the visual indicator is based on a number of times that the characteristic has been detected in the network data over a time interval.
3. The system of claim 2 , wherein the characteristic is indicated based on an occurrence of a bit pattern in the network data.
4. The system of claim 2 , wherein the characteristic is indicated based on an occurrence of a pattern of variation in a data rate associated with the network data.
5. The system of claim 1 , wherein each of the plurality of first devices is configured to determine the network traffic analysis information based on application of at least one of a signature-based rule and a behavioral rule to the network data.
6. The system of claim 1 , wherein the mathematical operation includes at least one of a minimum, a maximum, and an average.
7. The system of claim 1 , wherein:
the network traffic analysis information includes a maximum of the statistical data over each of the plurality of time intervals of the second time granularity; and
the characteristic of the network data is indicated by the maximum of the statistical data over at least one of the plurality of time intervals of the second time granularity substantially exceeding the average of the statistical data over the at least one of the plurality of time intervals of the second time granularity.
8. The system of claim 1 , wherein each of the plurality of first devices is configured to determine the network traffic analysis information based on performance of a mathematical operation on at least one of statistics and rule-based information associated with the network data, wherein the mathematical operation includes at least one of a convolution, a moving average, a sum of squares, a linear filtering operation, and a nonlinear filtering operation.
9. The system of claim 8 , wherein the visual indicator is based on a result of the mathematical operation on the network data.
10. The system of claim 1 , wherein each of the plurality of first devices is configured to generate an alert indication associated with the corresponding ones of the plurality of ports based on detection of the characteristic in the network data traversing the corresponding ones of the plurality of ports by each of the plurality of first devices.
11. The system of claim 10 , wherein the visual indicator is based on whether the alert indication is present for each of the plurality of ports.
12. The system of claim 1 , wherein the solicitation is a poll from the second device.
13. A system for monitoring and visualization of network data, comprising:
a first device comprising a processor; and
a plurality of second devices coupled to the first device, each of the plurality of second devices comprising a processor being associated with corresponding ones of a plurality of ports, each of the plurality of second devices being configured to determine network traffic analysis information associated with a characteristic of network data traversing each of the plurality of ports in response to a communication from the first device;
the first device being configured to receive a search request implicating the characteristic, to generate the communication based on the search request, to generate a network map including a visual indicator based on the network traffic analysis information, to receive an update of the network traffic analysis information from at least one of the plurality of second devices, and to refresh the visual indicator in real time to reflect the update of the network traffic analysis information: wherein
each of the plurality of first devices is configured to determine statistical data over each of a plurality of time intervals of a first time granularity based on the network data; and
the statistical data reduces the volume of the network traffic analysis information; and
each of the plurality of first devices is configured to determine the network traffic analysis information based on performance of a mathematical operation on the statistical data, wherein the network traffic analysis information is associated with each of a plurality of time intervals of a second time granularity, the first time granularity being finer than the second time granularity.
14. The system of claim 13 , wherein each of the plurality of second devices is configured to apply at least one of a signature-based rule and a behavioral rule to the network data to determine the network traffic analysis information in response to the communication from the first device based on the search request.
15. The system of claim 13 , wherein the visual indicator is based on a number of times that the characteristic has been detected in the network data over a time interval.
16. The system of claim 15 , wherein the characteristic is indicated based on at least one of an occurrence of a bit pattern in the network data and an occurrence of a pattern of variation in a data rate associated with the network data.
17. The system of claim 13 , wherein:
the first device is coupled to the plurality of second devices over a network; and
each of the plurality of second devices is configured to push the network traffic analysis information across a network independent of a solicitation from the network.
18. The system of claim 13 , wherein each of the plurality of second devices is configured to generate an alert indication associated with the corresponding ones of the plurality of ports based on detection of the characteristic in the network data traversing the corresponding ones of the plurality of ports by each of the plurality of second devices.