Scalable network monitoring system
A scaleable network monitoring system is discussed. The network monitoring system identifies network monitoring information for the network elements being monitored. By storing only a non-redundant subset of the identified network information in memory, the network monitoring system is able to monitor a much larger group of network elements than is possible with conventional monitoring systems which are burdened by memory constraints. The scaleable network monitoring system also employs a multi-threaded architecture that dynamically spawns an array of multi-technology monitoring sub-systems.
1. A non-transitory physical medium holding computer-executable instructions for scalable network monitoring that when executed cause at least one computing device to:
provide a network monitoring facility that includes a plurality of monitoring resources, the network monitoring facility monitoring a plurality of network elements communicating over a network with the plurality of monitoring resources, at least one of the plurality of monitoring resources dynamically spawning additional monitoring resources based on a response time of at least one network element in responding to a request initiated by the network monitoring facility;
dynamically adjust a pattern of monitoring requests based on a response time of at least one network element in responding to a request initiated by the network monitoring facility, the adjusting interleaving a request to a slower responding network element with requests to faster responding network elements;
identify a collection of network monitoring information for each of the plurality of network elements with the network monitoring facility, the identified network monitoring information being configuration and access information for the plurality of network elements and for agents associated with at least one of the plurality of network elements; and
programmatically store in memory a non-redundant subset of the collection of network monitoring information for the plurality of network elements.
2. The medium of claim 1 wherein an amount of resources spawned is based on a number of Network Interface Cards (NICs) available for use in performing the monitoring of the plurality of network elements.
3. The medium of claim 1 wherein an amount of resources spawned is based on a number of threads available on a computing device supporting the monitoring facility.
4. The medium of claim 1 wherein the dynamically spawned resources represent a plurality of technology-specific resources.
5. The medium of claim 1 wherein the network monitoring facility is one of a plurality of network monitoring facilities contributing to a central repository of network information.
6. A computing device-based system for scalable network monitoring, the computing-device based system comprising:
a network monitoring facility that includes a plurality of monitoring resources executing on the computing device, the network monitoring facility monitoring a plurality of network elements communicating over a network with the plurality of monitoring resources, at least one of the plurality of monitoring resources dynamically spawning additional monitoring resources based on a response time of at least one network element in responding to a request initiated by the network monitoring facility, the network monitoring facility identifying a collection of network monitoring information for each of the plurality of network elements, the collection of network monitoring information being configuration and access information for the plurality of network elements and for agents associated with at least one of the plurality of network elements; and
a memory storing a non-redundant subset of the network monitoring information for the plurality of network elements,
wherein the network monitoring facility dynamically adjusts a pattern of monitoring requests based on a response time of at least one network element in responding to a request initiated by the network monitoring facility, the adjusting interleaving a request to a slower responding network element with requests to faster responding network elements.
7. The system of claim 6 wherein
a plurality of technology-specific resources are dynamically spawned for use in performing the monitoring of the plurality of network elements.
8. A computer-implemented method for performing scalable network monitoring, comprising:
providing a network monitoring facility that includes a plurality of monitoring resources and is hosted on a computing device, the network monitoring facility monitoring a plurality of network elements communicating over a network with the plurality of monitoring resources, at least one of the plurality of monitoring resources dynamically spawning additional monitoring resources based on a response time of at least one network element in responding to a request initiated by the network monitoring facility;
dynamically adjusting a pattern of monitoring requests based on a response time of at least one network element in responding to a request initiated by the network monitoring facility, the adjusting interleaving a request to a slower responding network element with requests to faster responding network elements;
identifying a collection of network monitoring information for each of the plurality of network elements with the network monitoring facility, the identified network monitoring information being configuration and access information for the plurality of network elements and for agents associated with at least one of the plurality of network elements; and
programmatically storing in memory a non-redundant subset of the collection of network monitoring information for the plurality of network elements.
9. The method of claim 8 wherein an amount of resources spawned is based on a number of Network Interface Cards (NICs) available for use in performing the monitoring of the plurality of network elements.
10. The method of claim 8 wherein an amount of resources spawned is based on a number of threads available on a computing device supporting the monitoring facility.
11. The method of claim 8 wherein the dynamically spawned resources represent a plurality of technology-specific resources.
12. The method of claim 8 wherein the network monitoring facility is one of a plurality of network monitoring facilities contributing to a central repository of network information.