Network data management framework
A method includes receiving a plurality of inputs comprising data corresponding to a plurality of network elements, confirming presence of a given network element of the plurality of network elements on at least one network, and adding the given network element to a network element database. The method also includes interfacing with one or more network integration services of a plurality of network integration services to receive data corresponding to the given network element. The network element database is automatically updated with the received data, and the interfacing is performed via a message bus.
1. A method comprising:
receiving a plurality of inputs comprising data corresponding to a plurality of network elements, wherein at least one of the plurality of inputs comprises a request to add a given network element of the plurality of network elements to a network element database, wherein the given network element comprises a physical element of at least one network, and wherein the network element database is connected via a message bus to a plurality of network integration services, the plurality of network integration services being configured to perform monitoring and management services for the plurality of network elements;
confirming presence of the given network element on the at least one network, wherein the confirming comprises querying one or more network integration services of the plurality of network integration services to determine whether the one or more network integration services are performing at least one of the monitoring and management services for the given network element;
adding the given network element to the network element database responsive to confirming the presence of the given network element on the at least one network;
applying one or more rules to determine whether the given network element requires one or more of the monitoring and management services associated with one or more additional network integration services of the plurality of network integration services;
requesting service for the given network element from the one or more additional network integration services responsive to a determination that the given network element requires the one or more of the monitoring and management services;
interfacing with at least one of the one or more network integration services and the one or more additional network integration services via the message bus to receive data corresponding to the given network element;
determining whether the plurality of network elements remain as parts of the at least one network, wherein the determining comprises identifying at least one network element of the plurality of network elements that is inaccessible for a threshold number of designated intervals; and
automatically updating the network element database with the received data and an indication that the at least one network element has been inaccessible for the threshold number of the designated intervals;
wherein the method is performed by at least one processing platform comprising at least one processing device comprising a processor coupled to a memory.
2. The method of claim 1 wherein, in response to an affirmative determination that the one or more network integration services are performing at least one of the monitoring and management services for the given network element, the method further comprises transmitting a notification to at least one user that the given network element has been identified by the one or more network integration services.
3. The method of claim 1 wherein, in response to a negative determination that the one or more network integration services are performing at least one of the monitoring and management services for the given network element, the method further comprises triggering the one or more network integration services (i) to search for and to identify the given network element; and (ii) to at least one of monitor and manage the given network element in response to finding and identifying the given network element.
4. The method of claim 1 wherein the received data comprises a physical inventory and a logical inventory of the given network element.
5. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing platform causes said at least one processing platform:
to receive a plurality of inputs comprising data corresponding to a plurality of network elements, wherein at least one of the plurality of inputs comprises a request to add a given network element of the plurality of network elements to a network element database, wherein the given network element comprises a physical element of at least one network, and wherein the network element database is connected via a message bus to a plurality of network integration services, the plurality of network integration services being configured to perform monitoring and management services for the plurality of network elements;
to confirm presence of the given network element on the at least one network, wherein, in confirming the presence of the given network element on the at least one network, the program code causes said at least one processing platform to query one or more network integration services of the plurality of network integration services to determine whether the one or more network integration services are performing at least one of the monitoring and management services for the given network element;
to add the given network element to the network element database responsive to confirming the presence of the given network element on the at least one network;
to apply one or more rules to determine whether the given network element requires one or more of the monitoring and management services associated with one or more additional network integration services of the plurality of network integration services;
to request service for the given network element from the one or more additional network integration services responsive to a determination that the given network element requires the one or more of the monitoring and management services;
to interface with at least one of the one or more network integration services and the one or more additional network integration services via the message bus to receive data corresponding to the given network element;
to determine whether the plurality of network elements remain as parts of the at least one network, wherein the determining comprises identifying at least one network element of the plurality of network elements that is inaccessible for a threshold number of designated intervals; and
to automatically update the network element database with the received data and an indication that the at least one network element has been inaccessible for the threshold number of the designated intervals.
6. The computer program product according to claim 5 wherein, in response to a negative determination that the one or more network integration services are performing at least one of the monitoring and management services for the given network element, the program code further causes said at least one processing platform to trigger the one or more network integration services (i) to search for and to identify the given network element; and (ii) to at least one of monitor and manage the given network element in response to finding and identifying the given network element.
7. The computer program product according to claim 5 wherein, in response to an affirmative determination that the one or more network integration services are performing at least one of the monitoring and management services for the given network element, the program code further causes said at least one processing platform to transmit a notification to at least one user that the given network element has been identified by the one or more network integration services.
8. The computer program product according to claim 5 wherein the received data comprises a physical inventory and a logical inventory of the given network element.
9. The computer program product according to claim 5 wherein a data taxonomy for the network element database is variable based on content of the received data.
10. An apparatus comprising:
at least one processing platform comprising a plurality of processing devices;
said at least one processing platform being configured:
to receive a plurality of inputs comprising data corresponding to a plurality of network elements, wherein at least one of the plurality of inputs comprises a request to add a given network element of the plurality of network elements to a network element database, wherein the given network element comprises a physical element of at least one network, and wherein the network element database is connected via a message bus to a plurality of network integration services, the plurality of network integration services being configured to perform monitoring and management services for the plurality of network elements;
to confirm presence of the given network element on the at least one network, wherein, in confirming the presence of the given network element on the at least one network, said at least one processing platform is configured to query one or more network integration services of the plurality of network integration services to determine whether the one or more network integration services are performing at least one of the monitoring and management services for the given network element;
to add the given network element to the network element database responsive to confirming the presence of the given network element on the at least one network;
to apply one or more rules to determine whether the given network element requires one or more of the monitoring and management services associated with one or more additional network integration services of the plurality of network integration services;
to request service for the given network element from the one or more additional network integration services responsive to a determination that the given network element requires the one or more of the monitoring and management services;
to interface with at least one of the one or more network integration services and the one or more additional network integration services via the message bus to receive data corresponding to the given network element;
to determine whether the plurality of network elements remain as parts of the at least one network, wherein the determining comprises identifying at least one network element of the plurality of network elements that is inaccessible for a threshold number of designated intervals; and
to automatically update the network element database with the received data and an indication that the at least one network element has been inaccessible for the threshold number of the designated intervals.
11. The apparatus of claim 10 wherein, in response to an affirmative determination that the one or more network integration services are performing at least one of the monitoring and management services for the given network element, said at least one processing platform is further configured to transmit a notification to at least one user that the given network element has been identified by the one or more network integration services.
12. The apparatus of claim 10 wherein, in response to a negative determination that the one or more network integration services are performing at least one of the monitoring and management services for the given network element, said at least one processing platform is further configured to trigger the one or more network integration services (i) to search for and to identify the given network element; and (ii) to at least one of monitor and manage the given network element in response to finding and identifying the given network element.
13. The apparatus of claim 10 wherein the message bus is configured to transport messages between different message-oriented middleware (MOM) providers.
14. The apparatus of claim 13 wherein the different MOM providers use different protocols for data exchange.
15. The apparatus of claim 10 wherein the plurality of network integration services are configured to at least one of monitor performance of one or more of the plurality of network elements, manage configurations of the one or more of the plurality of network elements, manage the performance of the one or more of the plurality of network elements, manage lifecycles of the one or more of the plurality of network elements and track physical locations of the one or more of the plurality of network elements.
16. The apparatus of claim 10 wherein the received data comprises a physical inventory and a logical inventory of the given network element.
17. The apparatus of claim 10 wherein a data taxonomy for the network element database is variable based on content of the received data.
18. The apparatus of claim 10 wherein, in confirming the presence of a given network element on the at least one network, said at least one processing platform is further configured to implement at least one polling agent to attempt to establish communication with the given network element, wherein the implementation of the at least one polling agent is performed via the message bus.
19. The apparatus of claim 10 wherein said at least one processing platform is configured to receive the plurality of inputs comprising the data corresponding to the plurality of network elements via a user interface and an application programming interface (API).
20. The apparatus of claim 19 wherein the API is accessible by a user to provide a code version of the plurality of inputs comprising the data corresponding to the plurality of network elements.