Model-based systems and methods for monitoring resources
View Patent ↗Modeling systems and methods for constructing one or more models of a computing system using collected data. Certain model-based systems build topology models and/or model instances by transforming collected performance data into a collection-location independent form. In certain examples, systems include at least one agent for collecting performance data from monitored resource(s), canonical data transform (CDT) configurations, and a data transformation module for performing data transform operation(s) on the performance data based on at least one CDT configuration. The data transform operation may include generating and/or updating a topology model, assigning metrics to model object(s), updating properties of model object(s), creating associations between existing model objects, or the like. Certain systems and methods also allow for a single piece of data to be processed by multiple models or for pieces of data collected from different locations to be matched and/or associated with the same model object.
1. A method for dynamically modeling and monitoring performance data in a computing environment, the method comprising:
by a computer system comprising computer hardware:
receiving performance data collected by at least one agent module from multiple applications executing in multiple servers, wherein the performance data comprises different time series metrics about the multiple servers and the multiple applications executing in the multiple servers;
accessing a first model of a computing environment, wherein the first model comprises information reflecting an expected structure of the performance data collected by the at least one agent;
based, at least in part, on a comparison of the performance data with the expected structure, automatically generating from the first model a second model comprising at least a topology of nodes, wherein the topology of nodes represent the multiple servers and the multiple applications executing in the multiple servers of the computing environment; and
storing in a data repository the performance data comprising different time series metrics about the multiple servers and the multiple applications executing in the multiple servers, in association with the topology of nodes in the second model of the computing environment.
2. The method of claim 1 , wherein automatically generating the topology of nodes comprises generating at least a first data tree representing the multiple servers and the multiple applications executing in the multiple servers.
3. The method of claim 1 , additionally comprising receiving user input to generate the topology of nodes.
4. The method of claim 1 , further comprising matching performance data collected with the agent module with at least one of the nodes in the topology of nodes.
5. The method of claim 1 , wherein automatically generating further comprises associating data from first and second agent modules with a single node in the topology of nodes.
6. The method of claim 1 , additionally comprising generating a user notification when automatically generating comprises modifying a non-identity property of one of the nodes in the topology of nodes.
7. The method of claim 1 , wherein at least one of the nodes in the topology of nodes is associated with a canonical data transform.
8. The method of claim 1 , wherein at least one of the nodes in the topology of nodes is a canonical data transform configuration node.
9. The method of claim 1 , wherein at least one of the nodes in the topology of nodes is transformed into a configuration node.
10. A system for monitoring data in a computing environment, the system comprising:
one or more computer processors comprising computer hardware;
an agent module executing via the one or more computer processors, the agent module configured to obtain performance data about multiple applications executing in multiple servers, wherein the performance data comprises different time series metrics about the multiple servers and the multiple applications executing in the multiple servers;
a database storing at least a first model of a computing environment, wherein the first model comprises information reflecting an expected structure of the performance data obtained by the at least one agent;
a data transformation module implemented in the one or more computer processors, the data transformation module configured to:
receive the performance data collected by the agent module;
based, at least in part, on a comparison of the performance data with the expected structure, automatically generate from the first model a second model comprising at least a topology of nodes, wherein the topology of nodes represent the multiple servers and the multiple applications executing in the multiple servers in the computing environment; and
store in the database the performance data comprising different time series metrics about the multiple servers and the multiple applications executing in the multiple servers in association with the topology of nodes in the second model of the computing environment.
11. The system of claim 10 , wherein the data transformation module is configured to automatically generate at least a first data tree representing the multiple servers and the multiple applications executing in the multiple servers.
12. The system of claim 10 , wherein the data transformation module obtains user input while automatically generating the topology of nodes.
13. The system of claim 10 , wherein the data transformation module is further configured to match performance data collected with the agent module with at least one of the nodes in the topology of nodes.
14. The system of claim 10 , wherein the data transformation module is further configured to associate data from first and second agent modules with a single node in the topology of nodes.
15. The system of claim 10 , wherein the data transformation module is further configured to generate a user notification when modifying a non-identity property of one of the nodes in the topology of nodes.
16. The system of claim 10 , wherein at least one of the nodes in the topology of nodes is associated with a canonical data transform.
17. The system of claim 10 , wherein at least one of the nodes in the topology of nodes is a canonical data transform configuration node.
18. The system of claim 10 , wherein at least one of the nodes in the topology of nodes is transformed into a configuration node.