Correlation of performance data and structure data from an information technology environment
The disclosed system and method acquire and store performance measurements relating to performance of a component in an information technology (IT) environment and log data produced by the IT environment, in association with corresponding time stamps. The disclosed system and method correlate at least one of the performance measurements with at least one of the portions of log data.
1. A method comprising:
acquiring, by a computer system, performance measurements for a performance metric associated with one or more hardware or software components of an information technology (IT) environment;
acquiring, by the computer system, structure data indicative of structure characteristics of the IT environment, the structure data associated with the one or more hardware or software components of the IT environment;
correlating, by the computer system, at least a portion of the performance measurements for the performance metric with at least a portion of the structure data associated with the one or more hardware or software components of the IT environment, based on a correlation criteria; and
causing display, via a graphical user interface, of an indication of performance of at least one hardware or software component of the IT environment in association with the performance metric.
2. The method of claim 1 , wherein the correlation criterion relates to a machine in the IT environment.
3. The method of claim 1 , wherein the structure data are derived from log data associated with the one or more hardware or software components of the IT environment.
4. The method of claim 1 , wherein the structure data are derived from log data associated with the one or more hardware or software components of the IT environment, and wherein the log data is from a text-based log file.
5. The method of claim 1 , wherein the structure data are derived from log data associated with the one or more hardware or software components of the IT environment, the log data is from a text-based log file, and the performance measurements are not derived from a log file and are acquired independently of the log data.
6. The method of claim 1 , wherein the plurality of performance measurements are acquired without reference to log data.
7. The method of claim 1 , wherein the performance measurements have been acquired by direct measurement of the one or more hardware or software components of the IT environment.
8. The method of claim 1 , wherein the structure data are derived from log data associated with the one or more hardware or software components of the IT environment;
the method further comprising:
acquiring the log data in the form of a plurality of portions of log data; and
storing each of the acquired portions of log data.
9. The method of claim 1 , wherein the structure data are derived from log data associated with the one or more hardware or software components of the IT environment;
the method further comprising:
acquiring the log data in the form of a plurality of portions of log data;
and wherein said storing comprises storing each of the acquired performance measurements, each of the acquired structure data and each of the acquired portions of log data with a time-stamp in a time-series data store.
10. The method of claim 1 , wherein the correlation criterion is a time-based criterion.
11. The method of claim 1 , wherein the correlation criterion is not a time-based criterion.
12. The method of claim 1 , wherein the correlation criterion is a user-specified search criterion.
13. The method of claim 1 , wherein the correlation criterion is a user-specified search criterion that is not a time-based criterion.
14. The method of claim 1 , wherein said correlating comprises causing concurrent display of at least one performance measurement and at least one structure data that each satisfy the correlation criterion.
15. The method of claim 1 , wherein the performance metric comprises a performance metric for one or more hardware or software resources of a computer system.
16. The method of claim 1 , wherein the performance metric comprises a performance metric for at least one virtual machine or virtual machine host.
17. The method of claim 1 , wherein the performance metric comprises a performance metric for a virtual machine cluster.
18. The method of claim 1 , further comprising:
obtaining the correlation criterion from a user input to a graphical user interface element that enables a user to input a search criterion as said correlation criterion but does not enable input of a complete search query.
19. The method of claim 1 , further comprising:
obtaining the correlation criterion from a user input to a graphical user interface element, wherein the correlation criterion relates to a machine in the IT environment.
20. The method of claim 1 , further comprising, prior to said correlating:
obtaining the correlation criterion from a search query input by a user into a query box in a text-based search query language.
21. The method of claim 1 , further comprising, prior to said correlating:
obtaining the correlation criterion from a search query input by a user into a query box in a text-based search query language, wherein the correlation criterion relates to a machine in the IT environment.
22. The method of claim 1 further comprising:
storing, by the computer system, the acquired performance measurements and the acquired structure data, wherein
said storing comprises storing each of the acquired performance measurements and each of the acquired structure data with a time-stamp;
said correlating further comprises identifying at least one of the stored performance measurements and at least one of the stored structure data that have time stamps that satisfy a user-specified time criterion.
23. The method of claim 1 further comprising:
storing, by the computer system, the acquired performance measurements and the acquired structure data, wherein
said storing comprises storing each of the acquired performance measurements and each of the acquired structure data with a time-stamp in a time-series data store;
and said correlating comprises correlating a performance measurement of the IT environment with a structure data of the IT environment, by identifying a portion of stored structure data that has a time stamp that corresponds to a time stamp of one of the stored performance measurements.
24. The method of claim 1 further comprising:
storing, by the computer system, the acquired performance measurements and the acquired structure data, wherein
said storing comprises storing each of the acquired performance measurements and each of the acquired structure data with a time-stamp;
said correlating comprises:
identifying a particular performance measurement; and
identifying a portion of structure data that has a time stamp most recently preceding a time stamp associated with the particular performance measurement.
25. The method of claim 1 , wherein the performance measurements are stored in a first time-series data store, and the structure data are stored in a second time-series data store separate from the first time-series data store.
26. The method of claim 1 , wherein the performance measurements are stored in a time-series data store in a first format, and the log data are stored in said time-series data store in a second format different from the first format.
27. The method of claim 1 , wherein the performance measurements are stored in a first time-series data store in a first format, and the structure data are stored in a second time-series data store separate from the first time-series data store in a second format different from the first format.
28. The method of claim 1 , the method further comprising:
acquiring log data indicative of activity of the one or more hardware or software components of the IT environment;
storing each of the acquired portions of log data with an associated time stamp in a first time-series data store; and
storing the acquired performance measurements and the acquired structure data, wherein each of the acquired performance measurements are stored with an associated time stamp in a second time-series data store separate from the first time-series data store, and wherein each of the acquired structure data are stored with an associated time stamp in a third time-series data store separate from the first and second time-series data stores.
29. A non-transitory machine-readable storage medium for use in a processing system of a data intake and query system, the non-transitory machine-readable storage medium storing instructions, an execution of which in the processing system causes the processing system to perform operations comprising:
acquiring, performance measurements for a performance metric associated with one or more hardware or software components of an information technology (IT) environment;
acquiring, , structure data indicative of structure characteristics of the IT environment, the structure data associated with the one or more hardware or software components of the IT environment;
correlating, at least a portion of the performance measurements for the performance metric with at least a portion of the structure data associated with the one or more hardware or software components of the IT environment, based on a correlation criteria; and
causing display, via a graphical user interface, of an indication of performance of at least one hardware or software component of the IT environment in association with the performance metric.
30. A system comprising:
a communication device through which to communicate on a computer network;
and
at least one processor operatively coupled to the communication device and configured to perform operations including acquiring, performance measurements for a performance metric associated with one or more hardware or software components of an information technology (IT) environment;
acquiring, structure data indicative of structure characteristics of the IT environment, the structure data associated with the one or more hardware or software components of the IT environment;
correlating, , at least a portion of the performance measurements for the performance metric with at least a portion of the structure data associated with the one or more hardware or software components of the IT environment, based on a correlation criteria; and
causing display, via a graphical user interface, of an indication of performance of at least one hardware or software component of the IT environment in association with the performance metric.