Data model selection and application based on data sources
Embodiments include generating data models that may give semantic meaning for unstructured or structured data that may include data generated and/or received by search engines, including a time series engine. A method includes generating a data model for data stored in a repository. Generating the data model includes generating an initial query string, executing the initial query string on the data, generating an initial result set based on the initial query string being executed on the data, determining one or more candidate fields from one or results of the initial result set, generating a candidate data model based on the one or more candidate fields, iteratively modifying the candidate data model until the candidate data model models the data, and using the candidate data model as the data model.
1. A computer-implemented method, comprising:
selecting, based on a first data set being analyzed, one or more selected data models, wherein:
the first data set comprises a plurality of time-stamped, searchable events stored in a first data store,
each event in the plurality of time-stamped, searchable events includes a portion of unstructured raw machine data reflecting activity in an information technology environment, and
each selected data model of the one or more selected data models represents a view of the first data set that includes the portion of unstructured raw machine data;
receiving, via a first graphical user interface, a selection of a first object, wherein the first object is included in the one or more selected data models; and
retrieving, based on the first object from a computer memory, a first previously-stored object query associated with the first object and a first previously-stored object schema associated with the first object;
executing the first previously-stored object query to retrieve, from the data store, a first set of time-stamped, searchable events, wherein the first set of time-stamped, searchable events includes portions of unstructured raw machine data; and
applying the first previously-stored object schema to identify, in the first set of time-stamped, searchable events, a set of one or more fields included in the portions of unstructured raw machine data.
2. The computer-implemented method of claim 1 , further comprising causing display of the first graphical user interface that includes a set of objects, wherein the first object is included in the set of objects.
3. The computer-implemented method of claim 1 , wherein:
the first data store is included in a plurality of data stores, and the first data set is stored in only the first data store.
4. The computer-implemented method of claim 1 , further comprising:
extracting first field values from the set of one or more fields; and
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment.
5. The computer-implemented method of claim 1 , further comprising:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing display of the first search result in the first graphical user interface.
6. The computer-implemented method of claim 1 , further comprising:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing, based on the first search result, a production of a first alert or a first notification.
7. The computer-implemented method of claim 1 , further comprising:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing display of a second graphical user interface that includes a first set of data-manipulation controls,
wherein each data-manipulation control included in the first set of data-manipulation controls corresponds to a field included in the set of one or more fields, and
wherein the search query is modified via at least one data-manipulation control included in the first set of data-manipulation controls.
8. The computer-implemented method of claim 1 , further comprising:
extracting first field values from the set of one or more fields;
receiving, via the first graphical user interface, a selection of a first pre-defined search query; and
executing the first pre-defined search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment.
9. The computer-implemented method of claim 1 , wherein the first object is a root object.
10. One or more non-transitory computer-readable media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
selecting, based on a first data set being analyzed, one or more selected data models, wherein:
the first data set comprises a plurality of time-stamped, searchable events stored in a first data store,
each event in the plurality of time-stamped, searchable events includes a portion of unstructured raw machine data reflecting activity in an information technology environment, and
each selected data model of the one or more selected data models represents a view of the first data set that includes the portion of unstructured raw machine data;
receiving, via a first graphical user interface, a selection of a first object, wherein the first object is included in the one or more selected data models; and
retrieving, based on the first object from a computer memory, a first previously-stored object query associated with the first object and a first previously-stored object schema associated with the first object;
executing the first previously-stored object query to retrieve, from the data store, a first set of time-stamped, searchable events, wherein the first set of time-stamped, searchable events includes portions of unstructured raw machine data; and
applying the first previously-stored object schema to identify, in the first set of time-stamped, searchable events, a set of one or more fields included in the portions of unstructured raw machine data.
11. The non-transitory computer-readable media of claim 10 , wherein the one or more processors further perform the steps of causing display of the first graphical user interface that includes a set of objects, wherein the first object is included in the set of objects.
12. The non-transitory computer-readable media of claim 10 , wherein:
the first data store is included in a plurality of data stores, and
the first data set is stored in only the first data store.
13. The non-transitory computer-readable media of claim 10 , wherein the one or more processors further perform the steps of:
extracting first field values from the set of one or more fields; and
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment.
14. The non-transitory computer-readable media of claim 10 , wherein the one or more processors further perform the steps of:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing display of the first search result in the first graphical user interface.
15. The non-transitory computer-readable media of claim 10 , wherein the one or more processors further perform the steps of:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing, based on the first search result, a production of a first alert or a first notification.
16. The non-transitory computer-readable media of claim 10 , wherein the one or more processors further perform the steps of:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing display of a second graphical user interface that includes a first set of data-manipulation controls,
wherein each data-manipulation control included in the first set of data-manipulation controls corresponds to a field included in the set of one or more fields, and
wherein the search query is modified via at least one data-manipulation control included in the first set of data-manipulation controls.
17. The non-transitory computer-readable media of claim 10 , wherein the one or more processors further perform the steps of:
extracting first field values from the set of one or more fields;
receiving, via the first graphical user interface, a selection of a first pre-defined search query; and
executing the first pre-defined search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment.
18. The non-transitory computer-readable media of claim 10 , wherein the first object is a root object.
19. A computing device comprising:
a memory storing instructions; and
one or more processors that is coupled to the memory, and when executing the instructions, performs:
selecting, based on a first data set being analyzed, one or more selected data models, wherein:
the first data set comprises a plurality of time-stamped, searchable events stored in a first data store,
each event in the plurality of time-stamped, searchable events includes a portion of unstructured raw machine data reflecting activity in an information technology environment, and
each selected data model of the one or more selected data models represents a view of the first data set that includes the portion of unstructured raw machine data;
receiving, via a first graphical user interface, a selection of a first object, wherein the first object is included in the one or more selected data models; and
retrieving, based on the first object from a computer memory, a first previously-stored object query associated with the first object and a first previously-stored object schema associated with the first object;
executing the first previously-stored object query to retrieve, from the data store, a first set of time-stamped, searchable events, wherein the first set of time-stamped, searchable events includes portions of unstructured raw machine data; and
applying the first previously-stored object schema to identify, in the first set of time-stamped, searchable events, a set of one or more fields included in the portions of unstructured raw machine data.
20. The computing device of claim 19 , wherein the one or more processors further performs causing display of the first graphical user interface that includes a set of objects, wherein the first object is included in the set of objects.
21. The computing device of claim 19 , wherein:
the first data store is included in a plurality of data stores, and
the first data set is stored in only the first data store.
22. The computing device of claim 19 , wherein the one or more processors further performs:
extracting first field values from the set of one or more fields; and
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment.
23. The computing device of claim 19 , wherein the one or more processors further performs:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing display of the first search result in the first graphical user interface.
24. The computing device of claim 19 , wherein the one or more processors further performs:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing, based on the first search result, a production of a first alert or a first notification.
25. The computing device of claim 19 , wherein the one or more processors further performs:
extracting first field values from the set of one or more fields;
executing a search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment; and
causing display of a second graphical user interface that includes a first set of data-manipulation controls,
wherein each data-manipulation control included in the first set of data-manipulation controls corresponds to a field included in the set of one or more fields, and
wherein the search query is modified via at least one data-manipulation control included in the first set of data-manipulation controls.
26. The computing device of claim 19 , wherein the one or more processors further performs:
extracting first field values from the set of one or more fields;
receiving, via the first graphical user interface, a selection of a first pre-defined search query; and
executing the first pre-defined search query across the first field values to produce a first search result based at least in part on the first data set, wherein the first search result is indicative of a first performance of the information technology environment.
27. The computing device of claim 19 , wherein the first object is a root object.