Data identification using inverted indexes
Systems and methods are disclosed involving user interface (UI) search tools for locating data, including tools for summarizing indexed raw machine data that organize and present results to enable expansion and exploration of initial summarizations. The initial summarizations may be explored and refined to help users determine how to identify and best focus a search on data subsets of greater interest.
1. A method, comprising:
causing display, via a graphical user interface, of one or more identifiers of one or more groupings of events, each event including raw machine data corresponding with a timestamp, the one or more groupings of events being generated based on first filter criteria and categorization criteria, wherein the first filter criteria identifies a set of data, wherein the categorization criteria identifies one or more fields to categorize event references, wherein categorization criteria-value pairs correspond to unique combinations of the one or more fields and field values of the one or more fields, and wherein each grouping of the one or more groupings includes a respective group of event references corresponding to a respective group of events that have a same field-value for a field of the one or more fields and satisfy the first filter criteria;
in response to an interaction with a display object displayed via the graphical user interface and associated with a particular grouping of the one or more groupings, identifying, using an inverted index, one or more event references corresponding to one or more events that satisfy the first filter criteria and second filter criteria, wherein the second filter criteria is based on the particular grouping, and wherein the one or more event references correspond to a subset of data; and
causing display, via the graphical user interface, of an identifier of the one or more events.
2. The method of claim 1 , wherein causing display of the one or more identifiers comprises:
causing display of the one or more identifiers in response to execution of a query, wherein the query is associated with the first filter criteria and the categorization criteria, and wherein the set of data is processed as part of the query.
3. The method of claim 1 , wherein causing display of the one or more identifiers comprises:
causing display of the one or more identifiers further based on display criteria, wherein the display criteria comprises at least one of a sort order or a split by order.
4. The method of claim 1 , further comprising:
obtaining an input via the graphical user interface, wherein the input indicates the interaction with the display object.
5. The method of claim 1 , wherein at least one of the first filter criteria or the second filter criteria indicates at least one of a partition, a host, a source a sourcetype, a keyword, a field identifier, or a time range.
6. The method of claim 1 , wherein the inverted index comprises a plurality of entries, each entry of the plurality of entries comprising:
a respective token or a respective field-value pair; and
one or more respective event references, each event reference of the one or more respective event references indicative of a respective event that is associated with the respective token or a field-value corresponding to the respective field-value pair.
7. The method of claim 1 , wherein the inverted index indicates at least one of an origin or a partition associated with the one or more events.
8. The method of claim 1 , wherein the inverted index comprises an event reference array, the event reference array comprising, for each event reference of the one or more event references, a respective timestamp and a respective location identifier.
9. The method of claim 1 , wherein the raw machine data is generated by one or more components in an information technology environment.
10. The method of claim 1 , further comprising:
in response to a request received from a device, generating the one or more groupings.
11. The method of claim 1 , further comprising:
causing display of one or more graphical controls;
obtaining an input via the one or more graphical controls; and
generating the one or more groupings based on the input.
12. The method of claim 1 , further comprising:
causing display of one or more graphical controls;
obtaining an input via the one or more graphical controls; and
identifying the first filter criteria based on the input.
13. The method of claim 1 , further comprising:
causing display, via the graphical user interface, for each respective grouping of the one or more groupings, a respective count indicating a respective number of events associated with the respective grouping.
14. The method of claim 1 , wherein the one or more events correspond to a subset of a plurality of events that satisfy the first filter criteria and second filter criteria.
15. The method of claim 1 , further comprising:
processing the one or more events.
16. The method of claim 1 , further comprising:
categorizing the event references according to the categorization criteria; and
generating the one or more groupings based on categorizing the event references.
17. A computing system, comprising:
memory; and
one or more processing devices coupled to the memory and configured to:
cause display, via a graphical user interface, of one or more identifiers of one or more groupings of events, each event including raw machine data corresponding with a timestamp, the one or more groupings of events being generated based on first filter criteria and categorization criteria, wherein the first filter criteria identifies a set of data, wherein the categorization criteria identifies one or more fields to categorize event references, wherein categorization criteria-value pairs correspond to unique combinations of the one or more fields and field values of the one or more fields, and wherein each grouping of the one or more groupings includes a respective group of event references corresponding to a respective group of events that have a same field-value for a field of the one or more fields and satisfy the first filter criteria;
in response to an interaction with a display object displayed via the graphical user interface and associated with a particular grouping of the one or more groupings, identify, using an inverted index, one or more event references corresponding to one or more events that satisfy the first filter criteria and second filter criteria, wherein the second filter criteria is based on the particular grouping, and wherein the one or more event references correspond to a subset of the set of data; and
cause display, via the graphical user interface, of an identifier of the one or more events.
18. The computing system of claim 17 , wherein to cause display of the one or more identifiers, the one or more processing devices are further configured to:
cause display of the one or more identifiers in response to execution of a query, wherein the query is associated with the first filter criteria and the categorization criteria, and wherein the set of data is processed as part of the query.
19. Non-transitory computer readable media comprising computer-executable instructions, wherein execution of the computer-executable instructions by one or more processing devices causes the one or more processing devices to:
cause display, via a graphical user interface, of one or more identifiers of one or more groupings of events, each event including raw machine data corresponding with a timestamp, the one or more groupings of events being generated based on first filter criteria and categorization criteria, wherein the first filter criteria identifies a set of data, wherein the categorization criteria identifies one or more fields to categorize event references, wherein categorization criteria-value pairs correspond to unique combinations of the one or more fields and field values of the one or more fields, and wherein each grouping of the one or more groupings includes a respective group of event references corresponding to a respective group of events that have a same field-value for a field of the one or more fields and satisfy the first filter criteria;
in response to an interaction with a display object displayed via the graphical user interface and associated with a particular grouping of the one or more groupings, identify, using an inverted index, one or more event references corresponding to one or more events that satisfy the first filter criteria and second filter criteria, wherein the second filter criteria is based on the particular grouping, and wherein the one or more event references correspond to a subset of the set of data; and
cause display, via the graphical user interface, of an identifier of the one or more events.
20. The non-transitory computer readable media of claim 19 , wherein to cause display of the one or more identifiers, the execution of the computer-executable instructions by the one or more processing devices further causes the one or more processing devices to:
cause display of the one or more identifiers in response to execution of a query, wherein the query is associated with the first filter criteria and the categorization criteria, and wherein the set of data is processed as part of the query.