Filtering event records based on selected extracted value
Embodiments are directed towards real time display of event records and extracted values based on at least one extraction rule, such as a regular expression. A user interface may be employed to enable a user to have an extraction rule automatically generate and/or to manually enter an extraction rule. The user may be enabled to manually edit a previously provided extraction rule, which may result in real time display of updated extracted values. The extraction rule may be utilized to extract values from each of a plurality of records, including event records of unstructured machine data. Statistics may be determined for each unique extracted value, and may be displayed to the user in real time. The user interface may also enable the user to select at least one unique extracted value to display those event records that include an extracted value that matches the selected value.
1. A computer-implemented method, comprising:
accessing a set of events, each event associated with a timestamp and including in textual form a portion of machine data that was created to record activity that has previously occurred in an information technology environment;
causing display of at least a first event from the set of events, the display including the portion of machine data included in the first event;
receiving a user selection of a portion of text from the portion of machine data included in the displayed first event;
automatically determining a text extraction rule that, when applied to the portion of machine data included in the first event, would extract the selection of the portion of text from a field in the displayed first event;
for each event in the set of events, applying the text extraction rule to the portion of machine data included in the event to extract from the event a value of the field for the event;
receiving an indication of a selected one of the extracted values;
based on the selected one of the extracted values, causing display of a filtered subset of the events that includes only events having the selected displayed value in the field for the corresponding event and excludes events that do not have the selected displayed value in the field for the corresponding event; and
based on user input indicating that development of the text extraction rule is complete, storing the text extraction rule in computer memory as a definition for the field.
2. The method of claim 1 , wherein the text extraction rule includes a regular expression.
3. The method of claim 1 , wherein the machine data includes log data.
4. The method of claim 1 , wherein for a second event in the accessed set of events, causing display of the second event and an indication of a value that would be extracted by applying the text extraction rule to the portion of machine data included in the second event.
5. The method of claim 1 , wherein each extracted value is visually emphasized with each displayed event via a graphical user interface.
6. The method of claim 1 , wherein the selected one of the extracted values is one of a set of unique extracted values.
7. The method of claim 1 , wherein the selected one of the extracted values is selected via a graphical user interface.
8. The method of claim 1 , further comprising:
identifying a set of unique field values that would be extracted for the field by applying the extraction rule to events in the set of events; and
displaying one or more unique field values in the set of unique field values.
9. The method of claim 1 , wherein events from which the selected displayed value were not extracted are hidden.
10. The method of claim 1 , further comprising:
receiving an indication to de-select the selected one of the extracted values; and
based on the indication to de-select, displaying the set of events.
11. A system comprising:
at least one network device, comprising:
a processor; and
a non-transitory computer-readable storage medium containing instructions configured to cause the processor to perform operations including:
accessing a set of events, each event associated with a timestamp and including in textual form a portion of machine data that was created to record activity that has previously occurred in an information technology environment;
causing display of at least a first event from the set of events, the display including the portion of machine data included in the first event;
receiving a user selection of a portion of text from the portion of machine data included in the displayed first event;
automatically determining a text extraction rule that, when applied to the portion of machine data included in the first event, would extract the selection of the portion of text from a field in the displayed first event;
for each event in the set of events, applying the text extraction rule to the portion of machine data included in the event to extract from the event a value of the field for the event;
receiving an indication of a selected one of the extracted values;
based on the selected one of the extracted values, causing display of a filtered subset of the events that includes only events having the selected displayed value in the field for the corresponding event and excludes events that do not have the selected displayed value in the field for the corresponding event; and
based on user input indicating that development of the text extraction rule is complete, storing the text extraction rule in computer memory as a definition for the field.
12. The system of claim 11 , wherein the text extraction rule includes a regular expression.
13. The system of claim 11 , wherein the machine data includes log data.
14. The system of claim 11 , wherein for a second event in the accessed set of events, causing display of the second event and an indication of a value that would be extracted by applying the text extraction rule to the portion of machine data included in the second event.
15. The system of claim 11 , wherein each extracted value is visually emphasized with each displayed event via a graphical user interface.
16. The system of claim 11 , wherein the selected one of the extracted values is one of a set of unique extracted values.
17. The system of claim 11 , wherein the selected one of the extracted values is selected via a graphical user interface.
18. The system of claim 11 , wherein events from which the selected displayed value were not extracted are hidden.
19. The system of claim 11 , further comprising:
receiving an indication to de-select the selected one of the extracted values; and
based on the indication to de-select, displaying the set of events.
20. A computer-program product, tangibly embodied in a non-transitory machine-readable medium, including instructions configured to cause a data processing apparatus to:
access a set of events, each event associated with a timestamp and including in textual form a portion of machine data that was created to record activity that has previously occurred in an information technology environment;
cause display of at least a first event from the set of events, the display including the portion of machine data included in the first event;
receive a user selection of a portion of text from the portion of machine data included in the displayed first event;
automatically determine a text extraction rule that, when applied to the portion of machine data included in the first event, would extract the selection of the portion of text from a field in the displayed first event;
for each event in the set of events, apply the text extraction rule to the portion of machine data included in the event to extract from the event a value of the field for the event;
receive an indication of a selected one of the extracted values;
based on the selected one of the extracted values, cause display of a filtered subset of the events that includes only events having the selected displayed value in the field for the corresponding event and excludes events that do not have the selected displayed value in the field for the corresponding event; and
based on user input indicating that development of the text extraction rule is complete, store the text extraction rule in computer memory as a definition for the field.