Generating statistics associated with unique field values
Embodiments are directed towards real time display of event records and extracted values based on at least one extraction rule, such as a regular expression. A user interface may be employed to enable a user to have an extraction rule automatically generate and/or to manually enter an extraction rule. The user may be enabled to manually edit a previously provided extraction rule, which may result in real time display of updated extracted values. The extraction rule may be utilized to extract values from each of a plurality of records, including event records of unstructured machine data. Statistics may be determined for each unique extracted value, and may be displayed to the user in real time. The user interface may also enable the user to select at least one unique extracted value to display those event records that include an extracted value that matches the selected value.
1. A computer-implemented method, comprising:
organizing received machine data into a plurality of time-stamped events, wherein event of the plurality of time-stamped events includes a portion of the machine data produced by a component within an information technology environment and reflects activity within the information technology environment;
applying an extraction rule to the plurality of events to extract field values for a particular field defined by an extraction rule;
upon applying the extraction rule to extract field values for the particular field, determining one or more unique field values from the extracted field values for the particular field, as defined by the extraction rule, in the plurality of events;
determining a statistic associated with each of the one or more unique field values in the extracted field values at a location within each of the plurality of events, the location defined by the extraction rule;
causing display, via a graphical user interface, of a subset of the one or more unique field values;
causing display, via the graphical user interface, of information related to the statistic associated with the displayed unique field value among the subset of the one or more unique field values;
wherein the method is performed by one or more computing devices.
2. The method of claim 1 , further comprising:
receiving input corresponding to a selection of a particular unique field value among the subset of the one or more unique field values that have been displayed;
based on receiving the selection, determining a second set of events of the plurality of time-stamped events such that each event of the second set of events includes the selected particular unique field value in the particular field; and
causing display of the second set of events and their corresponding time stamps.
3. The method of claim 1 , wherein the plurality of time-stamped events is a sample subset of a larger dataset of events.
4. The method of claim 1 , wherein the statistic includes a percentage of the set of events having the unique field value in the particular field.
5. The method of claim 1 , wherein the statistic includes a total number of times the unique field value occurs in the particular field in the set of events.
6. The method of claim 1 , wherein the statistic includes a percent of a number of times the unique field value occurs in the particular field in the set of events compared to a total number of field values in the particular field in the set of events.
7. The method of claim 1 , wherein the extraction rule is a regular expression.
8. The method of claim 1 , wherein the extraction rule is automatically generated based on a user interaction with a graphical user interface.
9. The method of claim 1 , wherein the extraction rule is selected by a user via a graphical user interface.
10. An apparatus, comprising:
one or more data processors; and
one or more computer-readable storage media containing instructions which when executed on the one or more data processors, cause the one or more processors to perform operations including:
organizing received machine data into a plurality of time-stamped events, wherein each event of the plurality of time-stamped events includes a portion of the machine data produced by a component within an information technology environment and reflects activity within the information technology environment;
applying an extraction rule to the plurality of events to extract field values for a particular field defined by an extraction rule;
upon applying the extraction rule to extract field values for the particular field, determining one or more unique field values from the extracted field values for the particular field, as defined by the extraction rule, in the plurality of events;
determining a statistic associated with each of the one or more unique field values in the extracted field values at a location within each of the plurality of events, the location defined by the extraction rule;
causing display, via a graphical user interface, of a subset of the one or more unique field values; and
causing display, via the graphical user interface, of information related to the statistic associated with the displayed unique field value among the subset of the one or more unique field values.
11. The apparatus of claim 10 , wherein the operations further comprise:
receiving input corresponding to a selection of a particular unique field value among the subset of the one or more unique field values that have been displayed;
based on receiving the selection, determining a second set of events of the plurality of time-stamped events such that each event of the second set of events includes the selected particular unique field value in the particular field; and
causing display of the second set of events and their corresponding time stamps.
12. The apparatus of claim 10 , wherein the plurality of time-stamped events is a sample subset of a larger dataset of events.
13. The apparatus of claim 10 , wherein the statistic includes a percentage of the set of events having the unique field value in the particular field.
14. The apparatus of claim 10 , wherein the statistic includes a total number of times the unique field value occurs in the particular field in the set of events.
15. The apparatus of claim 10 , wherein the statistic includes a percent of a number of times the unique field value occurs in the particular field in the set of events compared to a total number of field values in the particular field in the set of events.
16. The apparatus of claim 10 , wherein the extraction rule is a regular expression.
17. The apparatus of claim 10 , wherein the extraction rule is automatically generated based on a user interaction with a graphical user interface.
18. The apparatus of claim 10 , wherein the extraction rule is selected by a user via a graphical user interface.
19. One or more non-transitory computer-readable storage media, storing one or more sequences of instructions, which when executed by one or more processors cause performance of:
organizing received machine data into a plurality of time-stamped events, wherein each event of the plurality of time-stamped events includes a portion of the machine data produced by a component within an information technology environment and reflects activity within the information technology environment;
applying an extraction rule to the plurality of events to extract field values for a particular field defined by an extraction rule;
upon applying the extraction rule to extract field values for the particular field, determining one or more unique field values from the extracted field values for the particular field, as defined by the extraction rule, in the plurality of events;
determining a statistic associated with each of the one or more unique field values in the extracted field values at a location within each of the plurality of events, the location defined by the extraction rule;
causing display, via a graphical user interface, of a subset of the one or more unique field values;
causing display, via the graphical user interface, of information related to the statistic associated with the displayed unique field value among the subset of the one or more unique field values.
20. The one or more non-transitory computer-readable storage media of claim 19 , wherein the one or more sequences of instructions, which when executed by the one or more processors cause further performance of:
receiving input corresponding to a selection of a particular unique field value among the subset of the one or more unique field values that have been displayed;
based on receiving the selection, determining a second set of events of the plurality of time-stamped events such that each event of the second set of events includes the selected particular unique field value in the particular field; and
causing display of the second set of events and their corresponding time stamps.
21. The one or more non-transitory computer-readable storage media of claim 19 , wherein the plurality of time-stamped events is a sample subset of a larger dataset of events.
22. The one or more non-transitory computer-readable storage media of claim 19 , wherein the statistic includes a percentage of the set of events having the unique field value in the particular field.
23. The one or more non-transitory computer-readable storage media of claim 19 , wherein the statistic includes a total number of times the unique field value occurs in the particular field in the set of events.
24. The one or more non-transitory computer-readable storage media of claim 19 , wherein the statistic includes a percent of a number of times the unique field value occurs in the particular field in the set of events compared to a total number of field values in the particular field in the set of events.
25. The one or more non-transitory computer-readable storage media of claim 19 ,
wherein the extraction rule is a regular expression.
26. The one or more non-transitory computer-readable storage media of claim 19 ,
wherein the extraction rule is automatically generated based on a user interaction with a graphical user interface.
27. The one or more non-transitory computer-readable storage media of claim 19 ,
wherein the extraction rule is selected by a user via a graphical user interface.