Event selection via graphical user interface control
The technology disclosed relates to formulating and refining field extraction rules that are used at query time on raw data with a late-binding schema. The field extraction rules identify portions of the raw data, as well as their data types and hierarchical relationships. These extraction rules are executed against very large data sets not organized into relational structures that have not been processed by standard extraction or transformation methods. By using sample events, a focus on primary and secondary example events help formulate either a single extraction rule spanning multiple data formats, or multiple rules directed to distinct formats. Selection tools mark up the example events to indicate positive examples for the extraction rules, and to identify negative examples to avoid mistaken value selection. The extraction rules can be saved for query-time use, and can be incorporated into a data model for sets and subsets of event data.
1. A computer-implemented method comprising:
causing display, via a graphical user interface, of a sample strategy control for use in selecting a sample set of events to which to apply a field extraction rule that extracts one or more values for one or more fields from the sample set of events;
receiving, via the sample strategy control, a selection of an option indicating a manner in which to select the sample set of events for which to apply the field extraction rule; and
causing display, via the graphical user interface, of the selected sample set of events having annotations indicating portions of text within the sample set of events to be extracted by the field extraction rule.
2. The method of claim 1 , wherein each event in the sample set of events includes a portion of raw data.
3. The method of claim 1 , wherein the option comprises an all events option, a diverse events option, or a rare events option.
4. The method of claim 1 further comprising selecting the sample set of events for which to apply the field extraction rule based on the selected option.
5. The method of claim 1 further comprising applying the field extraction rule to the selected sample set of events.
6. The method of claim 1 further comprising:
receiving a selection to apply the field extraction rule; and
applying the field extraction rule to the selected sample set of events.
7. The method of claim 1 further comprising:
receiving a selection to apply the field extraction rule; and
applying the field extraction rule to a set of events that includes the sample set of events and at least one other event.
8. The method of claim 1 , wherein the option indicates a clustering analysis approach for use in selecting the sample set of events.
9. The method of claim 1 , wherein the option comprises an indication of a diverse events sampling, wherein the diverse events sampling samples events from large clusters of events.
10. The method of claim 1 , wherein the option comprises an indication of a diverse events sampling, wherein the diverse events sampling samples a predetermined number of events from each cluster of a set of large clusters of events.
11. The method of claim 10 , wherein the predetermined number of events is based on the number of clusters in the set of large clusters of events.
12. The method of claim 1 , wherein the option comprises an indication of a sampling strategy that samples a number of events from event clusters, wherein the events sampled from the event clusters is based on a random selection or a periodic selection.
13. The method of claim 1 , wherein the option comprises an indication of a rare events sampling, wherein the rare events sampling samples events from small clusters of events.
14. The method of claim 1 further comprising:
receiving a selection, via a match control, of a matches option; and
based on the selected matches option, causing display of sample events that the field extraction rule succeeds in matching.
15. The method of claim 1 further comprising:
receiving a selection, via a match control, of a non-matches option; and
based on the selected non-matches option, causing display of sample events that field extraction rule fails in matching.
16. A system comprising:
one or more data processors; and
one or more computer-readable storage media containing instructions which when executed on the one or more data processors, cause the one or more processors to perform operations including:
causing display, via a graphical user interface, of a sample strategy control for use in selecting a sample set of events to which to apply a field extraction rule that extracts one or more values for one or more fields from the sample set of events;
receiving, via the sample strategy control, a selection of an option indicating a manner in which to select the sample set of events for which to apply the field extraction rule; and
causing display, via the graphical user interface, of the selected sample set of events having annotations indicating portions of text within the sample set of events to be extracted by the field extraction rule.
17. The system of claim 16 , wherein the option comprises an indication of a sampling strategy that samples a number of events from event clusters, wherein the events sampled from the event clusters is based on a random selection or a periodic selection.
18. One or more computer-storage media storing computer-executable instructions that, when executed by a computing device, perform a method for generating an extraction rule, the method comprising:
causing display, via a graphical user interface, of a sample strategy control for use in selecting a sample set of events to which to apply a field extraction rule that extracts one or more values for one or more fields from the sample set of events;
receiving, via the sample strategy control, a selection of an option indicating a manner in which to select the sample set of events for which to apply the field extraction rule; and
causing display, via the graphical user interface, of the selected sample set of events having annotations indicating portions of text within the sample set of events to be extracted by the field extraction rule.
19. The one or more computer-storage media of claim 18 further comprising:
receiving a selection to apply the field extraction rule; and
applying the field extraction rule to a set of events that includes the sample set of events and at least one other event.
20. The one or more computer-storage media of claim 18 further
comprising: receiving a selection, via a match control, of a matches option; and
based on the selected matches option, causing display of sample events that the field extraction rule succeeds in matching.