Log query user interface
A series of graphical user interfaces allows a user to define rules for parsing unstructured and structured log data and generate an aggregate rule to identify events across multiple lines of one or more log files. A first graphical user interface allows a user to select a line from a log file under analysis, search for matching lines in the log file, define rules for parsing the log file, and tokenize attributes of the selected lines. A second user interface allows the user to aggregate defined rules so that messages may be correlated to identify events that occur across multiple lines.
1. A method, comprising:
displaying, in a user interface for querying a log file, a plurality of lines of one or more log files;
receiving, at the user interface, a selection of at least a first and a second of the plurality of displayed lines;
for each of the selected lines:
receiving, at a name input field, an input specifying a rule name associated with the selected line,
receiving, at a selection field, a selection of one or more attributes of the selected line,
responsive to the selection of each of the one or more attributes of the selected line:
displaying an attribute name input field in the user interface, the attribute name input field associated with the selected attribute, and
receiving an attribute name for each of the displayed attribute name input fields;
selecting, in a rules column of the user interface, a first rule and a second rule for parsing the log file, the first rule indicated by a first rule name associated with the first selected line and the second rule indicated by a second rule name associated with the second selected line;
linking, in an aggregated column of the user interface, the first rule and second rule by associating at least one attribute name associated with first rule with the second rule name;
creating an aggregate rule from the linked first rule and the second rule; and
executing a query of the log file using the aggregated rule.
2. The method of claim 1 , wherein the log file includes one or more lines from different applications.
3. The method of claim 1 , wherein the log file is generated from a rails application.
4. The method of claim 1 , wherein the log file includes one or more lines generated prior to defining the rules.
5. The method of claim 1 , further comprising:
displaying a search interface;
receiving, in a search field included in the search interface, an input specifying one or more regular expressions included in the selected line; and
displaying, in the search interface, one or more lines that include the one or more specified regular expressions.
6. The method of claim 1 , wherein the selected line includes structured data.
7. The method of claim 1 , further comprising displaying in each attribute name input field a token corresponding to each attribute of the selected line that includes structured data.
8. The method of claim 1 , further comprising associating a different visual indicator with each selected attribute.
9. The method of claim 8 , further comprising:
displaying one or more lines that include one or more of the selected attributes; and
associating the different visual indicators with each attribute of the displayed one or more lines that include the one or more selected attributes.
10. The method of claim 1 , wherein linking the first rule and the second rule comprises:
receiving a selection of one or more attributes of the first rule; and
linking the selected attributed of the first rule to the second rule.
11. A non-transitory computer readable storage medium storing executable computer program instructions, the instructions when executed by a processor causing the processor to:
display, in a user interface for querying a log file, a plurality of lines of one or more log files;
receive, at the user interface, a selection of at least a first and a second of the plurality of displayed lines;
for each of the selected lines:
receive, at the user interface, an input specifying a rule name associated with the selected line,
receive, at a name input field, a selection of one or more attributes of the selected line,
responsive to the selection of each of the one or more attributes of the selected line:
display an attribute name input field in the user interface, the attribute name input field associated with the selected attribute, and
receive an attribute name for each of the displayed attribute name input fields;
select, in a rules column of the user interface, a first rule and a second rule for parsing the log file, the first rule indicated by a first rule name associated with the first selected line and the second rule indicated by a second rule name associated with the second selected line;
link, in an aggregated column of the user interface, the first rule and second rule by associating at least one attribute name associated with first rule with the second rule name;
create an aggregate rule from the linked first rule and the second rule; and
execute a query of the log file using the aggregated rule.
12. The non-transitory computer readable storage medium of claim 11 , wherein the log file includes one or more lines from different applications.
13. The non-transitory computer readable storage medium of claim 11 , wherein the log file is generated from a rails application.
14. The non-transitory computer readable storage medium of claim 11 , wherein the log file includes one or more lines generated prior to defining the rules.
15. The non-transitory computer readable storage medium of claim 11 , further comprising, the instructions when executed by the processor cause the processor to:
display a search interface;
receive, in a search field included in the search interface, an input specifying one or more regular expressions included in the selected line; and
display, in the search interface, one or more lines that include the one or more specified regular expressions.
16. The non-transitory computer readable storage medium of claim 11 , wherein the selected line includes structured data.
17. The non-transitory computer readable storage medium of claim 11 , further comprising, the instructions when executed by the processor cause the processor to display in each attribute name input field a token corresponding to each attribute of the selected line that includes structured data.
18. The non-transitory computer readable storage medium of claim 11 , further comprising, the instructions when executed by the processor cause the processor to associate a different visual indicator with each selected attribute.
19. The non-transitory computer readable storage medium of claim 18 , further comprising, the instructions when executed by the processor cause the processor to:
display one or more lines that include one or more of the selected attributes; and
associate the different visual indicators with each attribute of the displayed one or more lines that include the one or more selected attributes.
20. The non-transitory computer readable storage medium of claim 11 , wherein the instructions when executed by the processor cause the processor to link the first rule and the second rule comprises:
receiving a selection of one or more attributes of the first rule; and
linking the selected attributed of the first rule to the second rule.