Large log file diagnostics system
An information handling system (IHS) diagnostic system includes a user IHS that is coupled to a network and operable to generate a log file that is associated with a user IHS error. A distributed processing IHS is coupled to the user IHS through the network and operable to receive the log file generated by the user IHS over the network. That log file is then stored on a plurality of node IHS's in the distributed processing IHS. When a job request is received from the user IHS over the network, a job associated with the job request is performed on the log file using the plurality of node IHS's to create a job result. The job result that includes at least one cause of the user IHS error is then provided to the user IHS.
1. An error determination system, comprising:
a user subsystem that is configured to:
generate a log file that details the operation of the user subsystem, wherein the log file includes a plurality of logs comprising:
a first portion of the plurality of logs, wherein each log included in the first portion of the plurality of logs includes log data that is related to errors and log data that is unnecessary for error diagnosis; and
a second portion of the plurality of logs, wherein each log included in the second portion of the plurality of logs is unnecessary for error diagnosis; and
display a graphical user interface that is configured to initiate error diagnosis; and
an error diagnosis subsystem that is coupled to the user subsystem, wherein the error diagnosis subsystem is configured to:
access the log file in response to an instruction provided via the graphical user interface;
remove the second portion of the plurality of logs that are unnecessary for error diagnosis;
remove the log data that is unnecessary for error diagnosis from each log included in the first portion of the plurality of logs to provide filtered log data;
provide the filtered log data in predefined locations included in a data structure to create structured, filtered log data;
perform error diagnosis on the structured, filtered log data to determine at least one cause of an error in the user subsystem; and
communicate the at least one cause of the error in the user subsystem.
2. The system of claim 1 , wherein the predefined locations include predefined columns in the data structure.
3. The system of claim 2 , wherein the predefined columns include a timestamp column, a component column, and a log message column.
4. The system of claim 1 , wherein the second portion of the plurality of logs that are unnecessary for error diagnosis includes logs generated without timestamps, and wherein the log data that is unnecessary for error diagnosis and that is included in each log included in the first portion of the plurality of logs includes tags.
5. The system of claim 1 , wherein the error diagnosis subsystem is further configured to:
store the at least one cause of the error in the user subsystem in a reoccurring error repository.
6. The system of claim 1 , wherein the error diagnosis subsystem is further configured to:
receive an alert from the user subsystem that is associated with the error in the user subsystem and, in response, perform the error diagnosis.
7. The system of claim 1 , wherein the error diagnosis subsystem is further configured to:
provide, for display on a display device, a graphical rendering of at least some of the structured, filtered log data.
8. An information handling system (IHS), comprising:
a processing system; and
a memory system that includes instructions that, when executed by the processing system, cause the processing system to:
access a log file that details the operation of a user subsystem, wherein the log file includes a plurality of logs comprising:
a first portion of the plurality of logs, wherein each log included in the first portion of the plurality of logs includes log data that is related to errors and log data that is unnecessary for error diagnosis; and
a second portion of the plurality of logs, wherein each log included in the second portion of the plurality of logs is unnecessary for error diagnosis;
remove the second portion of the plurality of logs that are unnecessary for error diagnosis;
remove the log data that is unnecessary for error diagnosis from each log included in the first portion of the plurality of logs to provide filtered log data;
provide the filtered log data in predefined locations included in a data structure to create structured, filtered log data;
perform error diagnosis on the structured, filtered log data to determine at least one cause of an error in the user subsystem; and
communicate the at least one cause of the error in the user subsystem.
9. The IHS of claim 8 , wherein the predefined locations include predefined columns in the data structure.
10. The IHS of claim 9 , wherein the predefined columns include a timestamp column, a component column, and a log message column.
11. The IHS of claim 8 , wherein the second portion of the plurality of logs that are unnecessary for error diagnosis includes logs generated without timestamps, and wherein the log data that is unnecessary for error diagnosis and that is included in each log included in the first portion of the plurality of logs includes tags.
12. The IHS of claim 8 , wherein the memory system includes instructions that, when executed by the processing system, cause the processing system to:
store the at least one cause of the error in the user subsystem in a reoccurring error repository.
13. The system of claim 1 , wherein the memory system includes instructions that, when executed by the processing system, cause the processing system to:
receive an alert from the user subsystem that is associated with the error in the user subsystem and, in response, perform the error diagnosis.
14. The system of claim 1 , wherein the memory system includes instructions that, when executed by the processing system, cause the processing system to:
provide, for display on a display device, a graphical rendering of at least some of the structured, filtered log data.
15. A method for determining errors, comprising:
accessing, by an error diagnosis subsystem in response to an instruction provided on a graphical user interface on a user subsystem, a log file that details the operation of the user subsystem, wherein the log file includes a plurality of logs comprising:
a first portion of the plurality of logs, wherein each log included in the first portion of the plurality of logs includes log data that is related to errors and log data that is unnecessary for error diagnosis; and
a second portion of the plurality of logs, wherein each log included in the second portion of the plurality of logs is unnecessary for error diagnosis;
removing, by the error diagnosis subsystem, the second portion of the plurality of logs that are unnecessary for error diagnosis;
removing, by the error diagnosis subsystem, the log data that is unnecessary for error diagnosis from each log file included in the first portion of the plurality of logs to provide filtered log data;
providing, by the error diagnosis subsystem, the filtered log data in predefined locations included in a data structure to create structured, filtered log data;
performing, by the error diagnosis subsystem, error diagnosis on the structured, filtered log data to determine at least one cause of an error in the user subsystem; and
communicating, by the error diagnosis subsystem, the at least one cause of the error in the user subsystem.
16. The method of claim 15 , wherein the predefined locations include predefined columns in the data structure that include at least one of a timestamp column, a component column, and a log message column.
17. The method of claim 15 , wherein the second portion of the plurality of logs that are unnecessary for error diagnosis includes logs generated without timestamps, and wherein the log data that is unnecessary for error diagnosis and that is included in each log included in the first portion of the plurality of logs includes tags.
18. The method of claim 15 , further comprising:
storing, by the error diagnosis subsystem, the at least one cause of the error in the user subsystem in a reoccurring error repository.
19. The method of claim 15 , further comprising:
receiving, by the error diagnosis subsystem, an alert from the user subsystem that is associated with the error in the user subsystem and, in response, perform the error diagnosis.
20. The method of claim 15 , further comprising:
provide, by the error diagnosis subsystem for display on a display device, a graphical rendering of at least some of the structured, filtered log data.