Extraction of problem diagnostic knowledge from test cases
Embodiments of the present invention enable users to extract knowledge from testing scenarios performed during application development, and later employ that knowledge to interpret application usage scenarios to enhance serviceability of applications by expediting identification and solving of problems. In an exemplary embodiment, log data generated during simulation of test cases is analyzed to create one or more rules based on patterns in which one or more log entries appear in the log data. Later, log data may be analyzed to look for a pattern of log entries that matches a pattern-based rule, thereby facilitating faster identification and resolution of the problem.
1. A method comprising:
identifying a first set of log entries appearing in a first set of log data, wherein:
the first set of log entries is information pertaining to an application code in a first scenario, and
the first set of log data is generated during execution of the application code in the first scenario; and
creating a first rule based, at least in part, on a first pattern of the first set of log entries, wherein the first pattern includes:
a content of a first plurality of message identifiers that appears in the first set of log data, and
a chronological order in which the first plurality of message identifiers appears;
wherein:
at least creating the first rule based, at least in part, on the first pattern of the first set of log entries is performed by computer software running on computer hardware.
2. The method of claim 1 , further comprising:
identifying a second set of log entries appearing in a second set of log data, wherein the second set of log data is generated during execution of the application code in a second scenario;
determining the second set of log entries satisfy the first rule; and
providing, to a user, information describing the first scenario.
3. The method of claim 2 , further comprising:
associating information describing the second scenario with:
the first rule, and
information describing the first scenario.
4. The method of claim 2 , wherein:
the first scenario is an application development testing scenario, and
the second scenario is an end-user application usage scenario.
5. The method of claim 2 , further comprising:
updating a set of lines of the application code such that upon execution of the application code, a third set of log data is generated; and
creating a second rule based, at least in part, on a second pattern of a third set of log entries.
6. The method of claim 2 , wherein identifying the first set of log entries appearing in the first set of log data comprises:
identifying a first message identifier for each log entry in the first set of log entries.
7. The method of claim 6 , wherein determining the second set of log entries satisfy the first rule comprises:
determining a second plurality of message identifiers appears in the second set of log data matches:
the content of the first plurality of message identifiers, and
the chronological order in which the first plurality of message identifiers appears.
8. A computer program product comprising:
a computer readable storage medium having stored thereon:
first instructions executable by a device to cause the device to identify a first set of log entries appearing in a first set of log data, wherein:
the first set of log entries is information pertaining to an application code in a first scenario, and
the first set of log data is generated during execution of the application code in the first scenario; and
second instructions executable by a device to cause the device to create a first rule based, at least in part, on a first pattern of the first set of log entries, wherein the first pattern includes:
a content of a first plurality of message identifiers that appears in the first set of log data, and
a chronological order in which the first plurality of message identifiers appears.
9. The computer program product of claim 8 , further comprising:
third instructions executable by a device to cause the device to identify a second set of log entries appearing in a second set of log data, wherein the second set of log data is generated during execution of the application code in a second scenario;
fourth instructions executable by a device to cause the device to determine the second set of log entries satisfy the first rule; and
fifth instructions executable by a device to cause the device to provide, to a user, information describing the first scenario.
10. The computer program product of claim 9 , further comprising:
sixth instructions executable by a device to cause the device to associate information describing the second scenario with:
the first rule, and
information describing the first scenario.
11. The computer program product of claim 9 , wherein:
the first scenario is an application development testing scenario, and
the second scenario is an end-user application usage scenario.
12. The computer program product of claim 9 , further comprising:
sixth instructions executable by a device to cause the device to update a set of lines of the application code such that upon execution of the application code, a third set of log data is generated; and
seventh instructions executable by a device to cause the device to create a second rule based, at least in part, on a second pattern of a third set of log entries.
13. The computer program product of claim 9 , wherein first instructions to identify a first set of log entries appearing in a first set of log data comprise:
sixth instructions executable by a device to cause the device to identify a first message identifier for each log entry in the first set of log entries.
14. The computer program product of claim 13 , wherein fourth instructions to determine the second set of log entries satisfy the first rule comprise:
seventh instructions executable by a device to cause the device to determine a second plurality of message identifiers appears in the second set of log data matches:
the content of the first plurality of message identifiers, and
the chronological order in which the first plurality of message identifiers appears.
15. A computer system comprising:
a processor set; and
a computer readable storage medium;
wherein:
the processor set is structured, located, connected, and/or programmed to execute instructions stored on the computer readable storage medium; and
the instructions include:
first instructions executable by a device to cause the device to identify a first set of log entries appearing in a first set of log data, wherein:
the first set of log entries is information pertaining to an application code in a first scenario, and
the first set of log data is generated during execution of the application code in the first scenario; and
second instructions executable by a device to cause the device to create a first rule based, at least in part, on a first pattern of the first set of log entries, wherein the first pattern includes:
a content of a first plurality of message identifiers that appears in the first set of log data, and
a chronological order in which the first plurality of message identifiers appears.
16. The computer system of claim 15 , further comprising:
third instructions executable by a device to cause the device to identify a second set of log entries appearing in a second set of log data, wherein the second set of log data is generated during execution of the application code in a second scenario;
fourth instructions executable by a device to cause the device to determine the second set of log entries satisfy the first rule; and
fifth instructions executable by a device to cause the device to provide, to a user, information describing the first scenario.
17. The computer system of claim 16 , further comprising:
sixth instructions executable by a device to cause the device to associate information describing the second scenario with:
the first rule, and
information describing the first scenario.
18. The computer system of claim 16 , wherein:
the first scenario is an application development testing scenario, and
the second scenario is an end-user application usage scenario.
19. The computer system of claim 16 , further comprising:
sixth instructions executable by a device to cause the device to update a set of lines of the application code such that upon execution of the application code, a third set of log data is generated; and
seventh instructions executable by a device to cause the device to create a second rule based, at least in part, on a second pattern of a third set of log entries.
20. The computer system of claim 16 , wherein first instructions to identify a first set of log entries appearing in a first set of log data comprise:
sixth instructions executable by a device to cause the device to identify a first message identifier for each log entry in the first set of log entries.