Building signatures of application flows
An example device in accordance with an aspect of the present disclosure includes a screen identification engine to identify a screen(s) of a test run, an element identification engine to selectively identify an element(s) among available elements of the screen(s), and a signature building engine to build a signature corresponding to the test run. The signature incorporates the screen(s) and element(s) to capture an application flow of the test run, while excluding available elements that do not correspond to the application flow.
1. A computing system comprising:
a processor; and
a memory storing instructions executable to cause the processor to:
identify at least one screen of a test run of a test for an application;
identify at least one element in the at least one screen of the test run of the test for the application that corresponds to an application flow of the test run of the test for the application while excluding other elements in the at least one screen of the test run of the test for the application that do not correspond to the application flow of the test run of the test for the application, wherein the at least one element in the at least one screen of the test run of the test for the application is selectively identified from among available elements in the at least one screen of the test run of the test for the application;
build a test signature of the test run of the test for the application by incorporating the at least one screen of the test run of the test for the application and the at least one element in the at least one screen of the test run of the test for the application into the test signature of the test run of the test for the application to capture the application flow of the test run of the test for the application;
combine a plurality of test signatures, obtained from a plurality of corresponding test runs of the test for the application, into a combined plurality of test signatures;
compare the test signature of the test run of the test for the application to another test signature of another test run of the test for the application; and
display deviations between the test signature of the test run of the test for the application and the other test signature of the other test run of the test for the application to prompt a user based on the comparison.
2. The computing system of claim 1 , wherein the instructions are to cause the processor to identify the at least one screen of the test run of the test for the application based on image processing analysis of at least one screenshot of an application under test.
3. The computing system of claim 2 , wherein the instructions are to cause the processor to identify the at least one screen of the test run of the test for the application from at least one screenshot obtained at intervals from live capture of the test run of the test for the application or from recorded video of the test run of the test for the application.
4. The computing system of claim 1 , wherein the instructions are to cause the processor to identify the at least one element in the at least one screen of the test run of the test for the application based on user gaze data input activity.
5. The computing system of claim 1 , wherein the instructions are to cause the processor to identify the at least one element in the at least one screen of the test run of the test for the application based on input device data input activity.
6. The computing system of claim 1 , wherein the instructions are to cause the processor to identify the at least one element in the at least one screen of the test run of the test for the application based on simulated user input activity as performed by an automated test execution.
7. The computing system of claim 1 , wherein the instructions are to cause the processor to infer that activity occurred between captured screens based on a timestamp of input activity failing between prior and subsequent captured screens, and to identify the at least one element in the at least one screen of the test run of the test for the application based on changes between the prior and subsequent captured screens.
8. The computing system of claim 1 , wherein the instructions are to cause the processor to identify the application flow of the test run of the test for the application based on a sequence of the at least one screen of the test run of the test for the application, and the at least one element in the at least one screen of the test run of the test for the application corresponding to a given respective one of the at least one screen of the test run of the test for the application, as captured by the test signature of the test run of the test for the application.
9. The computing system of claim 1 , wherein the combined plurality of test signatures includes a superset of the at least one screen of the test run of the test for the application and the at least one element in the at least one screen of the test run of the test for the application from the combined plurality of test signatures.
10. The computing system of claim 9 , wherein the instructions are to cause the processor to combine elements, representing different flow paths through a given test, into the combined plurality of test signatures.
11. The computing system of claim 1 , wherein the other test signature of the other test run of the test for the application is a baseline test signature corresponding to a baseline test run of the test for the application.
12. The computing system of claim 1 , wherein the instructions are to cause the processor to check a subset of possible elements from the test run of the test for the application, which have been captured by the test signature of the test run of the test for the application, and to exclude uncaptured elements from the test run of the test for the application that are not associated with the test signature of the test run of the test for the application.
13. The computing system of claim 1 , wherein a given test signature is to represent features of the application corresponding to the at least one screen of the test run of the test for the application and the at least one element in the at least one screen of the test run of the test for the application, and to accommodate additions of new features without negatively affecting representation of already existing features.
14. The computing system of claim 1 , wherein the instructions are to cause the processor to display at least one element, during a current test run of the test for the application in the context of a current screen of the test run of the test for the application, to prompt the user, and wherein the displayed at least one element is chosen from a sample test signature to correspond to progress through the current test run of the test for the application.
15. The computing system of claim 14 , wherein the instructions are to cause the processor to highlight which elements on the current screen of the test run of the test for the application are relevant to the application flow of the test run of the test for the application being performed by displaying a live overlay while running the test.
16. The computing system of claim 14 , wherein the instructions are to cause the processor to provide a warning, during a test run of the test for the application, that at least a portion of the test run of the test for the application is not being covered, by comparing a visual test signature of the current test run of the test for the application with a sample test signature corresponding to a sample test run of the test for the application.
17. A method comprising:
identifying, by a processor of a computing device, at least one screen of a test run of a test for an application;
identifying, by the processor of the computing device, at least one element in the at least one screen of the test run of the test for the application that corresponds to an application flow of the test run of the test for the application while excluding other elements in the at least one screen of the test run of the test for the application that do not correspond to the application flow of the test run of the test for the application, wherein the at least one element in the at least one screen of the test run of the test for the application is selectively identified from among available elements in the at least one screen of the test run of the test for the application;
building, by the processor of the computing device, a test signature of the test run of the test for the application by incorporating the at least one screen of the test run of the test for the application and the at least one element in the at least one screen of the test run of the test for the application into the test signature of the test run of the test for the application to capture the application flow of the test run of the test for the application;
combining, by the processor of the computing device, a plurality of test signatures, obtained from a plurality of corresponding test runs of the test for the application, into a combined plurality of test signatures;
comparing, by the processor of the computing device, the test signature of the test run of the test for the application to another test signature of another test run of the test for the application; and
displaying, by the processor of the computing device, deviations between the test signature of the test run of the test for the application and the other test signature of the other test run of the test for the application to prompt a user based on the comparison.
18. The method of claim 17 , wherein the other test signature of the other test run of the test for the application is a baseline test signature corresponding to a baseline test run of the test for the application.
19. A non-transitory machine-readable storage medium encoded with instructions executable by a computing system that, when executed, cause the computing system to:
identify at least one screen of a test run of a test for an application;
identify at least one element in the at least one screen of the test run of the test for the application that corresponds to an application flow of the test run of the test for the application while excluding other elements in the at least one screen of the test run of the test for the application that do not correspond to the application flow of the test run of the test for the application, wherein the at least one element in the at least one screen of the test run of the test for the application is selectively identified from among available elements in the at least one screen of the test run of the test for the application;
build a test signature of the test run of the test for the application by incorporating the at least one screen of the test run of the test for the application and the at least one element in the at least one screen of the test run of the test for the application into the test signature of the test run of the test for the application to capture the application flow of the test run of the test for the application;
combine a plurality of test signatures, obtained from a plurality of corresponding test runs of the test for the application, into a combined plurality of test signatures;
compare the test signature of the test run of the test for the application to at least one other test signature of at least one other test run of the test for the application to establish a baseline application flow; and
display deviations between the application flow of the test run of the test for the application and the baseline application flow to prompt a user based on the comparison.
20. The non-transitory machine-readable storage medium of claim 19 , wherein the computing system is to determine the baseline application flow based on comparing multiple test signatures of a given test run of the test for the application, to identify the test signature of the test run of the test for the application as being different from a plurality of other test signatures, and to use the application flow of the test run of the test for the application consistent with the plurality of other test signatures.