Implementing integrated documentation and application testing
View Patent ↗A method, apparatus, and computer program product to implement integrated documentation and functional application testing are provided. An integrated test engine drives both functional application testing and documentation testing for the application. The integrated test engine uses documentation instructions, which are embedded with metadata and represent how to automate each step in the documentation and the expected results, and runs a series of tests that ensure that the application works as expected and that the documentation accurately reflects how the application works.
1. A computer-implemented method for implementing integrated documentation and functional application testing comprises:
applying an integrated test engine to drive both functional application testing and documentation testing for an application;
retrieving documentation instructions and documentation embedded metadata from documentation for the application;
said documentation instructions and documentation embedded metadata representing how to automate each step in the documentation testing and expected results, mapping documentation embedded metadata to functional test engine metadata;
using said documentation instructions to order functional test engine metadata;
forming a list of automated test instructions based upon the functional test engine metadata and ordering the automated test instructions based upon documentation instruction order;
wherein forming a list of automated test instructions based upon the functional test engine metadata includes translating the functional test engine metadata into a runable test instruction;
and running a series of tests defined by the list of automated test instructions against the application to functionally test both the application and the documentation.
2. The computer-implemented method as recited in claim 1 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes testing consistency between the documentation and the application.
3. The computer-implemented method as recited in claim 1 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes automated documentation testing with each individual program fix being made.
4. The computer-implemented method as recited in claim 1 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes separating functional test results for the application and documentation test results for the documentation.
5. The computer-implemented method as recited in claim 1 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes evaluating test results at different levels of a hierarchy for the application and the documentation with different error information captured at each level.
6. The computer-implemented method as recited in claim 1 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes capturing detailed error information with test results.
7. The computer-implemented method as recited in claim 1 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes sending an alert to predefined interested parties and systems.
8. A computer program product embodied on a non-transitory computer readable storage medium for implementing integrated documentation and functional application testing, said non-transitory computer readable storage medium storing instructions, and said instructions when executed by the computer system cause the computer system to perform the steps comprising:
providing an integrated test engine to drive both functional application testing and documentation testing for an application;
retrieving documentation instructions and documentation embedded metadata from documentation for the application;
said documentation instructions and documentation embedded metadata representing how to automate each step in the documentation testing and expected results, mapping documentation embedded metadata to functional test engine metadata;
using said documentation instructions to order functional test engine metadata;
forming a list of automated test instructions based upon the functional test engine metadata and ordering the automated test instructions based upon documentation instruction order;
wherein forming a list of automated test instructions based upon the functional test engine metadata includes translating the functional test engine metadata into a runable test instruction;
and running a series of tests defined by the list of automated test instructions against the application to functionally test both the application and the documentation.
9. The computer program product as recited in claim 8 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes testing consistency between the documentation and the application.
10. The computer program product as recited in claim 8 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes automated documentation testing with each individual program fix being made.
11. The computer program product as recited in claim 8 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes separating functional test results for the application and documentation test results for the documentation.
12. The computer program product as recited in claim 8 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes evaluating test results at different levels of a hierarchy for the application and the documentation with different error information captured at each level.
13. The computer program product as recited in claim 8 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes capturing detailed error information with test results.
14. The computer program product as recited in claim 8 wherein running the series of tests defined by the list of automated test instructions to functionally test both the application and the documentation includes sending an alert to predefined interested parties and systems.
15. An apparatus comprising a non-transitory computer readable storage medium embodying computer program code for implementing integrated documentation and functional application testing comprises:
an integrated test engine embodied on a non-transitory computer readable storage medium for driving both functional application testing and documentation testing for an application;
said integrated test engine retrieving documentation instructions and documentation embedded metadata from documentation for the application;
said documentation instructions and documentation embedded metadata representing how to automate each step in the documentation testing and expected results, said integrated test engine mapping documentation embedded metadata to functional test engine metadata;
said integrated test engine using said documentation instructions to order functional test engine metadata;
said integrated test engine forming a list of automated test instructions based upon the functional test engine metadata and ordering the automated test instructions based upon documentation instruction order;
wherein forming a list of automated test instructions based upon the functional test engine metadata includes translating the functional test engine metadata into a runable test instruction;
and said integrated test engine running a series of tests defined by the list of automated test instructions against the application to functionally test both the application and the documentation.
16. The apparatus for implementing integrated documentation and functional application testing as recited in claim 15 wherein said integrated test engine captures detailed error information with test results.
17. The apparatus for implementing integrated documentation and functional application testing as recited in claim 15 wherein said integrated test engine sends an alert to predefined interested parties and systems.
18. The apparatus for implementing integrated documentation and functional application testing as recited in claim 15 wherein said integrated test engine separates functional test results for the application and documentation test results for the documentation and evaluates test results.