Method and device for quasi-proxy assisted manual device testing
A system and method for providing assisted manual testing of computer related devices. Test commands are routed from a user system through a proxy module to a device under test. The responses of the device are routed through the proxy module to a user system. A user interface is run on the user system that allows the user to view the responses of the device in a log with the issued test commands. The user interface includes annotation dialog boxes and fields, highlighting elements and flagging elements through which a user can annotate and create notes for the test log as the test is being run on the device. Through the proxy module, a third party can act as a user and view the test log and user created annotations and notes as the test is being run on the device. The test log, annotation and notes can also be stored by the proxy module so that a third party can view them at a later time. The third party can act as a user in issuing commands through the proxy module to be run on the device, thereby assisting in the testing. Additionally, the third party can provide additional notes and annotation to the test log.
1. A method for managing a manual testing of at least one electronic device under test (abbreviated DUT), including:
coupling a proxy module running on a processor in communication between at least one client running on at least one tester system and at least one DUT;
receiving tester contact information, wherein the tester contact information identifies a tester using the tester system client to test the DUT;
receiving DUT contact information that identifies the DUT;
receiving and relaying test stimulus information from the tester system client and test response information from the DUT;
linking the test stimulus information with the tester contact information and the test response information with the DUT contact information;
receiving tester annotation information generated by the tester after a completion of at least one testing step and linking the tester annotation information with one or more items of the test stimulus information or the test response information; and
storing at least some linked items of received information from the test as a transcript of testing the DUT.
2. The method of claim 1 , wherein the tester annotation information includes a pass fail evaluation of at least one testing step.
3. The method of claim 1 , wherein the tester annotation information includes a narrative of performance of the DUT generated by the tester.
4. The method of claim 1 , further including transmitting the test response information and the tester annotation information to be displayed to the tester through a tester interface.
5. The method of claim 4 ,
wherein the test response information and the tester annotation information are formatted for display as a log, and
wherein the test response information and the linked tester annotation information are formatted to be displayed together in a window of the tester interface.
6. The method of claim 4 , further including transmitting the DUT contact information of the linked test response information to be displayed to the tester through the tester interface.
7. The method of claim 4 , further including transmitting the test stimulus information to be displayed to the tester through the tester interface.
8. The method of claim 1 , wherein the DUT is a network component.
9. The method of claim 1 , further including transmitting, from the proxy module, at least some of the stored transcript of testing the DUT to be displayed to a third party through a third party user interface, while the tester continues to use the proxy module testing the DUT.
10. The method of claim 9 , further including:
receiving third party annotation information generated by the third party and linking the received third party annotation information with one or more items of the test stimulus information or the test response information; and
storing the third party annotation information on storage accessible by the proxy module.
11. The method of claim 10 , wherein the third party annotation information includes a narrative of a performance of the DUT generated by the third party.
12. The method of claim 10 , further including transmitting the third party annotation information to be displayed to either the tester through the tester interface or the third party through the third party user interface.
13. The method of claim 10 , further including transmitting the test response information together with the linked third party annotation information to be displayed to either the tester or the third party as a log,
wherein the test response information and the linked third party annotation information are formatted to be displayed together in a window of either the tester interface or the third party user interface.
14. The method of claim 10 , further including transmitting the test response information and both the third party annotation information and the tester annotation information to be displayed to either the tester or the third party as a log,
wherein the test response information, the third party annotation information and the tester annotation information are formatted to be displayed together in a window of either the tester interface or the third party user interface.
15. The method of claim 14 , wherein the third party annotation information is formatted to be visually distinct from the tester annotation information.
16. The method of claim 1 , wherein at least part of the test stimulus information is replayed from a stored transcript of a previously run test.
17. The method of claim 1 , wherein at least part of the test stimulus information is manually input by the tester during the testing of the DUT.
18. A system for managing a manual testing of at least one electronic device under test (abbreviated DUT), including:
a proxy module running on at least one processor in communication between at least one client running on at least one tester system and at least one DUT, wherein the proxy module is configured to:
receive tester contact information, wherein the tester contact information identifies a tester using the tester system client to test the DUT;
receive DUT contact information that identifies the DUT;
receive and relay test stimulus information from the system client and test response information from the DUT;
associate the test stimulus information with the tester contact information and the test response information with the DUT contact information;
receive tester annotation information generated by the tester after a completion of at least one testing step and associate the tester annotation information with one or more items of the test stimulus information or the test response information from a tester; and
store at least some items of received information from the test as a transcript of testing the DUT.
19. The system of claim 18 , wherein the tester annotation information includes a pass fail evaluation of at least one testing step.
20. The system of claim 18 , wherein the tester annotation information includes a narrative of a performance of the DUT from the tester.
21. The system of claim 18 , wherein the proxy module is further configured to:
transmit at least some of the stored transcript of testing the DUT to a third party through a third party user interface;
receive third party annotation information associated with one or more items of the test stimulus information or the test response information, the third party annotation information being received from the third party through the third party user interface; and
store the third party annotation information on storage accessible by the proxy module.
22. A non-transitory computer readable storage medium impressed with computer program instructions for managing a manual testing of at least one electronic device under test (abbreviated DUT), the instructions, when executed on a processor, implement a method comprising:
receiving tester contact information, wherein the tester contact information identifies a tester using a tester system client to test the DUT;
receiving DUT contact information that identifies the DUT;
receiving and relaying test stimulus information from the tester system client and test response information from the DUT;
associating the test stimulus information with the tester contact information and the test response information with the DUT contact information;
receiving tester annotation information generated by the tester after a completion of at least one testing step and associating the tester annotation information with one or more items of the test stimulus information or the test response information; and
storing at least some items of received information from the test as a transcript of testing the DUT.
23. The non-transitory computer readable storage medium of claim 22 , wherein the tester annotation information includes a pass fail evaluation of at least one testing step.
24. The non-transitory computer readable storage medium of claim 22 , wherein the tester annotation information includes a narrative of a performance of the DUT from the tester.
25. The non-transitory computer readable storage medium of claim 22 , wherein the method further comprises:
transmitting at least some of the stored transcript of testing the DUT to a third party through a third party user interface;
receiving third party annotation information associated with one or more items of the test stimulus information or the test response information, the third party annotation information being received from the third party through the third party user interface; and
storing the third party annotation information on storage.