System level testing using a central test manager
A test control process initiates processing of a test case to be used in system level testing of a system unit under test. A query is sent, by the test control process, to a central test manager to determine a history of the test case. The history of the test case is obtained by the test control process based on the query. Processing of the test case continues, based on the history.
1 . A computer program product for facilitating processing within a computing environment, the computer program product comprising:
at least one computer readable storage medium and program instructions collectively stored on the at least one computer readable storage medium to perform operations comprising:
system level testing one or more systems under test by a plurality of test control processes executing in parallel while providing inter-communication among test control processes of the plurality of test control processes via a central test manager, the system level testing including executing multiple test cases in parallel in system level testing the one or more systems under test, and wherein the system level testing comprises:
initiating execution, by one test control process of the plurality of test control processes executing in parallel, of a test case used in the system level testing of a virtual machine of a system under test of the one or more systems under test;
prior to executing the test case, sending a query, by the one test control process, to the central test manager to determine history data relating to execution of the test case by one or more other test control processes of the plurality of test control processes executing in parallel;
obtaining, by the one test control process, the history data related to execution of the test case by another test control process of the plurality of test control processes executing in parallel, based on the query, wherein the history data includes contextual information related to execution of the test case by the one or more other test control processes of the plurality of test control processes executing in parallel; and
making a runtime decision, by the one test control process, whether to continue execution of the test case based on the obtained history data, and based on the runtime decision, continuing execution of the test case, by the one test control process based on the obtained history data related to execution of the test case, to perform system level testing of the virtual machine of the system under test of the one or more systems under test.
2 . The computer program product of claim 1 , wherein the virtual machine of the system under test is one virtual machine of the system under test of a plurality of virtual machines of the system under test, and wherein the system level testing is performed on the plurality of virtual machines of the system under test by test control processes of the plurality of test control processes executing in parallel, the test control processes being communicatively coupled to the central test controller.
3 . The computer program product of claim 2 , wherein the operations further include:
determining, by the one test control process, that an error associated with execution of the test case has occurred; and
providing an indication of the error to the central test manager for access by further test control processes of the plurality of test control processes.
4 . The computer program product of claim 1 , wherein the operations further include recording in a data repository, using the one test control process, execution information relating to execution of the test case.
5 . The computer program product of claim 1 , wherein the operations further include providing test case information to the central test manager to facilitate obtaining relevant history data from the central test manager for future test cases.
6 . The computer program product of claim 5 , wherein the test case information includes a start time of the test case, an end time of the test case, one or more progress indicators of the test case and test case results.
7 . The computer program product of claim 1 , wherein the history data of the test case includes an indication of a failure of a previous execution of the test case on another virtual machine of the system under test.
8 . The computer program product of claim 1 , wherein the history data of the test case includes an indication of success of a previous execution of the test case on another virtual machine of the system under test.
9 . The computer program product of claim 1 , wherein the history data of the test case includes an indication of no previous history of execution of the test case.
10 . The computer program product of claim 1 , wherein the operations further include continuing execution of the test case based on a selected preference.
11 . A computer system for facilitating processing within a computing environment, the computer system comprising:
a memory; and
at least one device coupled to the memory, wherein the computer system is configured to perform a method, the method comprising:
system level testing one or more systems under test by a plurality of test control processes executing in parallel while providing inter-communication among test control processes of the plurality of test control processes via a central test manager, the system level testing including executing multiple test cases in parallel in system level testing the one or more systems under test, and wherein the system level testing comprises:
initiating execution, by one test control process of the plurality of test control processes executing in parallel, of a test case used in the system level testing of a virtual machine of a system under test of the one or more systems under test;
prior to executing the test case, sending a query, by the one test control process, to the central test manager to determine history data relating to execution of the test case by one or more other test control processes of the plurality of test control processes executing in parallel;
obtaining, by the one test control process, the history data related to execution of the test case by another test control process of the plurality of test control processes executing in parallel, based on the query, wherein the history data includes contextual information related to execution of the test case by the one or more other test control processes of the plurality of test control processes executing in parallel; and
making a runtime decision, by the one test control process, whether to continue execution of the test case based on the obtained history data, and based on the runtime decision, continuing execution of the test case, by the one test control process based on the obtained history data related to execution of the test case, to perform system level testing of the virtual machine of the system under test of the one or more systems under test.
12 . The computer system of claim 11 , wherein the virtual machine of the system under test is one virtual machine of the system under test of a plurality of virtual machines of the system under test, and wherein the system level testing is performed on the plurality of virtual machines of the system under test by test control processes of the plurality of test control processes executing in parallel, the test control processes being communicatively coupled to the central test manager.
13 . The computer system of claim 12 , wherein method further includes:
determining, by the one test control process, that an error associated with execution of the test case has occurred; and
providing an indication of the error to the central test manager for access by further test control processes of the plurality of test control processes.
14 . The computer system of claim 11 , wherein the method further includes recording in a data repository, using the one test control process, execution information relating to execution of the test case.
15 . The computer system of claim 11 , wherein the method further includes providing test case information to the central test manager to facilitate obtaining relevant history data from the central test manager for future test cases.
16 . A computer-implemented method of facilitating processing within a computing environment, the computer-implemented method comprising:
system level testing one or more systems under test by a plurality of test control processes executing in parallel while providing inter-communication among test control processes of the plurality of test control processes via a central test manager, the system level testing including executing multiple test cases in parallel in system level testing the one or more systems under test, and wherein the system level testing comprises:
initiating execution, by one test control process of the plurality of test control processes executing in parallel, of a test case used in the system level testing of a virtual machine of a system under test of the one or more systems under test;
prior to executing the test case, sending a query, by the one test control process, to the central test manager to determine history data relating to execution of the test case by one or more other test control processes of the plurality of test control processes executing in parallel;
obtaining, by the one test control process, the history data related to execution of the test case by another test control process of the plurality of test control processes executing in parallel, based on the query, wherein the history data includes contextual information related to execution of the test case by the one or more other test control processes of the plurality of test control processes executing in parallel; and
making a runtime decision, by the one test control process, whether to continue execution of the test case based on the obtained history data, and based on the runtime decision, continuing execution of the test case, by the one test control process based on the obtained history data related to execution of the test case, to perform system level testing of the virtual machine of the system under test of the one or more systems under test.
17 . The computer-implemented method of claim 16 , wherein the virtual machine of the system under test is one virtual machine of the system under test of a plurality of virtual machines of the system under test, and wherein the system level testing is performed on the plurality of virtual machines of the system under test by test control processes of the plurality of test control processes executing in parallel, the test control processes being communicatively coupled to the central test manager.
18 . The computer-implemented method of claim 17 , further comprising:
determining, by the one test control process, that an error associated with execution of the test case has occurred; and
providing an indication of the error to the central test manager for access by further test control processes of the plurality of test control processes.
19 . The computer-implemented method of claim 16 , further comprising recording in a data repository, using the one test control process, execution information relating to execution of the test case.
20 . The computer-implemented method of claim 16 , further comprising providing test case information to the central test manager to facilitate obtaining relevant history data from the central test manager for future test cases.