Data processing system test suite management including dynamic resource reallocation and reconfiguration

1. A method of running a test suite in a data processing environment, the method comprising:

in response to receiving a test suite specification, a processor of a testing platform determining a schedule of execution of a test suite to test a system under test (SUT), wherein the SUT has a hardware resource set including at least one of a set including a processor system and a data storage system, and wherein the test suite includes a plurality of tests, each including a respective set of one or more testcases;

the processor initiating execution of the test suite on the SUT in accordance with the schedule; and

in response to failure of a hardware resource during execution of the test suite, the processor automatically and dynamically reallocating a test in the test suite to at least one different hardware resource in the hardware resource set.

2. The method of claim 1 , wherein determining the schedule comprises:

optimizing an order of the plurality of tests based on at least one of a set including hardware resources within the hardware resource set, time costs of the plurality of tests, time costs to update soft configurations of the hardware resource set between tests, and priorities of the plurality of tests.

3. The method of claim 2 , wherein:

the test suite specification specifies a number of iterations of at least one of the plurality of tests; and

the optimizing includes optimizing an order of the plurality of tests based on the number of iterations specified for the at last one of the plurality of tests.

4. The method of claim 3 , wherein:

the optimizing comprises executing iterations of a particular test among the plurality of tests on multiple platforms in parallel.

5. The method of claim 1 , and further comprising:

in response to failure of a hardware resource during execution of the test suite, the processor automatically and dynamically reconfiguring a soft configuration of the different hardware resource.

6. The method of claim 1 , and further comprising:

in response to completion of a first test among the plurality of tests on a particular hardware resource in the hardware resources set, the processor automatically and dynamically reconfiguring a soft configuration of the particular hardware resource and thereafter running a second test among the plurality of tests on the particular hardware resource using the reconfigured soft configuration.

7. A data processing system, comprising:

a processor;

data storage coupled to the processor, wherein the data storage includes test director program code executable by the processor to cause the processor to perform:

in response to receiving a test suite specification, the processor determining a schedule of execution of a test suite to test a system under test (SUT), wherein the SUT has a hardware resource set including at least one of a set including a processor system and a data storage system, and wherein the test suite includes a plurality of tests, each including a respective set of one or more testcases;

the processor initiating execution of the test suite on the SUT in accordance with the schedule; and

in response to failure of a hardware resource during execution of the test suite, the processor automatically and dynamically reallocating a test in the test suite to at least one different hardware resource in the hardware resource set.

8. The data processing system of claim 7 , wherein determining the schedule comprises:

optimizing an order of the plurality of tests based on at least one of a set including hardware resources within the hardware resource set, time costs of the plurality of tests, time costs to update soft configurations of the hardware resource set between tests, and priorities of the plurality of tests.

9. The data processing system of claim 8 , wherein:

the test suite specification specifies a number of iterations of at least one of the plurality of tests; and

the optimizing includes optimizing an order of the plurality of tests based on the number of iterations specified for the at last one of the plurality of tests.

10. The data processing system of claim 9 , wherein:

the optimizing comprises executing iterations of a particular test among the plurality of tests on multiple platforms in parallel.

11. The data processing system of claim 7 , wherein the test director program code further causes the data processing system to perform:

in response to failure of a hardware resource during execution of the test suite, the processor automatically and dynamically reconfiguring a soft configuration of the different hardware resource.

12. The data processing system of claim 7 , wherein the test director program code further causes the data processing system to perform:

in response to completion of a first test among the plurality of tests on a particular hardware resource in the hardware resources set, the processor automatically and dynamically reconfiguring a soft configuration of the particular hardware resource and thereafter running a second test among the plurality of tests on the particular hardware resource using the reconfigured soft configuration.

13. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions being executable by a processor of a data processing system to cause the processor to perform:

in response to receiving a test suite specification, the processor determining a schedule of execution of a test suite to test a system under test (SUT), wherein the SUT has a hardware resource set including at least one of a set including a processor system and a data storage system, and wherein the test suite includes a plurality of tests, each including a respective set of one or more testcases;

the processor initiating execution of the test suite on the SUT in accordance with the schedule; and

in response to failure of a hardware resource during execution of the test suite, the processor automatically and dynamically reallocating a test in the test suite to at least one different hardware resource in the hardware resource set.

14. The data processing system of claim 13 , wherein determining the schedule comprises:

optimizing an order of the plurality of tests based on at least one of a set including hardware resources within the hardware resource set, time costs of the plurality of tests, time costs to update soft configurations of the hardware resource set between tests, and priorities of the plurality of tests.

15. The data processing system of claim 14 , wherein:

the test suite specification specifies a number of iterations of at least one of the plurality of tests; and

the optimizing includes optimizing an order of the plurality of tests based on the number of iterations specified for the at last one of the plurality of tests.

16. The data processing system of claim 15 , wherein:

the optimizing comprises executing iterations of a particular test among the plurality of tests on multiple platforms in parallel.

17. The data processing system of claim 13 , wherein the program instructions further causes the data processing system to perform:

in response to failure of a hardware resource during execution of the test suite, the processor automatically and dynamically reconfiguring a soft configuration of the different hardware resource.

18. The data processing system of claim 13 , wherein the program instructions further causes the data processing system to perform:

in response to completion of a first test among the plurality of tests on a particular hardware resource in the hardware resources set, the processor automatically and dynamically reconfiguring a soft configuration of the particular hardware resource and thereafter running a second test among the plurality of tests on the particular hardware resource using the reconfigured soft configuration.