Method, device and computer program product for executing test cases

1. A method for executing a test case, comprising:

obtaining a set of test cases to be executed, the set of test cases being divided into one or more test subsets;

for a test case in the set of test cases:

determining a test platform type and a test script associated with the test case based on a knowledge base;

determining, based on the test platform type, a test subset to which the test case belongs;

executing the test case in the test subset based on the test script; and

obtaining running information of the test script based on the knowledge base, the running information including runtime information of the test script and being used for the execution of the test case;

wherein the set of test cases is divided into the one or more test subsets based on the test platform type and the runtime information such that differences in runtime among all of the test subsets are within a threshold range.

2. The method according to claim 1 , wherein the obtaining a set of test cases to be executed comprises:

obtaining, based on a set of components to be tested, the set of test cases by querying the knowledge base.

3. The method according to claim 1 , wherein the executing the test case in the test subset comprises:

executing, by a plurality of test execution engines, the plurality of test subsets in parallel.

4. The method according to claim 1 , wherein the executing the test case in the test subset comprises:

instantiating a test environment for the test platform type based on the test platform type; and

executing, in the test environment, a plurality of test scripts associated with a plurality of test cases in the test subset sequentially.

5. The method according to claim 4 , wherein the executing a plurality of test scripts associated with a plurality of test cases in the test subset sequentially comprises:

in response to a plurality of faults including a first fault and a second fault occurring during the execution of the test subset, adjusting a first test case associated with the first fault to be after a second test case associated with the second fault in order;

re-executing, for the adjusted plurality of faults, test cases associated with the plurality of faults.

6. The method according to claim 1 , further comprising:

after completion of the execution of the test subset, collecting a test result from a running log; and

generating a test report based on the collected test result.

7. The method according to claim 1 , wherein the method is used for automatic regression test, and the knowledge base is built by collecting historically executed test cases.

8. A device for executing a test case, comprising:

a processing unit; and

a memory coupled to the processing unit and storing instructions thereon, the instructions, when executed by the processing unit, perform the following acts:

obtaining a set of test cases to be executed, the set of test cases being divided into one or more test subsets;

for a test case in the set of test cases:

determining a test platform type and a test script associated with the test case based on a knowledge base;

determining, based on the test platform type, a test subset to which the test case belongs;

executing the test case in the test subset based on the test script; and

obtaining running information of the test script based on the knowledge base, the running information including runtime information of the test script and being used for the execution of the test case;

wherein the set of test cases is divided into the one or more test subsets based on the test platform type and the runtime information such that differences in runtime among all of the test subsets are within a threshold range.

9. The device according to claim 8 , wherein the obtaining a set of test cases to be executed comprises:

obtaining, based on a set of components to be tested, the set of test cases by querying the knowledge base.

10. The device according to claim 8 , wherein the executing the test case in the test subset comprises:

executing, by a plurality of test execution engines, the plurality of test subsets in parallel.

11. The device according to claim 8 , wherein the executing the test case in the test subset comprises:

instantiating a test environment for the test platform type based on the test platform type; and

executing, in the test environment, a plurality of test scripts associated with a plurality of test cases in the test subset sequentially.

12. The device according to claim 11 , wherein the executing a plurality of test scripts associated with a plurality of test cases in the test subset sequentially comprises:

in response to a plurality of faults including a first fault and a second fault occurring during the execution of the test subset, adjusting a first test case associated with the first fault to be after a second test case associated with the second fault in order;

re-executing, for the adjusted plurality of faults, test cases associated with the plurality of faults.

13. The device according to claim 8 , the acts further comprising:

after completion of the execution of the test subset, collecting a test result from a running log; and

generating a test report based on the collected test result.

14. The device according to claim 8 , wherein the device is used for automatic regression test, and the knowledge base is built by collecting historically executed test cases.

15. A computer program product that is tangibly stored on a non-transient computer readable medium and includes machine-executable instructions, the machine-executable instructions, when executed, for executing a test case by performing the steps of:

obtaining a set of test cases to be executed, the set of test cases being divided into one or more test subsets;

for a test case in the set of test cases:

determining a test platform type and a test script associated with the test case based on a knowledge base;

determining, based on the test platform type, a test subset to which the test case belongs;

executing the test case in the test subset based on the test script; and

obtaining running information of the test script based on the knowledge base, the running information including runtime information of the test script and being used for the execution of the test case;

wherein the set of test cases is divided into the one or more test subsets based on the test platform type and the runtime information such that differences in runtime among all of the test subsets are within a threshold range.

16. The computer program product of claim 15 , wherein the obtaining a set of test cases to be executed comprises:

obtaining, based on a set of components to be tested, the set of test cases by querying the knowledge base.

17. A method for executing a test case, comprising:

obtaining a set of test cases to be executed, the set of test cases being divided into one or more test subsets;

for a test case in the set of test cases:

determining a test platform type and a test script associated with the test case based on a knowledge base;

determining, based on the test platform type, a test subset to which the test case belongs; and

executing the test case in the test subset based on the test script;

wherein the executing the test case in the test subset comprises:

instantiating a test environment for the test platform type based on the test platform type; and

executing, in the test environment, a plurality of test scripts associated with a plurality of test cases in the test subset sequentially; and

wherein the executing a plurality of test scripts associated with a plurality of test cases in the test subset sequentially comprises:

in response to a plurality of faults including a first fault and a second fault occurring during the execution of the test subset, adjusting a first test case associated with the first fault to be after a second test case associated with the second fault in order; and

re-executing, for the adjusted plurality of faults, test cases associated with the plurality of faults.

18. A device for executing a test case, comprising:

a processing unit; and

a memory coupled to the processing unit and storing instructions thereon, the instructions, when executed by the processing unit, perform the following acts:

obtaining a set of test cases to be executed, the set of test cases being divided into one or more test subsets;

for a test case in the set of test cases:

determining a test platform type and a test script associated with the test case based on a knowledge base;

determining, based on the test platform type, a test subset to which the test case belongs; and

executing the test case in the test subset based on the test script;

wherein the executing the test case in the test subset comprises:

instantiating a test environment for the test platform type based on the test platform type; and

executing, in the test environment, a plurality of test scripts associated with a plurality of test cases in the test subset sequentially; and

wherein the executing a plurality of test scripts associated with a plurality of test cases in the test subset sequentially comprises:

in response to a plurality of faults including a first fault and a second fault occurring during the execution of the test subset, adjusting a first test case associated with the first fault to be after a second test case associated with the second fault in order; and

re-executing, for the adjusted plurality of faults, test cases associated with the plurality of faults.