Method and apparatus for creating tests for execution in a storage environment
Testcase recommendations are generated for a testcase creator application by training a learning function using metadata of previously generated testcases by parsing the metadata into steptasks, and providing the parsed metadata to the learning function to enable the learning function to determine relationships between the steptasks of the previously generated testcases, and using, by the testcase creator application, the trained learning function to obtain a predicted subsequent steptask for a given type of testcase to be generated. Each steptask describes one of the steps of the testcase using a concatenation of a step number of the one of the steps of the testcase, a module and a submodule to be used to perform of the one of the steps of the testcase, and a function to be performed at the one of the steps of the testcase.
1. A method of generating recommendations for a testcase creator application, comprising the steps of:
training a learning function using metadata of previously generated testcases, each test case including multiple steps, by parsing the metadata of the previously generated testcases into steptasks and sequences of steptasks and providing the parsed metadata to the learning function, to enable the learning function to learn the probability of what steptask will be executed next given an initial sequence of steptasks; and
obtaining a seed steptask by the testcase creator application, providing the seed steptask to the trained learning function, and using, by the testcase creator application, the trained learning function to obtain a predicted subsequent steptask for a given type of testcase to be generated and the seed steptask;
wherein each of the previously generated testcases includes a plurality of steps, and the step of parsing the metadata into steptasks comprises creating a steptask for each of the plurality of steps; and
wherein each steptask describes one of the steps of the testcase using a concatenation of a step number of the one of the steps of the testcase, a module and a submodule to be used to perform of the one of the steps of the testcase, and a function to be performed at the one of the steps of the testcase.
2. The method of claim 1 , wherein the predicted subsequent steptask is based on the given type of testcase to be generated and the seed steptask.
3. The method of claim 1 , wherein the seed steptask is a steptask of a new testcase to be generated by the testcase creator application.
4. The method of claim 3 , wherein the seed steptask is a first steptask of the new testcase to be generated by the testcase creator application.
5. The method of claim 1 , further comprising using the parsed metadata to determine duplicate testcases.
6. The method of claim 5 , wherein the step of using the parsed metadata comprises using the steptasks to create testcase fingerprints for each of the previously generated testcases, and comparing the testcase fingerprints to determine the duplicate testcases.
7. The method of claim 1 , further comprising analyzing an output of the learning function using a testcase rules engine to validate the output of the learning function.
8. A storage environment, comprising:
a plurality of storage systems;
a testcase creator application configured to create testcases to be executed in the storage environment; and
a testcase automation generator, the testcase automation generator containing control logic configured to:
train a learning function using metadata of previously generated testcases, each test case including multiple steps, by parsing the metadata of the previously generated testcases into steptasks and sequences of steptasks and providing the parsed metadata to the learning function to enable the learning function to learn the probability of what steptask will be executed next given an initial sequence of steptasks;
receive, as input from the testcase creator application, a type of testcase to be generated and a seed steptask;
use the trained learning function to obtain a predicted subsequent steptask based on the type of testcase to be generated and the seed steptask; and
provide the predicted subsequent steptask to the testcase creator application;
wherein each of the previously generated testcases includes a plurality of steps, and the control logic configured to parse the metadata into steptasks is further configured to create a steptask for each of the plurality of steps; and
wherein each steptask describes one of the steps of the testcase using a concatenation of a step number of the one of the steps of the testcase, a module and a submodule to be used to perform of the one of the steps of the testcase, and a function to be performed at the one of the steps of the testcase.
9. The storage environment of claim 8 , wherein the predicted subsequent steptask is based on the given type of testcase to be generated and the seed steptask.
10. The storage environment of claim 8 , wherein the seed steptask is a steptask of a new testcase to be generated by the testcase creator application.
11. The storage environment of claim 10 , wherein the seed steptask is a first steptask of the new testcase to be generated by the testcase creator application.
12. The storage environment of claim 8 , further comprising control logic configured to use the parsed metadata by the learning function to determine duplicate testcases.
13. The storage environment of claim 12 , wherein the control logic configured to use the parsed metadata is configured to use the steptasks to create testcase fingerprints for each of the previously generated testcases, and compare the testcase fingerprints to determine the duplicate testcases.
14. The storage environment of claim 8 , further comprising a testcase rules engine, and control logic configured to analyze an output of the learning function using the testcase rules engine to validate the output of the learning function.