SYSTEM AND METHOD FOR TEST STRATEGY OPTIMIZATION
A test strategy optimizer for minimizing the impact of software update correctness testing is provided for software having several processes. Each process may have a criticality level associated with it and a test effort level associated with it. An update analyzer may determine what functions are modified and a dependency analyzer may determine what processes are connected to modifications, and thus require testing. User input may specify global test parameters related to test time, test completeness per criticality level, test iterations, etc. The test strategy optimizer will then take the process parameters, process dependencies, and user criteria to calculate the most efficient test procedure and provide information about the same. The test strategy optimizer may also provide adjustment tools, so users may modify parameters, based on the resulting information.
1 . A method of increasing software testing efficiency, comprising:
compiling, with an electronic processor, a list of relevant processes;
assigning, with the electronic processor, a criticality attribute to each relevant process;
assigning, with the electronic processor, a test effort metric to each relevant process;
determine a minimum call rate for each active artifact;
compile, with the electronic processor, a minimum test scope that satisfies the assigned metrics;
provide, via a user interface executed on the electronic processor, a set of re-planning tools configured to receive input modifying parameters and recompiling the minimum test scope.
2 . The method of claim 1 , further comprising:
determining dependencies between relevant processes, wherein compiling a minimum test scope is based at least in part on the dependencies.
3 . The method of claim 1 , wherein the list of relevant processes is defined by which processes call an artifact that has been changed.
4 . The method of claim 1 , further comprising:
establishing a global criticality level on which the minimum test scope is based in part.
5 . A method of optimizing a software package testing strategy, comprising:
assign a criticality level to each of a plurality of processes;
assign an effort level to each process;
responsive to receiving an update to the software package, wherein the software package includes the plurality of processes and each process calls upon one or more artifacts and each artifact may be called by one or more processes, performing with an electronic processor:
determining which of the one or more artifacts are changed by the update (“updated artifacts”);
determining a list of relevant processes as those from the plurality of processes that calls one or more of the updated artifacts;
receiving a plurality of minimum test requirements;
determining an optimized test strategy that satisfies the plurality of minimum test requirements based on parameters that include: the criticality level assigned to each process, the effort level assigned to each process, dependencies between relevant processes, a specified minimum call rate for each updated artifact, and a global criticality level that defines how complete the testing strategy must be; and
providing re-planning tools to display a result from the optimized test strategy and recalculates based on user input adjustments to the parameters.
6 . A system for increasing software testing efficiency, comprising:
an electronic processor configured to execute a software package that include a plurality of processes and a plurality of artifacts, and responsive to a software update, the electronic processor configure to:
compile a list of relevant processes;
assign a criticality attribute to each relevant process;
assign a test effort metric to each relevant process;
determine a minimum call rate for each active artifact;
compile a minimum test scope that satisfies the assigned metrics;
provide a set of re-planning tools configured to receive input modifying parameters and recompiling the minimum test scope.
7 . The system of claim 6 , wherein the processor is further configured to: determine dependencies between relevant processes, wherein compiling a minimum test scope is based at least in part on the dependencies.
8 . The system of claim 6 , wherein the list of relevant processes is defined by which processes call an artifact that has been changed.
9 . The system of claim 6 wherein the processor is further configured to: establish a global criticality level on which the minimum test scope is based in part.