Automated atomic system testing
View Patent ↗Atomic testing of a multiplicity of scenarios includes generating a listing of interacting scenarios which are likely to cause a failure, and testing ones of the scenarios not included in the listing according to a binary search strategy to identify a subset of the scenarios as a source of failure among the scenarios. Additionally, the listing can be updated with newly identified interacting scenarios which are likely to cause a failure.
1. A machine implemented method for the atomic testing of a plurality of scenarios, comprising:
generating a listing of interacting ones of the scenarios which are likely to cause a failure;
storing the said listing to a memory; and,
testing ones of the scenarios not included in said listing according to a binary search strategy to identify a subset of the scenarios as a source of failure among the scenarios.
2. The machine implemented method of claim 1 , wherein generating comprises populating said listing with scenarios that are known to have interaction problems with one another.
3. The machine implemented method of claim 1 , wherein said testing comprises:
concurrently executing a full set of the scenarios not included in said listing to detect a failure; and,
responsive to detecting a failure, decomposing said full set into subsets, concurrently executing at least one of said subsets to detect a failure, and repeatedly decomposing said subsets into further subsets and concurrently executing said further subsets until identifying a subset of scenarios causing said failure.
4. The machine implemented method of claim 1 , further comprising updating said listing with newly identified interacting ones of the scenarios which are likely to cause a failure.
5. A machine implemented method for atomically testing scenarios for an application under test comprising:
identifying a set of the scenarios that are known to have interaction problems with one another;
recording to a memory said identified set in a listing;
providing said listing as input to a testing tool; and,
testing ones of the scenarios not included in said listing according to a binary search strategy to identify a subset of the scenarios as a source of failure among the scenarios.
6. The machine implemented method of claim 5 , wherein said testing comprises:
concurrently executing a full set of the scenarios not included in said listing to detect a failure; and,
responsive to detecting a failure, decomposing said full set into subsets, concurrently executing at least one of said subsets to detect a failure, and repeatedly decomposing said subsets into further subsets and concurrently executing said further subsets until identifying a subset of scenarios causing said failure.
7. The machine implemented method of claim 5 , further comprising updating said listing with newly identified interacting ones of the scenarios which are likely to cause a failure.