Techniques for distributed testing
View Patent ↗Techniques for distributed testing are provided. Resources are identified for performing tests over a network. The tests and policies are sent to the resources and a proxy. The proxy delivers data for the tests to the resources and enforces the policies during the tests. The proxy also gathers statistics and results from the resources, which are executing the tests, and the proxy reports the statistics and results to one or more third-party services for subsequent manipulation and analysis.
1. A computer-implemented method that is adapted to executed by one or more processors of a proxy to perform the method, comprising:
identifying, by the proxy, a set of resources, via policies, the set of resources distributed over a network, each resource associated with a different processing environment from remaining resources;
delivering, by the proxy, test data to each of the resources over the network on an as-requested basis to each of the resources to ensure network bandwidth is not adversely impacted on the network; and
capturing, by the proxy, test results for tests performed by the resources in response to the delivered test data.
2. The method of claim 1 further comprising, delivering, from the proxy, the test results to a third-party service over the network, the third-party service collects, reports, and manages the test results.
3. The method of claim 1 , wherein identifying further includes deriving the policies that identify each of the resources from user-supplied characteristics for the set of resources and the processing environments of those set of resources.
4. The method of claim 1 , wherein identifying further includes identifying at least one of the resources, via a particular one of the policies, as a virtual machine.
5. The method of claim 1 , wherein identifying further includes identifying at least one of the processing environments for one of the resources as a virtual processing environment.
6. The method of claim 1 , wherein delivering further includes distributing a particular one of the tests to a particular resource configured for that resource's processing environment.
7. The method of claim 6 , wherein distributing further includes providing the particular one of the tests as a story that is a distributed test having a specific sequence of operations that the particular resource executes as commands using the test data.
8. The method of claim 1 , wherein delivering further includes distributing the test data to at least one resource when that at least one resource makes a request for the test data.
9. The method of claim 1 , wherein capturing further includes managing and controlling, over the network and by the proxy, each test when executed by that test's resource.
10. A computer-implemented method that is adapted to be executed by one or more processors of a proxy to perform the method, comprising, comprising:
configuring, by the proxy, stories for execution on clients over a network, each story defining a test having a specific sequence of operations and specific settings for a particular one of the clients, and each client having a different processing environment from remaining clients;
delivering, by the proxy, each story to that story's client over the network;
providing, by the proxy, test data as for the stories as requested by each client; and
controlling, managing, and participating, by the proxy, in each execution of each story when processed by that story, and wherein processing restrictions for each story are enforced on each client.
11. The method of claim 10 further comprising, forwarding to a third-party service over the network test results and statistics gathered for each story once processed by each client.
12. The method of claim 10 , wherein configuring further includes identifying each client based on user-supplied characteristics for the processing environments.
13. The method of claim 10 , wherein configuring further includes identifying each client based on evaluated policies.
14. The method of claim 10 , wherein controlling, managing, and participating further includes enforcing policies as each story is processed over the network by that story's client.
15. The method of claim 10 further comprising, generating, by the proxy, reports summarizing test results from executing the stories by the clients.