Functional software testing framework for determinate level testing
A method and system of testing coded features is provided that provides deterministic test results. The method includes building an instance of the hosted application using a minimum set of information required for the instance of the hosted application. A coded feature to be tested is deployed to the created instance of the hosted application and tests are run against the deployed coded feature.
1. A method of testing a feature to be deployed as part of a hosted application comprising:
building an individual, replicated instance of the hosted application using a minimum set of information required for the instance of the hosted application, wherein the instance comprises a dedicated stack hosting a server with a mock services unit emulating systems representing external dependencies, and a developer's database instance comprising minimal database content selected by a meta data unit;
deploying a coded feature to the replicated instance of the hosted application; and
running a test on the deployed coded feature.
2. The method of claim 1 , wherein building an instance of the hosted application includes utilizing a meta data unit to analyze database content and selecting a minimum set of database content to package into archive files provided to the instance of the hosted application.
3. The method of claim 1 , wherein the archive files are used repetitively by a developer each time an instance of the hosted application is built to test a new coded feature.
4. The method of claim 1 , wherein the hosted application is an ecommerce application and the minimum set of information retrieved from the database includes template and site files.
5. The method of claim 1 , wherein running a test on the deployed coded feature includes writing a functional test and deploying the functional test to a replication system.
6. The method of claim 5 , wherein the replication system includes a plurality of nodes that based on the received functional test simulate users interacting with the hosted application.
7. The method of claim 6 , wherein the replication system interacts with the hosted application in an automated fashion.
8. The method of claim 6 , wherein the plurality of nodes are Selenium nodes.
9. The method of claim 6 , wherein the plurality of nodes communicate with the instance of a hosted application use HTTP/S protocol.
10. A system configured to test a feature to be deployed as part of a hosted application, the system comprising:
a workstation coupled to the communications network;
a dedicated application stack coupled to the workstation via a communication network, wherein the dedicated application stack is configured to host an instance of a hosted application and a coded feature deployed to the dedicated application stack form the workstation, wherein the workstation provides meta data to the dedicated application stack that describes or represents a minimum set of information required for the instance of the hosted application; and
a replication system coupled to the workstation via a communication network, wherein the workstation provides functional tests for the replication system to perform on the deployed coded feature.
11. The method of claim 10 , wherein the workstation is configured to enable a developer to write the coded feature and the functional test.
12. The method of claim 11 , wherein the archive files represent a snapshot of the database that can be re-used each time a new instance of the hosted application is created to test.
13. The method of claim 10 , wherein the workstation includes a meta data unit that analyzes database content and selects a minimum set of database content to package into archive files provided to the dedicated application stack to create the instance of the hosted application.
14. The method of claim 11 , wherein the hosted application is an ecommerce application and the minimum set of information retrieved from the database includes template and site files.
15. The method of claim 11 , wherein the workstation further provides to the dedicated application stack a mock services application that emulates services provided by third party service providers such that the instance of the hosted application is free from external dependencies.
16. The method of claim 11 , wherein the replication system includes a plurality of nodes that interact with the instance of the hosted application to simulate users interacting with the hosted application and the coded feature being tested.
17. The method of claim 16 , wherein plurality of nodes are Selenium nodes.
18. The method of claim 11 , wherein the replication system interacts with the instance of the hosted application in an automated fashion based on functional tests provided by the workstation.