On-demand services environment testing framework

1. A method of providing a test framework in an on-demand services environment, the method comprising:

accessing a plurality of tests via plug-ins to a core platform of the test framework;

receiving, by a user interface, a selection of tests for execution from the plurality of tests, wherein the selected tests are configured to test a plurality of layers of a software product, wherein one of the plurality of layers of the software product comprises: a graphical user interface (GUI) layer, a web service layer, an application programming interface (API) layer, a database layer, or a network test layer;

executing, by an execution engine coupled to the core platform, the selected tests;

storing test results for the executed selected tests on a configurable repository; and

reporting the stored test results in a summarized form on the user interface.

2. The method of claim 1 , wherein the executing the selected tests begins in response to a designation in a predetermined schedule.

3. The method of claim 1 , wherein the executing the selected tests begins in response to occurrence of a triggered event.

4. The method of claim 1 , wherein the executing the selected tests begins in response to an on-demand invocation.

5. The method of claim 1 , further comprising:

determining the plug-ins for each of the layers of the software product to be tested.

6. The method of claim 1 , wherein the executing the selected tests comprises distributing execution from the execution engine to a plurality of test clients.

7. The method of claim 1 , further comprising:

controlling versions of code for the tests by using source code management (SCM).

8. The method of claim 1 , further comprising:

extending the core platform to support a new test by adding a new plug-in.

9. The method of claim 1 , wherein two of the plurality of layers of the software product comprise two of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

10. The method of claim 1 , wherein three of the plurality of layers of the software product comprise three of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

11. The method of claim 1 , wherein four of the plurality of layers of the software product comprise four of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

12. The method of claim 1 , wherein the plurality of layers of the software product comprise: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

13. A non-transitory computer-readable storage medium having one or more instructions thereon for providing a test framework in an on-demand services environment, the instructions when executed by one or more processors causing the one or more processors to carry out:

accessing a plurality of tests via plug-ins to a core platform of the test framework;

receiving, by a user interface, a selection of tests for execution from the plurality of tests, wherein the selected tests are configured to test a plurality of layers of a software product, wherein one of the plurality of layers of the software product comprises: a graphical user interface (GUI) layer, a web service layer, an application programming interface (API) layer, a database layer, or a network test layer;

executing, by an execution engine coupled to the core platform, the selected tests;

storing test results for the executed selected tests on a configurable repository; and

reporting the stored test results in a summarized form on the user interface.

14. The computer-readable storage medium of claim 13 , wherein the executing the selected tests begins in response to at least one of: a designation in a predetermined schedule, occurrence of a triggered event, and an on-demand invocation.

15. The computer-readable storage medium of claim 13 , wherein the instructions when executed further cause the one or more processors to carry out:

determining the plug-ins for each of the layers of the software product to be tested.

16. The computer-readable storage medium of claim 13 , wherein the executing the selected tests comprises distributing execution from the execution engine to a plurality of test clients.

17. The computer-readable storage medium of claim 13 , wherein the instructions when executed further cause the one or more processors to carry out:

controlling versions of code for the tests by using source code management (SCM).

18. The computer-readable storage medium of claim 13 , wherein the instructions when executed further cause the one or more processors to carry out:

extending the core platform to support a new test by adding a new plug-in.

19. The computer-readable storage medium of claim 13 , wherein two of the plurality of layers of the software product comprise two of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

20. The computer-readable storage medium of claim 13 , wherein three of the plurality of layers of the software product comprise three of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

21. The computer-readable storage medium of claim 13 , wherein four of the plurality of layers of the software product comprise four of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

22. The computer-readable storage medium of claim 13 , wherein the plurality of layers of the software product comprise: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

23. An apparatus for providing a test framework in an on-demand services environment, the apparatus comprising:

a processor; and

one or more stored sequences of instructions which, when executed by the processor, cause the processor to carry out:

accessing a plurality of tests via plug-ins to a core platform of the test framework;

receiving, by a user interface, a selection of tests for execution from the plurality of tests, wherein the selected tests are configured to test a plurality of layers of a software product, wherein one of the plurality of layers of the software product comprises: a graphical user interface (GUI) layer, a web service layer, an application programming interface (API) layer, a database layer, or a network test layer;

executing, by an execution engine coupled to the core platform, the selected tests;

storing test results for the executed selected tests on a configurable repository; and

reporting the stored test results in a summarized form on the user interface.

24. The apparatus of claim 23 , wherein the executing the selected tests begins in response to at least one of: a designation in a predetermined schedule, occurrence of a triggered event, and an on-demand invocation.

25. The apparatus of claim 23 , wherein the instructions when executed further cause the processor to carry out:

determining the plug-ins for each of the layers of the software product to be tested.

26. The apparatus of claim 23 , wherein the executing the selected tests comprises distributing execution from the execution engine to a plurality of test clients.

27. The apparatus of claim 23 , wherein the instructions when executed further cause the processor to carry out:

controlling versions of code for the tests by using source code management (SCM).

28. The apparatus of claim 23 , wherein the instructions when executed further cause the processor to carry out:

extending the core platform to support a new test by adding a new plug-in.

29. The apparatus of claim 23 , wherein two of the plurality of layers of the software product comprise two of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

30. The apparatus of claim 23 , wherein three of the plurality of layers of the software product comprise three of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

31. The apparatus of claim 23 , wherein four of the plurality of layers of the software product comprise four of: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.

32. The apparatus of claim 23 , wherein the plurality of layers of the software product comprise: the graphical user interface (GUI) layer, the web service layer, an application programming interface (API) layer, the database layer, and the network test layer.