Measuring and optimizing test resources and test coverage effectiveness through run time customer profiling and analytics

1. A system comprising:

a processor in communication with one or more types of memory, the processor configured to:

perform an accounting of available test resources within one or more organizations;

store data relating to the accounting of available test resources;

store data relating to one or more test resource goals;

determine to analyze the data relating to the accounting of available test resources;

analyze the data relating to the accounting of available test resources with respect to the data relating to one or more test resource goals;

determine that the available test resources within one or more organizations are either optimal or non-optimal;

responsive to determining ineffective resource utilization, change the resource utilization goals to reallocate resources to more productive organizations or environments, wherein reallocating resources to more productive organizations or environments comprises providing de-duplication of test efforts; and

provide a visualization of available test resources and test resource deployment recommendations.

2. The system of claim 1 wherein the available test resources within one or more organizations comprise available test resources across one or more of each of test organizations, test environments and an enterprise.

3. The system of claim 1 wherein the data relating to one or more test resource goals is selected from the group consisting of enterprise, organizations, test environments, test workloads, test cases, test scenarios, test skills, test planners, test architects, testers, business partners, OEMs, open source foundations, other related factors and metrics that are resources expenses, and limitations or enablement's associated with business geography, cultural sensitivities and legal obligations, and time zone contradictions.

4. The system of claim 1 wherein the available test resources comprise human resources and physical resources.

5. The system of claim 1 wherein the processor configured to analyze the data relating to the accounting of available test resources with respect to the data relating to one or more test resource goals comprises the processor configured to determine via historical and run time customer profiling and analytics a score and ranking of use of resources using one or more factors or metrics.

6. The system of claim 5 wherein the one or more factors or metrics is selected from the group consisting of: test problems found per resource cost using data from resources data stores along with test execution workload run facts data; customer detected problems; environment or configuration optimization; workload optimization comprising functional coverage, stress and activity levels, and workload characteristics' attainment; operational optimization; duplication of test effort within and across test organizations; test plan coverage efficiency; problem and/or critical situation recreate capabilities; and factors or metrics impacting test resource return on investment.

7. The system of claim 1 , wherein the visualization shows the available test resources and coverage ranked and scored according to a plurality of customizable factors.

8. A computer program product comprising:

a non-transitory storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising:

performing, by a processor, an accounting of available test resources within one or more organizations;

storing, by the processor, data relating to the accounting of available test resources;

storing, by the processor, data relating to one or more test resource goals;

determining, by the processor, to analyze the data relating to the accounting of available test resources;

analyzing, by the processor, the data relating to the accounting of available test resources with respect to the data relating to one or more test resource goals;

determining, by the processor, from the analyzing by the processor, the data relating to the accounting of available test resources with respect to the data relating to one or more test resource goals that the available test resources within one or more organizations are either optimal or non-optimal;

responsive to determining ineffective resource utilization, changing the resource utilization goals to reallocate resources to more productive organizations or environments, wherein reallocating resources to more productive organizations or environments comprises providing de-duplication of test efforts; and

providing a visualization of available test resources and test resource deployment recommendations.

9. The computer program product of claim 8 wherein the available test resources within one or more organizations comprise available test resources across one or more of each of test organizations, test environments and an enterprise.

10. The computer program product of claim 8 wherein the data relating to one or more test resource goals is selected from the group consisting of enterprise, organizations, test environments, test workloads, test cases, test scenarios, test skills, test planners, test architects, testers, business partners, OEMs, open source foundations, other related factors and metrics that are resources expenses, and limitations or enablement's associated with business geography, cultural sensitivities and legal obligations, and time zone contradictions.

11. The computer program product of claim 8 wherein the available test resources comprise human resources and physical resources.

12. The computer program product of claim 8 wherein analyzing, by the processor, the data relating to the accounting of available test resources with respect to the data relating to one or more test resource goals comprises determining via historical and run time customer profiling and analytics a score and ranking of use of resources using one or more factors or metrics.

13. The computer program product of claim 8 , wherein the visualization shows the available test resources and coverage ranked and scored according to a plurality of customizable factors.