IP Library › Granted Patent US 9,753,839
Granted Patent B2
US 9,753,839 · App. 15/074,112 · Granted Sep 5, 2017

Test script evaluation system and method

Inventors: Ravikumar Balakrishnan (Tamil Nadu, IN); Rajesh Chengalpathy (Tamil Nadu, IN); S. Yogeswaran (Chennai, IN)
Assignee: ACCENTURE GLOBAL SERVICES LIMITED
G06F11/3672
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,753,839
App. No.
15/074,112
Granted
Sep 5, 2017
Kind
B2
Abstract

A method and a computer system include a protocol evaluation engine that evaluates a test script. The method includes receiving a test script and requirements, developing a set of protocol evaluators, evaluating the test script by comparing the protocol evaluators with the test script, determining a final score for the evaluator for the test script and generating a group score for a plurality of test scripts for identifying a tester for the test script based on the group score. The computer system includes a process and memory and processor executable instructions to carry out the above method.

Claims (47)

1. A method for evaluating one or more test scripts used testing aspects target system, comprising:

receiving, via a communications interface, a test script and a plurality of requirements for the test script wherein the plurality of requirements facilitate evaluation of the test script and are in pre-determined format;

developing a set of protocol evaluators based on the plurality of requirements, wherein the set of protocol evaluators comprises a business requirements evaluator, a validation language requirements evaluator, a template evaluator, a completeness evaluator, and a descriptiveness evaluator, wherein each protocol evaluator of the set of protocol evaluators contains one or more factors;

storing the developed set of protocol evaluators in a computer readable memory;

executing each protocol evaluator with a protocol evaluation engine, wherein:

execution of the business requirements evaluator controls the protocol evaluator to determine whether the test script tests specified business requirements,

execution of the language requirements evaluator controls the protocol evaluator to determine whether the test script is written in a specified language,

execution of the template evaluator controls the protocol evaluator to determine whether the test script is prepared using a specified template,

execution of the completeness evaluator controls the protocol evaluator to determine whether the test script meets completeness requirements, and

execution of the descriptiveness evaluator controls the protocol evaluator to determine whether the test script meets descriptiveness requirements,

wherein execution of each protocol evaluator with the protocol evaluation engine the further comprises

assigning an initial score to the test script;

for each protocol evaluator:

comparing the one or more factors of the protocol evaluator with the test script to thereby determine whether the test script deviates with at least one of the one or more factors of the protocol evaluator, and in response assigning a deviation thereto;

determining a deductible points for each deviation according to a pre-determined rule up to a maximum deductible points;

subtracting the deductible points from the initial score for the test script to thereby obtain a final score; and

generating a group score for a plurality of test scripts based on a pre-determined category and the final score of the plurality of test scripts for identifying a tester for the test script based on the group score.

2. The method of claim 1 , wherein for a predetermined subset of deviations, the corresponding deductible points comprises the initial score as the deductible points for the deviation such that upon subtracting the deductible points from the initial score, a zero point score is allocated as the final score and the evaluating is terminated.

3. The method of claim 2 , wherein the predetermined subset of deviations comprises the test script is not in a right template or the test script is not completed.

4. The method of claim 1 , wherein generating the group score comprises adding up the final scores according to the pre-determined category.

5. The method of claim 1 , wherein the group score comprises: a tester based score and a test script based score.

6. The method of claim 5 , wherein the tester based score comprises an identification for the tester.

7. The method of claim 5 , wherein the test script based score comprises an aggregate score that is computed according to the final score.

8. The method of claim 7 , wherein the test script based score is generated by using the aggregate score wherein the tester based score comprises a plurality of pre-determined tester categories.

9. A computer system, comprising:

a processor coupled with a communications interface and a non-transitory computer readable medium storing processor executable instructions comprising a protocol evaluation engine that evaluates one or more test scripts configured to cause the processor to:

receive a test script and a plurality of requirements for the test script via the communications interface, wherein the plurality of requirements facilitate evaluation of the test script and are in pre-determined format;

develop a set of protocol evaluators based on the plurality of requirements evaluator wherein the set of protocol evaluators comprises a business requirements, a validation language requirements evaluator, a template evaluator, a completeness evaluator and a descriptiveness evaluator, wherein each protocol evaluator contains one or more factors;

store the developed set of protocol evaluators in a computer readable memory;

execute each protocol evaluator with a protocol evaluation engine, wherein:

execution of the business requirements evaluator controls the protocol evaluator to determine whether the test script tests specified business requirements,

execution of the language requirements evaluator controls the protocol evaluator to determine whether the test script is written in a specified language,

execution of the template evaluator controls the protocol evaluator to determine whether the test script is prepared using a specified template,

execution of the completeness evaluator controls the protocol evaluator to determine whether the test script meets completeness requirements, and

execution of the descriptiveness evaluator controls the protocol evaluator to determine whether the test script meets descriptiveness requirements,

wherein execution of each protocol evaluator with the protocol evaluation engine the further comprises:

assigning an initial score to the test script; for each protocol evaluator:

comparing the one or more factors of the protocol evaluators with the test script, and determining whether the test script deviates with at least one of the one or more factors, and in response assigning a deviation thereto;

determining a deductible points for each deviation according to a pre-determined rule up to a maximum deductible points, and determining a final score for the evaluator for the test script by subtracting the deductible points from the initial score for the test script to obtain the final score; and

generate a group score for a plurality of test scripts based on a pre- determined category and the final score of the plurality of test scripts for identifying a tester for the test script based on the group score.

10. The computer system of claim 9 , wherein for a predetermined subset of deviations, the corresponding deductible points comprises the initial score as the deductible points for the deviation such that upon subtracting the deductible points from the initial score, a zero point score is allocated as the final score and the evaluating is terminated.

11. The computer system of claim 10 , wherein the predetermined subset of deviations comprises the test script is not in a right template or the test script is not completed.

12. The computer system of claim 9 , wherein the instructions configured to cause the one or more processors to generate the group score further comprise instructions configured to cause the one or more processors to add up the final scores according to the pre-determined category.

13. The computer system of claim 9 , wherein the group score comprises: a tester based score and a test script based score.

14. The computer system of claim 13 , wherein the tester based score comprises an identification for the tester.

15. The computer system of claim 13 , wherein the test script based score comprises an aggregate score that is computed according to the final score.

16. The computer system of claim 15 , wherein the instructions configured to cause the one or more processors to generate the group score may further comprise instructions configured to cause the one or more processors to generate the tester based score by using the aggregate score wherein the tester based score comprises a plurality of pre-determined tester categories.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2016
From: BALAKRISHNAN, RAVIKUMAR; CHENGALPATHY, RAJESH; YOGESWARAN, S.
To: ACCENTURE GLOBAL SERVICES LIMITED
Reel/Frame 039030/0897 →
Priority Claims (1)
IN 1359/CHE/2015 · Mar 19, 2015 · national
Continuity (1)
Related Publication 20160275003A1 · Sep 22, 2016