Test cycle optimization using contextual association mapping
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for test cycle optimization using contextual association mapping. In one aspect, a method includes obtaining an artefact that includes a collection of reference items, where each reference item includes a sequence of words, generating candidate tags from each of the reference items based on the sequences of words in the reference items, selecting a subset of the candidate tags as context tags based on an amount that the candidate tags appear in the reference items, obtaining a sample item that includes a sequence of words, identifying a subset of the context tags in the sequence of words in the sample item, and classifying a subset of the reference items as contextually similar to the sample item based the context tags that were identified.
1. A computer-implemented method, the method comprising:
obtaining an artefact that includes a collection of reference test cases, where each reference test case includes a sequence of words;
generating candidate tags from each of the reference test cases based on the sequences of words in the reference test cases;
determining, for each of the candidate tags, a number of the reference test cases of the collection in which the candidate tag appears;
determining, for each candidate tag, whether to select the candidate tag as a context tag used to classify the reference test cases based on the number of the reference test cases in which the candidate tag appears;
obtaining a sample test case that includes a sequence of words;
identifying a subset of the context tags in the sequence of words in the sample test case;
classifying a subset of the reference test cases as contextually similar to the sample test case based the context tags that were identified; and
executing the subset of the reference test cases classified as contextually similar to the sample test case based the context tags that were identified.
2. The method of claim 1 , wherein determining, for each candidate tag, whether to select the candidate tag as a context tag used to classify the reference test cases based on the number of the reference test cases in which the candidate tag appears comprises:
determining that a proportion of the reference test cases that the candidate tag appears in satisfies a proportion criteria.
3. The method of claim 1 , wherein classifying a subset of the reference test cases as contextually similar to the sample test case based the context tags that were identified comprises:
determining that each of the reference test cases in the subset of reference test cases includes at least one of the context tags that were identified.
4. The method of claim 1 , wherein generating candidate tags from each of the reference test cases based on the sequences of words in the reference test cases comprises:
generating the candidate tags from a particular reference test case of the reference test cases based on different portions of the sequence of words in the reference test case.
5. The method of claim 1 , wherein identifying a subset of the context tags in the sequence of words in the sample test case comprises:
for each context tag, determining whether the sequence of words in the sample test case includes the context tag; and
in response to determining that the sequence of words in the sample test case includes a particular context tag of the context tags, identifying the particular context tag.
6. The method of claim 1 , wherein identifying a subset of the context tags in the sequence of words in the sample test case comprises:
determining a domain of the sample test case; and
selecting the context tags based on the domain of the sample test case.
7. The method of claim 1 , comprising:
determining signatures for each of the context tags; and
determining attributes for each of the signatures,
wherein classifying a subset of the reference test cases as contextually similar to the sample test case based the context tags that were identified comprises:
determining that the signatures for the context tags that were identified match signatures for the context tags in the reference test case of the subset of the reference test case.
8. A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
obtaining an artefact that includes a collection of reference test cases, where each reference test case includes a sequence of words;
generating candidate tags from each of the reference test cases based on the sequences of words in the reference test cases;
determining, for each of the candidate tags, a number of the reference test cases of the collection in which the candidate tag appears;
determining, for each candidate tag, whether to select the candidate tag as a context tag used to classify the reference test cases based on the number of the reference test cases in which the candidate tag appears;
obtaining a sample test case that includes a sequence of words;
identifying a subset of the context tags in the sequence of words in the sample test case;
classifying a subset of the reference test cases as contextually similar to the sample test case based the context tags that were identified; and
executing the subset of the reference test cases classified as contextually similar to the sample test case based the context tags that were identified.
9. The system of claim 8 , wherein determining, for each candidate tag, whether to select the candidate tag as a context tag used to classify the reference test cases based on the number of the reference test cases in which the candidate tag appears comprises:
determining that a proportion of the reference test cases that the candidate tag appears in satisfies a proportion criteria.
10. The system of claim 8 , wherein classifying a subset of the reference test cases as contextually similar to the sample test case based the context tags that were identified comprises:
determining that each of the reference test cases in the subset of reference test cases includes at least one of the context tags that were identified.
11. The system of claim 8 , wherein generating candidate tags from each of the reference test cases based on the sequences of words in the reference test cases comprises:
generating the candidate tags from a particular reference test case of the reference test cases based on different portions of the sequence of words in the reference test case.
12. The system of claim 8 , wherein identifying a subset of the context tags in the sequence of words in the sample test case comprises:
for each context tag, determining whether the sequence of words in the sample test case includes the context tag; and
in response to determining that the sequence of words in the sample test case includes a particular context tag of the context tags, identifying the particular context tag.
13. The system of claim 8 , wherein identifying a subset of the context tags in the sequence of words in the sample test case comprises:
determining a domain of the sample test case; and
selecting the context tags based on the domain of the sample test case.
14. The system of claim 8 , the operations comprising:
determining signatures for each of the context tags; and
determining attributes for each of the signatures,
wherein classifying a subset of the reference test cases as contextually similar to the sample test case based the context tags that were identified comprises:
determining that the signatures for the context tags that were identified match signatures for the context tags in the reference test case of the subset of the reference test case.
15. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
obtaining an artefact that includes a collection of reference test cases, where each reference test case includes a sequence of words;
generating candidate tags from each of the reference test cases based on the sequences of words in the reference test cases;
determining, for each of the candidate tags, a number of the reference test cases of the collection in which the candidate tag appears;
determining, for each candidate tag, whether to select the candidate tag as a context tag used to classify the reference test cases based on the number of the reference test cases in which the candidate tag appears;
obtaining a sample test case that includes a sequence of words;
identifying a subset of the context tags in the sequence of words in the sample test case;
classifying a subset of the reference test cases as contextually similar to the sample test case based the context tags that were identified; and
executing the subset of the reference test cases classified as contextually similar to the sample test case based the context tags that were identified.