Method and apparatus for automatically isolating minimal distinguishing stimuli in design verification and software development
View Patent ↗The invention provides a method for detecting and isolating software bugs and generating a minimal set of stimuli to reproduce the bugs. The present invention utilizes a recursive algorithm to compare the output of successively smaller software blocks of a program in development to a verified output sample. The smallest software blocks which are found to contain a bug are isolated. For each of these isolated blocks, the smallest input vector is determined such that the application of this vector to the block expresses the bug. The present invention utilizes a separate recursive algorithm to determine these minimal vectors.
1. A computer-implemented method of debugging software comprising:
obtaining a software module;
obtaining a first input test vector;
obtaining a bug list, wherein said bug list comprises a minimal set of stimuli to reproduce a software bug in said software module;
generating a first output vector by applying said first input test vector to said software module;
applying a comparison test to said first output vector to determine whether a bug exists in said software module;
applying a module decomposition test to said software module when the result of said comparison test is positive;
obtaining a module decomposition list comprising two or more submodules of said software module and iteratively processing said module decomposition list when the result of said module decomposition test is positive, wherein iteratively processing said module decomposition list comprises removing at least one submodule; and
appending said software module and said first input test vector to said bug list when said software module is a minimal module based on module decomposition list as determined by the module decomposition test.
2. The method of claim 1 wherein said comparison test comprises:
obtaining an optimal result vector;
comparing said first output vector to said optimal result vector; and
determining whether said first output vector is at variance with said optimal result vector.
3. The method of claim 1 wherein the iterative processing step comprises:
obtaining a second input test vector such that the application of said second input test vector to said two or more submodules generates a second output test vector; and
recursively processing said two or more submodules and said second output test vector.
4. The method of claim 3 wherein the recursively processing step comprises:
obtaining said minimal module;
obtaining said first input test vector; and
applying a vector decomposition test to said first input test vector.
5. The method of claim 4 further comprising:
generating a third output vector by applying said first input test vector to said minimal module when the result of said vector decomposition test is negative;
applying said comparison test to said third output vector to determine whether said first input test vector recreates the bug; and
appending said input test vector to a test list when the result of said comparison test is positive.
6. The method of claim 5 further comprising:
obtaining a vector decomposition list comprising two or more subvectors of said first input test vector when the result of said vector decomposition test is positive; and
iteratively processing each entry in said vector decomposition list by recursively applying said vector decomposition test to said subvectors.
7. The method of claim 6 in which said software module and said input test vector are obtained by iterating through the entries in said bug list.
8. A computer system for debugging software comprising:
a processor;
a memory;
a storage device; and
software instructions stored in the memory for enabling the computer system under control of the processor, to:
obtain a software module;
obtain a first input test vector;
obtain a bug list, wherein said bug list comprises a minimal set of stimuli to reproduce a
software bug in said software module;
generate a first output vector by applying said first input test vector to said software module;
apply a comparison test to said first output vector to determine whether a bug exists in said software module;
apply a module decomposition test to said software module when the result of said comparison test is positive;
obtain a module decomposition list comprising two or more submodules of said software module and iteratively processing said module decomposition list when the result of said module decomposition test is positive, wherein iteratively processing said module decomposition list comprises removing at least one submodule; and
append said software module and said first input test vector to said bug list when said software module is a minimal module based on module decomposition list as determined by the module decomposition test.