Test coverage analysis
View Patent ↗A test coverage analysis method and corresponding apparatus are disclosed, wherein, by executing the program under test using one or more test cases, generating one or more heapdump files containing the call stack information of the program under test, and analyzing the call stack information in the one or more heapdump files, the coverage information of the one or more test cases in terms of functions in the program under test is obtained.
1. A computer-implemented method for analyzing test coverage of a program under test, comprising:
executing the program under test using a test case;
generating a heapdump file containing call stack information of called subroutines of the program under test;
obtaining based upon an analysis of the call stack information, coverage information; wherein the analyzing includes:
performing a hash operation on each function call entry, and an obtained hash code is an identification of the function call entry, and
recording an association between the identification and a corresponding function call stack and test case, wherein a call stack consists of stack frames each of which corresponds to one of the called subroutines.
2. The method of claim 1 , further comprising filtering, using filter rules, function call entries in the call stack information.
3. The method of claim 2 , wherein
the filter rules include a partial or full name of a package containing the program under test, and
the filtering filters out the function call entries that do not contain the partial or full name of the package.
4. The method of claim 2 , wherein
the filter rules include a name of a class or method not required for analyzing test coverage of the program under test, and
the filtering filters out the function call entries containing the name of the class or method.
5. The method of claim 1 , wherein
the program under test is executed using a plurality of test cases, and
the coverage information includes
a specific function called during the executing of the program under test, and
an identification of at least one of the plurality of test cases associated with the specific function being called.
6. The method of claim 1 , wherein
the coverage information includes one or more functions in the program under test not called during the executing of the program under test.
7. The method of claim 1 , wherein
the analyzing includes
sorting the identifications of the function call entries in an identification list, and
removing repetitive identifications from the identification list, and the identification list is used to obtain the coverage information.
8. The method of claim 1 , wherein
a plurality of heapdump files are generated during the executing the program under test, and
the coverage information is based upon the plurality of heapdump files.
9. A computer hardware system configure to analyze test coverage of a program under test, comprising:
at least one processor, wherein the at least one processor is configure to initiate and/or perform:
executing the program under test using a test case;
generating a heapdump file containing call stack information of called subroutines of the program under test;
obtaining, based upon an analysis of the call stack information, coverage information; wherein the analyzing includes:
performing a hash operation on each function call entry, and an obtained hash code is an identification of the function call entry; and
recording an association between the identification and a corresponding function call stack and test case, wherein a call stack consists of stack frames each of which corresponds to one of the called subroutines.
10. The system of claim 9 , wherein the at least one processor is further configured to initiate and/or perform:
filtering, using filter rules, function call entries in the call stack information.
11. The system of claim 10 , wherein
the filter rules include a partial or full name of a package containing the program under test, and
the filtering filters out the function call entries that do not contain the partial or full name of the package.
12. The system of claim 10 , wherein
the filter rules include a name of a class or method not required to analyze test coverage of the program under test, and
the filtering filters out the function call entries containing the name of the class or method.
13. The system of claim 9 , wherein
the program under test is executed using a plurality of test cases, and
the coverage information includes
a specific function called during the executing of the program under test, and
an identification of at least one of the plurality of test cases associated with the specific function being called.
14. The system of claim 9 , wherein
the coverage information includes one or more functions in the program under test not called during the executing of the program under test.
15. The system of claim 9 , wherein
the analyzing includes
sorting the identifications of the function call entries in an identification list, and
removing repetitive identifications from the identification list, and the identification list is used to obtain the coverage information.
16. The system of claim 9 , wherein
a plurality of heapdump files are generated during the executing the program under test, and
the coverage information is based upon the plurality of heapdump files.