IP Library › Granted Patent US 12,505,030
Granted Patent B2
US 12,505,030 · App. 18/237,979 · Granted Dec 23, 2025

Fair method for selecting regression cases

Inventors: Bernie Hu (Chengdu, CN); Shuang Zheng (Chengdu, CN); Ellie Jiang (Chengdu, CN)
Assignee: Dell Products L.P.
G06F11/3692
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,505,030
App. No.
18/237,979
Granted
Dec 23, 2025
Kind
B2
Abstract

Methods, system, and non-transitory processor-readable storage medium for a test selection system are provided herein. An example method includes selecting a regression test case from a plurality of regression test cases in a software testing lifecycle system. A test selection system calculates a score for the regression test case using an Analytic Hierarchy Process (AHP) assigned weight. Using the score, the test selection system visualizes a relationship between the regression test case and goals associated with a regression testing effort. The test selection system selects the regression test case for use in the regression testing effort based on the visualized relationship, and executes the regression test case on a system.

Claims (52)

1 . A method comprising:

selecting, by a test selection system, a regression test case from a plurality of regression test cases in a software testing lifecycle system;

calculating a score for the regression test case using an Analytic Hierarchy Process (AHP) assigned weight, wherein the AHP assigned weight is determined based on multiple valued factors including feature coverage, code coverage, test point coverage, and defect ticket;

using the score, automatically generating, by the test selection system, a visual representation displaying quantified relationships between the regression test case and specific regression testing coverage objectives for the software system;

selecting, by the test selection system, the regression test case for use in the regression testing effort based on the visualized relationship that demonstrates optimal resource allocation for achieving the regression testing coverage objectives;

automatically executing the regression test case on a system to detect software defects, wherein the method is implemented by at least one processing device comprising a processor coupled to a memory; and

visualizing the relationship to determine an optimal number of regression test cases to execute on the system by displaying a graphical representation showing how incremental addition of regression test cases affects achievement of regression testing coverage goals until reaching an inflection point where the marginal benefit of adding more regression test cases begins to diminish significantly.

2 . The method of claim 1 wherein calculating the score for the regression test case comprises:

identifying a plurality of valued factors associated with the regression test case.

3 . The method of claim 1 wherein calculating the score for the regression test case comprises:

normalizing a plurality of valued factors associated with the regression test case.

4 . The method of claim 3 wherein normalizing the plurality of valued factors comprises:

normalizing the plurality of valued factors using a min-max normalization.

5 . The method of claim 1 wherein calculating the score for the regression test case comprises:

determining a respective weight associated with each of a plurality of valued factors associated with the regression test case using AHP.

6 . The method of claim 1 wherein calculating the score for the regression test case comprises:

maximizing a subset of valued factors associated with the regression test case.

7 . The method of claim 6 wherein the subset of value factors comprises feature coverage, code coverage, test point coverage, and defect ticket.

8 . The method of claim 1 wherein calculating the score for the regression test case comprises:

minimizing a subset of valued factors associated with the regression test case.

9 . The method of claim 8 wherein the subset of value factors comprises feature overlap, test point overlap execution time and case creation time.

10 . The method of claim 1 wherein calculating the score for the regression test case comprises:

calculating a respective score for each regression test case in a plurality of regression test cases.

11 . The method of claim 1 wherein using the score, visualizing, by the test selection system, the relationship between the regression test case and goals associated with a regression testing effort comprises:

visualizing the relationship using an elbow method that plots regression test case coverage against the number of selected regression test cases to identify an optimal inflection point for regression testing efficiency.

12 . The method of claim 1 wherein using the score, visualizing, by the test selection system, the relationship between the regression test case and goals associated with a regression testing effort comprises:

sorting a plurality of scores associated with a plurality of regression test cases.

13 . The method of claim 12 further comprising:

visualizing a subset of the plurality of regression test cases associated with highest scores in the plurality of sorted scores.

14 . The method of claim 1 wherein selecting, by the test selection system, the regression test case for use in the regression testing effort based on the visualized relationship comprises:

selecting an optimal number of regression test cases to execute on the system.

15 . The method of claim 14 further comprising:

selecting the optimal number of regression test cases from a subset of a plurality of regression test cases, wherein the subset of regression test cases has highest scores among the plurality of regression test cases.

16 . The method of claim 1 executing the regression test case on the system comprises:

executing a subset of a plurality of regression test cases, wherein the subset of regression test cases has highest scores among the plurality of regression test cases.

17 . The method of claim 1 executing the regression test case on the system comprises:

verifying the selection of the regression test case for use in the regression testing effort based on a change in defect tickets.

18 . A system comprising:

at least one processing device comprising a processor coupled to a memory; the at least one processing device being configured:

to select, by a test selection system, a regression test case from a plurality of regression test cases in a software testing lifecycle system;

to calculate a score for the regression test case using an Analytic Hierarchy Process (AHP) assigned weight, wherein the AHP assigned weight is determined based on multiple valued factors including feature coverage, code coverage, test point coverage, and defect ticket;

using the score, to automatically generate, by the test selection system, a visual representation displaying quantified relationships between the regression test case and specific regression testing coverage objectives for the software system;

to select, by the test selection system, the regression test case for use in the regression testing effort based on the visualized relationship that demonstrates optimal resource allocation for achieving the regression testing coverage objectives;

to automatically execute the regression test case on a system to detect software defects; and

visualizing the relationship to determine an optimal number of regression test cases to execute on the system by displaying a graphical representation showing how incremental addition of regression test cases affects achievement of regression testing coverage goals until reaching an inflection point where the marginal benefit of adding more regression test cases begins to diminish significantly.

19 . A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes said at least one processing device:

to select, by a test selection system, a regression test case from a plurality of regression test cases in a software testing lifecycle system;

to calculate a score for the regression test case using an Analytic Hierarchy Process (AHP) assigned weight, wherein the AHP assigned weight is determined based on multiple valued factors including feature coverage, code coverage, test point coverage, and defect ticket;

using the score, to automatically generate, by the test selection system, a visual representation displaying quantified relationships between the regression test case and specific regression testing coverage objectives for the software system;

to select, by the test selection system, the regression test case for use in the regression testing effort based on the visualized relationship that demonstrates optimal resource allocation for achieving the regression testing coverage objectives;

to automatically execute the regression test case on a system to detect software defects; and

visualizing the relationship to determine an optimal number of regression test cases to execute on the system by displaying a graphical representation showing how incremental addition of regression test cases affects achievement of regression testing coverage goals until reaching an inflection point where the marginal benefit of adding more regression test cases begins to diminish significantly.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2023
From: HU, BERNIE; ZHENG, SHUANG; JIANG, ELLIE
To: DELL PRODUCTS L.P.
Reel/Frame 064702/0859 →
Priority Claims (1)
CN 202310937000.3 · Jul 27, 2023 · national
Continuity (1)
Related Publication 20250036556A1 · Jan 30, 2025
References Cited (14)
US 6601017B1 · Kennedy · 2003 [cited by examiner]
US 7613953B2 · Voruganti · 2009 [cited by examiner]
US 9830255B2 · Raghavan · 2017 [cited by examiner]
US 10127143B2 · Hamilton, II · 2018 [cited by examiner]
US 20090265681A1 · Beto · 2009 [cited by examiner]
US 20210349812A1 · Culibrk · 2021 [cited by examiner]
US 20220342663A1 · Barkaee · 2022 [cited by examiner]
US 20240028500A1 · Du · 2024 [cited by examiner]
Kazmi, Rafaqut, et al. “Effective regression test case selection: A systematic literature review.” ACM Computing Surveys (CSUR) 50.2 (2017): pp. 1-32. (Year: 2017). [cited by examiner]
Biswas, Swarnendu, et al. “Regression test selection techniques: A survey.” Informatica 35.3 (2011). pp. 289-322. (Year: 2011). [cited by examiner]
Yoo, Shin, and Mark Harman. “Regression testing minimization, selection and prioritization: a survey.” Software testing, verification and reliability 22.2 (2012): pp. 67-120. (Year: 2012). [cited by examiner]
Jones, James A., Mary Jean Harrold, and John Stasko. “Visualization of test information to assist fault localization.” Proceedings of the 24th international conference on Software engineering. 2002. pp. 467-477. (Year: … [cited by examiner]
Yuan, Ming, and Yi Lin. “Model selection and estimation in regression with grouped variables.” Journal of the Royal Statistical Society Series B: Statistical Methodology 68.1 (2006): pp. 49-67. (Year: 2006). [cited by examiner]
Chittimalli, Pavan Kumar, and Mary Jean Harrold. “Regression test selection on system requirements.” Proceedings of the 1st India software engineering conference. 2008. pp. 87-96. (Year: 2008). [cited by examiner]