IP Library › Granted Patent US 8,171,459
Granted Patent B2
US 8,171,459 · App. 12/272,623 · Granted May 1, 2012

System and method for software performance testing and determining a frustration index

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,171,459
App. No.
12/272,623
Granted
May 1, 2012
Kind
B2
Abstract

A system and method for determining a frustration index for a software suite based upon the measurements of the software's performance. The frustration index communicates the overall state of a customer's performance-related user experience as defined by a set of testing criteria and specified testing scenarios. Actual test measurements of one or more pre-specified criteria in one or more pre-specified testing scenarios or operating environments are first received, calculated or otherwise determined. Priority weights are provided for each of the pre-specified criteria in each of the pre-specified testing scenarios. Actual test measurements are then compared to target quantities, to provide a delta percentage between the actual measurements and the target quantities. The frustration index (or indices) is calculated as the result of a ratio of the delta percentage between the actual and the target to the priority weight of the criterion.

Claims (35)

1. A system for calculating one or more frustration indices F for a user of a computer software application, comprising:

a processor;

a memory;

a logic or software for receiving a set of target measurements B, each corresponding to one or more specified test criteria in one or more specified test scenarios and reflecting the user's expectation as to the performance of the computer software application;

a logic or software for receiving a set of actual measurements A, each corresponding to measurements of the one or more specified test criteria in the one or more specified test scenarios;

a logic or software for determining a priority weight D for each of the one or more specified test criteria;

a logic or software for calculating one or more actual/target deltas or delta percentages C between each of the set of actual measurements and the set of target measurements by determining a difference between a target measurement and an actual measurement and dividing the difference by the target measurement; and

a logic or software for calculating the one or more frustration indices F as ratios of the one or more actual/target deltas or delta percentages C to the corresponding priority weights D, wherein the one or more frustration indices F represent the user's satisfaction experience with the performance of the computer software application as defined by the one or more specified test criteria in the one or more specified test scenarios.

2. The system of claim 1 wherein the step of determining the priority weight D for each of the one or more specified test criteria further comprises the step of receiving information about the importance of each of the one or more specified test criteria to the user.

3. The system of claim 1 wherein the step of determining the priority weight D for each of the one or more specified test criteria further comprises the step of determining the frequency of testing of each of the one or more specified test criteria.

4. The system of claim 1 further comprising, following the step of calculating the one or more frustration indices F, the steps of:

calculating an overall frustration index for a specified test scenario by summing the one or more frustration indices F for the specified test scenario; and

calculating an overall frustration index for all specified test scenarios by summing the one or more frustration indices F for all specified test scenarios.

5. A method, executed by a computer, for calculating one or more frustration indices F for a user of a computer software application, comprising the steps of:

receiving a set of target measurements B, each corresponding to one or more specified test criteria in one or more specified test scenarios and reflecting the user's expectation as to the performance of the computer software application;

receiving a set of actual measurements A, each corresponding to measurements of the one or more specified test criteria in the one or more specified test scenarios;

determining a priority weight D for each of the one or more specified test criteria;

calculating one or more actual/target deltas or delta percentages C between each of the set of actual measurements and the set of target measurements by determining a difference between a target measurement and an actual measurement and dividing the difference by the target measurement; and

calculating the one or more frustration indices F as ratios of the one or more actual/target deltas or delta percentages C to the corresponding priority weights D, wherein the one or more frustration indices F represent the user's satisfaction experience with the performance of the computer software application as defined by the one or more specified test criteria in the one or more specified test scenarios.

6. The method of claim 5 wherein the step of determining the priority weight D for each of the one or more specified test criteria further comprises the step of receiving information about the importance of each of the one or more specified test criteria to the user.

7. The method of claim 5 wherein the step of determining the priority weight D for each of the one or more specified test criteria further comprises the step of determining the frequency of testing of each of the one or more specified test criteria.

8. The method of claim 5 further comprising, following the step of calculating the one or more frustration indices F, the steps of:

calculating an overall frustration index for a specified test scenario by summing the one or more frustration indices F for the specified test scenario; and

calculating an overall frustration index for all specified test scenarios by summing the one or more frustration indices F for all specified test scenarios.

9. A computer readable storage medium, including instructions stored thereon which when read and executed by a computer cause the computer to perform a method for calculating one or more frustration indices F for a user of a computer software application, comprising the steps of:

receiving a set of target measurements B, each corresponding to one or more specified test criteria in one or more specified test scenarios and reflecting the user's expectation as to the performance of the computer software application;

receiving a set of actual measurements A, each corresponding to measurements of the one or more specified test criteria in the one or more specified test scenarios;

determining a priority weight D for each of the one or more specified test criteria;

calculating one or more actual/target deltas or delta percentages C between each of the set of actual measurements and the set of target measurements by determining a difference between a target measurement and an actual measurement and dividing the difference by the target measurement; and

calculating the one or more frustration indices F as ratios of the one or more actual/target deltas or delta percentages C to the corresponding priority weights D, wherein the one or more frustration indices F represent the user's satisfaction experience with the performance of the computer software application as defined by the one or more specified test criteria in the one or more specified test scenarios.

10. The computer readable storage medium of claim 9 wherein the step of determining the priority weight D for each of the one or more specified test criteria further comprises the step of receiving information about the importance of that each of the one or more specified test criteria to the user.

11. The computer readable storage medium of claim 9 wherein the step of determining the priority weight D for each of the one or more specified test criteria further comprises the step of determining the frequency of testing of each of the one or more specified test criteria.

12. The computer readable storage medium of claim 9 further comprising, following the step of calculating the one or more frustration indices F, the steps of:

calculating an overall frustration index for a specified test scenario by summing the one or more frustration indices F for the specified test scenario; and

calculating an overall frustration index for all specified test scenarios by summing the one or more frustration indices F for all specified test scenarios.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2010
From: BEA SYSTEMS, INC.
To: ORACLE INTERNATIONAL CORPORATION
Reel/Frame 025192/0244 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2008
From: OJA, SCOTT; TOCCO, STEVE; ROTH, BILL
To: BEA SYSTEMS, INC.
Reel/Frame 021848/0309 →