Service quality evaluator having adaptive evaluation criteria
View Patent ↗An improved method is provided for evaluating service quality of a software application residing in a computing environment. The method includes: monitoring first and second metrics indicative of performance of the software application; evaluating the first metric in relation to a first evaluation criterion; evaluating the second metric in relation to a second evaluation criterion different than the first evaluation criterion; and determining the state of service for the software application based in part on the evaluation of the second metric. Over time, the second evaluation criterion is adapted based on the outcome of the evaluation of the first metric.
1. A method for evaluating service quality of a software application residing in a computing environment, comprising:
executing a service quality evaluator on a computer processor;
determining, by the service quality evaluator, a first numeric value indicating a state of service for a system component by monitoring a metric associated with the system component and evaluating the metric associated with the system component in accordance with a first evaluation directive, where performance of the software application depends on the system component;
comparing, by the service quality evaluator, the first numeric value to a threshold;
determining, by the service quality evaluator, a second numeric value indicating a state of service for the software application by monitoring a metric associated with the software application and evaluating the metric associated with the software application in accordance with a second evaluation directive;
multiplying, by the service quality evaluator, the second numeric value by a first weighting factor when the first numeric value exceeds the threshold; and
multiplying, by the service quality evaluator, the second numeric value by a second weighting factor when the first numeric value is less than the threshold.
2. The method of claim 1 further comprises
determining a third numeric value indicating a state of service for the software application in accordance with a third evaluation directive;
multiplying the third numeric value by the second weighting factor when the first numeric value exceeds the threshold; and
multiplying the third numeric value by the first weighting factor when the first numeric value is less than the threshold.
3. The method of claim 2 further comprises aggregating the weighted second numeric value with the weighted third numeric value.
4. A method for evaluating service quality of a software application residing in a computing environment, comprising:
executing a service quality evaluator on a computer processor;
determining, by the service quality evaluator, a first numeric value indicating a state of service for a system component by monitoring a metric associated with the system component and evaluating the metric associated with the system component in accordance with a first evaluation directive, where performance of the software application depends on the system component;
determining, by the service quality evaluator, a second numeric value indicating a state of service for the software application by monitoring a metric associated with the software application and evaluating the metric associated with the software application in accordance with a second evaluation directive;
selecting, by the service quality evaluator, a value for a first weighting factor as a function of the first numeric value;
weighting, by the service quality evaluator, the second numeric value by the first weighting factor;
determining, by the service quality evaluator, a third numeric value indicating a state of service for the software application by monitoring a metric associated with the software application and evaluating the metric associated with the software application in accordance with a third evaluation directive;
selecting, by the service quality evaluator, a value for a second weighting factor as a function of the first numeric value;
weighting, by the service quality evaluator, the third numeric value by the second weighting factor; and
assigning a state of service for the software application by aggregating the weighted second numeric value with the weighted third numeric value.
5. The method of claim 4 further comprises
comparing, by the service quality evaluator, the first numeric value to a threshold; and
assigning a value to the first and second weighting factors based on the comparison.
6. The method of claim 5 further comprises changing the value assigned to at least one of the first and second weighting factors in accordance with changes in the first numeric value.
7. The method of claim 4 wherein determining the second numeric value further includes monitoring multiple metrics indicative of the performance of the software application and evaluating each of the metrics in relation to a different evaluation criterion.
8. The method of claim 4 wherein assigning a state of service for the software application further comprises computing a weighted average.