Detecting computer system simulation errors
Validating simulation models. A computing environment includes a performance scenario of a system. The performance scenario includes device models defining device behavior and/or capacity. The performance scenario further includes interconnections between one or more device models. A static model analysis of the system is performed. The static model analysis analyzes at least one of configuration of device models defined by the performance scenario or interconnection of device models defined by the performance scenario. A static capacity analysis to analyze device model limitations as they relate to statically defined performance scenario characteristics is performed. An application constraints validation can be performed. This includes comparing the performance scenario to software deployment best practices and rules related to models similar to the performance scenario. A simulation runtime validation may also be performed to evaluate dynamic device usage and latencies to simulate the system.
1 . In a computing environment, including a performance scenario of a system, the performance scenario including device models defining device behavior and/or capacity, the performance scenario further including interconnections between one or more device models, computer readable media including computer executable instructions configured to:
perform a static model analysis of the system, wherein the static model analysis analyzes at least one of configuration of device models defined by the performance scenario or interconnection of device models defined by the performance scenario;
perform a static capacity analysis to analyze device model limitations as they relate to statically defined performance scenario characteristics; and
perform an application constraints validation comprising comparing the performance scenario to software deployment best practices and rules related to models similar to the performance scenario.
2 . The computer readable media of claim 1 , wherein the computer executable instructions are further configured to perform a simulation based runtime evaluation of the performance scenario by simulating one or more loads on one or more device models as dictated by the application component n the performance scenario.
3 . The computer readable media of claim 2 , wherein performing a simulation runtime evaluation of the performance scenario comprises:
detecting that a device model has insufficient capacity; and
modifying the device model with insufficient capacity to have infinite capacity such that other device models can continue to be evaluated in the context of the performance scenario.
4 . The computer readable media of claim 1 , wherein the computer executable instructions are further configured to detect errors that are related to misconfigured communication routs and/or connections in the performance scenario and disable generating transactions for a class of transactions affected by the routing errors.
5 . The computer readable media of claim 1 , wherein performing a static model analysis comprises evaluating expected inputs to one or more device models.
6 . The computer readable media of claim 1 , wherein performing a static model analysis comprises evaluating the presence or absence of expected device models based on included device models.
7 . The computer readable media of claim 1 , wherein performing a static model analysis comprises evaluating one or more higher level conditions and not evaluating one or more lower level conditions dependent on the higher level conditions when an error results from evaluating the one or more higher level conditions.
8 . The computer readable media of claim 1 , wherein performing a static model analysis comprises returning an error for one or more higher level conditions and not returning an error for one or more lower level conditions dependent on the higher level conditions when an error results from evaluating the one or more higher level conditions.
9 . The computer readable media of claim 1 , wherein performing an application constraints validation comprises evaluating if the existence of a device model in the performance scenario does not conflict with the existence of another device model in the performance scenario.
10 . The computer readable media of claim 1 , wherein performing a static capacity analysis comprises evaluating if capacity of a device model in the performance scenario is exceeded.
11 . The computer readable media of claim 1 , wherein performing an application constraints validation comprises referencing rule files.
12 . The computer readable media of claim 1 , further comprising a validation results data structure including results generated from the static model structure analysis of the system, the static capacity analysis, and the validation of other constraints referenced by the performance scenario.
13 . The computer readable media of claim 12 , wherein the validation results data structure comprises XML.
14 . In a computing system configured to perform modeling functions for modeling complex systems to detect system capacities and capabilities, a computer readable medium comprising data structures and computer executable instructions for facilitating modeling of complex systems, the computer readable medium comprising:
a first data structure comprising one or more device models defining device behavior and/or capacity organized into a performance scenario connecting device models together to model a system; and
computer executable instructions for performing an application constraints validation including comparing the performance scenario to the application deployment and configuration best practices and providing indications when the best practices dictate against the configuration of the performance scenario.
15 . The computer readable medium of claim 14 , further comprising a second data structure comprising one or more rule files including the software deployment best practices and rules.
16 . The computer readable medium of claim 15 , wherein the rule files are extensible such that additional software deployment best practices and rules can be added.
17 . In a computing environment, including a performance scenario of a system, the performance scenario including device models defining device behavior and/or capacity, the performance scenario further including interconnections between one or more device models, a method of evaluating the system, the method comprising:
detecting an error associated with a device model during a simulation runtime validation of the device; and
modifying the device model during the simulation runtime validation to obviate the error such that other device models can continue to be evaluated in the context of the performance scenario.
18 . The method of claim 17 , wherein detecting an error comprises detecting that a device model has insufficient capacity and modifying the device model comprises configuring the device model to have infinite capacity.
19 . The method of claim 18 , further comprising canceling transactions in a backlogged queue so as to prevent the transactions from overwhelming downstream device models when the device model is configured to have infinite capacity.
20 . The method of claim 17 , wherein detecting an error comprises detecting that a performance scenario has one or more misconfigured communication routes or connection errors and wherein modifying the device model to obviate the error comprises removing a transaction class affected by the routing error from a queue of transactions to be processed by the device model and disabling any further generation of transaction instances from this transaction class until the end of simulation.