IP multimedia subsystem (IMS) communication testing
Systems and methods for testing performance of communications over an IP Multimedia Subsystem (IMS) or Evolved Packet Core (EPC) are disclosed. Based on simulated communications that appear initiated from user devices, performance measures can be determined from monitored responses to the simulated communication as well as information obtained from nodes in the IMS or EPC.
1. A computer-implemented method for testing performance of communications over an IP Multimedia Subsystem (IMS) or Evolved Packet Core (EPC) network, the method comprising:
obtaining configuration information for simulating user device-initiated communications over the IMS or EPC network;
prioritizing a plurality of test cases based on communication patterns in the IMS or EPC network, wherein the communication patterns comprise feedback identifying a proportion of different communication types occurring during a previous designated time window and wherein the prioritization corresponds to the proportion of different communication types during the previous designated time window;
selecting a test case from the prioritized plurality of test cases;
executing the test case based, at least in part, on the configuration information, wherein the test case includes one or more messages in accordance with a protocol for communicating over the IMS or EPC network, and wherein executing the test case comprises initiating transmission of the one or more messages from a simulated user device to illicit and monitor a response from an IMS or EPC node;
obtaining at least one response to the one or more messages; and
determining a measure of performance based, at least in part, on the response.
2. The computer-implemented method of claim 1 , wherein the configuration information indicates at least one of a quantity, type, or identification of user devices for simulation.
3. The computer-implemented method of claim 2 , wherein the configuration information further indicates one or more infrastructure equipment associated with the user devices for simulation.
4. The computer-implemented method of claim 1 , wherein the IMS or EPC node corresponds to at least one of a Proxy-CSCF (P-CSCF), Interrogating-CSCF (I-CSCF), Serving-CSCF (S-CSCF), Telephony Application Server (TAS), Presence Server, Rich Messaging Server (RMS), Home Subscriber Server (HSS), or Application Service (AS) Server.
5. The computer-implemented method of claim 1 , wherein the type of communication corresponds to at least one of Voice over LTE Network (VoLTE), Video over LTE (ViLTE), Rich Communication Services (RCS), Voice over Wi-Fi (VoWiFi), or Push to talk over Cellular (PoC) communication.
6. The computer-implemented method of claim 1 , further comprising determining whether to execute an additional test case based on a result from the test case.
7. The computer-implemented method of claim 1 , wherein the one or more messages comprises a call connection request.
8. The computer-implemented method of claim 1 , further comprising generating provisioning information corresponding to the configuration information and including the provisioning information in the one or more messages.
9. The computer-implemented method of claim 1 , further comprising filtering the test case from the prioritized plurality of test cases based on compatibility with simulated user devices or infrastructure equipment.
10. The computer-implemented method of claim 1 , further comprising filtering the test case from the prioritized plurality of test cases based on preferences of a service provider associate with the IMS or EPC network.
11. A non-transitory computer-readable medium storing computer-executable instructions that, when executed by a processor, causes the processor to perform operations comprising:
obtaining configuration information for simulating communications initiated from at least one user device and directed to one or more nodes of an IP Multimedia Subsystem (IMS) or Evolved Packet Core (EPC) network, wherein the IMS or EPC network includes a plurality of nodes;
prioritizing one or more messages from a plurality of messages, wherein the one or more messages match the configuration information for the at least one user device for transmission to the one or more nodes of the IMS or EPC network, wherein the plurality of messages are based on real-time or historical communication patterns in the IMS or EPC network, wherein the real-time or historical communication patterns for a communication parameter comprises a pattern identifying a proportion of different communication types occurring during a previous designated time window, and wherein the prioritization corresponds to the proportion of different communication types during the previous designated time window;
transmitting the one or more messages to the one or more nodes to cause a simulated communication in order to illicit and monitor a response from the one or more nodes; and
determining a measure of performance based, at least in part, on the response to the one or more messages.
12. The non-transitory computer-readable medium of claim 11 , wherein the operations further comprise probing at least one node of the IMS or EPC network.
13. The non-transitory computer-readable medium of claim 12 , wherein the at least one node is on a network path of the simulated communication.
14. The non-transitory computer-readable medium of claim 12 , wherein probing the at least one node comprises obtaining at least one message or data packet received at the at least one node.
15. The non-transitory computer-readable medium of claim 14 , wherein the at least one message or data packet relates to the at least one user device.
16. The non-transitory computer-readable medium of claim 11 , wherein transmitting the one or more messages comprises transmitting the one or more messages in accordance with a protocol for communication over the IMS or EPC network.
17. The non-transitory computer-readable medium of claim 16 , wherein the protocol for communication over the IMS or EPC network corresponds to Session Initiation Protocol (SIP).
18. A system comprising:
a plurality of computing devices in communication with one another via an IP Multimedia Subsystem (IMS) or Evolved Packet Core (EPC) network; and
a target computing device communicatively connected to the IMS or EPC network, the target computing device configured to:
determine a first test case for testing performance of communications initiated from at least one simulated user device over the IMS or EPC network, wherein the first test case is selected from a plurality of test cases prioritized based on real-time performance feedback for a communication parameter in the IMS or EPC network, wherein the real-time performance feedback for a communication parameter comprises feedback identifying a threshold fluctuation for one type of communication during a previous designated time window and wherein the prioritization corresponds to the one type of communication meeting the threshold fluctuation during the previous designated time window;
execute the first test case including one or more messages to be communicated to the IMS or EPC network, wherein executing the test case comprises automatically simulating the one or more messages as initiated from the at least one simulated user device in order to illicit and monitor a response from an IMS or EPC node; and
determine a measure of performance based, at least in part, on the response to the one or more messages.
19. The system of claim 18 , wherein the measure of performance corresponds to at least one of an error rate, connection robustness, response time, audio quality, or video quality.
20. The system of claim 18 , wherein the target computing device is further configured to obtain configuration information for simulating the at least one user device.
21. The system of claim 20 , wherein the target computing device is further configured to generate the one or more messages based, at least in part, on the configuration information.
22. The system of claim 18 , wherein the target computing device is further configured to parse the response to derive one or more parameters included in the response.
23. The system of claim 22 , wherein the measure of performance is further based on the one or more parameters.
24. The system of claim 18 , wherein the target computing device is further configured to determine a second test case based, at least in part, on the determined measure of performance.
25. The computer-implemented method of claim 18 , wherein the threshold fluctuation corresponds to a drop of one type of communication traffic.