Automated method and system for evaluating mobile applications to facilitate network and/or application remediation
Execution of at least one script and at least one application on at least one wireless test device is facilitated. The at least one script includes device-executable code configured to simulate user interaction with the at least one application on the at least one wireless test device. The at least one script is executed to simulate the user interaction, while the at least one wireless test device is connected to a wireless network. Results of the execution of the at least one script and the at least one application are logged using a test platform. The results include application layer metrics and at least one of data link layer metrics and network layer metrics. The application layer metrics and the at least one of data link layer metrics and network layer metrics are correlated by timestamp.
1 . A method comprising:
facilitating execution of at least one script and at least one application on at least one wireless test device, the at least one script including device-executable code configured to simulate user interaction with the at least one application on the at least one wireless test device, the at least one script being executed to simulate the user interaction, while the at least one wireless test device is connected to a wireless network;
logging results of the execution of the at least one script and the at least one application using a test platform, the results including application layer metrics and at least one of data link layer metrics and network layer metrics, wherein the application layer metrics and the at least one of data link layer metrics and network layer metrics are correlated by timestamp; and
identifying a system condition to be remediated, the identifying comprising correlating an application layer activity defined by the application layer metrics with a network activity defined by the at least one of the data link layer metrics and the network layer metrics.
2 . The method of claim 1 , further comprising setting network conditions of the wireless network on the at least one wireless test device prior to executing the at least one script and the at least one application, wherein, in the logging of the results, the results further include the network conditions.
3 . The method of claim 2 , wherein:
the execution includes executing the at least one script and the at least one application on a plurality of wireless test devices; and
the logging step includes logging the results of the execution of the at least one script and the at least one application on the plurality of wireless test devices.
4 . The method of claim 3 , wherein the execution includes simultaneously executing the at least one script and the at least one application on the plurality of wireless test devices.
5 . The method of claim 4 , further comprising, responsive to the results of the execution, remediating at least one issue with the wireless network.
6 . A method comprising:
facilitating execution of at least one script and at least one application on at least one wireless test device, the at least one script including device-executable code configured to simulate user interaction with the at least one application on the at least one wireless test device, the at least one script being executed to simulate the user interaction, while the at least one wireless test device is connected to a wireless network; and
logging results of the execution of the at least one script and the at least one application using a test platform, the results including application layer metrics and at least one of data link layer metrics and network layer metrics, wherein the application layer metrics and the at least one of data link layer metrics and network layer metrics are correlated by timestamp, wherein the remediating comprises at least one of: increasing capacity of the wireless network, adjusting at least one radio access network (RAN) site of the wireless network, modifying parameters of the wireless network to change when a cell-to-cell handover occurs, modifying parameters of the wireless network to change when roaming to a partner network should be triggered, and/or changing Dual SIM Dual Standby (DSDS) settings in at least one of the devices to trigger a more efficient and/or seamless network transition.
7 . The method of claim 5 , further comprising operating the wireless network with the at least one issue remediated, thereby improving the performance of the at least one application.
8 . The method of claim 4 , further comprising, responsive to the results of the execution, facilitating remediation of at least one issue with the at least one application.
9 . The method of claim 8 , further comprising operating the wireless network and causing execution of the application on at least one wireless execution device with the at least one issue remediated, thereby improving the performance of the at least one application.
10 . The method of claim 4 , wherein the loading, executing, and logging steps are carried out without human input to the plurality of wireless test devices.
11 . The method of claim 1 , wherein, in the logging step, the results include the application layer metrics, the data link layer metrics, and the network layer metrics.
12 . The method of claim 1 , further comprising injecting commands of the at least one script from a remote device to the at least one wireless test device to facilitate the executing of the at least one script and the at least one application.
13 . The method of claim 1 , wherein the executing and logging steps are initiated in response to comparison of at least one key performance indicator to at least one predetermined value.
14 . The method of claim 1 , further comprising:
monitoring, with at least one remote device, the execution of the at least one script and the at least one application on the at least one wireless test device; and
responsive to the monitoring indicating an issue, the at least one remote device instructing the at least one wireless test device to re-initiate the execution of the at least one script and the at least one application on the at least one wireless test device.
15 . A non-transitory computer readable medium comprising computer executable instructions which when executed by a computer cause the computer to perform a method comprising:
facilitating execution of at least one script and at least one application on at least one wireless test device, the at least one script including device-executable code configured to simulate user interaction with the at least one application on the at least one wireless test device, the at least one script being executed to simulate the user interaction, while the at least one wireless test device is connected to a wireless network;
logging results of the execution of the at least one script and the at least one application using a test platform, the results including application layer metrics and at least one of data link layer metrics and network layer metrics, wherein the application layer metrics and the at least one of data link layer metrics and network layer metrics are correlated by timestamp; and
identifying a system condition to be remediated, the identifying comprising correlating an application layer activity defined by the application layer metrics with a network activity defined by the at least one of the data link layer metrics and the network layer metrics.
16 . A system comprising:
a memory; and
at least one processor, coupled to the memory, and operative to:
facilitate execution of at least one script and at least one application on at least one wireless test device, the at least one script including device-executable code configured to simulate user interaction with the at least one application on the at least one wireless test device, the at least one script being executed to simulate the user interaction, while the at least one wireless test device is connected to a wireless network;
log results of the execution of the at least one script and the at least one application using a test platform, the results including application layer metrics and at least one of data link layer metrics and network layer metrics, wherein the application layer metrics and the at least one of data link layer metrics and network layer metrics are correlated by timestamp; and
identify a system condition to be remediated, the identifying comprising correlating an application layer activity defined by the application layer metrics with a network activity defined by the at least one of the data link layer metrics and the network layer metrics.
17 . A system for testing application performance in wireless networks, comprising:
at least one wireless test device configured to execute at least one script and at least one application while the at least one wireless test device is connected to the wireless network, the at least one script including device-executable code configured to simulate user interaction with the at least one application on the at least one wireless test device, the at least one script being executed to simulate the user interaction; and
a test platform configured to log results of the execution of the at least one script and the at least one application, the results including application layer metrics and at least one of data link layer metrics and network layer metrics, and configured to identify a system condition to be remediated, the identifying comprising correlating an application layer activity defined by the application layer metrics with a network activity defined by the at least one of the data link layer metrics and the network layer metrics, wherein the application layer metrics and the at least one of data link layer metrics and network layer metrics are correlated by timestamp.
18 . The system of claim 17 , wherein the at least one wireless test device is further configured to set network conditions of the wireless network prior to executing the at least one script and the at least one application, and wherein the results further include the network conditions.
19 . The system of claim 18 , wherein the at least one wireless test device comprises a plurality of wireless test devices, and the test platform is configured to log the results of the execution of the at least one script and the at least one application on the plurality of wireless test devices.
20 . The system of claim 19 , wherein the plurality of wireless test devices are configured to simultaneously execute the at least one script and the at least one application.
21 . The system of claim 17 , wherein the results include the application layer metrics, the data link layer metrics, and the network layer metrics.
22 . The system of claim 17 , further comprising a remote device coupled to the at least one wireless test device and configured to inject commands of the at least one script to the at least one wireless test device to facilitate the execution of the at least one script and the at least one application.
23 . The system of claim 17 , wherein the at least one script includes logic configured to compare at least one key performance indicator to at least one predetermined value and to cause execution of the at least one script in response to the comparison and logging are initiated in response to comparison of at least one key performance indicator to at least one predetermined value.
24 . The system of claim 17 , further comprising at least one remote device configured to:
monitor the execution of the at least one script and the at least one application on the at least one wireless test device; and
responsive to the monitoring indicating an issue, instruct the at least one wireless test device to re-initiate the execution of the at least one script and the at least one application on the at least one wireless test device.