Monitoring of IoT simulated user experience
The present invention relates to a computer implemented method, preferably a computer implemented method, and a system, which have been designed to bridge a gap in the End User experience monitoring that has been created by the adoption of cloud based services by Enterprise customer by replicating exactly the actions performed by the user on a cloud based application in order to determine the true end user experience and alert in case of unexpected latency and also by analyzing at the same time the impacts of the Internet network and the local infrastructure of the Enterprise user on the end user experience of the cloud based application that is monitored.
1. A method for monitoring a software as a service (SaaS) application located on a cloud-based server and operated from an on-premises location of a user over the internet, wherein the method comprises:
replicating at least one action performed by said user of the SaaS application using a diagnostic tool installed in memory on a computer at the on-premises location of the user by performing tests to provide simulation results, said tests comprising end user simulation tests, local IT tests, and network and internet tests, said tests being operated from the on-premises location of the user and executed on the cloud-based server in order to test the SaaS application from where the user is located; and
collecting and storing the simulation results.
2. The method according to claim 1 , wherein the diagnostic tool is configured to run a plurality of tests comprising:
one or more end user simulation tests comprising: create an email, send email, create task, calendar availability, create meeting, full email routing trip, upload a document to an online library, and download a document from the online library;
one or more local IT tests comprising: synchronization between premises and cloud, server performance, network availability performance, certificate authentication, server activity and usage, and authentication simulation; and
one or more network and internet tests comprising: port availability, round trip ping, DNS availability, packet loss, jitter calculation, and internet bandwidth.
3. The method according to claim 2 , further comprising determining a health and performance of the SaaS application that is experienced by the user based on the simulation results.
4. The method according to claim 3 , wherein determining the health and performance of the SaaS application comprises correlating the simulation results, the local IT tests, and the network and internet tests to pinpoint whether performance issues come from the cloud-based server, the internet or the on-premises location of the user.
5. The method according to claim 1 , further comprising encrypting the simulation results before transferring the simulation results using a communication service to a hub connected to the Internet.
6. The method according to claim 5 , wherein communication between the communication service and the hub is configured to be only in one direction.
7. The method according to claim 1 , further comprising performing at least one of the tests for the SaaS application located on a server at the on-premises location to determine when there is a difference of end user experience between on-premises and cloud services.
8. The method according to claim 1 , wherein the diagnostic tool is configured to run the simulation tests to reproduce the at least one action by said user while using Microsoft Exchange including: open mail using Microsoft Exchange web services (EWS); create task; create email; create meeting; create folder; search item; send mail; download attachment, upload attachment; retrieve free/busy status; Autodiscover; authentication using Exchange Web services.
9. The method according to claim 1 further comprising generating an alert when the user is experiencing a latency with the SaaS application.
10. The method according to claim 1 , further comprising:
determining when performance issues are occurring; and
identifying each action which are affected by the performance issues.
11. A system for monitoring a software as a service (SaaS) application located on a cloud-based server and operated from an on-premises location of a user over the internet, wherein the system comprises:
a memory for storing instructions, which when executed by a computer cause the computer to:
install a diagnostic tool in the memory using an orchestrator at the on-premises location;
activate the diagnostic tool to replicate at least one action performed by said user of the SaaS application using the diagnostic tool installed on the memory at the on-premises location of the user by performing a plurality of tests to provide simulation results, said plurality of tests comprising end user simulation tests, local IT tests, and network and internet tests, said plurality of tests being operated from the on-premises location of the user and executed on the cloud-based server in order to test the SaaS application from where the user is located;
store the simulation results in the memory; and
transfer the simulation results using a communication service through a communication protocol from the memory to a hub connected to the Internet.
12. The system according to claim 11 , wherein the memory includes additional instructions, which when executed by the computer configure the computer to:
determine when performance issues are occurring; and
identify each action which are affected by the performance issues.
13. The system according to claim 11 , wherein the communication protocol is an AMPQ or HTTPS protocol.
14. The system according to claim 11 , wherein the memory includes additional instructions, which when executed by the computer configured the computer to activate several tests simultaneously.
15. The system according to claim 11 , wherein the simulation results are encrypted with an encryption key before the transfer, and wherein the communication service is isolated so as to have no access to the encryption key.
16. The system according to claim 11 , wherein the orchestrator and the communication service are in a Master service, and wherein the diagnostic tool is in a Worker Service.
17. The system according to claim 16 , wherein the Worker Service makes the simulation results available to the Master service to communicate with a Rabbit MQ Bus.
18. The system according to claim 11 , further comprising a platform comprising a plurality of resilient micro-services designed to automatically execute the at least one action performed by the user from multiple locations.
19. The system according to claim 11 , wherein the diagnostic tool is configured to run the plurality of tests comprising:
one or more end user simulation tests comprising: create an email, send email, create task, calendar availability, create meeting, full email routing trip, upload a document to an online library, and download a document from the online library;
one or more local IT tests comprising: synchronization between premises and cloud, server performance, network availability performance, certificate authentication, server activity and usage, and authentication simulation; and
one or more network and internet tests comprising: port availability, round trip ping, DNS availability, packet loss, jitter calculation, and internet bandwidth.
20. The system according to claim 19 , further comprising determining a health and performance of the SaaS application that is experienced by the user based on the simulation results; wherein determining the health and performance of the SaaS application comprises correlating the simulation results, the local IT tests, and the network and internet tests to pinpoint whether performance issues come from the cloud-based server, the internet or the on-premises location of the user.