User experience scoring and user interface
Systems and methods are described for providing and configuring an overall user experience score. Mobile and desktop user devices can collect and send data to a server about an application installed on the devices and the health of the devices. The server can use the application data and device health information to determine three scores for the application: a mobile score for a mobile version, a desktop score for a desktop version, and a device health score. The server can determine an overall user experience score based on the lowest of the three scores. The server can cause the overall user experience score to be displayed in a first graphical user interface (“GUI”). A second GUI can allow an administrator to reconfigure scoring metrics for the user experience scores by moving elements on a sliding bar that changes thresholds.
1. A method for providing a user experience score for an application, comprising:
receiving first application data from a mobile version of the application executing on a plurality of mobile user devices, the first application data including user experience information for the mobile version of the application over a period of time;
determining a mobile user experience score for each of the plurality of mobile user devices based on the first application data;
receiving second application data from a desktop version of the application executing on a plurality of desktop user devices, the second application data including user experience information for the desktop version of the application over a period of time, wherein the second application data includes an amount of time that the application has been in the foreground of its corresponding desktop user device;
determining a desktop user experience score for a portion of the plurality of desktop user devices based on the second application data, the portion of the plurality of desktop user devices corresponding to desktop user devices that had the application in the foreground above a minimum usage threshold;
receiving device health information regarding the plurality of mobile user devices and the plurality of desktop user devices;
determining, for each mobile user device in the plurality of mobile user devices and each desktop user device in the portion of the plurality of desktop user devices, a device health user experience score based on the device health information; and
determining, for each mobile user device in the plurality of mobile user devices and each desktop user device in the portion of the plurality of desktop user devices, an overall user experience score, the user experience score being the lowest of the mobile user experience score, the desktop user experience score, and the device health score;
assigning each of the overall user experience scores to one of a plurality of categories based on at least one category threshold;
displaying, in a graphical user interface (“GUI”), a percentage of overall user experience scores in each of the plurality of categories, the GUI including, on a slide bar, a movable element for each of the plurality of categories;
receiving, at the GUI, user input moving one movable element on the slide bar; and
dynamically adjusting the displaying of the percentage of overall user experience scores in each of the plurality of categories based on the received input.
2. The method of claim 1 , wherein the first and second application data includes an indication of at least one of crash rate, average latency time, and error information of the application.
3. The method of claim 1 , wherein the first application data includes an amount of time that the application has been in the foreground of its corresponding mobile user device, and wherein the mobile user experience score is determined based on a portion of the first application data, the portion of the first application data corresponding to mobile user devices that had the application in the foreground above the minimum usage threshold.
4. The method of claim 1 , wherein the device health information includes an indication of at least one of battery health, operating system crashes, boot time, shutdown time, and available storage, and wherein the device health user experience score is further based on the indication.
5. The method of claim 1 , further comprising:
determining an overall user experience score for each of a plurality of applications managed by an organization; and
determining an overall user experience score for the organization based on the overall user experience scores of the plurality of applications.
6. The method of claim 1 , wherein the lowest score is determined for each user of the application, and the overall user experience score is based on an average of each user's lowest score.
7. The method of claim 1 , further comprising:
displaying, in the GUI, a percentage of mobile experience scores below a first scoring threshold; and
displaying, in the GUI, a percentage of desktop experience scores below a second scoring threshold.
8. A non-transitory, computer-readable medium containing instructions that, when executed by a hardware-based processor, performs stages for providing a user experience score for an application, the stages comprising:
receiving first application data from a mobile version of the application executing on a plurality of mobile user devices, the first application data including user experience information for the mobile version of the application over a period of time;
determining a mobile user experience score for each of the plurality of mobile user devices based on the first application data;
receiving second application data from a desktop version of the application executing on a plurality of desktop user devices, the second application data including user experience information for the desktop version of the application over a period of time, wherein the second application data includes an amount of time that the application has been in the foreground of its corresponding desktop user device;
determining a desktop user experience score for a portion of the plurality of desktop user devices based on the second application data, the portion of the plurality of desktop user devices corresponding to desktop user devices that had the application in the foreground above a minimum usage threshold;
receiving device health information regarding the plurality of mobile user devices and the plurality of desktop user devices;
determining, for each mobile user device in the plurality of mobile user devices and each desktop user device in the portion of the plurality of desktop user devices, a device health user experience score based on the device health information; and
determining, for each mobile user device in the plurality of mobile user devices and each desktop user device in the portion of the plurality of desktop user devices, an overall user experience score, the user experience score being the lowest of the mobile user experience score, the desktop user experience score, and the device health score;
assigning each of the overall user experience scores to one of a plurality of categories based on at least one category threshold;
displaying, in a graphical user interface (“GUI”), a percentage of overall user experience scores in each of the plurality of categories, the GUI including, on a slide bar, a movable element for each of the plurality of categories;
receiving, at the GUI, user input moving one movable element on the slide bar; and
dynamically adjusting the displaying of the percentage of overall user experience scores in each of the plurality of categories based on the received input.
9. The non-transitory, computer-readable medium of claim 8 , wherein the first and second application data includes an indication of at least one of crash rate, average latency time, and error information of the application.
10. The non-transitory, computer-readable medium of claim 8 , wherein the first application data includes an amount of time that the application has been in the foreground of its corresponding mobile user device, and wherein the mobile user experience score is determined based on a portion of the first application data, the portion of the first application data corresponding to mobile user devices that had the application in the foreground above the minimum usage threshold.
11. The non-transitory, computer-readable medium of claim 8 , wherein the device health information includes an indication of at least one of battery health, operating system crashes, boot time, shutdown time, and available storage, and wherein the device health experience score is further based on the indication.
12. The non-transitory, computer-readable medium of claim 8 , the stages further comprising:
determining an overall user experience score for each of a plurality of applications managed by an organization; and
determining an overall user experience score for the organization based on the overall user experience scores of the plurality of applications.
13. The non-transitory, computer-readable medium of claim 8 , wherein the lowest score is determined for each user of the application, and the overall user experience score is based on an average of each user's lowest score.
14. The non-transitory, computer-readable medium of claim 8 , the stages further comprising:
displaying, in the GUI, a percentage of mobile experience scores below a first scoring threshold; and
displaying, in the GUI, a percentage of desktop experience scores below a second scoring threshold.
15. A system for providing a user experience score for an application, comprising:
a memory storage including a non-transitory, computer-readable medium comprising instructions; and
a computing device including a hardware-based processor that executes the instructions to carry out stages comprising:
receiving first application data from a mobile version of the application executing on a plurality of mobile user devices, the first application data including user experience information for the mobile version of the application over a period of time;
determining a mobile user experience score for each of the plurality of mobile user devices based on the first application data;
receiving second application data from a desktop version of the application executing on a plurality of desktop user devices, the second application data including user experience information for the desktop version of the application over a period of time, wherein the second application data includes an amount of time that the application has been in the foreground of its corresponding desktop user device;
determining a desktop user experience score for a portion of the plurality of desktop user devices based on the second application data, the portion of the plurality of desktop user devices corresponding to desktop user devices that had the application in the foreground above a minimum usage threshold;
receiving device health information regarding the plurality of mobile user devices and the plurality of desktop user devices;
determining, for each mobile user device in the plurality of mobile user devices and each desktop user device in the portion of the plurality of desktop user devices, a device health user experience score based on the device health information; and
determining, for each mobile user device in the plurality of mobile user devices and each desktop user device in the portion of the plurality of desktop user devices, an overall user experience score, the user experience score being the lowest of the mobile user experience score, the desktop user experience score, and the device health score;
assigning each of the overall user experience scores to one of a plurality of categories based on at least one category threshold;
displaying, in a graphical user interface (“GUI”), a percentage of overall user experience scores in each of the plurality of categories, the GUI including, on a slide bar, a movable element for each of the plurality of categories;
receiving, at the GUI, user input moving one movable element on the slide bar; and
dynamically adjusting the displaying of the percentage of overall user experience scores in each of the plurality of categories based on the received input.
16. The system of claim 15 , wherein the first and second application data includes an indication of at least one of crash rate, average latency time, and error information of the application.
17. The system of claim 15 , wherein the first application data includes an amount of time that the application has been in the foreground of its corresponding mobile user device, and wherein the mobile user experience score is determined based on a portion of the first application data, the portion of the first application data corresponding to mobile user devices that had the application in the foreground above the minimum usage threshold.
18. The system of claim 15 , wherein the device health information includes an indication of at least one of battery health, operating system crashes, boot time, shutdown time, and available storage, and wherein the device health experience score is further based on the indication.
19. The system of claim 15 , the stages further comprising:
determining an overall user experience score for each of a plurality of applications managed by an organization; and
determining an overall user experience score for the organization based on the overall user experience scores of the plurality of applications.
20. The system of claim 15 , wherein the lowest score is determined for each user of the application, and the overall user experience score is based on an average of each user's lowest score.