System and method for evaluating application errors in e-commerce applications
Systems and methods for tracking and ranking errors in computer systems may be used in e-commerce applications in order to identify errors that occur in e-commerce user sessions along with an estimate of potential lost revenues resulting from the error. The errors and associated lost revenues may allow prioritizing of which errors to address.
1. A method for evaluating e-commerce application errors comprising:
collecting error information of e-commerce application errors experienced by users of a plurality of different e-commerce applications in associated e-commerce sessions, wherein each of the errors is associated with an issue identifier and a unique error including a portion indicative of an e-commerce application of the plurality of e-commerce applications that generated the respective error, wherein the issue identifier can identify common issues across the different e-commerce applications;
for each of the errors, determining error funnel statistics for users experiencing the respective error, the error funnel statistics providing an indication of a number of users progressing to each next stage in a multi-stage commerce progress funnel of the e-commerce application associated with the respective error;
generating a user interface providing, for a respective e-commerce application of the plurality of different e-commerce application, indications of one or more of the errors associated with the respective e-commerce application and a respective estimated revenue loss resulting from each of the respective errors, the estimated revenue lost determined based on an average purchase amount for the e-commerce application and a difference between error funnel statistics for the error and average funnel progression statistics of users of the e-commerce application, wherein the indications of one or more of the errors provided in the generated user interface are presented in a ranked order based on at least an estimated time to fix the respective error; and
transmitting the generated user interface to a remote computer.
2. The method of claim 1 , wherein collecting error information comprises:
receiving and storing session information from a plurality of users, the session information of each of the plurality of users associated with the respective user's interaction with the e-commerce application and comprising error indications of one or more application errors resulting from the user's interaction with the e-commerce application, each of the one or more application errors identified by a unique error identifier.
3. The method of claim 2 , wherein the session information further comprises:
interaction indications of one or more application interactions of the e-commerce application with at least one server.
4. The method of claim 3 , further comprising:
processing session information to determine the average funnel progression statistics and the error funnel progression statistics.
5. The method of claim 1 , wherein the indications of one or more of the errors presented in the generated user interface are presented in a ranked order further based on the estimated revenue lost resulting from the respective error.
6. The method of claim 1 , wherein the error information is collected from a user's device from a data collection script embedded in the e-commerce application.
7. The method of claim 6 , further comprising:
receiving a request for the data collection script from a computing device; and
transmitting the requested data collection script to the computing device.
8. The method of claim 1 , wherein the error information is further collected from one or more servers associated with the e-commerce application.
9. The method of claim 1 , wherein session information includes information for recreating a user's view of the e-commerce session.
10. A non-volatile computer readable memory storing instructions, which when executed by a processor of a system configure the system to perform a method comprising:
collecting error information of e-commerce application errors experienced by users of a plurality of different e-commerce applications in associated e-commerce sessions, wherein each of the errors is associated with an issue identifier and a unique error including a portion indicative of an e-commerce application of the plurality of e-commerce applications that generated the respective error, wherein the issue identifier can identify common issues across the different e-commerce applications;
for each of the errors, determining error funnel statistics for users experiencing the respective error, the error funnel statistics providing an indication of a number of users progressing to each next stage in a multi-stage commerce progress funnel of the e-commerce application associated with the respective error;
generating a user interface providing, for a respective e-commerce application of the plurality of different e-commerce application, indications of one or more of the errors associated with the respective e-commerce application and a respective estimated revenue loss resulting from each of the respective errors, the estimated revenue lost determined based on an average purchase amount for the e-commerce application and a difference between error funnel statistics for the error and average funnel progression statistics of users of the e-commerce application, wherein the indications of one or more of the errors provided in the generated user interface are presented in a ranked order based on at least an estimated time to fix the respective error; and
transmitting the generated user interface to a remote computer.
11. The non-volatile computer readable memory of claim 10 , wherein collecting error information comprises:
receiving and storing session information from a plurality of users, the session information of each of the plurality of users associated with the respective user's interaction with the e-commerce application and comprising error indications of one or more application errors resulting from the user's interaction with the e-commerce application, each of the one or more application errors identified by a unique error identifier.
12. The non-volatile computer readable memory of claim 11 , wherein the session information further comprises:
interaction indications of one or more application interactions of the e-commerce application with at least one server.
13. The non-volatile computer readable memory of claim 12 , wherein the method performed by executing the stored instructions further comprises:
processing session information to determine the average funnel progression statistics and the error funnel progression statistics.
14. The non-volatile computer readable memory of claim 10 , wherein the indications of one or more of the errors presented in the generated user interface are presented in a ranked order further based on the estimated revenue lost resulting from the respective error.
15. The non-volatile computer readable memory of claim 10 , wherein the error information is collected from a user's device from a data collection script embedded in the e-commerce application.
16. The non-volatile computer readable memory of claim 15 , wherein the method performed by executing the stored instructions further comprises:
receiving a request for the data collection script from a computing device; and
transmitting the requested data collection script to the computing device.
17. The non-volatile computer readable memory of claim 10 , wherein the error information is further collected from one or more servers associated with the e-commerce application.
18. The non-volatile computer readable memory of claim 10 , wherein session information includes information for recreating a user's view of the session.
19. A system for evaluating application errors, the system comprising:
a processor for executing instructions; and
a memory storing instructions, which when executed by the processor configures the system to perform a method comprising:
collecting error information of e-commerce application errors experienced by users of a plurality of different e-commerce applications in associated e-commerce sessions, wherein each of the errors is associated with an issue identifier and a unique error including a portion indicative of an e-commerce application of the plurality of e-commerce applications that generated the respective error, wherein the issue identifier can identify common issues across the different e-commerce applications;
for each of the errors, determining error funnel statistics for users experiencing the respective error, the error funnel statistics providing an indication of a number of users progressing to each next stage in a multi-stage commerce progress funnel of the e-commerce application associated with the respective error;
generating a user interface providing, for a respective e-commerce application of the plurality of different e-commerce application, indications of one or more of the errors associated with the respective e-commerce application and a respective estimated revenue loss resulting from each of the respective errors, the estimated revenue lost determined based on an average purchase amount for the e-commerce application and a difference between error funnel statistics for the error and average funnel progression statistics of users of the e-commerce application, wherein the indications of one or more of the errors provided in the generated user interface are presented in a ranked order based on at least an estimated time to fix the respective error; and
transmitting the generated user interface to a remote computer.