IP Library › Granted Patent US 9,514,021
Granted Patent B2
US 9,514,021 · App. 15/143,578 · Granted Dec 6, 2016

Mobile application performance measuring system

Inventors: Ioannis Vlachogiannis (San Francisco, CA); Vasileios Karampinas (San Francisco, CA)
Assignee: Splunk Inc.
G06F11/3409G06F11/302G06F11/3013G06F11/3082G06F11/3495
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,514,021
App. No.
15/143,578
Filed
Apr 30, 2016
Granted
Dec 6, 2016
Kind
B2
Art Unit
2113
USPC
714/47.1
Abstract

A quality score for a computer application release is determined using a first number of unique users who have launched the computer application release on user devices and a second number of unique users who have encountered at least once an abnormal termination with the computer application release on user devices. Additionally or optionally, an application quality score can be computed for a computer application based on quality scores of computer application releases that represent different versions of the computer application. Additionally or optionally, a weighted application quality score can be computed for a computer application by further taking into consideration the average application quality score and popularity of a plurality of computer applications.

Claims (48)

1. A method, comprising:

monitoring operations of a computer application program executing on a mobile device, among a plurality of mobile devices, using a monitoring code included in the computer application program that sends application performance events relating to the computer application program to a collection device, the application performance events include application performance data relating to the computer application program;

receiving, by a server, application performance events from one or more collection devices;

calculating, by the server, a user experience score using application performance data extracted from received application performance events associated with a particular computer application program; and

causing display, by the server, of the user experience score or a representation of the user experience score.

2. The method as recited in claim 1 , further comprising:

retrieving a set of user experience scores for the computer application program over a series of version numbers from a datastore; and

wherein causing display of the user experience score further comprises:

causing display of each user experience score in the set of user experience scores along with an associated version number.

3. The method as recited in claim 1 , further comprising:

calculating a count of unique users that started the computer application program from unique user identifiers extracted from the application performance events associated with the particular computer application program identifier; and

wherein causing display of the user experience score further comprises:

causing display of the count.

4. The method as recited in claim 1 , wherein causing display of the user experience score further comprises:

causing display of a stability calculation for the computer application program and an associated version number.

5. The method as recited in claim 1 , wherein the user experience score is calculated for a specific time period.

6. The method as recited in claim 1 , wherein the calculating a user experience score calculates the user experience score for a particular operating system running the computer application program.

7. The method as recited in claim 1 , wherein the calculating a user experience score calculates the user experience score for a particular geographical area for mobile devices running the computer application program.

8. The method as recited in claim 1 , wherein the calculating a user experience score calculates the user experience score for a particular mobile device type running the computer application program.

9. The method as recited in claim 1 , wherein the user experience score indicates an average user experience for the computer application program across a plurality of version numbers.

10. The method as recited in claim 1 , wherein the calculating a user experience score includes a popularity rating of the computer application program in relation to other computer application programs.

11. The method as recited in claim 1 , wherein at least one application performance event among the application performance events includes information about system conditions under which the application performance event occurred.

12. A non-transitory computer-readable medium storing one or more sequences of instructions, wherein execution of the one or more sequences of instructions by one or more processors causes the one or more processors to perform:

monitoring operations of a computer application program executing on a mobile device, among a plurality of mobile devices, using a monitoring code included in the computer application program that sends application performance events relating to the computer application program to a collection device, the application performance events include application performance data relating to the computer application program;

receiving, by a server, application performance events from one or more collection devices;

calculating, by the server, a user experience score using application performance data extracted from received application performance events associated with a particular computer application program; and

causing display, by the server, of the user experience score or a representation of the user experience score.

13. The non-transitory computer-readable medium as recited in claim 12 , further comprising:

retrieving a set of user experience scores for the computer application program over a series of version numbers from a datastore; and

wherein causing display of the user experience score further comprises:

causing display of each user experience score in the set of user experience scores along with an associated version number.

14. The non-transitory computer-readable medium as recited in claim 12 , further comprising:

calculating a count of unique users that started the computer application program from unique user identifiers extracted from the application performance events associated with the particular computer application program identifier; and

wherein causing display of the user experience score further comprises:

causing display of the count.

15. The non-transitory computer-readable medium as recited in claim 12 , wherein the causing display of the user experience score further comprises:

causing display of a stability calculation for the computer application program and the associated version number.

16. The non-transitory computer-readable medium as recited in claim 12 , wherein the calculating a user experience score calculates the user experience score for a particular operating system running the computer application program.

17. The non-transitory computer-readable medium as recited in claim 12 , wherein the calculating a user experience score calculates the user experience score for a particular geographical area for mobile devices running the computer application program.

18. A system, comprising:

a monitoring code included in a computer application program executing on a mobile device, among a plurality of mobile devices, that sends application performance events relating to the computer application program to a collection device, the application performance events include application performance data relating to the computer application program;

an application performance event receiving device, implemented at least partially in hardware at a server, that receives application performance events from one or more collection devices;

a user experience calculation device, implemented at least partially in hardware at the server, that calculates a user experience score using application performance data extracted from the application performance events associated with the particular computer application program; and

a display formatting device, implemented at least partially in hardware at the server, that causes display of the user experience score or a representation of the user experience score.

19. The system as recited in claim 18 , further comprising:

a subsystem, implemented at least partially in hardware, that retrieves a set of user experience scores for the computer application program over a series of version numbers from a datastore; and

wherein the display formatting device causes display of each user experience score in the set of user experience scores along with an associated version number.

20. The system as recited in claim 18 , wherein the display subsystem causes display of a stability calculation for the computer application program and an associated version number.

Assignments (3)
CHANGE OF NAME Recorded Jul 22, 2025
From: SPLUNK INC.
To: SPLUNK LLC
Reel/Frame 072170/0599 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2025
From: SPLUNK LLC
To: CISCO TECHNOLOGY, INC.
Reel/Frame 072173/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2016
From: VLACHOGIANNIS, IOANNIS; KARAMPINAS, VASILEIOS
To: SPLUNK INC.
Reel/Frame 039368/0193 →
Continuity (4)
Continuation 14929290 · Oct 31, 2015
Continuation 14610944 · Jan 30, 2015
Continuation 14215667 · Mar 17, 2014
Related Publication 20160246696A1 · Aug 25, 2016