Methods and Systems for Deduplicating Redundant Usage Data for an Application
An exemplary method to deduplicate redundant usage data for an application includes receiving, from a first source, a first set of usage data for an application. The method further includes receiving, from a second source, a second set of usage data for the application. The method further includes comparing data of the first set of usage data with data of the second set of usage data. In accordance with a determination that a degree of similarity between the first set of usage data and the second set of usage data satisfies a threshold, the method further includes providing a report regarding the application based on the first set of usage data.
1 . A method, comprising:
at a server system having one or more processors and memory storing instructions for execution by the one or more processors:
receiving, from a first source, a first set of usage data for an application;
receiving, from a second source, a second set of usage data for the application;
comparing data of the first set of usage data with data of the second set of usage data; and
in accordance with a determination that a degree of similarity between the first set of usage data and the second set of usage data satisfies a threshold, providing a report regarding the application based on the first set of usage data.
2 . The method of claim 1 , wherein providing the report comprises generating a dashboard showing usage statistics for the application.
3 . The method of claim 1 , wherein:
the first set of usage data contains additional metadata relative to the second set of usage data.
4 . The method of claim 3 , wherein:
the method further comprises storing the first set of usage data in a first log; and
providing the report comprises accessing the first set of usage data in the first log to generate the report.
5 . The method of claim 4 , further comprising, in accordance with the determination that the degree of similarity between the first set of usage data and the second set of usage data satisfies the threshold, storing the second set of usage data in a second log that is not used for reporting on the application.
6 . The method of claim 1 , wherein the degree of similarity is a threshold percentage.
7 . The method of claim 1 , wherein receiving the first set of usage data and the second set of usage data comprise receiving multiple messages providing data for the first and second sets over a period of time, the method further comprising:
periodically repeating the comparing; and
providing respective reports when the periodic comparing determines that the degree of similarity satisfies the threshold.
8 . The method of claim 1 , wherein comparing data of the first set of usage data with data of the second set of usage data comprises:
extracting a respective subset from the first set of usage data;
extracting a respective subset from the second set of usage data; and
comparing the respective subsets from the first set of usage data and the second set of usage data.
9 . The method of claim 8 , wherein extracting the respective subset from the first set of usage data and the respective subset from the second set of usage data comprises extracting an application type, an application event, a client type, and an application version from the first set of usage data and from the second set of usage data.
10 . The method of claim 9 , wherein:
extracting the respective subset from the first set of usage data comprises forming a first tuple of data; and
extracting the respective subset from the second set of usage data comprises forming a second tuple of data.
11 . The method of claim 1 , wherein:
the application is a calendaring application;
the first source is a first application, distinct from the calendaring application, that communicates events to the calendaring application,
the second source is a second application, distinct from the calendaring application, that communicates events to the calendaring application,
the first set of usage data comprises events associated with the calendar application, and
the second set of usage data comprises events associated with the calendar application.
12 . The method of claim 1 , wherein:
the application is a social media application associated with the server system;
the first source is associated with the server system; and
the second source is a third-party provider that receives usage data from the social media application and communicates the received usage data from the social media application to the server system.
13 . The method of claim 1 , further comprising, in accordance with a determination that the degree of similarity between the first set of usage data and the second set of usage data does not satisfy the threshold:
storing the first set of usage data and the second set of usage data in a log; and
providing a report regarding the application based on the first set of usage data and the second set of usage data stored in the log.
14 . A server system, comprising:
a processor; and
memory storing one or more programs for execution by the processor, the one or more programs including instructions for:
receiving, from a first source, a first set of usage data for an application;
receiving, from a second source, a second set of usage data for the application;
comparing data of the first set of usage data with data of the second set of usage data; and
in accordance with a determination that a degree of similarity between the first set of usage data and the second set of usage data satisfies a threshold, providing a report regarding the application based on the first set of usage data.
15 . The system of claim 14 , wherein providing the report comprises generating a dashboard showing usage statistics for the application.
16 . The system of claim 14 , wherein:
the first set of usage data contains additional metadata relative to the second set of usage data.
17 . The system of claim 16 , wherein:
the one or more programs further including instructions for storing the first set of usage data in a first log; and
the one or more programs further including instructions for providing the report comprises accessing the first set of usage data in the first log to generate the report.
18 . The system of claim 17 , further comprising, in accordance with the determination that the degree of similarity between the first set of usage data and the second set of usage data satisfies the threshold, storing the second set of usage data in a second log that is not used for reporting on the application.
19 . The system of claim 14 , wherein comparing data of the first set of usage data with data of the second set of usage data comprises:
extracting a respective subset from the first set of usage data;
extracting a respective subset from the second set of usage data; and
comparing the respective subsets from the first set of usage data and the second set of usage data.
20 . A non-transitory computer-readable storage medium, storing one or more programs configured for execution by one or more processors of a server system, the one or more programs including instructions, which when executed by the one or more processors cause the server system to:
receive, from a first source, a first set of usage data for an application;
receive, from a second source, a second set of usage data for the application;
compare data of the first set of usage data with data of the second set of usage data; and
in accordance with a determination that a degree of similarity between the first set of usage data and the second set of usage data satisfies a threshold, provide a report regarding the application based on the first set of usage data.