Content delivery network analytics management via edge stage collectors
Example embodiments herein include a system having one or more edge servers disposed in an edge site of a content delivery network (CDN). The system can include a collector for collecting analytics associated with requests for content in the CDN. One or more additional collectors can be instantiated in the system, for example, in response to an increase in recordable events detected in the CDN. The system can include an aggregator for aggregating the collected analytics with analytics collected from other edge stages of the CDN. The system can also include a data store that stores the aggregated analytics according to a configurable data model.
1. A method comprising:
collecting, at an edge stage of a content delivery network (CDN), analytics associated with requests for content in the CDN, wherein the analytics are collected via one or more collectors disposed in the edge stage, wherein the one or more collectors are associated with one or more edge servers disposed in the edge stage;
instantiating one or more additional collectors in response to detecting an increase in content in the CDN;
aggregating the collected analytics from the edge stage with analytics collected from at least one other edge stage collector of the CDN;
storing the aggregated analytics in a database according to a configured data model;
providing, via a portal for a first customer of the CDN, access to stored analytics associated with requests for content of the first customer; and
providing, via the portal for a second customer of the CDN, access to stored analytics associated with requests for content of the second customer.
2. The method as recited in claim 1 , further comprising:
filtering the collected analytics according to a data collection policy.
3. The method as recited in claim 1 , wherein the analytics are stored in batches.
4. The method as recited in claim 3 , wherein the batches comprise bins.
5. The method as recited in claim 4 , wherein the bins comprise time bins.
6. The method as recited in claim 4 , wherein the aggregated analytics comprise the batches aggregated into data sets corresponding to a plurality of bins.
7. The method as recited in claim 1 , further comprising:
discarding at least a portion of the collected analytics according to a data retention policy.
8. The method as recited in claim 7 , wherein the collected analytics are discarded based on an age of the collected analytics according to the data retention policy.
9. The method as recited in claim 1 , wherein the database comprises a database cluster administered by a database management system.
10. The method as recited in claim 1 , further comprising:
enabling the first customer of the CDN to configure a first data model for storing aggregated analytics associated with requests for content of the first customer.
11. The method as recited in claim 10 , further comprising:
enabling the second customer of the CDN to configure a second data model for storing aggregated analytics associated with requests for content of the second customer.
12. The method as recited in claim 10 , wherein the first customer of the CDN is enabled to configure the first data model based on a service level.
13. A system comprising:
at least one edge server disposed at an edge stage of a content delivery network (CDN);
at least one collector module configured to collect analytics associated with requests for content in the CDN, wherein each of the at least one collector modules being associated with at least one of the at least one edge servers, wherein one or more additional collector modules are instantiated in response to a detected increase in content in the CDN;
an aggregator module configured to aggregate the collected analytics from the at least one edge servers with analytics collected from at least one other edge stage collector module of the CDN;
a data store configured to store the aggregated analytics in a database according to a configured data model; and
a portal configured to provide access to the stored aggregated analytics, wherein for a first customer of the CDN, the portal is further configured to provide access to stored analytics associated with requests for content of the first customer, and wherein for a second customer of the CDN, the portal is further configured to provide access to stored analytics associated with requests for content of the second customer.
14. The system as recited in claim 13 , wherein the at least one collector module is configured to filter the collected analytics according to a data collection policy.
15. The system as recited in claim 13 , wherein the at least one collector module is configured to store the collected analytics from the at least one edge server in batches.
16. The system as recited in claim 15 , wherein the batches comprise bins.
17. The system as recited in claim 16 , wherein the bins comprise time bins.
18. The system as recited in claim 13 , wherein the at least one collector module is operable to discard at least a portion of the collected analytics based on a data retention policy.
19. The system as recited in claim 13 , wherein the aggregator module is configured to discard at least a portion of the collected analytics according to a data retention policy.
20. The system as recited in claim 13 , wherein the portal is further configured to enable the first customer of the CDN to configure a first data model for storing aggregated analytics associated with requests for content of the first customer.
21. The system as recited in claim 20 , wherein the portal is further configured to enable the second customer of the CDN to configure a second data model for storing aggregated analytics associated with requests for content of the second customer.
22. A non-transitory computer-readable medium storing instructions thereon for operation by a computer program to perform operations comprising:
collecting, at an edge stage of a content delivery network (CDN), analytics associated with requests for content in the CDN, wherein the analytics are collected via one or more collectors disposed in the edge stage, wherein the one or more collectors are associated with one or more edge servers disposed in the edge stage;
instantiating one or more additional collectors in response to detecting an increase in content in the CDN;
aggregating the collected analytics from the edge stage with analytics collected from at least one other edge stage collector of the CDN;
storing the aggregated analytics in a database according to a configured data model;
providing, via a portal for a first customer of the CDN, access to stored analytics associated with requests for content of the first customer;
providing, via the portal for a second customer of the CDN, access to stored analytics associated with requests for content of the second customer; and
enabling the first customer of the CDN to configure a first data model for storing aggregated analytics associated with requests for content of the first customer.