Store and forward logging in a content delivery network
A computer-implemented method on a device. The device has hardware including storage. The method includes obtaining log event data from at least one component or service on the device that is to be delivered to a component or service on a distinct device. Each log event data item has a priority. If a connection to an external location is lost, at least some of the log event data items are selectively stored in the storage, wherein the storing is based on priority of the log event data items. Otherwise, if the connection is not lost, at least some of the log event data items are sent to the at least one external location.
1. A computer-implemented method operable on a device, said device comprising hardware including storage,
the method comprising:
(A) obtaining, from at least one component or service on said device, log event data items, each item of log event data being produced by a corresponding at least one component or service on said device, each log event data item having a corresponding priority of at least two priorities;
(B) determining if a connection to at least one external location is lost, and,
(B)(1) when it is determined in (B) that said connection is not lost, sending at least some of said log event data items to said at least one external location, and,
(B)(2) when it is determined in (B) that said connection is lost, selectively storing at least some of said log event data items in said storage, wherein said storing is based on priority of said log event data items.
2. The method of claim 1 , wherein said storing is based on priority-based rules.
3. The method of claim 2 , wherein said priority-based rules comprise priority-based allotments of a first class of said storage.
4. The method of claim 3 , wherein said priority-based rules comprise priority-based allotments of a second class of said storage.
5. The method of claim 1 , further comprising:
(C) determining if said connection to said at least one external location is still lost, and
(C)(1) when it is determined in (C) that said connection is not still lost, sending at least some stored log event data items to said at least one external location.
6. The method of claim 1 wherein a first class of said storage comprises memory storage.
7. The method of claim 6 , wherein a second class of said storage comprises disk storage.
8. The method of claim 1 , wherein said connection is considered to be lost in (B) if: the connection is (i) disconnected, or (ii) sufficiently degraded to prevent reliable transmission of data, or (iii) degraded such that a throughput rate on the connection is not sufficient to match the log data generation rate.
9. The method of claim 1 , further comprising:
(C) pruning at least some log event data stored in said storage.
10. The method of claim 1 , wherein said storing in (B)(2) uses storage of a first class of said storage before using storage of a second class of said storage.
11. The method of claim 2 , wherein said priority-based rules allocate a non-zero amount of storage of a first class of said storage for at least one of said priorities.
12. The method of claim 11 , wherein said priority-based rules allocate a non-zero amount of storage of a second class of said storage for at least one of said priorities.
13. The method of claim 11 , wherein said device tracks usage of storage of said first class of storage for at least one of said priorities.
14. The method of claim 12 , wherein said device tracks usage of storage of said second class of storage for at least one of said priorities.
15. An article of manufacture comprising a nontransitory computer-readable medium having program instructions stored thereon, the program instructions, operable on a device, said device comprising hardware including storage, wherein said instructions, when executed by a processor in said device, cause said processor to:
(a) obtain, from at least one component or service on said device, log event data items, each item of log event data being produced by a corresponding at least one component or service on said device, each log event data item having a corresponding priority of at least two priorities;
(b) determine if a connection to at least one external location is lost, and,
(b)(1) when it is determined in (b) that said connection is not lost, send at least some of said log event data items to said at least one external location, and,
(b)(2) when it is determined in (b) that said connection is lost, selectively store at least some of said log event data items in said storage, wherein said storing is based on priority of said log event data items.
16. The article of manufacture of claim 15 , wherein said storing in (b)(2) is based on priority-based rules.
17. The article of manufacture of claim 16 , wherein said priority-based rules comprise priority-based allotments of a first class of said storage.
18. The article of manufacture of claim 17 , wherein said priority-based is rules comprise priority-based allotments of a second class of said storage.
19. The article of manufacture of claim 15 , wherein said instructions, when executed by a processor in said CDN, further cause said processor to:
(c) determine if said connection to said at least one external location is still lost, and
(c)(1) when it is determined in (c) that said connection is not still lost, send at least some stored log event data items to said at least one external location.
20. The article of manufacture of claim 15 , wherein a first class of said storage comprises memory storage.
21. The article of manufacture of claim 20 , wherein a second class of said storage comprises disk storage.
22. The article of manufacture of claim 15 , wherein said connection is considered to be lost in (B) if: the connection is (i) disconnected, or (ii) sufficiently degraded to prevent reliable transmission of data, or (iii) degraded such that a throughput rate on the connection is not sufficient to match the log data generation rate.
23. The article of manufacture of claim 15 , said instructions, when executed by a processor in said CDN, further cause said processor to:
(c) prune at least some log event data stored in said storage.
24. The article of manufacture of claim 15 , wherein said storing in (b)(2) is uses storage of a first class of said storage before using storage of a second class of said storage.
25. The article of manufacture of claim 15 , wherein said priority-based rules allocate a non-zero amount of storage of a first class of said storage for at least one of said priorities.
26. The article of manufacture of claim 25 , wherein said priority-based rules allocate a non-zero amount of storage of a second class of said storage for at least one of said priorities.
27. The article of manufacture of claim 25 , wherein said device tracks usage of storage of said first class of storage for at least one of said priorities.
28. The article of manufacture of claim 26 , wherein said device tracks usage of storage of said second class of storage for at least one of said priorities.