Scalable monitoring and error handling in multi-latency systems
View Patent ↗Example embodiments of the present invention provide a method, an apparatus, and a computer program product for scalable monitoring and error handling in multi-latency systems. The method includes gathering events from a multi-latency logical data store comprising a first data store having a first data latency and a second related data store having a second data latency substantially different than the first data latency. Processing then may be performed on the gathered events, with notification of the processed events provided toward downstream queues for consumption. In certain embodiments, consumption comprises holistic error handling; according, in those embodiments holistic error handling of the multi-latency logical data store may be performed according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store.
1. A computer-implemented method comprising:
gathering events by a computer from a multi-latency logical data store comprising a first data store having a first data latency and a second related data store having a second data latency substantially different than the first data latency;
processing the gathered events by the computer, wherein the processing includes receiving, correlating, and aggregating the gathered events by the computer; and
providing notification of the processed gathered events by the computer toward downstream queues for consumption.
2. The method of claim 1 wherein consumption comprises holistic error handling, the method further comprising performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store.
3. The method of claim 2 wherein performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store comprises performing error handling according to a holistic view of the multi-latency logical data store and the notification of the processed gathered events for consumption.
4. The method of claim 2 wherein performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store comprises performing holistic error handling of at least one of the first data store and the second data store.
5. The method of claim 2 wherein performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store comprises performing holistic error handling of one or more of service level agreement (SLA) violations and security policy violations related to multi-latency tables, synchronization violations, and availability issues related to the multi-latency logical data store.
6. The method of claim 1 wherein gathering events from a multi-latency logical data store comprising a first data store having a first data latency and a second related data store having a second data latency substantially different than the first data latency comprises:
gathering events from a first adapter for the first data store; and
gathering events from a second adapter for the second data store.
7. The method of claim 1 wherein providing notification of the processed gathered events toward downstream queues for consumption comprises providing event notifications for reporting and error handling.
8. The method of claim 1 wherein providing notification of the processed gathered events toward downstream queues for consumption comprises:
accessing the processed gathered events;
classifying the processed gathered events; and
publishing results of the event classification to a plurality of downstream queues.
9. A system comprising:
one or more processors; and
memory storing computer program code that when executed on one or more of the one or more processors causes the system to perform the operations of:
gathering events from a multi-latency logical data store comprising a first data store having a first data latency and a second related data store having a second data latency substantially different than the first data latency;
processing the gathered events, wherein the processing includes receiving correlating, and aggregating the gathered events; and
providing notification of the processed gathered events toward downstream queues for consumption.
10. The system of claim 9 wherein consumption comprises holistic error handling, the memory further storing computer program code for performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store.
11. The system of claim 10 wherein computer program code for performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store further comprises computer program code for performing error handling according to a holistic view of the multi-latency logical data store and the notification of the processed gathered events for consumption.
12. The system of claim 10 wherein computer program code for performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store further comprises computer program code for performing holistic error handling of at least one of the first data store and the second data store.
13. The system of claim 10 wherein computer program code for performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store further comprises computer program code for performing holistic error handling of one or more of service level agreement (SLA) violations and security policy violations related to multi-latency tables, synchronization violations, and availability issues related to the multi-latency logical data store.
14. The system of claim 9 wherein gathering events from a multi-latency logical data store comprising a first data store having a first data latency and a second related data store having a second data latency substantially different than the first data latency comprises:
gathering events from a first adapter for the first data store; and
gathering events from a second adapter for the second data store.
15. The system of claim 9 wherein providing notification of the processed gathered events toward downstream queues for consumption comprises providing event notifications for reporting and error handling.
16. The system of claim 9 wherein providing notification of the processed gathered events toward downstream queues for consumption comprises:
accessing the processed gathered events;
classifying the processed gathered events; and
publishing results of the event classification to a plurality of downstream queues.
17. A computer program product including a non-transitory computer-readable storage medium encoded with computer program code that, when executed on a processor of a computer, causes the computer to perform error handling in multi-latency systems, the computer program product comprising:
computer program code for gathering events from a multi-latency logical data store comprising a first data store having a first data latency and a second related data store having a second data latency substantially different than the first data latency;
computer program code for processing the gathered events, wherein the processing includes computer program code for receiving correlating, and aggregating the gathered events; and
computer program code for providing notification of the processed gathered events toward downstream queues for consumption.
18. The computer program product of claim 17 wherein consumption comprises computer program code for holistic error handling, wherein the holistic error handling performs the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store.
19. The computer program product of claim 18 wherein performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store comprises performing error handling according to a holistic view of the multi-latency logical data store and the notification of the processed gathered events for consumption.
20. The computer program product of claim 17 wherein performing holistic error handling of the multi-latency logical data store according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store comprises performing holistic error handling of at least one of the first data store and the second data store.
21. The computer program product of claim 17 wherein the computer program code for providing notification of the processed gathered events toward downstream queues for consumption comprises providing event notifications for reporting and error handling.