Distributed message queue stream verification

1. An apparatus for verification of messages in a distributed message queue, comprising:

a central verification analysis system, installed on at least one central verification analysis server, and configured to receive and aggregate verification reports and organize verification reports by a message topic, including producer verification reports from a producer metrics collector module and consumer verification reports from a consumer metrics collector module;

a metric management application, installed on a central management server, that presents to users data related to verification information aggregated by the central verification analysis system;

wherein messages from the producer metrics collector module include a cumulative checksum;

wherein producer verification messages are received at least when no other messages are sent in a particular time period;

wherein the central verification analysis system determines (a) whether any messages were lost or duplicated, (b) the time it takes produced messages to be consumed, and (c) uses a combination of verification messages and cumulative checksums to assess the fidelity of the computations performed in (a); and

a graphical user interface provided by the metric management application allowing a user to interact with and view the calculations completed by the central verification analysis system and request receipt of notifications.

2. The apparatus of claim 1 further comprising an API for providing the graphical user interface.

3. The apparatus of claim 1 wherein the verification reports are encapsulated in messages and sent through a distributed message queue system.

4. The apparatus of claim 3 wherein the producer verification reports contain:

counts of messages sent by a producer;

a count on the number of bytes sent by a producer;

a measurement of message sizes; and

a transport time.

5. The apparatus of claim 3 wherein the producer verification reports contain:

aggregate checksums for the data sent by a producer.

6. The apparatus of claim 5 wherein the checksum is a cumulative checksum.

7. The apparatus of claim 6 wherein the cumulative checksum comprises an aggregation of existing checksums.

8. The apparatus of claim 1 wherein producer verification reports are received for each time window, and a report indicating no messages is received during a time window if no messages were sent.

9. The apparatus of claim 1 wherein the verification reports include counts and checksums on individual topics.

10. The apparatus of claim 1 wherein a time stamp is attached to each message, and wherein metrics are grouped by time stamps.

11. A system for verification of messages in a distributed message queue, comprising:

a central verification analysis system, installed on at least one central verification analysis server, and configured to receive and aggregate verification reports and organize verification reports by a message topic;

a consumer metrics collector module installed on at least one consumer computing device, and configured to collect metrics on messages received from a distributed message queue system and send consumer verification reports to the central verification analysis system;

wherein the consumer verification reports contain (a) counts of messages received from a producer, (b) a count on the number of bytes received from a producer, (c) a measurement of message sizes, and (d) a transport time;

wherein the consumer metrics collector module groups metrics by time stamps;

wherein the consumer metrics collector module detects missing sequence numbers;

wherein the consumer metrics collector module sends a report indicating no messages were received during a time window if no messages were received;

wherein the verification reports include counts and checksums on individual topics;

a metric management application, installed on a central management server, that presents to users analysis of verification information aggregated by the central verification analysis system;

wherein the central verification analysis system determines (a) whether any messages were lost or duplicated, (b) the time it takes produced messages to be consumed, and (c) uses a combination of verification messages and cumulative checksums to assess the fidelity of the computations in performed in (a); and

a graphical user interface provided by the metric management application allowing a user to interact with and view the calculations completed by the central verification analysis system and request receipt of notifications, wherein an API provides the graphical user interface.

12. A system for verification of messages in a distributed message queue, comprising:

a central verification analysis system, installed on at least one central verification analysis server, and configured to receive and aggregate verification reports and organize verification reports by a message topic;

a producer metrics collector module installed on a producer computing device and configured to collect metrics on messages sent to a distributed message queue system and send producer verification reports to the central verification analysis system, wherein the producer metrics collector module attaches a time stamp to each message, wherein the producer metrics collector module attaches a sequence number to each message;

wherein the producer verification reports contain (a) counts of messages sent by a producer, (b) a count on the number of bytes sent by a producer, (c) a measurement of message sizes, and (d) a transport time;

wherein the producer metrics collector module sends producer verification reports for each time window; and

wherein the producer metrics collector module sends a report indicating no messages were sent during a time window if no messages were sent;

wherein the verification reports include counts and checksums on individual topics;

a metric management application, installed on a central management server, that presents to users analysis of verification information aggregated by the central verification analysis system;

wherein the producer metrics collector module is configured to add a cumulative checksum to messages sent out by the producer computer;

wherein the producer metrics collector module is configured to send out verification messages at least when no other messages are sent in a particular time period;

wherein the central verification analysis system determines (a) whether any messages were lost or duplicated, (b) the time it takes produced messages to be consumed, and (c) uses a combination of verification messages and cumulative checksums to assess the fidelity of the computations in performed in (a); and

a graphical user interface provided by the metric management application allowing a user to interact with and view the calculations completed by the central verification analysis system and request receipt of notifications, wherein an API provides the graphical user interface.

13. A method for verification of messages in a distributed message queue, comprising:

collecting metrics in a producer metrics collector module on messages sent by a producer to a distributed message queue system;

receiving producer verification reports from a producer;

receiving consumer verification reports from a consumer;

receiving and aggregating verification reports at a central verification analysis system and organizing verification reports by a message topic;

presenting to users an analysis of verification information aggregated by the central verification analysis system;

wherein the messages from the producer include a cumulative checksum;

wherein producer verification messages are received at least when no other messages are sent in a particular time period; and

wherein the central verification analysis system determines (a) whether any messages were lost or duplicated, (b) the time it takes produced messages to be consumed, and (c) uses a combination of verification messages and cumulative checksums sent via the producer and consumer metrics collectors to assess the fidelity of the computations in performed in (a).

14. The method of claim 13 further comprising encapsulating the verification reports in messages and sending encapsulated reports through a distributed message queue system.

15. The method of claim 13 further comprising aggregating checksums for the data sent by a producer to provide an aggregated checksum, wherein the aggregated checksum is a cumulative checksum.

16. The method of claim 15 wherein the cumulative checksum comprises an aggregation of existing checksums.

17. The method of claim 13 producer verification reports are received for each time window, and a report indicating no messages is received during a time window if no messages were sent.

18. The method of claim 13 wherein the verification reports include counts and checksums on individual topics.

19. The method of claim 13 wherein each message includes a time stamp, and further comprising grouping metrics by time stamps.

20. The method of claim 13 wherein a sequence number is attached to each message, so that missing sequence numbers are detectable.