Apparatus and method for data replication monitoring with streamed data updates
A method implemented in a computer network includes identifying a transactional change data capture event at a transactional database. A transaction event stream is created with metadata characterizing the transactional change data capture event. A replication change data capture event is identified at a replication database corresponding to the transactional database. A replication event stream with metadata characterizing the replication change data capture event is created. The transaction event stream and the replication event stream are evaluated to selectively identify a replication performance failure within a specified time threshold of the replication performance failure.
1. A method implemented in a computer network, comprising:
identifying a transactional change data capture event at a transactional database;
creating a transaction event stream with metadata characterizing the transactional change data capture event;
identifying a replication change data capture event at a replication database corresponding to the transactional database;
creating a replication event stream with metadata characterizing the replication change data capture event; and
evaluating the transaction event stream and the replication event stream to check that every transaction committed on the transactional database is also committed on the replication database and selectively identify a replication performance failure within a specified time threshold of the replication performance failure, wherein evaluating is performed by an in-memory stream processor operative as a continuous query engine that applies rules and reports events on in flight data and thereby provides a real-time verification mechanism that continuously and incrementally monitors replication operations prior to replication failure.
2. The method of claim 1 further comprising identifying a missing database transaction.
3. The method of claim 1 further comprising identifying a database table associated with the replication performance failure.