Reducing reading of database logs by persisting long-running transaction data
View Patent ↗According to one embodiment of the present invention, a system reduces re-reading of database logs by persisting long running transaction data. The system processes the database log records of the database transaction log; generates a snapshot of the database log records at periodic intervals, wherein each snapshot includes database log records for pending transactions; and in response to an interruption in processing of the database log records, utilizes a snapshot to restore database log records for the pending transactions and resume processing of the database transaction log from a position succeeding the database log records of the selected snapshot.
1. A computer-implemented method of processing database log records of a database transaction log comprising:
receiving database log records of the database transaction log and processing at least some of the received records;
generating snapshots of the database log records, wherein each snapshot includes database log records for pending transactions, and a transaction is pending when at least one of the log records for the transaction remains to be processed; and
in response to an interruption in processing of the database log records, utilizing a selected snapshot to restore database log records for the pending transactions and resuming processing of the database transaction log from a position succeeding the database log records of the selected snapshot.
2. The computer-implemented method of claim 1 , wherein each snapshot is associated with log information for a corresponding committed transaction, and the method further comprises:
comparing a most recent committed transaction to the associated log information of the generated snapshots and selecting a snapshot based on the comparisons.
3. The computer-implemented method of claim 1 , further comprising:
recording information pertaining to processed database log records at periodic occasions,
wherein each of the snapshots is generated at one of the occasions based on the recorded information from a prior one of the occasions.
4. The computer-implemented method of claim 1 , wherein processing the database log records comprises storing the records for pending transactions in corresponding transaction queues.
5. The computer-implemented method of claim 4 , wherein restoring database log records comprises restoring the database log records to the corresponding transaction queues.
6. The computer-implemented method of claim 1 , wherein the snapshot excludes database log records for pending transactions processed after a cutoff.
7. The computer-implemented method of claim 6 , further comprising utilizing the database transaction log to restore the database log records for pending transactions processed after the cutoff.